Jobs
>
San Francisco

    Innovation Team Data Engineer - San Francisco, CA, United States - City and County of San Francisco

    City and County of San Francisco
    City and County of San Francisco San Francisco, CA, United States

    3 weeks ago

    Default job background
    Description

    The Mayor's Office of Innovation is a new team working on Mayoral-directed strategic priorities, emphasizing data analysis, human-centered design thinking, cross-departmental coordination, and public-private partnerships to ensure outcomes-based policy making.


    The Innovation Team is focused on improving service delivery and city performance across the City through replicable, strategic projects in key policy areas like small business recovery, housing, and homelessness and mental health services.

    Priority initiatives could include a customer journey and data insight project to demonstrate how City dollars are funding better outcomes through our non-profit partners.

    The City grants millions of dollars to non-profit organizations to address homelessness but has no way of demonstrating the outcomes of grants across all departments.

    The City funds services delivered by many non-profit organizations, but has no data set of all City-funded services.

    There is no reliable and up-to-date list of City-funded services that departments and non-profit organizations can use, making it hard for residents to be referred to services when they need help.

    Data access across departments is siloed, limiting the City's capacity for system-level analysis and improvement.

    We are looking for a curious and resourceful Data Engineer to show the power of data in bringing transparency and accountability to services, while keeping equity and ethical use of data at the forefront.


    We offer flexibility with a hybrid remote and in-person work environment in our office in San Francisco, California (minimum 2 days per week at City Hall, otherwise remote).

    Must be a California resident.

    As the Innovation Team Data Engineer, you will be a part of the Mayor's Innovation Team, and report to the Mayor's Office.

    However, your position is based within Digital Services under DataSF, and will collaborate closely with the Chief Data Officer and the Chief Digital Services Officer.

    You will work directly with the Mayor's policy staff and Department leadership, as well as community providers to identify existing data, gaps in reporting, and develop outcomes-based reporting structures.

    This position is funded, in part, through the Bloomberg Philanthropies Government Innovation Team, and will work in close partnership with the Bloomberg Center for Public Innovation at Johns Hopkins University.

    The Innovation Team will also include a Data Program Manager, a Service Designer, and a Project Manager.

    As a small and agile team, you will work together to deliver prototypes and solutions that will help address the city's most pressing challenges.

    As the Data Engineer, you will be the technical lead on the program, working with stakeholders in departments to understand data sources and pipelines and building these out in a pragmatic way.

    You will advise the Mayor's Office on the most feasible deliverables that are both technically possible, and high impact.

    You will be supported throughout by the rest of the Innovation team, the Chief Data Officer, and the Chief Digital Services Officer.

    Work with departmental staff to develop extract, transform, load (ETL) requirements for individual datasets
    Consult with various departments on the best way to automate and publish datasets within their data ecosystems
    Apply an ethical lens to the appropriate use of data

    Create new analytics pipelines using ETL/ELT approaches according to standards and patterns you help develop and refine
    Serve as the technical lead for database exports, manipulation, and procedures used to create and update data incorporated into the data platform
    Implement analytics pipelines and/or data models to support analytics work
    Migrate existing ETLs to newer infrastructure to improve data quality and reliability as needed
    Standardize and improve existing pipelines to adhere to best practices

    ~ As needed help iterate and refine best practices

    You will also identify ways in which data standardization, and data access, can contribute to the City's commitment to equitable and ethical service delivery and analytics.

    In collaboration with departments, you will identify data gaps that hinder equity analysis.

    Removing barriers and making it easier for all people to access services or knowledge is a core part of any role with DataSF and the Innovation Team.

    The Innovation Team is committed to building a team whose diversity reflects the residents we serve.

    An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].

    Three (3) years of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of an enterprise network.

    One (1) year is equivalent to thirty (30) semester units/ forty-five (45) quarter units with a minimum of 10 semester / 15 quarter units in one of the fields above or a closely related field.

    Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.
    Comfort with risk and trying new things
    Familiarity with Agile development methodology and experience working in iterative development cycles
    Commitment to equity and the use of data to meet the needs of all San Franciscans
    Data Engineering
    Programming proficiency in Python
    Strong SQL skills
    Experience writing ETL code and/or authoring ETLs through a framework
    Experience working with a variety of databases, APIs, and formats to extract and transform data
    Experience deploying code on cloud-based infrastructure (Azure or AWS preferred)
    Experience training non-technical users to use technology to support their work

    Experience in data cleaning and manipulation for analytics use
    Strong quantitative analysis skills
    Strong data visualization skills
    Experience using business intelligence tools (e.g. PowerBI, Tableau) to develop visualizations

    Data management
    Well-versed in the principles of open data management
    Familiarity with open data platforms and/or data catalogs

    Familiarity with Microsoft's Azure Cloud Tools and/or Power BI

    Veterans Preference
    Copies of Application Documents
    Diversity Statement

    Mailed, hand delivered or faxed documents/applications will not be accepted.
    Connie Poon, Senior Human Resources Analyst at Connie.
    Your application MUST include a resume.

    Applicants may be required to submit verification of qualifying education and experience at any point in the application and/or departmental selection process.

    Written verification must be submitted on employer's official letterhead, specifying name of employee, dates of employment, types of employment (part-time/full-time), job title(s), description of duties performed, and the verification must be signed by the employer.

    Experience claimed in self-employment must be supported by documents verifying income, earnings, business license and experience comparable to the minimum qualifications of the position.

    Copies of income tax papers or other documents listing occupations and total earnings must be submitted.


    Note:

    Falsifying one's education, training, or work experience or attempted deception on the application may result in disqualification for this and future job opportunities with the City and County of San Francisco.

    Applications will be screened for relevant qualifying experience. Qualified applicants with disabilities requiring reasonable accommodation in the selection process must contact the Agency by phone at or, if hearing impaired at TTY).
    The City and County of San Francisco encourages women, minorities and persons with disabilities to apply.

    Applicants will be considered regardless of their sex, race, age, religion, color, national origin, ancestry, physical disability, mental disability, medical condition (associated with cancer, a history of cancer, or genetic characteristics), HIV/AIDS status, genetic information, marital status, sexual orientation, gender, gender identity, gender expression, military and veteran status, or other protected category under the law.

    #
  • WPRO TALENTS

    Data Engineer

    1 week ago

    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • WPRO TALENTS

    Data Engineer

    1 week ago

    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • Nexus Solutions

    Data Engineer

    2 weeks ago

    Nexus Solutions Emeryville, United States

    Soda is teaming up with a leading E-commerce platform based in Germany that specializes in creating lottery platforms. With 20 years of experience, they have continuously grown and innovated across Europe. In 2022, they raised an impressive €286 million for social projects and ch ...

  • Infinity Ventures

    Data Engineer

    2 weeks ago

    Infinity Ventures Oakland, United States

    Oakland Infomotion GmbH is looking for a Data Engineer (m/w/d) to join our team. We are passionate about extracting the maximum value from data and are looking for someone who shares our enthusiasm and has a strong understanding of digital technology. · As a Data Engineer, you wi ...

  • BayOne Solutions

    Data Engineer

    2 weeks ago

    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scalable a ...

  • Bayone

    Data Engineer

    1 week ago

    Bayone San Francisco, United States

    Your role at Sephora: · As a Sr. Software Engineer you will design and implement innovative analytical solutions and work alongside the product engineering team, evaluating new features and architecture. Reporting to the Engineering Manager, Data Platform, you will work closely ...

  • Triune Infomatics Inc

    Data Engineer

    1 week ago

    Triune Infomatics Inc San Francisco, United States

    Role: Data Engineer · Location: Hybrid in Pleasanton, CA · Duration: 6 months · Areas of Responsibility Include: · • Build test and implement Data Engineering - ETL, Data Integrations, Data Governance, Data Quality. · • Build reusable Data Engineering assets and frameworks. ...

  • Legalist

    Data Engineer

    1 week ago

    Legalist San Francisco, United States

    Job Description · Job DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to ...

  • TEKsystems

    Data Engineer

    2 weeks ago

    TEKsystems San Francisco, United States

    : · The data engineer will collaborate closely with the growth and data foundation teams to define and create foundational data tables, migrate test tables while adhering to EDW standards, and build self-serve ETL frameworks capable of handling streaming and batch processing. The ...

  • ConsultNet

    Data Engineer

    1 week ago

    ConsultNet San Francisco, United States

    Data Engineer · Direct Hire · 100% Remote · Salary: $130, ,000 a year + company equity · Job Description: · Seeking Data Software Engineer who is well versed in Python and SQL and who loves to code. No specific industry experience required but Healthcare background is a plus ...

  • ConsultNet

    Data Engineer

    1 week ago

    ConsultNet San Francisco, United States

    Data Engineer · Direct Hire · 100% Remote · Salary: $130, ,000 a year + company equity · Job Description: · Seeking Data Software Engineer who is well versed in Python and SQL and who loves to code. No specific industry experience required but Healthcare background is a plus. Mus ...

  • Saxon Global

    Data Engineer

    2 weeks ago

    Saxon Global San Francisco, United States

    Client: T he County of Sacramento · Position: Data Engineer - ETL, Spark, Airflow Specialist · Location: Sacramento, Ca ONLY CANDIDATES LOCAL TO SACRAMENTO WILL BE CONSIDERED. 100% ONSITE WORK · Rate:$65/hr. on C2C (Some Flex) · Visa: Open · Duration: 12+ Months · Looking f ...

  • Speak

    Data Engineer

    1 week ago

    Speak San Francisco, United States

    Job Description · Job DescriptionAbout usOur mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion peop ...

  • BayOne Solutions

    Data Engineer

    3 weeks ago

    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scala ...

  • FocusKPI Inc.

    Data Engineer

    1 week ago

    FocusKPI Inc. San Francisco, United States

    Job Description · Job DescriptionFocusKPI is looking for a Data Engineer to join one of our client's team and to support them. As a member of the Data Engineering, you own the ETL/ELT pipelines and data warehouse that are used to analyze trends and activity in our client's produc ...

  • Hexcel

    Data Engineer

    5 days ago

    Hexcel West Valley City, United States

    With our strong investment in research and development and our culture of continuous improvement, Hexcel is the industry leader in the manufacturing of advance composite materials, including carbon fiber, woven reinforcements, resins, prepregs, honeycombs and additive manufacture ...

  • BayOne Solutions

    Data Engineer

    3 weeks ago

    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Fra ...

  • Asana

    Data Engineer

    1 week ago

    Asana San Francisco, United States

    As part of our dynamic Data Engineering team, you will play a pivotal role in aiding company-wide, data-informed decision making. Product and Business teams leverage our data assets to optimize user adoption, growth, and experience. We partner with other Data Infrastructure teams ...

  • Sia Partners

    Data Engineer

    1 week ago

    Sia Partners San Francisco, United States

    Job Description · Job DescriptionCompany Description · Sia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 ...

  • Kesta IT

    Data Engineer

    22 hours ago

    Kesta IT West Valley City, United States

    Come build, innovate, disrupt, and thrive · K?STA I.T is actively seeking a Data Engineer foran immediate contract engagement with our government client. · Work Location: This position is remote. · Job Description: · The IT department of our client is working on a comprehensiv ...