Jobs
>
San Francisco

    Data Engineer - San Francisco, United States - TEKsystems

    Default job background
    Description
    :


    The data engineer will collaborate closely with the growth and data foundation teams to define and create foundational data tables, migrate test tables while adhering to EDW standards, and build self-serve ETL frameworks capable of handling streaming and batch processing.

    The engineer will also take ownership of ETL workflows, ensuring data quality and availability, and integrate schema registry while establishing data lineage in coordination with other teams.

    Scope of Work


    • Foundational Data Tables
    :

    ■ Define and create foundational data tables for new features.

    ■ Ensure adherence to EDW standards.


    • Test Tables Migration
    :

    ■ Collaborate with analytics partners to migrate test tables into the data foundation.

    ■ Validate and optimize migrated data.


    • Self-Serve ETL Frameworks
    :

    ■ Build, scale, and optimize self-serve ETL frameworks for streaming and batch processing.

    ■ Own ETL workflows, ensuring data quality and availability.


    • Collaboration with Data Engineering Teams
    :

    ■ Integrate schema registry into ETL processes.

    ■ Establish data lineage for all data domains in coordination with other teams.

    Top Skills Details:

    Python, SQL, ,ETL, ,Spark, AWS, Snowflake, Data warehouse ,Airflow/Terraform

    About TEKsystems:

    We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity.

    We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.

    As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change.

    That's the power of true partnership. TEKsystems is an Allegis Group company.


    The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.


  • WPRO TALENTS

    Data Engineer

    4 days ago


    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • WPRO TALENTS

    Data Engineer

    2 days ago


    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • Nexus Solutions

    Data Engineer

    1 week ago


    Nexus Solutions Emeryville, United States

    Soda is teaming up with a leading E-commerce platform based in Germany that specializes in creating lottery platforms. With 20 years of experience, they have continuously grown and innovated across Europe. In 2022, they raised an impressive €286 million for social projects and ch ...

  • Infinity Ventures

    Data Engineer

    1 week ago


    Infinity Ventures Oakland, United States

    Oakland Infomotion GmbH is looking for a Data Engineer (m/w/d) to join our team. We are passionate about extracting the maximum value from data and are looking for someone who shares our enthusiasm and has a strong understanding of digital technology. · As a Data Engineer, you wi ...

  • FocusKPI Inc.

    Data Engineer

    2 days ago


    FocusKPI Inc. San Francisco, United States

    Job Description · Job DescriptionFocusKPI is looking for a Data Engineer to join one of our client's team and to support them. As a member of the Data Engineering, you own the ETL/ELT pipelines and data warehouse that are used to analyze trends and activity in our client's produc ...

  • Speak LLC

    Data Engineer

    5 days ago


    Speak LLC San Francisco, United States

    About us · Our mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion people around the world are activ ...

  • Hazel Health, Inc.

    Data Engineer

    1 week ago


    Hazel Health, Inc. San Francisco, United States

    Hazel Health, the national leader in school-based telehealth, was founded in 2015 to address systemic inequities in healthcare access, and ensure all children can get the quality care they need and deserve. We leverage digital health technology to provide on-demand physical and m ...

  • Speak

    Data Engineer

    1 day ago


    Speak San Francisco, United States

    Job Description · Job DescriptionAbout usOur mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion peop ...

  • Pathway Vet Alliance

    Data Engineer

    1 week ago


    Pathway Vet Alliance San Francisco, United States

    About Pathway · Deeptech start-up, founded in March 2020. Our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scal ...

  • Tekfortune Inc

    Data Engineer

    6 days ago


    Tekfortune Inc San Francisco, United States

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the ...

  • VRChat Inc

    Data Engineer

    4 days ago


    VRChat Inc San Francisco, United States

    Join the VRChat team · VRChat offers a first-of-its kind, game-changing platform that provides an endless collection of social immersive experiences and gives the power of creation to its robust community. With over 250,000 worlds and growing, VRChat's vision is to allow users t ...

  • Arine

    Data Engineer

    1 week ago


    Arine San Francisco, United States

    Based in San Francisco, Arine is a rapidly growing healthcare technology and clinical services company with a mission to ensure individuals receive the safest and most effective treatments for their unique and evolving healthcare needs. · Frequently, medications cause more harm ...

  • Triune Infomatics Inc

    Data Engineer

    4 days ago


    Triune Infomatics Inc San Francisco, United States

    Role: Data Engineer · Location: Hybrid in Pleasanton, CA · Duration: 6 months · Areas of Responsibility Include: · • Build test and implement Data Engineering - ETL, Data Integrations, Data Governance, Data Quality. · • Build reusable Data Engineering assets and frameworks. ...

  • Bayone

    Data Engineer

    5 days ago


    Bayone San Francisco, United States

    Your role at Sephora: · As a Sr. Software Engineer you will design and implement innovative analytical solutions and work alongside the product engineering team, evaluating new features and architecture. Reporting to the Engineering Manager, Data Platform, you will work closely ...

  • Asana

    Data Engineer

    4 days ago


    Asana San Francisco, United States

    As part of our dynamic Data Engineering team, you will play a pivotal role in aiding company-wide, data-informed decision making. Product and Business teams leverage our data assets to optimize user adoption, growth, and experience. We partner with other Data Infrastructure teams ...

  • Legalist

    Data Engineer

    1 day ago


    Legalist San Francisco, United States

    Job Description · Job DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to ...

  • Rigil Corporation

    Data Engineer

    1 week ago


    Rigil Corporation San Francisco, United States

    Job Description · Job DescriptionRole: Data Engineer · About Rigil: · Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders. · Location: S ...

  • Saxon Global

    Data Engineer

    1 week ago


    Saxon Global San Francisco, United States

    Client: T he County of Sacramento · Position: Data Engineer - ETL, Spark, Airflow Specialist · Location: Sacramento, Ca ONLY CANDIDATES LOCAL TO SACRAMENTO WILL BE CONSIDERED. 100% ONSITE WORK · Rate:$65/hr. on C2C (Some Flex) · Visa: Open · Duration: 12+ Months · Looking f ...

  • ConsultNet

    Data Engineer

    4 days ago


    ConsultNet San Francisco, United States

    Data Engineer · Direct Hire · 100% Remote · Salary: $130, ,000 a year + company equity · Job Description: · Seeking Data Software Engineer who is well versed in Python and SQL and who loves to code. No specific industry experience required but Healthcare background is a plus ...

  • TEKsystems

    Data Engineer

    1 week ago


    TEKsystems San Francisco, United States

    : · The data engineer will collaborate closely with the growth and data foundation teams to define and create foundational data tables, migrate test tables while adhering to EDW standards, and build self-serve ETL frameworks capable of handling streaming and batch processing. Th ...