Jobs
>
San Francisco

    Lead Data Engineer - San Francisco, United States - Disney Entertainment & ESPN Technology

    Disney Entertainment & ESPN Technology
    Disney Entertainment & ESPN Technology San Francisco, United States

    5 days ago

    Default job background
    Regular
    Description

    Job Summary:

    The Lead Data Engineer will contribute to the Company's success by partnering with business, analytics and infrastructure teams to design and build data pipelines to facilitate measuring subscriber movements and metrics. Collaborating across disciplines, they will identify internal/external data sources, design table structure, define ETL strategy & automated Data Quality checks. You will also help mentor and guide other more junior data engineers in their data pipeline development.

    Responsibilities and Duties of the Role:

  • Lead the successful design and implementation of complex technical problems.
  • Lead and contribute to the design and growth of our Data Products and Data Warehouses around Subscriber movements and metrics.
  • Use sophisticated analytical thought to exercise judgement and identify innovative solutions.
  • Partner with technical and non-technical colleagues to understand data and reporting requirements, and Collaborate with Data Product Managers, Data Architects and other Data Engineers to design, implement, and deliver successful data solutions
  • Design table structures and define ETL pipelines to build performant Data solutions that are reliable and scalable in a fast growing data ecosystem.
  • Develop Data Quality checks
  • Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
  • Serve as an advanced resource to other Data Engineers on the team, and mentor and coach more junior members of the team helping to improve their skills, knowledge, and productivity.

    • Required Education, Experience/Skills/Training:

    Basic Qualifications

  • 7+ years of data engineering experience developing large data pipelines.
  • Strong understanding of data modeling principles including Dimensional modeling, data normalization principles.
  • Good understanding of SQL Engines and able to conduct advanced performance tuning.
  • Ability to think strategically, analyze and interpret market and consumer information.
  • Strong communication skills – written and verbal presentations.
  • Excellent conceptual and analytical reasoning competencies.
  • Comfortable working in a fast-paced and highly collaborative environment.
  • Familiarity with Agile Scrum principles and ceremonies

    • Preferred Qualifications

  • 4+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, required.
  • 5+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
  • 3+ years of experience programming languages (. Python, Pyspark), preferred.
  • 3+ years of experience with data orchestration/ETL tools (Airflow, Nifi), preferred.
  • Experience with Snowflake, Databricks/EMR/Spark & Airflow a plus.

    • Required Education

  • Bachelor's Degree in Computer Science, Information Systems or related field, or equivalent work experience.
  • Master's Degree a plus.
    • The hiring range for this position in Santa Monica, California is $149,300 to $200,200 per year, in San Francisco, California is $163,400 to $219,200 per year, in Seattle, Washington is $156,300 - $209,600 per year, and in New York City, NY is $156,300 - $209,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered
  • Sia Partners

    Data Engineer

    2 weeks ago

    Sia Partners San Francisco, United States

    Sia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in tur ...

  • Notion

    Data Engineer

    2 days ago

    Notion San Francisco, United States

    About Us: · We're on a mission to make it possible for every person, team, and company to be able to tailor their software to solve any problem and take on any challenge. Computers may be our most powerful tools, but most of us can't build or modify the software we use on them e ...

  • Unreal Gigs

    Data Engineer

    1 week ago

    Unreal Gigs San Francisco, United States Full time

    Company Overview: Welcome to the forefront of data-driven innovation At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to ...

  • Pathway Vet Alliance

    Data Engineer

    6 days ago

    Pathway Vet Alliance San Francisco, United States

    About Pathway · Deeptech start-up, founded in March 2020. Our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scal ...

  • Sia Partners

    Data Engineer

    2 weeks ago

    Sia Partners San Francisco, United States Full time

    Job Description · Sia Partners is looking for a talented Data Engineer to support our activities within the Data Science Business Unit. You will be working alongside with our Data Science consultants and our clients on Data Engineering topics, including creating relevant data mod ...

  • Rigil Corporation

    Data Engineer

    1 week ago

    Rigil Corporation San Francisco, United States Full time

    Role: Data Engineer · About Rigil: · Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders. · Location: San Francisco, CA · Job Type: Fu ...

  • Work & Co

    Data Engineer

    2 weeks ago

    Work & Co San Francisco, United States Freelance

    Sr. Data Engineer (Contractor) · Presence is a San-Francisco based consultancy specializing in digital product development and innovation for global brands. We've been delivering cutting-edge projects for ten years– and we're growing · We're currently seeking a Sr Data Engineer ...

  • BayOne Solutions

    Data Engineer

    5 days ago

    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scalable a ...

  • Stefanini

    Data Engineer

    3 weeks ago

    Stefanini San Francisco, United States

    Job Description · Details: Stefanini Group is hiring Stefanini is looking for Cloud Data Engineer in San Francisco, CA(Hybrid) For quick Apply, please reach out to Ayush Dwivedi - call: / email: Open to W2 Candidates only (US Citizens & Green Card Holders Only) Contributes to ...

  • Hexcel

    Data Engineer

    4 weeks ago

    Hexcel West Valley City, United States

    With our strong investment in research and development and our culture of continuous improvement, Hexcel is the industry leader in the manufacturing of advance composite materials, including carbon fiber, woven reinforcements, resins, prepregs, honeycombs and additive manufacture ...

  • OpenAI

    Data Engineer

    3 days ago

    OpenAI San Francisco, United States

    About the team · The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society. The work scope covers a wide range of projects from detection to model improvement to evaluation, aiming to ...

  • SonderMind

    Data Engineer

    6 days ago

    SonderMind San Francisco, United States

    About SonderMind · At SonderMind, we know that therapy works. SonderMind provides accessible, personalized mental healthcare that produces high-quality outcomes for patients. SonderMind's individualized approach to care starts with using innovative technology to help people not ...

  • Ciber

    Data Engineer

    1 week ago

    Ciber West Valley City, United States

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to ad ...

  • Sia Partners

    Data Engineer

    6 days ago

    Sia Partners San Francisco, United States

    Sia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in tur ...

  • Varite

    Data Engineer

    6 days ago

    Varite San Francisco, United States

    Pay rate range: $65-75/hr. · ***Cloud Data Engineer*** · Location: San Francisco · Position type: Hybrid (2+ days in office) · Position Description: · • Designs, develops, modifies, tests, and automates the data warehouse and business intelligence applications solutions. This i ...

  • CHG Medical Staffing

    Data Engineer

    1 week ago

    CHG Medical Staffing West Valley City, United States

    Healthcare's helping hand. · CHG shook things up in 1979 by inventing the locum tenens staffing model. We connect doctors with patients who need their care. As the largest physician staffing firm in America, our providers treat millions of patients each year. · Our industry is ...

  • Unreal Gigs

    Data Engineer

    3 weeks ago

    Unreal Gigs San Francisco, United States

    Job Description · Job DescriptionCompany Overview: Welcome to the forefront of data-driven innovation At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructur ...

  • Django Rest Framework

    Data Engineer

    6 days ago

    Django Rest Framework San Francisco, United States

    hims & hers is hiring a · Remote Data Engineer · We're looking for a savvy and experienced Senior Data Engineer to join the Data Platform Engineering team at Hims. As a Senior Data Engineer, you will work with the analytics engineers, product managers, engineers, security, DevOp ...

  • Forhyre

    Data Engineer

    4 days ago

    Forhyre San Francisco, United States

    Job Description · Job DescriptionWe are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions. · Data analyst responsibilities include conducting full lifecycle anal ...

  • FORE Enterprise

    Data Engineer

    6 days ago

    FORE Enterprise San Francisco, United States

    Working at FORE · FORE is unlocking dormant operational data with advanced AI to diagnose operational challenges and support better performance. With the close advisory from leading academic experts in Information and Operational Theory, we enable leaders across Tech, Healthcare ...