Jobs
>
New York City

    Lead Data Engineer - New York, United States - High 5

    Default job background
    Description
    Job Title: Lead Data Engineer

    Location : Onsite 5 days in NYC

    Pay Rate: $60/hr - $65/hr

    Duration : 11 Months

    Job Description

    Our Ads & Data Platforms team, a segment under Disney Entertainment & ESPN Technology, is looking for a Lead Data Engineer. Data is essential for all our decision-making needs whether it's related to product design, measuring advertising effectiveness, helping users discover new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Content Engineering team is seeking a highly hardworking Data Engineer with a strong technical background and passionate about diving deeper into Big Data to develop state of the art Data Solutions.

    Responsibilities

    • Contribute to the design and growth of our Data Products and Data Warehouses around Content Performance and Content Engagement data.

    • Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data environments (cloud, on-prem, hybrid)

    • Our tech stack includes AWS, Databricks, Snowflake, Spark and Airflow

    • Help architect data solutions/frameworks and define data models for the underlying data warehouse and data marts

    • Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions

    • Maintain detailed documentation of your work and changes to support data quality and data governance

    • Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)

    • Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team

    Basic Qualifications

    • 7+ years of data engineering experience developing large data pipelines

    • Strong SQL skills and ability to create queries to extract data and build performant datasets

    • Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data at large scale

    • Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query)

    Preferred Qualifications

    • Nice to have experience with Cloud technologies like AWS (S3, EMR, EC2)

    • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines

    • Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices

    • Good Scripting skills, including Bash scripting and Python

    • Familiar with Scrum and Agile methodologies

    • You are a problem solver with strong attention to detail and excellent analytical and communication skills

    Required Education

    • Bachelor's Degree in Computer Science, Information Systems or related field

    Preferred Education

    • Master's Degree in Computer Science, Information Systems or related field
    • Published on 22 Jan 2024, 10:33 PM

  • Storm3

    Data Engineer

    4 weeks ago


    Storm3 New York, United States

    Lead Data Engineer · Series B, Startup · New York (Hybrid) · $200, ,000 + Significant Equity + Bonus · The company is a leading provider of virtual care to help tackle substance use. · ‍ Responsibilities: · Develop and maintain data pipelines for extracting, transforming and lo ...

  • Jane Street

    Data Engineer

    3 weeks ago


    Jane Street New York, United States Full time

    About the Position · We are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do. · Using our mix of in-house and op ...

  • Action Tech

    Data Engineer

    2 weeks ago


    Action Tech New York, United States

    This is a full time, direct hire position that requires 3 to 4 days a week onsite in NYC · All applicants must be local to the NY, NJ, CT area · We are looking for an outstanding Data Engineer to join our New York-based team who can help build the infrastructure to make data a ce ...

  • Capstone Investment Advisors

    Data Engineer

    3 weeks ago


    Capstone Investment Advisors New York, United States

    RESPONSIBILITIES: · Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend dat ...

  • Coda Search│Staffing

    Data Engineer

    1 week ago


    Coda Search│Staffing New York, United States

    Our client, a top hedge fund in Midtown is looking for a Data Engineer to join their Strategic Finance team. This team conducts analysis to drive decision making across the firm. · The ideal candidate will have 3-5 years experience. · Experience: · Degree in a quantitative disc ...

  • Artech LLC

    Data Engineer

    1 week ago


    Artech LLC Newark, United States

    Job Description: · Artech is currently looking for experienced professional for the below position. · Job Title: Data Engineer · Job ID: · Location: 213 Washington St, Newark, Nj 07102 · Duration: 6+ Months · Job Description: · Greater than 10 years of data engineering developme ...

  • The Tie

    Data Engineer

    3 weeks ago


    The Tie New York, United States

    The Tie is a leading provider of information services for digital assets. Our core offering, The Tie Terminal, is the fastest and most comprehensive workstation for institutional digital asset investors. The Terminal brings together real-time news from thousands of primary source ...

  • Silver Search, Inc

    Data Engineer

    1 day ago


    Silver Search, Inc New York, United States

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** · Contract-to-hire · Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data ...

  • UnitedHealth Group

    Senior Data Engineer

    2 weeks ago


    UnitedHealth Group New York, United States

    Lead design, development, enhancement, and integration of analytical data products and/or data warehouse solutions. Analyze data sources and system landscape related to medical claims and adjacent domains. Partner with SMEs to become a domain expert. ...

  • Elevano

    Data Engineer

    6 hours ago


    Elevano New York, United States

    Our client is looking for Data Engineers. The company culture is to push ideas through prototyping to see if there are better ways of more efficiently servicing at scale traffic. If you are passionate about wrangling massive amounts of data then this would be a good place for you ...

  • New York Blood Center

    Data Engineer

    4 weeks ago


    New York Blood Center New York, United States

    · Data Engineer · Job Locations · US-NY-New York · Job ID · Category · Information Technology · Minimum Rate · USD $100,000.00/Yr. · Maximum Rate · USD $115,000.00/Yr. · Work Location Type · Hybrid · Overview · At New York Blood Center Enterprises (NYBCe), one of the most ...


  • Havas Media Network New York, United States

    Sr. Data Engineer, Job Description · Position Overview: · Havas Media Network is looking for an experienced data engineer who wants to bring their career to the next level in a rapidly growing industry. You must be a self-starter with a desire to challenge yourself by acquiring ...

  • Open Systems Technologies

    Data Engineer

    4 weeks ago


    Open Systems Technologies New York, United States

    A financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...

  • Logistics Management Institute

    Data Engineer

    4 weeks ago


    Logistics Management Institute New York, United States

    Overview · LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions, logistics, and management advisory services. We deliver integrated capabilities that incorporate emerging technologies and a ...

  • HappyFunCorp

    Data Engineer

    12 hours ago


    HappyFunCorp New York, United States

    Data Engineer / Analyst - Remote - Contract · *This position is 100% remote* (This role will primarily operate on East Coast hours) · HappyFunCorp helps businesses develop great products and deliver powerful technical solutions with a blend of deep engineering skills, human-foc ...

  • Jobot

    Data Engineer

    2 weeks ago


    Jobot New York, United States

    Job Description · Job Description100% Remote · This Jobot Consulting Job is hosted by: Duran Workman · Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume. · Salary: $75 - $95 per hour · A bit about us: · We are seeking a dynamic and experie ...

  • Numeus

    Data Engineer

    6 hours ago


    Numeus New York, United States

    Numeus is a diversified digital asset investment firm built to the highest institutional standards, combining synergistic businesses across Alpha Strategies, Trading, and Asset Management. · Numeus was founded by successful executives with decades of experience across the financ ...


  • Goldman Sachs New York, United States

    MORE ABOUT THIS JOB: · The Client Data Engineering team manages a Data Engineering departmental initiative, executed by Goldman Sachs' Data Intelligence Office (DIO), to curate client data connected through division client data models, and make the data retrievable via API and t ...

  • Qloo Inc.

    Data Engineer

    6 hours ago


    Qloo Inc. New York, United States

    The Company You'll Join · At Qloo, our cutting-edge Taste AI technology leverages extraordinary amounts of data-over half a billion records of public figures, places, and things, plus a globe-spanning consumer behavior and sentiment database-to unearth deep insights about consum ...

  • iCapital

    Data Engineer

    2 weeks ago


    iCapital New York, United States

    iCapital is powering the world's alternative investment marketplace. Our financial technology platform has transformed how advisors, wealth management firms, asset managers, and banks evaluate and recommend bespoke public and private market strategies for their high-net-worth cli ...