Jobs
>
New York City

    Lead Data Engineer - New York, United States - Peak Partners Llc

    Peak Partners Llc
    Peak Partners Llc New York, United States

    3 weeks ago

    Default job background
    Description


    Peak Partner's client, a global software development company, is looking to hire a Lead Data Engineer to join their team to work on innovative technologies in the Data Engineering space.

    This position is mainly remote, but candidates must be local to the Baltimore County area and
    report into the office as needed.


    Responsibilities :
    Design, develop, and support scalable data processing pipelines using Apache Spark and Java/Scala.
    Lead a talented team and make a significant impact on the client's data engineering capabilities.
    Implement and manage workflow orchestration with Airflow for efficient data processing.
    Proficiently use SQL for querying and data manipulation tasks.
    Collaborate with cross-functional teams to gather requirements and ensure alignment with data engineering solutions.


    Requirements :


    Bachelor's degree in computer science or another relevant discipline, and a minimum of five years relevant experience in Data Engineering.

    Solid experience with Apache Spark for large-scale data processing.
    Proficiency in Java or Scala programming languages.
    Strong knowledge of Airflow for workflow orchestration.
    Proficient in SQL for data querying and manipulation.
    Familiarity with Avro and Schema Registry for efficient data serialization.
    Experience with containerization technologies such as Docker and orchestration tools like Kubernetes (K8S).
    Hands-on experience with cloud-based data engineering services, preferably Azure Data Factory or AWS Glue.
    Understanding of release management processes.
    Familiarity with version control systems such as Git and experience with release pipelines using Azure DevOps or similar tools.


    If you think you have the qualifications stated above and are interested in exploring a new opportunity, we will welcome the chance to review your resume and talk further.

  • Understood

    Data Engineering

    2 weeks ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • EQUINOX

    Engineering Contractor, Data

    1 week ago

    EQUINOX New York, United States Freelance

    **Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...

  • FanDuel

    Data Engineering Director

    1 week ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • LTIMindtree

    Specialist - Data Engineering

    2 weeks ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • STV Group

    Junior Data Engineering Specialist

    1 week ago

    STV Group New York, United States

    We are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...

  • Bayer Industry Services (Currenta GmbH & Co. OHG)

    Senior Data Engineer

    3 weeks ago

    Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United States

    Das kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...

  • CBRE

    IT Data Center Engineer

    2 weeks ago

    CBRE New York, United States

    Teilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...

  • Hunter Bond

    Data Engineer

    3 days ago

    Hunter Bond New York, United States

    Job title: Data Engineer · Client: Elite Quantitative Trading Firm · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loadin ...

  • Social Capital Resources

    Data Engineer

    3 weeks ago

    Social Capital Resources New York, United States

    Data Engineer · Hybrid Role 4 days/week NYC · $120-130k base + bonus · Our client, an investment manager in NYC, is looking to add a Jr. Data Engineer to their team. The ideal candidate will have 1-3 years of Data Engineer/Development experience. Financial services experience is ...

  • Net2Source Inc.

    Data Engineer

    2 weeks ago

    Net2Source Inc. New York, United States

    W2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...

  • Hunter Bond

    Data Engineer

    6 days ago

    Hunter Bond New York, United States

    Job title: Data Engineer · Client: Elite Fintech · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loading (ETL) processes ...

  • Logistics Management Institute

    Data Engineer

    2 weeks ago

    Logistics Management Institute New York, United States

    Overview · LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions, logistics, and management advisory services. We deliver integrated capabilities that incorporate emerging technologies and a ...

  • Bardess Group, Ltd.

    Data Engineer

    2 weeks ago

    Bardess Group, Ltd. New York, United States

    Job Description · Job DescriptionLocation Desired: New Jersey or Remote · Location Option: Virtual Home Office with occasional travel to client sites · Data Engineer: · As a Data Engineer you will work hands-on with some of the most innovative clients and use cases. Leveraging yo ...

  • ASCENDING LLC

    Data Engineer

    4 weeks ago

    ASCENDING LLC New York, United States Full time

    Full-time, Remote - Location Requirement: MUST be located in the Eastern Time Zone · Available for W-2 or 1099 Individual. · Our client, one of the largest Amazon Web Services (AWS) partners for data services, is looking for a true Mid level Big Data Engineer to contribute to jo ...

  • Codex Tech-it

    Data Engineer

    2 weeks ago

    Codex Tech-it New York, United States

    Codex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a strong focus on data quality and ac ...

  • Stealth AI Startup

    Data Engineer

    3 weeks ago

    Stealth AI Startup New York, United States

    Are you fascinated by the potential of the intersection between artificial intelligence and blockchain technology? Do you thrive in fast-paced environments where innovation is the norm? Interested in being a founding member of an early-stage start-up? · If so, we want you to be ...

  • Capital Fund Management (CFM)

    Data Engineer

    3 weeks ago

    Capital Fund Management (CFM) New York, United States

    ABOUT CFM · Founded in 1991, we are a global quantitative and systematic asset management firm applying a scientific approach to finance to develop alternative investment strategies that create value for our clients. · We value innovation, dedication, collaboration and the abilit ...

  • HelloFresh

    Data Engineer

    2 weeks ago

    HelloFresh New York, United States

    Job Description · As a Data Engineer, you will work with the Fulfillment Planning Technology team to help build the next generation suite of internal tools that enable Planning and Operations teams to see and act quickly to changing business conditions. The Data Engineer will bui ...

  • GroTech Search

    Data Engineer

    3 weeks ago

    GroTech Search New York, United States

    Senior Data Engineer - Generative AI · New York - hybrid · $160-180k · We are working with a leading financial services client who are looking for a dynamic and enthusiastic Senior Data Engineer to spearhead the design and execution of our company's modern data management stra ...

  • Publicis Groupe

    Data Engineer

    2 weeks ago

    Publicis Groupe New York, United States

    Company Description · Publicis Media harnesses the power of modern media through global agency brands CJ, Performics, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith. A key business solution of Publicis Groupe ([Euronext Paris FR , CAC 40], Publicis ...