Jobs
>
Jersey City

    Data Engineer - Jersey City, United States - A.M. Best

    A.M. Best
    A.M. Best Jersey City, United States

    3 weeks ago

    Default job background
    Description
    Overview

    The Data Engineer will build data pipelines / data orchestrator and data structures for existing operational data stores, Azure data lake & data warehouse. They will develop proof-of-concepts to evaluate new technologies and suggest improved and better ways to re-architect existing data loading processes and data structures. They will work independently with minimal supervision within the Data Engineering team and will collaborate with other teams in an agile environment. They will have a creative mindset, knack to solve complex problems, passion to work with data, and a positive attitude.

    Responsibilities
    • Design and develop ELT / ETL to load data from internal sources into operational data stores, Azure data lake and data warehouse.
    • Create APIs, data structures and schemas to store and retrieve data.
    • Create and maintain data mappings, data definitions, architecture and data flow diagrams.
    • Implement solutions to validate and test data quality.
    • Build proof-of-concepts to determine viability of new processes and technologies.
    • Deploy and manage code in non-prod and prod environments.
    • Troubleshoot data related issues and fix defects.
    • Optimize and performance tune databases and queries.
    • Participate in code reviews and train other team members.
    • Document code and create code templates based on industry best practices.
    Qualifications
    • Bachelor's Degree and/or equivalent experience required.
    • Minimum 5 years of experience working as a Data Engineer, ETL Engineer, Data/ETL Architect or similar roles.
    Skills

    • 5+ years of solid continuous experience in Python.

    • 3+ years of continuous experience with Airflow.

    • 3+ years of experience with Azure Data Factory (ADF) or similar.

    • 3+ years of experience working with relational databases: Oracle, SQL Server, PostgreSQL, or similar.

    • 3+ years of experience working with NoSQL databases: MongoDB, Cosmos DB, DocumentDB or similar

    • 3+ years of experience writing SQL code.

    • 3+ years of experience in Kimball Dimensional Modeling (Star-Schema).

    • 2+ years of experience in columnar databases: Snowflake, Azure Synapse, or similar.

    • 2+ years of Azure / AWS experience.

    Pluses, but not required: Any work experience in the following:

    • ETL / ELT: Spark, Apache NiFi, Kafka, Luigi, Prefect.

    • Languages: Java, Scala, R.

    • Platforms: Databricks.

    • Databases: Redis, Elasticsearch.

    • Data Orchestrator: Control-M, JAMS.
  • Understood

    Data Engineering

    2 weeks ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • EQUINOX

    Engineering Contractor, Data

    2 weeks ago

    EQUINOX New York, United States Freelance

    **Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...

  • FanDuel

    Data Engineering Director

    2 weeks ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • LTIMindtree

    Specialist - Data Engineering

    2 weeks ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • STV Group

    Junior Data Engineering Specialist

    1 week ago

    STV Group New York, United States

    We are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...

  • CBRE

    IT Data Center Engineer

    3 weeks ago

    CBRE New York, United States

    Teilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...

  • Jarvis Walker

    Data Engineer

    3 weeks ago

    Jarvis Walker Jersey City, United States

    Data Engineer · We are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lin ...

  • YASH Technologies

    Data Engineer

    1 week ago

    YASH Technologies Jersey City, United States

    Hi, · We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume. · Requirement Details: · Location: Jersey City, NJ · Work Authorizations: Citizen, GC EAD, Green Card, H4 EAD · Position Type: Contract · Job Ti ...

  • SANS

    Data Engineer

    1 week ago

    SANS Jersey City, United States

    Job Title - Data Engineer - Snowflake · Location - Jersey City, NJ (Hybrid) · Duration - 12+ Months · Requirements: · 8 to 10 Yrs IT experience on Data driven initiatives with recent 2-3 Yrs experience in snowflake is mandatory · SQL, Data Warehousing, Data Modeling, Cloud based ...

  • Diverse Lynx

    Data Engineer

    3 weeks ago

    Diverse Lynx Jersey City, United States

    Job Title: Data Engineer ( Python + AWS) · Location : Jersey City , NJ (Onsite, Local s only) · Job responsibilities : Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to bui ...

  • ClifyX

    Data Engineer

    3 weeks ago

    ClifyX Jersey City, United States

    Job title : Data Engineer - Databricks · Location : New Jersey (Remote) · Duration : Contract / Fulltime · Health Care Company · $75/Hr (Contract) · salary K/Annum (Fulltime) · Job Description: · • Experience with PySpark or Python · • DataBricks experience is mandatory · • Ex ...

  • Lord Abbett & Co.

    Data Engineer

    4 weeks ago

    Lord Abbett & Co. Jersey City, United States

    Lord Abbett is looking for a talented and experienced developer to join our development team to support the continued development of our analytics platforms. Besides regular individual contributions, Data Engineers are expected to be deep technical e Data Engineer, Data Architect ...

  • Expedite Technology Solutions LLC

    Data Engineer

    3 weeks ago

    Expedite Technology Solutions LLC Jersey City, United States

    Provide technical design and develop Extract/Transform/Load (ETL), ELT applications that interface with Datametica's customer applications. · Lead and implement data driven solutions and collaborate with larger development teams · Lead and Develop Test Strategy, Test Plan, Test C ...

  • YASH Technologies

    Data Engineer

    6 days ago

    YASH Technologies Jersey City, United States

    Looking for 10+ yrs Senior Resource · Mandatory Skills · Oracle · Mongo DB · Data Engineer · NO SQL database · Data Modeling · The Senior Database Engineer(MongoDB) will lead complex or critical database management initiatives that typically involve multiple disciplines and busin ...

  • Tradeweb Markets LLC

    Data Engineer

    2 weeks ago

    Tradeweb Markets LLC Jersey City, United States

    The Billing Technology team is responsible for the overall ownership of our internal billing and invoicing systems including the development, quality assurance and operations of the platform. · As a member of this team, you will be able to take in a set of complex requirements a ...

  • iPivot, LLC

    Data Engineer

    3 weeks ago

    iPivot, LLC Jersey City, United States

    Role: Data Engineer · Fulltime/Contract · Location: New Jersey City, NJ · Hybrid · ...

  • Jarvis Walker

    Data Engineer

    18 hours ago

    Jarvis Walker Jersey City, United States

    Data Engineer · We are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lin ...

  • Hire Talent

    Data Engineer

    3 weeks ago

    Hire Talent Jersey City, United States

    PGIM Fixed Income - Data Engineer · PGIM is the diversified asset management business of Prudential Financial, Inc. (NYSE: PRU). With $1.4 trillion in assets under management, and 38 offices spanning 16 countries, PGIM is among the world's top-10 largest asset managers. Comprised ...

  • EmergiTel

    Data Engineer

    2 weeks ago

    EmergiTel Jersey City, United States

    5+ years of Hands on experience in developing custom connectors and plugins for CyberArk PSM and CPM. · Work on design and development activities for privileged access management function by using programming and scripting languages such as python, PowerShell, TCL, AutoIT, CyberA ...

  • EmergiTel

    Data Engineer

    3 weeks ago

    EmergiTel Jersey City, United States

    5+ years of Hands on experience in developing custom connectors and plugins for CyberArk PSM and CPM. · Work on design and development activities for privileged access management function by using programming and scripting languages such as python, PowerShell, TCL, AutoIT, Cyber ...