Jobs
>
Newark

    Data Engineer - Newark, United States - Hire Talent

    Hire Talent
    Hire Talent Newark, United States

    3 weeks ago

    Default job background
    Description

    High level requirements for the role:

    1. Data ingestion from various on-prem and cloud sources
    2. Ability to build ETL pipelines to transform raw data into format suitable for analysis (hands on experience working with ETL tools like AWS Glue, Informatica etc.) and orchestrate transformation (using Airflow, other DAG tools)
    3. Experience working with big data technologies and data formats (e.g., Parquet, Delta, Iceberg)
    4. Expertise in Python, Spark and SQL programming languages
    5. Strong experience working on cloud platforms (AWS, Azure)
    6. Proven track record of enterprise data modeling including building schemas for data warehousing
    7. Knowledge of real-time data streaming and real-time analytics
    8. Knowledge of Microsoft suite of tools is desired (Power BI, Synapse suite of analytics tools, Azure Data Factory)
    Your Impact:
    • Data ingestion from various on-prem and cloud sources, optimize data for large data processing
    • Build ETL pipelines to collect, blend, transform raw data into suitable formats for analysis (hands on experience working with ETL tools like AWS Glue, Informatica etc.) and orchestrate transformation (using Airflow, other DAG tools)
    • Create enterprise data models and define standards for data warehouse management adhering to data model definitions
    • Interact with data analytics and reporting teams to understand how data needs to be structured for consumption.
    • Configure and maintains MDM tools and system processes to ensure proper function of MDM mechanisms.
    • Define master data quality validation criteria and implements automatic error detection schemes.
    • Implement data lineage capability to understand data movement across the enterprise
    • Implement data governance and standards including data definitions, data quality rules, data lineage, business glossary functions
    • Support domain owners and data stewards to analyze quality issue root causes and remediation efforts.
    • Monitor cross-BU data provisioning to ensure provisioning is done via official sources.
    Your Skills and Experience:
    • Bachelors' degree is required in a relevant field.
    • 6+ years of experience working in a data engineering role supporting an on-prem Data Lake; experience within institutional asset management is a plus.
    • 4+ years of strong experience with working on cloud platforms (AWS, Azure) (CloudFormation Templates, IAM, Aurora, EventBridge, Lambda, CloudWatch);
    • 2+ years of experience with Snowflake (SnowSQL, SnowPark)
    • 5+ years of experience with any relational database (SQL, Store procedures, functions)
    • 5+ years of experience with Python, Spark and SQL programming languages .
    • Extensive hands-on experience in modern data lake architecture, database development, and data modeling.
    • Knowledge of real-time data streaming and real-time analytics
    • Knowledge of Microsoft suite of tools is desired (Power BI, Synapse suite of analytics tools, Azure Data Factory)
    • Strong implementation skills and working knowledge of data structures, algorithms and big data tools (Spark, Hadoop, Python, SQL, NoSQL, Hive); Must have hands-on experience using Spark.
    • Solid Linux OS and Shell Scripting experience.
    • Experience working with big data technologies and data formats (e.g., Parquet, Delta, Iceberg)
    • Extensive experience with at least one of the following RDMS: Oracle, SQL Server, Postgres or MySQL.
    • Strong communication skills: able to partner with technical and business stakeholders to drive innovative solutions.
    • Prior experience using data governance technology tools.
    • Prior experience in a lead role is desired but not required.
    • Experience working in an agile environment embracing collaboration within and across teams.
    • Excellent written and verbal communication skills.
    • Detail oriented; Analytical with strong problem-solving abilities.
    • Professional and energetic self-starter. Comfortable with ambiguity, able to effectively take the conceptual to the pragmatic.
    ll qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender, identity, national origin, disability, or protected veteran status.
  • Understood

    Data Engineering

    3 weeks ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • EQUINOX

    Engineering Contractor, Data

    2 weeks ago

    EQUINOX New York, United States Freelance

    **Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...

  • FanDuel

    Data Engineering Director

    2 weeks ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • LTIMindtree

    Specialist - Data Engineering

    2 weeks ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • 4 Staffing Corp

    Data Engineer

    3 weeks ago

    4 Staffing Corp Newark, United States

    About the job Data Engineer (Financial Services) · Data Engineer (Fixed Income Capital Markets) · Full-time, direct employment · Hybrid onsite/remote - Newark, NJ · No visa sponsorship or C2C at this time · Job Description: · Our client is seeking a skilled and experienced ...

  • Spectraforce Technologies

    Data Engineer

    3 weeks ago

    Spectraforce Technologies Newark, United States

    Job Title: Data Engineer · Location: Newark, NJ (Hybrid) · Duration: 6 Months (Temp to Hire) · Pay Rate starts from: $55/hr. on W2 · Job Description: · Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to ou ...

  • Diverse Lynx

    Data Engineer

    3 weeks ago

    Diverse Lynx Newark, United States

    Snowflake Data Engineer- · snowflake , · python · Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their abil ...

  • Phaxis

    Data Engineer

    1 week ago

    Phaxis Newark, United States

    Junior Data Engineer (3+ years): Salary is $110k-$140k + bonus · Senior Data Engineer (5+ years): Salary is $135k-$155k + bonus · 3 days remote and 2 days onsite in Newark, NJ · All candidates will need to complete a Python assessment · Must Have Qualifications: · 3+ experience i ...

  • Proit

    Data Engineer

    3 weeks ago

    Proit Newark, United States

    Job DescriptionSkill: AWS Data Engineer · * Must have AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. · Experience Required: · * Minimum 5 years of professional experience in data integration and management. · * 3+ years of hands ...

  • STV Group

    Junior Data Engineering Specialist

    1 week ago

    STV Group New York, United States

    We are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...

  • Iris Software Inc.

    AWS Data Engineer

    2 weeks ago

    Iris Software Inc. Newark, United States

    Iris's client, a large insurance company, is currently searching for a strong for AWS Data Engineer. · Our client has offices all over the world and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. · Job title: ...

  • FYI Solutions

    AWS Data Engineer

    3 weeks ago

    FYI Solutions Newark, United States

    Role: AWS Data Engineer · Location: Newark, NJ - Hybrid · Target Start Date: ASAP · Right to hire: Yes · Qualifications: · Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience · Experience implementing, supporting ...

  • Hire Talent

    Lead Data Engineer

    3 weeks ago

    Hire Talent Newark, United States

    Lead Data Engineer VMS Prudential · Level 3 (potentially level 4) · Right to hire (conversion is possible) · Long term requirement (Initial couple months will want to join them FT) · Narayana Murthy is HM · Interview process: about 3 rounds of interviews · Notes: Chief Data O ...

  • Atlantic Partners

    AWS Data Engineer

    2 weeks ago

    Atlantic Partners Newark, United States

    Our direct client is seeking an AWS Data Engineer for an 8-month contract-to-hire opportunity to work HYBRID (2-3 days/wk) in their Newark, NJ location. THIS IS A W2 ONLY ROLE - NO C2C /THIRD PARTIES. · Qualifications Bachelor's degree in Computer Science, Software Engineering, M ...

  • JSR Tech Consulting

    Lead Data Engineer

    3 weeks ago

    JSR Tech Consulting Newark, United States Right to Hire

    Long term contract to hire. · Lead data engineer role with a major Financial Services company. · Hybrid work environment days onsite in Newark, NJ. · - Engineering lead to help the design/build of the enterprise data platforms · Design, Develop and Implement · End-to-end dat ...

  • Peer Consulting Resources Inc.

    AWS Data Engineer

    1 day ago

    Peer Consulting Resources Inc. Newark, United States

    Contact Details · Name: Savitha Chinnappa · Email: savitha.- · Cell: · Job Title: AWS Data Engineer (On W2) · Location: Newark, NJ (Onsite) · Duration: Months (Possibility of Extension) · Years of Experience: 7+ Yrs · Job Description: · AWS Certifications · Data pipeline (inges ...

  • JSR Tech Consulting

    Azure Data Engineer

    18 hours ago

    JSR Tech Consulting Newark, United States

    Design and implement Azure data solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Synapse. · Develop and implement data integration processes using Azure Data Factory. · Extract data from various sources, transform it, and load it into data warehouses or data ...

  • JSR Tech Consulting

    Sr. Data Engineer

    3 weeks ago

    JSR Tech Consulting Newark, United States

    Job Description : · 8p - Engineering lead to help the design/build of the CDO enterprise data platforms · Design, Develop and ImplementEnd-to-end data solutions (ingest, storage, integration, processing, access) on AWS. · Data intake/ request/ onboarding services and service d ...

  • Diverse Lynx

    Azure Data Engineer

    18 hours ago

    Diverse Lynx Newark, United States

    Role: Azure Data Engineer · Location: Newark, New Jersey · Type : Full Time/ permanent Job · Job Description · " Strong knowledge of Azure data services, including Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse Analytics, and Azure SQL Server · " Experience ...

  • Phaxis

    Azure Data Engineer

    1 week ago

    Phaxis Newark, United States

    Qualifications: · 3+ yrs of experience in building data and analytics platform focused on Azure data and analytics solutions · Proficiency in Azure suite of services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake · Experience imple ...