Jobs
>
Newark

    Lead Data Engineer - Newark, United States - JSR Tech Consulting

    JSR Tech Consulting
    JSR Tech Consulting Newark, United States

    2 weeks ago

    Default job background
    Right to Hire
    Description

    Long term contract to hire.
    Lead data engineer role with a major Financial Services company.

    Hybrid work environment days onsite in Newark, NJ.

    - Engineering lead to help the design/build of the enterprise data platforms
    Design, Develop and Implement

    • End-to-end data solutions (ingest, storage, integration, processing, access) on AWS.
    • Data intake/ request/ onboarding services and service documentation.
    • Data ingestion services for batch/ real time data ingest and service documentation.
    • Data processing services for batch/ real time (Glue/ Kinesis/ EMR) and service documentation.
    • Data storage services for data lake (S3)/ data warehouses (RDS/ Redshift)/ data marts and service documentation.
    • Data services layer including Athena, Redshift, RDS, microservices and APIs.
    • Pipeline orchestration services including lambda, step functions, MWAA (optional).
    • Data security services (IAM/ KMS/ SM/ encryption/ anonymization/ RBAC) and service documentation.
    • Data access provisioning services (Accounts, IAM Roles RBAC), processes, documentation and education.
    • Data provisioning services for data consumption patterns including microservices, APIs and extracts.
    • Metadata capture and catalog services for data lake (S3/ Athena), data warehouses (RDS/ Redshift), Microservices/ APIs.
    • Metadata capture and catalog services for pipeline/ log data for monitoring / support.
    • Architect and implement CI/ CD strategy for EDP .
    • Implement high velocity streaming solutions using Amazon Kinesis, SQS, and SMS.
    • Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift.
    • Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
    • Implement cost/ spend monitoring for AWS based data platform.
    • Implement audit reporting for access of AWS based data platform.
    • Contribute to the implementation of a data strategy to enable LOBs and Corporate Functions with a robust, holistic view of data - driven decision making.
    • Partner with immediate engineering team, product owner, IT, partners on EDP agenda.
    • Leverage and continuously develop best practices, standards, and frameworks.
    • Provide technology thought leadership, consulting, and coaching/ mentoring.
    • Work with scrum master to develop and own backlog, stories, epics, sprints.
    • System design and Architecture for products/ applications for EDP.
    • Work closely with various stakeholders (BI, AIML, MDM and other teams) to understand their use-cases and design optimal solution for them.
    • Execute technical design and infrastructure strategy for EDP .
    • Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case.
    Qualifications
    • Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience.
    • Experience implementing, supporting data platforms on AWS for large enterprises.
    • Full stack development experience building secure internal facing applications.
    • Programming experience with Java, Python/ Scala, Shell scripting.
    • Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
    • Solid experience implementing solutions on AWS based data lakes preferred.
    • Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB.
    • AWS Solutions Architect or AWS Big Data Certification preferred.
    • Experience in AWS data lake, data warehouse and business analytics.
    • Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift.
    • Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.
    • Experience with DevOps and Continuous Integration/ Delivery (CI/ CD) concepts and tools.
    • Experience with business intelligence tools such as Tableau, Power BI or equivalent.
    • Knowledge of ETL/ ELT.
    • Awareness of Data Management & Governance tools.
    • Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired.
    • Experience working on Agile projects.
  • Understood

    Data Engineering

    2 weeks ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • EQUINOX

    Engineering Contractor, Data

    1 week ago

    EQUINOX New York, United States Freelance

    **Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...

  • FanDuel

    Data Engineering Director

    2 weeks ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • LTIMindtree

    Specialist - Data Engineering

    2 weeks ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • Phaxis

    Data Engineer

    1 week ago

    Phaxis Newark, United States

    Junior Data Engineer (3+ years): Salary is $110k-$140k + bonus · Senior Data Engineer (5+ years): Salary is $135k-$155k + bonus · 3 days remote and 2 days onsite in Newark, NJ · All candidates will need to complete a Python assessment · Must Have Qualifications: · 3+ experience i ...

  • 4 Staffing Corp

    Data Engineer

    3 weeks ago

    4 Staffing Corp Newark, United States

    About the job Data Engineer (Financial Services) · Data Engineer (Fixed Income Capital Markets) · Full-time, direct employment · Hybrid onsite/remote - Newark, NJ · No visa sponsorship or C2C at this time · Job Description: · Our client is seeking a skilled and experienced ...

  • Diverse Lynx

    Data Engineer

    2 weeks ago

    Diverse Lynx Newark, United States

    Snowflake Data Engineer- · snowflake , · python · Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their abil ...

  • SPECTRAFORCE

    Data Engineer

    4 weeks ago

    SPECTRAFORCE Newark, United States

    Job Title: AWS Data Engineer · All potential applicants are encouraged to scroll through and read the complete job description before applying.Location: Newark, NJ – Hybrid (2/3 days onsite/week)Duration: 8 Months (Temp to Perm Hire)Qualifications:Bachelor's degree in Computer S ...

  • Spectraforce Technologies

    Data Engineer

    2 weeks ago

    Spectraforce Technologies Newark, United States

    Job Title: Data Engineer · Location: Newark, NJ (Hybrid) · Duration: 6 Months (Temp to Hire) · Pay Rate starts from: $55/hr. on W2 · Job Description: · Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to ou ...

  • Hire Talent

    Data Engineer

    2 weeks ago

    Hire Talent Newark, United States

    High level requirements for the role: · Data ingestion from various on-prem and cloud sources · Ability to build ETL pipelines to transform raw data into format suitable for analysis (hands on experience working with ETL tools like AWS Glue, Informatica etc.) and orchestrate tra ...

  • Proit

    Data Engineer

    2 weeks ago

    Proit Newark, United States

    Job DescriptionSkill: AWS Data Engineer · * Must have AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. · Experience Required: · * Minimum 5 years of professional experience in data integration and management. · * 3+ years of hands ...

  • STV Group

    Junior Data Engineering Specialist

    1 week ago

    STV Group New York, United States

    We are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...

  • Iris Software Inc.

    AWS Data Engineer

    2 weeks ago

    Iris Software Inc. Newark, United States

    Iris's client, a large insurance company, is currently searching for a strong for AWS Data Engineer. · Our client has offices all over the world and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. · Job title: ...

  • FYI Solutions

    Lead Data Engineer

    3 weeks ago

    FYI Solutions Newark, United States

    Responsibilities · Implement and support · end-to-end data lake/warehousing/mart/business intelligence/ analytics/ services solutions (ingest, storage, integration, processing, services, access) in AWS · data lake data intake/request/onboarding services and service documentation ...

  • Hire Talent

    Lead Data Engineer

    3 weeks ago

    Hire Talent Newark, United States

    Lead Data Engineer VMS PrudentialLevel 3 (potentially level 4)Right to hire (conversion is possible)Long term requirement (Initial couple months will want to join them FT)Narayana Murthy is HMInterview process: about 3 rounds of interviews · Notes: · Chief Data OfficeProvided d ...

  • JSR Tech Consulting

    Sr. Data Engineer

    2 weeks ago

    JSR Tech Consulting Newark, United States

    Job Description : · 8p - Engineering lead to help the design/build of the CDO enterprise data platforms · Design, Develop and ImplementEnd-to-end data solutions (ingest, storage, integration, processing, access) on AWS. · Data intake/ request/ onboarding services and service d ...

  • JSR Tech Consulting

    Lead Data Engineer

    4 weeks ago

    JSR Tech Consulting Newark, United States

    Long term contract to hire. Lead data engineer role with a major Financial Services company. · Hybrid work environment days onsite in Newark, NJ. · - Engineering lead to help the design/build of the enterprise data platforms · Design, Develop and Implement · End-to-end data s ...

  • Hire Talent

    Lead Data Engineer

    2 weeks ago

    Hire Talent Newark, United States

    Lead Data Engineer VMS Prudential · Level 3 (potentially level 4) · Right to hire (conversion is possible) · Long term requirement (Initial couple months will want to join them FT) · Narayana Murthy is HM · Interview process: about 3 rounds of interviews · Notes: Chief Data O ...

  • Atlantic Partners

    AWS Data Engineer

    1 week ago

    Atlantic Partners Newark, United States

    Our direct client is seeking an AWS Data Engineer for an 8-month contract-to-hire opportunity to work HYBRID (2-3 days/wk) in their Newark, NJ location. THIS IS A W2 ONLY ROLE - NO C2C /THIRD PARTIES. · Qualifications Bachelor's degree in Computer Science, Software Engineering, M ...

  • FYI Solutions

    AWS Data Engineer

    3 weeks ago

    FYI Solutions Newark, United States

    Role: AWS Data Engineer · Location: Newark, NJ - Hybrid · Target Start Date: ASAP · Right to hire: Yes · Qualifications: · Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience · Experience implementing, supporting ...