Jobs
>
Newark

    Lead Data Engineer - Newark, United States - FYI Solutions

    FYI Solutions
    FYI Solutions Newark, United States

    4 weeks ago

    Default job background
    Description

    Responsibilities

    Implement and support

    · end-to-end data lake/warehousing/mart/business intelligence/ analytics/ services solutions (ingest, storage, integration, processing, services, access) in AWS

    · data lake data intake/request/onboarding services and service documentation

    · data lake ingestion services for batch/real time data ingest and service documentation

    · data processing services (ETL/ELT) for batch/real time (Glue/Kinesis/EMR) and service documentation

    · data storage services for data lake (S3)/ data warehouses (RDS/Redshift)/ data marts and service documentation

    · data services layer including Athena, Redshift, RDS, microservices and APIs

    · pipeline orchestration services including lambda, step functions, MWAA (optional)

    · data security services (IAM/KMS/SM/encryption/anonymization/RBAC) and service documentation

    · data access provisioning services (Accounts, IAM Roles RBAC), processes, documentation and education

    · data provisioning services for data consumption patterns including microservices, APIs and extracts

    · metadata capture and catalog services for data lake(S3/Athena), data warehouses (RDS/Redshift), Microservices/APIs

    · metadata capture and catalog services for pipeline/log data for monitoring /support

    · Implement CI/CD pipelines

    · Prepare documentation for data projects utilizing AWS based enterprise data platform

    · Implement high velocity streaming solutions using Amazon Kinesis, SQS, and SMS

    · Migrate data from traditional relational database systems to AWS relational databases such as Amazon RDS, Aurora, and Redshift

    · Migrate data from traditional file systems and NAS shares to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift

    · Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift

    · Provide cost/spend monitoring reporting for AWS based data platform data initiatives

    · Provide governance/audit reporting for access of AWS based data platform

    · Lead the implementation of a data lake strategy to enable LOBs and Corporate Functions with a robust, holistic view of data - driven decision making

    · Serve as delivery lead for EDP data initiatives product owner

    · Partner with immediate engineering team, product owner, IT, partners on EDP agenda

    · Provide technology thought leadership, consulting, and coaching/mentoring

    · Establish development, qa, stage and production migration/support processes

    · Establish best practices for development and support teams

    · Deliver end-end data initiatives from ingest-consume via microservices/ apis, jdbc/ odbc, file extracts etc.

    · Work with scrum master to develop and own backlog, stories, epics, sprints

    Qualifications

    • Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
    • Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises
    • Programming experience with Java, Python/ Scala, Shell scripting
    • Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
    • Solid experience implementing solutions on AWS based data lakes
    • Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB
    • AWS Solutions Architect or AWS Big Data Certification preferred

    · Experience in AWS data lake/data warehouse/business analytics

    · Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift

    · Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS

    · Experience with DevOps and Continuous Integration/ Delivery (CI/ CD) concepts and tools

    · Experience with business intelligence tools such as Tableau, Power BI or equivalent

    · Knowledge of ETL/ ELT

    · Experience in production support from Level 1 to Level 3

    · Awareness of Data Management & Governance tools

    · Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired

    · Experience working on Agile projects

  • Understood

    Data Engineering

    3 weeks ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • EQUINOX

    Engineering Contractor, Data

    2 weeks ago

    EQUINOX New York, United States Freelance

    **Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...

  • FanDuel

    Data Engineering Director

    2 weeks ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • LTIMindtree

    Specialist - Data Engineering

    2 weeks ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • 4 Staffing Corp

    Data Engineer

    3 weeks ago

    4 Staffing Corp Newark, United States

    About the job Data Engineer (Financial Services) · Data Engineer (Fixed Income Capital Markets) · Full-time, direct employment · Hybrid onsite/remote - Newark, NJ · No visa sponsorship or C2C at this time · Job Description: · Our client is seeking a skilled and experienced ...

  • Spectraforce Technologies

    Data Engineer

    3 weeks ago

    Spectraforce Technologies Newark, United States

    Job Title: Data Engineer · Location: Newark, NJ (Hybrid) · Duration: 6 Months (Temp to Hire) · Pay Rate starts from: $55/hr. on W2 · Job Description: · Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to ou ...

  • Phaxis

    Data Engineer

    1 week ago

    Phaxis Newark, United States

    Junior Data Engineer (3+ years): Salary is $110k-$140k + bonus · Senior Data Engineer (5+ years): Salary is $135k-$155k + bonus · 3 days remote and 2 days onsite in Newark, NJ · All candidates will need to complete a Python assessment · Must Have Qualifications: · 3+ experience i ...

  • Diverse Lynx

    Data Engineer

    3 weeks ago

    Diverse Lynx Newark, United States

    Snowflake Data Engineer- · snowflake , · python · Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their abil ...

  • Hire Talent

    Data Engineer

    3 weeks ago

    Hire Talent Newark, United States

    High level requirements for the role: · Data ingestion from various on-prem and cloud sources · Ability to build ETL pipelines to transform raw data into format suitable for analysis (hands on experience working with ETL tools like AWS Glue, Informatica etc.) and orchestrate tra ...

  • Proit

    Data Engineer

    3 weeks ago

    Proit Newark, United States

    Job DescriptionSkill: AWS Data Engineer · * Must have AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. · Experience Required: · * Minimum 5 years of professional experience in data integration and management. · * 3+ years of hands ...

  • STV Group

    Junior Data Engineering Specialist

    1 week ago

    STV Group New York, United States

    We are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...

  • Iris Software Inc.

    AWS Data Engineer

    2 weeks ago

    Iris Software Inc. Newark, United States

    Iris's client, a large insurance company, is currently searching for a strong for AWS Data Engineer. · Our client has offices all over the world and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. · Job title: ...

  • FYI Solutions

    AWS Data Engineer

    3 weeks ago

    FYI Solutions Newark, United States

    Role: AWS Data Engineer · Location: Newark, NJ - Hybrid · Target Start Date: ASAP · Right to hire: Yes · Qualifications: · Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience · Experience implementing, supporting ...

  • Peer Consulting Resources Inc.

    AWS Data Engineer

    1 day ago

    Peer Consulting Resources Inc. Newark, United States

    Contact Details · Name: Savitha Chinnappa · Email: savitha.- · Cell: · Job Title: AWS Data Engineer (On W2) · Location: Newark, NJ (Onsite) · Duration: Months (Possibility of Extension) · Years of Experience: 7+ Yrs · Job Description: · AWS Certifications · Data pipeline (inges ...

  • Hire Talent

    Lead Data Engineer

    3 weeks ago

    Hire Talent Newark, United States

    Lead Data Engineer VMS Prudential · Level 3 (potentially level 4) · Right to hire (conversion is possible) · Long term requirement (Initial couple months will want to join them FT) · Narayana Murthy is HM · Interview process: about 3 rounds of interviews · Notes: Chief Data O ...

  • Remotely

    Senior Data Engineer

    4 weeks ago

    Remotely Newark, United States

    This is a remote position. · Senior Data Engineer (3-5 year experience, remote) · Be part of our future This job posting builds our talent pool for potential future openings. We'll compare your skills and experience against both current and future needs. If there's a match, we' ...

  • Hire Talent

    Lead Data Engineer

    4 weeks ago

    Hire Talent Newark, United States

    Lead Data Engineer VMS PrudentialLevel 3 (potentially level 4)Right to hire (conversion is possible)Long term requirement (Initial couple months will want to join them FT)Narayana Murthy is HMInterview process: about 3 rounds of interviews · Notes: · Chief Data OfficeProvided d ...

  • Atlantic Partners

    AWS Data Engineer

    2 weeks ago

    Atlantic Partners Newark, United States

    Our direct client is seeking an AWS Data Engineer for an 8-month contract-to-hire opportunity to work HYBRID (2-3 days/wk) in their Newark, NJ location. THIS IS A W2 ONLY ROLE - NO C2C /THIRD PARTIES. · Qualifications Bachelor's degree in Computer Science, Software Engineering, M ...

  • JSR Tech Consulting

    Lead Data Engineer

    3 weeks ago

    JSR Tech Consulting Newark, United States Right to Hire

    Long term contract to hire. · Lead data engineer role with a major Financial Services company. · Hybrid work environment days onsite in Newark, NJ. · - Engineering lead to help the design/build of the enterprise data platforms · Design, Develop and Implement · End-to-end dat ...

  • JSR Tech Consulting

    Sr. Data Engineer

    3 weeks ago

    JSR Tech Consulting Newark, United States

    Job Description : · 8p - Engineering lead to help the design/build of the CDO enterprise data platforms · Design, Develop and ImplementEnd-to-end data solutions (ingest, storage, integration, processing, access) on AWS. · Data intake/ request/ onboarding services and service d ...