Jobs
>
Parsippany

    AWS Data Engineer - Parsippany, United States - Iris Software Inc.

    Iris Software Inc.
    Iris Software Inc. Parsippany, United States

    19 hours ago

    Default job background
    Technology / Internet
    Description

    IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer – Parsippany, NJ Hybrid - 3 days per week). This is a Contract to hire Role opportunity.

    AWS Data Engineer

    Parsippany, NJ Hybrid - 3 days per week)

    Nature of Contract – Contract to hire Opportunity

    Focus is : Databricks Products, AWS (Glue/Athena/kinesis/aurora etc.), Python or PySpark Development experience, building Data pipelines.

    We are seeking a highly skilled AWS Data Engineer with expertise in building Data pipelines and processing solutions on the AWS platform, focusing on Databricks, Delta Lake, and Python development. The ideal candidate will have a strong background in relational and non-relational data architecture, data classification, and working collaboratively with Data Scientists and Architects.

    Key Responsibilities:

    • Design, develop, and optimize Data pipelines and processing solutions on the AWS platform, emphasizing Databricks, Delta Lake, and Python.
    • Collaborate with Data Scientists, Architects, and business stakeholders to gather and clarify requirements for Data Lake components.
    • Utilize AWS services such as CloudFormation, Lambda, API Gateway, S3, DynamoDB, RDS, Glue, Athena, and QuickSight for data management and analysis.
    • Develop metadata-driven Data Lake solutions for ingesting historic and real-time structured/semi-structured/unstructured data.
    • Implement ETL/ELT pipelines and ensure data integrity, quality, and security throughout the process.
    • Manage changes in enterprise-grade operational Data Lake environments and ensure scalability and efficiency.
    • Utilize tools like Gliffy for creating diagrams representing Business Processes, ERD, and AWS Architecture.
    • Develop solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security following AWS best practices.
    • Experience in Relational/NOSQL database integration into an Enterprise Data Lake environment.
    • Set up AWS CloudWatch, CloudTrail for monitoring, and optimizing Data Lake environments.
    • Write SQL queries using AWS Athena and map various relational DB queries to Athena.
    • Proficient in Python, PySpark, and AWS Glue ETL jobs for data processing and transformations.
    • Follow and enforce strict standards for code quality, automated testing, infrastructure-as-code, and code maintainability.
    • Lead the development of user stories and translate requirements into Problem Statements in an agile collaborative environment.

    Qualifications:

    • 10+ years of experience in data management with a focus on AWS Data solutions.
    • Strong expertise in relational and non-relational data architecture and classification.
    • Hands-on experience with Databricks, Delta Lake, AWS services, Python, or PySpark development.
    • Experience in designing and implementing ETL/ELT pipelines for Data processing.
    • Knowledge of AWS EMR and its application in data processing and analytics.
    • Proficiency in SQL queries using AWS Athena and mapping relational DB queries.
    • Experience in de-normalizing/flattening data structures in Parquet/ORC formats.
    • Good understanding of AWS IAM policies for implementing Data Lake security best practices.
    • Robust debugging skills and knowledge of automated testing platforms and unit tests.

    Looking forward to hear from you...

    Thanks and Regards,

    Bharat Sharma

    Sr. Technical Recruiter

    IRIS Software, Inc.

  • Understood

    Data Engineering

    4 days ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • Diverse Lynx

    Data Engineer

    1 week ago

    Diverse Lynx Parsippany, United States

    Job Title Data Engineer Skill Snowflake Minimum Experience 4 - 6 Years Qualification BACHELOR OF COMPUTER SCIENCE Location Newport Beach, C · Job Description : · Skill: Python, Snowflake, AWS, git, docker, azure DevOps, Control-M Enhance and maintain Python based ETL fr ...

  • Wallenius Wilhelmsen

    Data Engineer

    1 week ago

    Wallenius Wilhelmsen Parsippany, United States

    Overview · DATA ENGINEER · Dreaming of a career that combines your passion for data with cutting-edge technology? Look no further · Wallenius Wilhelmsen is seeking a Data Engineer to join our dynamic Data Services Team. · *Please note this is a hybrid role requiring the employ ...

  • LTIMindtree

    Specialist - Data Engineering

    2 days ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • FanDuel

    Data Engineering Director

    1 day ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • Datalore Technologies Inc

    GCP Data Engineer

    4 days ago

    Datalore Technologies Inc Parsippany, United States

    Position: GCP Data Engineer · Location: Parsippany NJ (Hybrid) – weekly 3 days at client location · Duration: Long Term contract · Need Data Engineer with GCP Experience along with the below Primary Skills: · Python · Airflow · Cloud experience preferably with GCP · Version contr ...

  • Avance Consulting

    GCP Data Engineer

    3 days ago

    Avance Consulting Parsippany, United States

    Job Description · Job DescriptionGCP Data Engineer · Location: Parsippany / New Jersey · Tech stack: BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc · • 5 years Experience in Data warehouse and Data lake implementation · • 3 years of experience in Goo ...

  • US Tech Solutions

    Principal Data Engineer

    4 days ago

    US Tech Solutions Parsippany, United States

    Responsibilities: · Work closely with cross-functional teams, including product managers, data scientists and engineers to understand project requirements and objectives ensuring alignment with overall business goals. · Build data ingestion framework and data pipelines to ingest ...

  • US Tech Solutions

    Principal Data Engineer

    1 week ago

    US Tech Solutions Parsippany-Troy Hills, United States Right to Hire

    Responsibilities: Work closely with cross-functional teams, including product managers, data scientists and engineers to understand project requirements and objectives ensuring alignment with overall business goals. · Build data ingestion framework and data pipelines to ingest u ...

  • Apex Systems

    Principal Data Engineer

    1 week ago

    Apex Systems Parsippany-Troy Hills, United States Contract

    Job#: · Job Description: · Apex Systems combines with parent company ASGN Inc. to make it the 2nd largest IT staffing agency in the country. · Apex has an opportunity open for a Principal Data Engineer. If interested in discussing the position further, please send an MS Word v ...

  • QData

    Cloud Data Engineer

    5 days ago

    QData Parsippany, United States contract

    Data gets extracted using DataStage using FTP. The predictive modeling is done using R Python and Linux scripting.Primary Skills Python R SQL Datastage Linux scripting API knowledge SSIS. Supporting skills - Azure platform knowledge and Partykit. Experience on Azure Data factory ...

  • QData

    Cloud Data Engineer

    4 days ago

    QData Parsippany, United States contract

    Responsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery r ...

  • Bayer Industry Services (Currenta GmbH & Co. OHG)

    Senior Data Engineer

    2 weeks ago

    Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United States

    Das kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...

  • CBRE

    IT Data Center Engineer

    1 week ago

    CBRE New York, United States

    Teilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...

  • First Soft Solutions

    AWS Data Engineer

    1 day ago

    First Soft Solutions Florham Park, United States

    Job Description · Job DescriptionWe are actively hiring for Sr.AWS Data Engineer · C2C · Senior Data Engineer · Location: Florham Park, NJ OR Charlotte, NC (Hybrid) · AWS Data Engineer (Spark, AWS, Glue) · Must Skill: · Work with development teams and other project leaders/stak ...

  • The CSI Companies

    Data Engineer

    1 week ago

    The CSI Companies Roseland, United States

    Data Engineer- Roseland, NJ- Hybrid CSI Companies is hiring a highly qualified Data Engineer for a comprehensive global provider of cloud-based Human Capital Management solutions and Business Process Outsourcing (BPO) services, analytics and compliance located in New Jersey. As ...

  • Zelis Healthcare

    Lead Data Engineer

    2 weeks ago

    Zelis Healthcare Convent Station, United States

    Summary: · Build High level technical design both for Streaming and batch processing systems · Design and build reusable components, frameworks and libraries at scale to support analytics data products · Perform POCs on new technology, architecture patterns · Design and imple ...

  • Zelis

    Lead Data Engineer

    2 weeks ago

    Zelis Convent Station, United States

    Duties: · Design, develop and implement scalable batch/real time data pipelines (ETLs) to integrate data from a variety of sources into Data Warehouse and Data Lake. Design and implement data model changes that align with warehouse dimensional modeling standards. Maintain and sup ...

  • ADP

    Principal Architect

    2 days ago

    ADP Parsippany, United States

    **ADP Technology Services, Inc. is hiring a Principal Architect in our Parsippany, NJ location.** · - Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? · - Are you looking to join a dynamic, inclusive team e ...

  • Actalent

    Quality Assurance Specialist

    2 days ago

    Actalent Parsippany, United States Full time

    Seeking 1 Quality Assurance Specialist · HYBRID ROLE- MUST BE ONISTE IN PARSIPPANY, NJ · Description: · • Provide Quality oversight to biologics Contract Manufacturing Organization (CMO) operations including but not limited to review/approval of CMO batch records, disposition, de ...