Jobs

    Senior Data Engineer - Alpharetta, United States - Motion Recruitment

    Motion Recruitment
    Motion Recruitment Alpharetta, United States

    3 weeks ago

    Motion Recruitment background
    Accounting / Finance
    Description

    Global FinTech giant is seeking a Senior Software Engineer/Python developer for a 12+ month long-term contract opportunity in Atlanta, GA./HYBRID -2 days onsite/LOCAL CANDIDATES ONLY/W2 CANDIDATES ONLY-No visa transfers or Sponsorships offered at this time

    You will be responsible for overseeing Application systems, architecture, design, data workflow, logical processes, and system interfaces.

    Required Skills & Experience

    • Understanding of mainframe copybook, data storage
    • Experience in kubernetes, docker
    • Experience in python and pyspark
    • Kafka, streaming
    • Shell script

    This role involves:

    This role involves:

    • Understanding Mainframe Copy Books: Familiarity with mainframe copy books for data deserialization and ingestion.
    • Experience in Python and PySpark: Required for data processing and streaming applications, especially for integrating with Kafka and AWS services.
    • Containerization in Docker: Knowledge of Docker for containerizing data lakes and big data applications, especially in cloud environments like AWS.
    • Data Ingestion with Mainframe: Understanding of how to ingest data from mainframe systems into modern data pipelines.
    • Real-time Streaming with Kafka: Experience in streaming real-time data from mainframe systems using Kafka, enabling other applications to consume the data.
    • Hands-on Architecture: Ability to design and implement solutions, with a focus on practical implementation.
    • Storage and Computing in AWS: Proficiency in utilizing AWS services for storage and computing needs, including data lake formation.
    • Proof of Concepts (POCs) in Java: Involvement in developing POCs using Java for cloud-based data processing.
    • Hybrid Work Environment: Comfortable with a hybrid work setup, spending some time onsite and some time working remotely.

    In summary, this role requires a blend of technical skills in Python, PySpark, Docker, Kafka, AWS, and Java, along with the ability to design and implement data solutions that involve mainframe systems, real-time streaming, and cloud environments.

  • LocumTenens

    Data Engineer

    59 minutes ago

    LocumTenens Alpharetta, United States

    JOB DESCRIPTION: · The Data Engineer is responsible for supporting and developing business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/ ...

  • Equifax

    Data Engineer

    3 weeks ago

    Equifax Alpharetta, United States

    Equifax's Data Fabric team is seeking an experienced Sr. Data Engineer who can build, design and maintain the enterprise applications on the global data platform. · T o adhere to our corporate location policies, this resource will be required to be local to the surrounding Atlant ...

  • U.S. Orthopaedic Partners

    data validation engineer

    3 weeks ago

    U.S. Orthopaedic Partners Alpharetta, United States

    USOP is a dynamic and innovative Orthopaedic Healthcare company committed to leveraging cutting-edge technologies to drive business success. We seek a skilled and detail-oriented Data Validation Engineer to join our Alpharetta, GA-based team in ensuring our data's accuracy, integ ...

  • merchant e-Solutions

    Data Engineer, Business Intelligence

    12 hours ago

    merchant e-Solutions Alpharetta, United States

    The Opportunity: · As we are embarking on our journey to a modern architecture on the cloud, we are looking for talented engineers to join us to build our future. You will get an opportunity to work on challenging problems in a high-volume and mission critical environment. US W ...

  • CapB InfoteK

    Big Data Engineer

    2 weeks ago

    CapB InfoteK Alpharetta, United States

    We are looking for a Big Data Engineer for our long-term multiyear project out of Alpharetta, GA. (Remote till COVID). · Responsibilities: · 5-10 years of hands on experience working with Hadoop and Informatica power center. · Experience in Hadoop ecosystem and experience in ap ...

  • Equifax

    Big Data Engineer

    1 hour ago

    Equifax Alpharetta, United States

    Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. · Equifax is seeking creative, high-energy and driven Big Data En ...

  • Money Fit by DRS

    Azure Data Engineer

    2 weeks ago

    Money Fit by DRS Alpharetta, United States

    Technical Skills- Azure Data Factory Azure Analysis Services Azure Data Lake Store, Pyspark · Experience 10 to 18 yrs · Should have hand-on experience on Azure Data Factory Azure Data Lake Azure Automation Account Storage Accounts HD Insights Azure Data bricks Batch Accounts and ...

  • Omni Inclusive

    Network Data Engineer

    3 weeks ago

    Omni Inclusive Alpharetta, United States

    Primary skills: · SD-Wan · Secondary Skills: · Network Automation · Primary Skills/ Scope · 10+ Years of related IT experience. · Hands on experience in software development specifically in Python, GIT, Ansible and YAML · Hands on experience in Layer 3 protocols (BGP, OSPF, EIG ...

  • LocumTenens

    Data Engineer

    2 weeks ago

    LocumTenens Alpharetta, United States

    JOB DESCRIPTION: · The Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to ...

  • ATech Placement

    Data Engineer

    3 weeks ago

    ATech Placement Alpharetta, United States

    We are looking for a Data Engineer to design, build and operate large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, RedShift, Lambda, Glue · Technical Skills and Requirements · ...

  • LocumTenens

    Data Engineer

    3 weeks ago

    LocumTenens Alpharetta, United States

    The Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT's data lak ...

  • Pyramid Consulting

    Data Engineers

    3 weeks ago

    Pyramid Consulting Alpharetta, United States

    Design, develop and validate the ETL mechanisms implemented on databases, validate data integrations using XML. Create prototypes for automation tools to read present production code. Analyze, Design and build automation tools to manage tasks. Create story and tasks, estimate tim ...

  • The Ladders

    Data Engineer

    1 day ago

    The Ladders Alpharetta, United States

    Job Description: · • Snowflake data engineer will be responsible for architecting large-scale data intelligence solutions, performing architectural assessments, crafting architectural options and analysis around Snowflake Data Warehouse. · • Finalize preferred solution alternat ...

  • Jackson Healthcare

    Data Engineer

    2 days ago

    Jackson Healthcare Alpharetta, United States

    Overview · has been leading the way in a booming healthcare industry since 1995. Locum Tenens is a Latin phrase meaning, "to substitute for." When hospitals are understaffed, they rely on us to find them the right temporary physicians to fill in when needed. Every associate at ...

  • ADP

    Lead Data Security Engineer

    1 week ago

    ADP Alpharetta, United States

    ADP is hiring a Data Security Engineer · Are you ready to help us design the future-state to secure and govern our Data? · Well, this may be the role for you. Ready to make your mark? · As a Data Security Engineer, · you will join a highly skilled and focused Global Security tea ...

  • Colonial Pipeline

    Principal Data and Machine Learning Engineer

    2 weeks ago

    Colonial Pipeline Alpharetta, United States

    Colonial has provided a wide range of opportunities for job candidates who are highly qualified, skilled, motivated and team players. Employees find exciting opportunities to grow and develop their careers at a stable company which offers a generous compensation and benefits pack ...

  • Visionaire Partners

    Senior Data Engineer

    3 weeks ago

    Visionaire Partners Alpharetta, United States

    Senior Data Engineer · We seek a Senior Data Engineer for an exciting new opportunity You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernization ...

  • Elsevier

    Data Engineer II

    2 days ago

    Elsevier Alpharetta, United States

    Data Engineer II · Are you a customer centric and data driven individual? · Are you a highly skilled data engineer looking to drive innovation? · About the Business · LexisNexis Risk Solutions provides customers with solutions and decision tools that combine public and industry ...

  • PamTen

    Azure Data Engineer

    3 weeks ago

    PamTen Alpharetta, United States

    Project description · We are seeking a highly skilled and experienced Senior Developer specializing in Data Engineering to join our technology-driven team. The ideal candidate will have significant hands-on expertise in Data Factory, Databricks, and a strong background in designi ...

  • Colonial Pipeline

    Senior Data Engineer

    2 days ago

    Colonial Pipeline Alpharetta, United States

    Colonial has provided a wide range of opportunities for job candidates who are highly qualified, skilled, motivated and team players. Employees find exciting opportunities to grow and develop their careers at a stable company which offers a generous compensation and benefits pack ...