Jobs

    Big Data Engineer - Alpharetta, United States - HCL Global Systems

    HCL Global Systems
    HCL Global Systems Alpharetta, United States

    1 week ago

    Default job background
    Description
    JD

    Extract, Transform and Load data from multiple sources and multiple formats using Big Data Technologies.

    Development, enhancement, and support of data ingestion jobs from various source systems following existing design patterns using GCP Services such as Apache Spark, Dataproc, Dataflow, BigQuery, Airflow, etc.

    Work across Teams and senior engineers to make Data more accessible to others within the organization.

    Modify data extraction pipelines into standardized approaches that can be repeatable and reusable with minimal supervision from senior engineers.

    Automation of manual processes, optimize data delivery, re-designing infrastructure for greater scalability, etc.

    Work closely with senior engineers to optimize query and data access techniques.

    Apply modern software development practices (serverless computing, microservices architecture, CI/CD, infrastructure-as-code, etc.)

    Participate in a tight-knit engineering team employing agile software development practices. What experience you need

    Bachelor's degree in Computer Science, Systems Engineering or equivalent experience.

    5+ years of work experience as a Big Data Engineer.

    3+ years of experience using Technologies such as Apache Spark, Hive, HDFS, Beam (Optional).

    3+ years of experience in SQL and Scala or Python.

    2+ years experience with software build management tools like Maven or Gradle.

    2+ years of experience working with Cloud Technologies such as GCP, AWS or Azure.

    What could set you apart

    Data Engineering using GCP Technologies (BigQuery, DataProc, Dataflow, Composer, DataStream, etc)

    Experience writing data pipelines.

    Self-starter that identifies/responds to priority shifts with minimal supervision

    Source code control management systems (e.g. SVN/Git, Github) and build tools like Maven & Gradle.

    Agile environments (e.g. Scrum, XP)

    Relational databases (e.g. SQL Server, Oracle, MySQL)

    Atlassian tooling (e.g. JIRA, Confluence, and Github
  • ATech Placement

    Data Engineer

    3 weeks ago

    ATech Placement Alpharetta, United States

    We are looking for a Data Engineer to design, build and operate large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, RedShift, Lambda, Glue · Technical Skills and Requirements · ...

  • LocumTenens

    Data Engineer

    2 weeks ago

    LocumTenens Alpharetta, United States

    JOB DESCRIPTION: · The Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to ...

  • LocumTenens

    Data Engineer

    2 weeks ago

    LocumTenens Alpharetta, United States

    The Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT's data lak ...

  • Equifax

    Data Engineer

    4 weeks ago

    Equifax Alpharetta, United States

    Develop and operationalize large-scale enterprise data solutions with a focus on high availability, low latency and scalability. Provide guidance,documentation and automation capabilities for Disaster Recovery as part of application deployment. Ensur Data Engineer, Cloud Architec ...

  • Pyramid Consulting

    Data Engineers

    2 weeks ago

    Pyramid Consulting Alpharetta, United States

    Design, develop and validate the ETL mechanisms implemented on databases, validate data integrations using XML. Create prototypes for automation tools to read present production code. Analyze, Design and build automation tools to manage tasks. Create story and tasks, estimate tim ...

  • Equifax

    Data Engineer

    3 weeks ago

    Equifax Alpharetta, United States

    Equifax's Data Fabric team is seeking an experienced Sr. Data Engineer who can build, design and maintain the enterprise applications on the global data platform. · T o adhere to our corporate location policies, this resource will be required to be local to the surrounding Atlant ...

  • Jackson Healthcare

    Data Engineer

    3 weeks ago

    Jackson Healthcare Alpharetta, United States

    Overview · has been leading the way in a booming healthcare industry since 1995. Locum Tenens is a Latin phrase meaning, "to substitute for." When hospitals are understaffed, they rely on us to find them the right temporary physicians to fill in when needed. Every associate at ...

  • Jackson Healthcare

    Data Engineer

    4 weeks ago

    Jackson Healthcare Alpharetta, United States

    Overview · has been leading the way in a booming healthcare industry since 1995. Locum Tenens is a Latin phrase meaning, "to substitute for." When hospitals are understaffed, they rely on us to find them the right temporary physicians to fill in when needed. Every associate at ...

  • Visionaire Partners

    Senior Data Engineer

    3 weeks ago

    Visionaire Partners Alpharetta, United States

    Senior Data Engineer · We seek a Senior Data Engineer for an exciting new opportunity You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernization ...

  • National Christian Foundation

    Senior Data Engineer

    3 weeks ago

    National Christian Foundation Alpharetta, United States

    Job Description · Headquartered in Alpharetta, Georgia, National Christian Foundation (NCF) is a 501(c)(3) charitable grantmaking ministry that provides creative giving solutions and inspires biblical generosity among Christian families, advisors, and charities. NCF has received ...

  • Motion Recruitment

    Senior Data Engineer

    3 weeks ago

    Motion Recruitment Alpharetta, United States

    Global FinTech giant is seeking a Senior Software Engineer/Python developer for a 12+ month long-term contract opportunity in Atlanta, GA./HYBRID -2 days onsite/LOCAL CANDIDATES ONLY/W2 CANDIDATES ONLY-No visa transfers or Sponsorships offered at this time · You will be responsib ...

  • PamTen

    Azure Data Engineer

    2 weeks ago

    PamTen Alpharetta, United States

    Project description · We are seeking a highly skilled and experienced Senior Developer specializing in Data Engineering to join our technology-driven team. The ideal candidate will have significant hands-on expertise in Data Factory, Databricks, and a strong background in designi ...

  • Mississippi Sports Medicine & Orthopaedic Center

    data validation engineer

    1 week ago

    Mississippi Sports Medicine & Orthopaedic Center Alpharetta, United States

    Job Details · Description · USOP is a dynamic and innovative Orthopaedic Healthcare company committed to leveraging cutting-edge technologies to drive business success. We seek a skilled and detail-oriented Data Validation Engineer to join our Alpharetta, GA-based team in ensur ...

  • Brickhouse Resources

    Cloud Data Engineer

    1 week ago

    Brickhouse Resources Alpharetta, United States

    Job Title: Cloud Data Engineer - Azure · Job Location: Johns Creek, GA or Remote · Job Type: Direct Hire/FTE; US Citizens and/or Green Card holders only · Workplace Schedule: Mon - Fri, standard business hours; · Must be able to work in the US without employer sponsorship · ...

  • Alliance of Professionals & Consultants

    Data Software Engineer

    1 week ago

    Alliance of Professionals & Consultants Alpharetta, United States

    Job Description · Are you an experienced Data Software Engineer? If so, let's talk · Our client is actively seeking a talented Data Software Engineer to work with a team located in Alpharetta, GA. This is a direct hire opportunity with our client. · This is a hybrid position. ...

  • Equifax

    Big Data Engineer

    2 weeks ago

    Equifax Alpharetta, United States

    Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. · Equifax is seeking creative, high-energy and driven Big Data En ...

  • Money Fit by DRS

    Azure Data Engineer

    1 week ago

    Money Fit by DRS Alpharetta, United States

    Technical Skills- Azure Data Factory Azure Analysis Services Azure Data Lake Store, Pyspark · Experience 10 to 18 yrs · Should have hand-on experience on Azure Data Factory Azure Data Lake Azure Automation Account Storage Accounts HD Insights Azure Data bricks Batch Accounts and ...

  • U.S. Orthopaedic Partners

    data validation engineer

    3 weeks ago

    U.S. Orthopaedic Partners Alpharetta, United States

    USOP is a dynamic and innovative Orthopaedic Healthcare company committed to leveraging cutting-edge technologies to drive business success. We seek a skilled and detail-oriented · Data Validation Engineer · to join our Alpharetta, GA-based team in ensuring our data's accuracy, ...

  • Colonial Pipeline

    Manager Data Engineering

    6 days ago

    Colonial Pipeline Alpharetta, United States

    Colonial has provided a wide range of opportunities for job candidates who are highly qualified, skilled, motivated and team players. Employees find exciting opportunities to grow and develop their careers at a stable company which offers a generous compensation and benefits pack ...

  • CapB InfoteK

    Big Data Engineer

    1 week ago

    CapB InfoteK Alpharetta, United States

    We are looking for a Big Data Engineer for our long-term multiyear project out of Alpharetta, GA. (Remote till COVID). · Responsibilities: · 5-10 years of hands on experience working with Hadoop and Informatica power center. · Experience in Hadoop ecosystem and experience in ap ...