- Work experience with ETL, Data Modeling, and Data Architecture.
- Experience with Big Data technologies such as Hadoop/Hive/Spark.
- Skilled in writing and optimizing SQL.
- Experience operating very large data warehouses or data lakes.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Experience in designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks
- Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
- Integrating end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.
- Knowledge of Engineering and Operational Excellence using standard methodologies.
- Comfortable using PySpark APIs to perform advanced data transformations.
- Familiarity with implementing classes with Python.
-
Data Engineer
1 day ago
LocumTenens Alpharetta, United StatesJOB DESCRIPTION: · The Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to ...
-
Data Engineer
5 days ago
LocumTenens Alpharetta, United StatesThe Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT's data lak ...
-
Data Engineer
1 week ago
Equifax Alpharetta, United StatesEquifax's Data Fabric team is seeking an experienced Sr. Data Engineer who can build, design and maintain the enterprise applications on the global data platform. · T o adhere to our corporate location policies, this resource will be required to be local to the surrounding Atlant ...
-
Data Engineers
5 days ago
Pyramid Consulting Alpharetta, United StatesDesign, develop and validate the ETL mechanisms implemented on databases, validate data integrations using XML. Create prototypes for automation tools to read present production code. Analyze, Design and build automation tools to manage tasks. Create story and tasks, estimate tim ...
-
Data Engineer
1 week ago
Jackson Healthcare Alpharetta, United StatesOverview · has been leading the way in a booming healthcare industry since 1995. Locum Tenens is a Latin phrase meaning, "to substitute for." When hospitals are understaffed, they rely on us to find them the right temporary physicians to fill in when needed. Every associate at ...
-
Data Engineer
2 weeks ago
LocumTenens Alpharetta, United StatesThe Data Engineer is responsible for supporting and developing business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LTs data lake a ...
-
Data Engineer
1 week ago
Equifax Alpharetta, United StatesDevelop and operationalize large-scale enterprise data solutions with a focus on high availability, low latency and scalability. Provide guidance,documentation and automation capabilities for Disaster Recovery as part of application deployment. Ensur Data Engineer, Cloud Architec ...
-
Data Engineer
1 week ago
Jackson Healthcare Alpharetta, United StatesOverview · has been leading the way in a booming healthcare industry since 1995. Locum Tenens is a Latin phrase meaning, "to substitute for." When hospitals are understaffed, they rely on us to find them the right temporary physicians to fill in when needed. Every associate at ...
-
Senior Data Engineer
1 week ago
Visionaire Partners Alpharetta, United StatesSenior Data Engineer · We seek a Senior Data Engineer for an exciting new opportunity You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernization ...
-
Big Data Engineer
5 days ago
Equifax Alpharetta, United StatesEquifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. · Equifax is seeking creative, high-energy and driven Big Data En ...
-
Senior Data Engineer
1 week ago
National Christian Foundation Alpharetta, United StatesJob Description · Headquartered in Alpharetta, Georgia, National Christian Foundation (NCF) is a 501(c)(3) charitable grantmaking ministry that provides creative giving solutions and inspires biblical generosity among Christian families, advisors, and charities. NCF has received ...
-
Senior Data Engineer
1 week ago
Motion Recruitment Alpharetta, United StatesGlobal FinTech giant is seeking a Senior Software Engineer/Python developer for a 12+ month long-term contract opportunity in Atlanta, GA./HYBRID -2 days onsite/LOCAL CANDIDATES ONLY/W2 CANDIDATES ONLY-No visa transfers or Sponsorships offered at this time · You will be responsib ...
-
Azure Data Engineer
5 days ago
PamTen Alpharetta, United StatesProject description · We are seeking a highly skilled and experienced Senior Developer specializing in Data Engineering to join our technology-driven team. The ideal candidate will have significant hands-on expertise in Data Factory, Databricks, and a strong background in designi ...
-
Azure Data Engineer
2 weeks ago
The JOY FM Alpharetta, United States: · Senior Data Engineer We seek a Senior Data Engineer for an exciting new opportunity You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernizatio ...
-
data validation engineer
6 days ago
U.S. Orthopaedic Partners Alpharetta, United StatesUSOP is a dynamic and innovative Orthopaedic Healthcare company committed to leveraging cutting-edge technologies to drive business success. We seek a skilled and detail-oriented · Data Validation Engineer · to join our Alpharetta, GA-based team in ensuring our data's accuracy, ...
-
Big Data Engineer
1 week ago
CapB InfoteK Alpharetta, United StatesWe are looking for a Big Data Engineer for our long-term multiyear project out of Alpharetta, GA. (Remote till COVID). · Responsibilities: · • 5-10 years of hands on experience working with Hadoop and Informatica power center. · • Experience in Hadoop ecosystem and experience in ...
-
data validation engineer
1 week ago
U.S. Orthopaedic Partners Alpharetta, United StatesUSOP is a dynamic and innovative Orthopaedic Healthcare company committed to leveraging cutting-edge technologies to drive business success. We seek a skilled and detail-oriented Data Validation Engineer to join our Alpharetta, GA-based team in ensuring our data's accuracy, integ ...
-
Data Integration Engineer
2 weeks ago
Hexaware Technologies Alpharetta, United StatesAbout the job · What Working at Hexaware offers: · Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team membe ...
-
Data Integration Engineer
2 weeks ago
Hexaware Technologies Alpharetta, United StatesAbout the job · What Working at Hexaware offers: · Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team membe ...
-
Data Integration Engineer
3 days ago
Hexaware Technologies Alpharetta, United StatesAbout the job · What Working at Hexaware offers: · Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member ...
Data Engineer - Alpharetta, United States - ATech Placement
Description
We are looking for a Data Engineer to design, build and operate large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, RedShift, Lambda, Glue
Technical Skills and Requirements