Data Engineer - Atlanta, GA
2 days ago
Job description
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Zettalogix INC, is seeking the following. Apply via Dice today
Title: Data Engineer (Databricks)
Duration: 12 month contract
Location: Atlanta, GA - hybrid onsite and would prefer local to Atlanta
Other: banking or financial services experience
Data Engineering:
Design and maintain scalable data pipelines using Spark, Python, and Databricks for real-time and batch processing.
Build and manage ELT workflows using Fivetran and integrate data into Snowflake for analytics and reporting.
Develop and optimize data models and warehouse structures to support business intelligence and machine learning use cases.
Collaborate with cross-functional teams to understand data needs and deliver reliable, governed, and high-quality data solutions.
Implement cloud-native data solutions and ensure performance, security, and compliance across platforms.
Architect and deploy data solutions on cloud platforms (e.g., Azure, AWS, or Google Cloud Platform) using Databricks and Snowflake.
Implement CI/CD pipelines for data workflows and infrastructure as code (IaC) using tools like Terraform or Azure DevOps.
Additional notes from today s call with the hiring manager Primary Platform: The new data layer is entirely built on Databricks; candidates must have strong, hands-on Databricks experience and be comfortable working heads-down in that environment. Core Responsibilities:
Build scalable data pipelines to ingest data from legacy systems into Databricks.
Support Bronze Silver Gold data transformation architecture.
Ensure data is available for reporting in Power BI and/or ThoughtSpot.
Preferred Skills:
Proficient in Python/PySpark for data engineering tasks.
Experience implementing CI/CD pipelines (no dedicated DevOps support, but doesn't need to build from scratch).
Familiarity with Databricks-native data quality checks.
Presentation Layer:
Snowflake is used for reporting by some clients knowledge of Snowflake is helpful but deep expertise isn t required.
Additional Context:
Collaboration and current team includes 3 front-end and 3 back-end developers.
Future direction includes LLM integration for reasoning models and multi-tenant, on-prem connectivity (e.g., SQL Server, Azure SQL).
Some components will connect to Foundry from the Silver layer.
Similar jobs
The data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. · ...
1 month ago
We're seeking a talented Data Engineer to join ICE Data Services in a cross-cutting role that will help define and implement our next-generation data platform. · This is an opportunity to shape our data engineering practice from the ground up, working directly with key stakeholde ...
1 month ago
We are currently searching for a seasoned Lead Data Engineer to spearhead the evolution of a complex data ecosystem. · ...
1 month ago
Detailed description of skills and experiences required for a Data Engineer role. · ...
2 weeks ago
· Are you a passionate Lead Data Engineer ready to shape the future of data products? · Lead the processing of structured and unstructured data, ensuring high data quality and integrity. · Spearhead the development and optimization of data solutions within enterprise data wareho ...
1 week ago
+We're hiring a highly technical ETL Developer to join a growing Data Import Team. · + · ++Build and maintain ETL workflows using SSIS, Azure Data Factory, and custom scripting · Support ingestion of primarily relational data, with some unstructured sources · Integrate data from ...
3 weeks ago
This position is hiring a Data Engineer with experience focused on testing data in a software engineering capacity. · Implementing QA testing for AI analytical models. · A strong knowledge of machine learning processes and frameworks is required. · ...
1 month ago
Data engineer role with a focus on testing data in software engineering capacity. · This IT role requires a significant set of technical skills. · A strong knowledge of machine learning processes and frameworks is required. · The candidate will play a crucial role in ensuring the ...
1 month ago
We are seeking a Data Engineer to join our dynamic team.The ideal candidate is an enthusiastic problem-solver who excels at building scalable data systems and has hands-on experience with Databricks, Looker, AWS, MongoDB, PostgreSQL, and Terraform. · ...
3 weeks ago
Onsite | No C2C | No 3rd Parties | MUST BE IN ATLANTA AREA · We're hiring a highly technical ETL Developer to join a growing Data Import Team, responsible for ingesting data into a centralized Enterprise Data Warehouse. This hands-on, data-engineering–focused role sits at the fro ...
2 days ago
+Job summary · Role Name: Data Engineer · +Responsibilities7+ years of experience in data engineering and data pipeline development. · ...
2 weeks ago
We are seeking a talented Data Engineer to join our dynamic team. · Develop mechanisms for retrieving and aggregating operational data from the AWS fleet. · Enhance the performance of data queries and streamline extract, transform, load (ETL) procedures. · Collaborate with team m ...
3 weeks ago
We are seeking a Data Engineering & Analytics Manager for a 6-month contract to hire opportunity local to Atlanta. · Lead the design and delivery of scalable data engineering and analytics solutions in cloud environments. · Partner with business stakeholders to translate reportin ...
1 month ago
Cargill's size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way. · ...
1 month ago
We are currently seeking a Data Engineer / Data Modeler (DataStage / Payments Subsystem / FTE / Onsite) to join our team in Atlanta, Georgia (US-GA), United States. · ...
1 month ago
A Fortune 100 retail client of Insight Global is looking to hire elite Data Engineers to join their Enterprise Data & Analytics Team. · ...
3 weeks ago
We're seeking a talented Data Engineer to join ICE Data Services in a cross-cutting role that will help define and implement our next-generation data platform. · In this pivotal position, you'll lead the design and implementation of scalable self-service data pipelines with a str ...
1 month ago
We are looking for an experienced Data Engineer to support data platform development and large-scale data processing initiatives for Mastercard. The ideal candidate will have strong expertise in AWS-based data engineering, modern data lakes, and distributed processing frameworks. ...
1 month ago
Data Engineer responsible for data archiving, data engineering, and data visualization. Team is working on various projects including JDE migration, Enterprise One implementation, Hyperion migration to OneStream, Mulesoft integration with SSIS/store procedures, · MSFT Fabric impl ...
1 month ago
We are looking for a Data Engineer to join our growing data platform team and help build, operate, and scale the foundational data infrastructure that powers analytics, · machine learning, and business decision-making across the company. · In this role, you'll design and maintain ...
1 month ago
We are looking for a Data Engineer to join our growing data platform team and help build operate and scale the foundational data infrastructure that powers analytics machine learning and business decision-making across the company. · Design and maintain reliable secure cost-effic ...
4 weeks ago