- Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system.
- Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.
- Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process.
- Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.
- Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner.
- Active Top-Secret Clearance with the ability to obtain an SCI
- A Counter Intelligence Polygraph is required after start.
- Bachelor's degree in Engineering, Computer Science, or other related analytical, scientific, or technical discipline.
- At least 6 years experience with ETL.
- Database ETL engineers should have experience with Oracle 11g/12c, Sun Solaris OS, Linux (CentOS, Red Hat), and Windows environments.
- Strong proficiency in programming languages such as Scala, or Java.
- Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.
- In-depth knowledge of ETL best practices, data integration techniques, and data quality management.
- Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift.
- MUST have strong UNIX/LINUX experience
- Understanding of concepts of Data Lakehouse architecture as well as OpenSearch is a plus.
- Experience using software repository tools such as GIT or SVN.
-
ETL Engineer
1 week ago
Booz Allen Hamilton Huntsville, United States Full timeETL EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal ins ...
-
ETL Engineer, Mid
11 hours ago
Booz Allen Hamilton Huntsville, United StatesETL Engineer, MidThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivota ...
-
ETL Engineer, Mid
3 weeks ago
Booz Allen Hamilton Huntsville, United States Full timeJob Number: R0195849 · ETL Engineer, MidThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing bi ...
-
ETL Engineer, Mid
1 week ago
Booz Allen Hamilton Huntsville, United States Full timeETL Engineer, MidThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivota ...
-
ETL Engineer
3 weeks ago
Booz Allen Hamilton Huntsville, United States Full timeJob Number: R0195747 · ETL EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big dat ...
-
ETL Engineer Senior
5 days ago
BAE Systems USA Huntsville, United States**Job Description** · As a member of our team, you will join a diverse group of driven professionals who design the products and systems that support enhanced capabilities, protect national security, and keep critical information and infrastructure secure. With us, you will be a ...
-
ETL Engineer
1 month ago
Booz Allen Hamilton Huntsville, United StatesJob Number: R0195712 · ETL EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data c ...
-
ETL Engineer Senior
2 days ago
BAE Systems USA Huntsville, United StatesJob Description As a member of our team, you will join a diverse group of driven professionals who design the products and systems that support enhanced capabilities, protect national security, and keep critical information and infrastructure secure. With us, you will be able to ...
-
ETL Engineer, Mid
3 weeks ago
Booz Allen Huntsville, United StatesETL Engineer, Mid · The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivo ...
-
ETL Engineer – Hybrid Possible
4 weeks ago
AnaVation Huntsville, United States Full timeBe Challenged and Make a Difference In a world of technology, people make the difference. We believe if we invest in great people, then great things will happen. At AnaVation, we provide unmatched value to our customers and employees through innovative solutions and an engaging c ...
-
ETL Engineer III- Secret
3 weeks ago
Jacobs Huntsville, United StatesYour Impact: · Jacobs is searching for an ETL Engineer to join our team in Huntsville, AL. You will be working in Department of Justice organization that's mission is to accelerate operations through data and new analytical insights. The entire section works to provide the entire ...
-
ETL Engineer Senior
6 days ago
BAE Systems USA Huntsville, United StatesJob Description As a member of our team, you will join a diverse group of driven professionals who design the products and systems that support enhanced capabilities, protect national security, and keep critical information and infrastructure secure. With us, you will be able to ...
-
ETL Engineer Senior
4 weeks ago
BAE Systems Huntsville, United States Full timeJob Description · As a member of our team, you will join a diverse group of driven professionals who design the products and systems that support enhanced capabilities, protect national security, and keep critical information and infrastructure secure. With us, you will be able ...
-
ETL Engineer, Mid
4 weeks ago
Booz Allen Hamilton Huntsville, United StatesJob Number: R0195849 · ETL Engineer, Mid The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing b ...
-
ETL Engineer, Mid
1 week ago
Booz Allen Hamilton Huntsville, United StatesJob Number: R0195849 · ETL Engineer, Mid The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing b ...
-
ETL Engineer, Mid
5 days ago
Booz Allen Hamilton Huntsville, United StatesETL Engineer, Mid · The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield p ...
-
ETL Engineer, Mid
3 weeks ago
Booz Allen Hamilton Huntsville, United StatesJob Number: R0195849 · ETL Engineer, Mid The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing b ...
-
ETL Engineer, Mid
1 month ago
Booz Allen Hamilton Huntsville, United StatesJob Number: R0195849 · ETL Engineer, MidThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big d ...
-
Sr. Data Engineer/ETL Engineer
3 weeks ago
Marathon TS Huntsville, United StatesPosition Overview: · Marathon TS is looking for a Senior ETL Engineer to join our team supporting our Federal customer out of Huntsville, AL.This position will provide the ability to make a significant impact to the mission while also allowing the candidate to grow their skills ...
-
ETL Engineer II with Security Clearance
2 weeks ago
Advantex Consulting Huntsville, United StatesETL Engineer III · Location: Huntsville, Alabama · Clearance Requirement: Top Secret (SCI Eligibility) Role and Responsibilities We are seeking a Data Engineer who can leverage experience and expertise in data exploration, engineering, and ETL to explore, architect, develop, and ...
Sr. Data Engineer/ETL Engineer - Huntsville, United States - Marathon TS
Description
Position Overview:Marathon TS is looking for a Senior ETL Engineer to join our team supporting our Federal customer out of Huntsville, AL.This position will provide the ability to make a significant impact to the mission while also allowing the candidate to grow their skills and career. Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs. The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution.
Core Resbonsibilities
Marathon TS is committed to the development of a creative, diverse and inclusive work environment. In order to provide equal employment and advancement opportunities to all individuals, employment decisions at Marathon TS will be based on merit, qualifications, and abilities. Marathon TS does not discriminate against any person because of race, color, creed, religion, sex, national origin, disability, age or any other characteristic protected by law (referred to as "protected status").