- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
- Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
- Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
- Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
- Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
- Maintain documentation for software applications, workflows, and processes.
- Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
- Secret clearance is preferred
- Minimum of 3 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
- High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, JavaScript/JSON, SQL, and Jupyter Notebooks. Scala is preferred.
- Strong problem-solving skills and ability to solve complex data-related issues.
- Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
- Understanding of data modeling/visualization, database design principles, and data governance practices.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Detail-oriented mindset with a commitment to delivering high-quality results.
-
We are seeking an experienced Databricks Platform Engineer to help drive our enterprise data modernization strategy.This unique opportunity positions you at the forefront of our mission to accelerate advanced analytics data science and machine learning across the enterprise by bu ...
St. Louis $101,700 - $173,200 (USD)1 month ago
-
+ AWS Databricks engineer · St Louis MO Remote Evernorth · Mandatory: AWS Databricks Pyspark 9-15 experience client service delivery experience on Amazon AWS (AWS) · Experience in big data database and data warehouse architecture and delivery Extensive hands-on experience impleme ...
St. Louis1 month ago
-
We are making massive investments in emerging technologies to improve how we work with our clients and with each other. · Working in Technology here means using your skills to build, deliver and maintain the technologies that enable us to deepen and support those relationships. T ...
St. Louis $101,700 - $173,200 (USD)1 month ago
-
Data Engineer supporting USTRANSCOM's Global Bulk Fuel mission. Work on complex logistics and sustainment challenges that affect global force movement, fuel availability, and operational readiness across the Department of Defense. · Engineer, analyze, and model data from the Join ...
St. Louis3 weeks ago
-
This unique opportunity positions you at the forefront of our mission to accelerate advanced analytics, · data science, · and machine learning across the enterprise by building, · managing, · and evolving our Databricks platform on Azure.supporting Azure Databricks environment. · ...
St. Louis $101,700 - $173,200 (USD)3 weeks ago
-
We are seeking a Data Engineer to support USTRANSCOM's Global Bulk Fuel mission, working on complex logistics and sustainment challenges that affect global force movement, fuel availability, and operational readiness across the Department of Defense. · The role involves engineeri ...
St. Louis, MO3 weeks ago
-
We are looking for a talented individual that can serve as a subject matter expert in their area of focus and represent their department on complex assignments. · ...
St Louis, MO2 weeks ago
-
We are looking for a talented individual that can serve as a subject matter expert in their area of focus and represent their department on complex assignments.You will be responsible for evaluating elements of technologies effectiveness through requirements gathering, testing, r ...
St. Louis1 month ago
-
+ Job summary · As a Senior Engineer on our Cloud Data Engineering team you will be responsible for migrating existing data platform solutions to cloud-based platforms using Microsoft Azure Cloud PaaS technologies.+ Evaluate elements of technology effectiveness through requiremen ...
St. Louis1 month ago
-
This role is primarily office-based at a local Perficient location. · lead the development team and have strong development and programming skills in Python, SQL, PySpark, · Databricks, Notebook Repositories, Medallion Architecture , CI/CD and ETL platforms associated with Data L ...
Creve Coeur Full time1 month ago
- Work in company
Lead Infrastructure Databricks Engineer with Kubernetes and AWS
Only for registered members
We empower every employee to build AI fluency and actively engage with AI tools to drive innovation and efficiency. · This role is primarily office-based at a local Perficient location. · ...
Creve Coeur Full time3 weeks ago
-
We're seeking a hands-on Senior Software Engineer to design and implement scalable cloud-based data quality solutions. · Develop & Optimize: Build and maintain robust data quality frameworks using PySpark Databricks Python. · Design & Deploy: Architect and implement ETL/ELT pipel ...
O'Fallon, MO1 month ago
-
We're seeking a hands-on Senior Software Engineer to design and implement scalable, cloud-based data quality solutions.This highly technical role (70% coding) leverages cutting-edge technologies like Databricks, PySpark, · AWS with a future focus on AI-driven data quality. · Buil ...
O'fallon1 month ago
-
We're shaping the future of data integrity and trust at Mastercard. · ...
O'Fallon, MO1 month ago
-
At Mastercard, we're shaping the future of data integrity and trust. · ...
O'fallon $115,000 - $184,000 (USD)1 month ago
-
Our Purpose · Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions s ...
O'fallon $140,000 - $231,000 (USD)4 days ago
-
We are looking for a hands-on Data Engineer with strong software engineering skills to design and implement scalable, cloud-based solutions that ensure the accuracy, consistency, and reliability of our data pipelines. · This role is highly technical—about 70% coding—and will evol ...
O'fallon $140,000 - $231,000 (USD)1 week ago
-
As a Lead AI Data Engineer at Mastercard, you will play a pivotal role in designing scalable data pipelines, building robust feature engineering workflows, and creating shared tools that empower data scientists across the organization. · ...
O'Fallon, MO1 month ago
-
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. · Act as a technical thought leader across the B&MI organization · Facilitate cross-team collaboration by aligning engineering product data science infrastructure teams around shared goal ...
O'Fallon, MO1 month ago
-
+ Lead AI Data Engineer responsible for designing scalable data pipelines · + Building robust feature engineering workflows · + Collaborating with ML Engineering and ML Ops teams to build and maintain data quality monitoring systems · Required Skills: Python SQL big data technolo ...
O'fallon $140,000 - $231,000 (USD)1 month ago
-
Lead AI Data Engineer at Mastercard Security Services responsible for designing scalable data pipelines and building robust feature engineering workflows. · The Cyber and Fraud Solutions Data Science team develops AI products to help issuers fight fraud. · ...
O'fallon $140,000 - $231,000 (USD) Full time1 month ago
Databricks Engineer - O'Fallon - SBS Creatix
Description
Onsite at Scott AFB
US Citizenship is Required
Salary is 100K to 130k, depending on years of experience.
Seeking a skilled and highly motivated Databricks Engineer to join an exciting and growing team within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
Responsibilities
Requirements
Compensation:
$130,000 per year
-
Databricks Platform Engineer
Only for registered members St. Louis
-
AWS Databricks engineer
Only for registered members St. Louis
-
Databricks Platform Engineer
Only for registered members St. Louis
-
Data Engineer- DataBricks
Only for registered members St. Louis
-
Databricks Platform Engineer
Only for registered members St. Louis
-
Data Engineer- DataBricks
Only for registered members St. Louis, MO
-
Databricks Senior Engineer
Only for registered members St Louis, MO
-
Databricks Senior Engineer
Only for registered members St. Louis
-
Databricks Senior Engineer
Only for registered members St. Louis
-
Lead Databricks Data Engineer
Full time Only for registered members Creve Coeur
-
Lead Infrastructure Databricks Engineer with Kubernetes and AWS
Full time Only for registered members Creve Coeur
-
Senior Software Engineer
Only for registered members O'Fallon, MO
-
Senior Software Engineer
Only for registered members O'fallon
-
Senior Software Engineer
Only for registered members O'Fallon, MO
-
Senior Software Engineer
Only for registered members O'fallon
-
Lead Data Engineer
Only for registered members O'fallon
-
Lead Software Engineer
Only for registered members O'fallon
-
Lead, AI Data Engineer
Only for registered members O'Fallon, MO
-
Senior Principal Software Engineer
Only for registered members O'Fallon, MO
-
Lead, Data Engineer
Only for registered members O'fallon
-
Lead, AI Data Engineer
Full time Only for registered members O'fallon