- Design, build, test, and implement scalable data pipelines using Python and SQL.
- Maintain and optimize our Snowflake data warehouse's performance, including data ingestion and query optimization.
- Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow.
- Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality.
- Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones.
- Maintain code via CI/CD processes as defined in our Azure DevOps platform.
- Senior level hands on Data Engineering roles, with a focus on building and implementing scalable data pipelines for data ingestion.
- Performance Tuning experience
- Expertise in Snowflake, including data ingestion and performance optimization.
- Strong SQL skills for writing efficient queries and optimizing existing ones.
- Advanced Python skills for data extraction from APIs using AWS Lambda, Glue, etc.
- Experience with AWS services such as Lambda, Airflow, Glue, S3, SNS, Coudwatch, etc.
- CI/CD pipeline expertise beyond ADO.
- Understanding of deployment strategies.
- Knowledge of maintaining and optimizing data warehouses.
- Experience working in a SAFe Agile/SCRUM environment.
- Familiarity with ETL/ELT processes.
- Experience with Fivetran and DBT is a plus.
-
We are seeking a technically-driven and architecturally-minded Data Engineer to join our engineering team.The ideal candidate is a hands-on expert who can architect modern data engineering solutions, · implement advanced modeling techniques, · and leverage the latest industry tre ...
Charlotte1 month ago
-
We are seeking a highly skilled Data Engineer with strong experience in AWS-based data pipelines and modern data engineering practices. · Design, build, and maintain scalable data pipelines primarily on AWS. · Work extensively with AWS services, including S3, Lambda, and Glue. · ...
Charlotte1 month ago
-
Data Engineer - AI and ML Focused · A software developer with hands-on experience on Python and AI/ML platforms designing experiments to test hypotheses and validate model assumptions. · Implementing clustering, classification, regression algorithms as needed for data mining tech ...
Charlotte $80,000 - $140,000 (USD) per year1 week ago
-
We're looking for a hands-on Data Engineer to build and optimize scalable data pipelines in Amazon Web Services.If you enjoy transforming raw data into analytics-ready datasets and working with modern data lake architectures, this role is for you. · ...
Charlotte1 month ago
-
We help clients turn their data into something powerful, useful, and even beautiful. · You'll be right in the middle of that mission-designing robust data systems, unifying messy data sources, and building pipelines that fuel meaningful insights. · ...
Charlotte3 weeks ago
-
Job Summary:We are seeking a Data Engineer with strong Python and AI/ML platform experience to design, build, and deploy data-driven solutions. · Analyze experimental results · Develop machine learning models · ...
Charlotte3 weeks ago
-
Our client a leading insurance carrier is looking to grow their data engineering team. We're seeking experienced Data Engineers for multiple hybrid openings supporting a modern, cloud-based data platform. · ...
Charlotte1 month ago
-
Data Engineer leading International investment bank seeking experienced software Data engineers to support design development of strategic data platform. · Implement solutions using - Azure cloud services · Azure Data Factory · Azure Lake Gen 2 · ...
Charlotte3 weeks ago
-
We are seeking a Data Engineer with strong Snowflake and Data Architecture experience to support enterprise data initiatives for a leading investment management client. · ...
Charlotte2 weeks ago
-
Data engineer role at Voto Consulting LLC. Required experience in data engineering, data integration and quality roles. · 3+ years of work and/or educational experience in data engineering. · Proficiency in SQL and at least one programming language such as Python or R. · ...
Charlotte1 month ago
-
SYSTEMTEC is seeking a mid-level Data Engineer for a hybrid opportunity in Charlotte, NC. The candidate will strengthen and support a growing enterprise data ecosystem and collaborate closely with a cross-functional analytics group to translate business requirements into scalable ...
Charlotte $80,000 - $140,000 (USD) per year23 hours ago
-
We are looking for a Data Engineer to join our team and help build out our Data Mesh platform. ...
Charlotte Freelance1 month ago
-
Company Description · HorizonIT is a leading technology & staffing solutions company committed to delivering end-to-end excellence in IT talent acquisition, consulting, and project execution. With a strong foundation built upon over a decade of industry experience, HorizonIT part ...
Charlotte $80,000 - $140,000 (USD) per year21 hours ago
-
Xylem is seeking a Data Engineer to build and support data platforms that power Finance, Operations, and Customer tools across the organization. · We invite passionate individuals to join our team dedicated to exceeding customer expectations through innovative solutions. · ...
Charlotte $80,000 - $140,000 (USD) per year1 week ago
-
Design and develop a comprehensive data platform supporting financial data management and analytics. Collaborate closely with cross-functional teams to establish reference data systems for securities and pricing data. · Implement solutions utilizing Azure cloud services, includin ...
Charlotte1 month ago
-
The Data Engineer II will design, develop and refine data pipelines and warehousing solutions using AWS services. · Collaborate with Lead Developers and Solution Architects to understand requirements. · Develop reliable data pipelines and ensure high data quality. · ...
Charlotte1 month ago
-
Join Insurance's Enterprise Data Services team as a Senior Data Engineer and play a pivotal role in modernizing our data ecosystem. · ...
Charlotte1 month ago
-
We are seeking a highly skilled Data Engineer with strong experience in AWS-based data pipelines and modern data engineering practices.The ideal candidate will be hands-on with Python/PySpark, possess solid API development knowledge, and demonstrate proficiency in version control ...
Charlotte1 month ago
-
Data engineer with experience in data engineering involving analytics-focused data warehouse environments such as Snowflake. Proficient in SQL and Python programming languages. · Design and develop data pipelines utilizing Data Vault 2.0 on our cloud data warehouse in Snowflake. ...
Charlotte $100,000 - $110,000 (USD)1 month ago
-
We are seeking a Senior Data Engineer to support the stabilization and optimization of our data warehouse. This is a hands-on, contract role with approximately 50% coding and 50% design/consulting responsibilities. · ResponsibilitiesParticipate in a workshop to clarify detailed s ...
Charlotte1 month ago
-
Design and conduct experiments to test hypotheses and validate model assumptions. · Analyze experimental results and provide recommendations for further optimization. · Implement clustering, classification, regression, and other machine learning algorithms as needed. · Collaborat ...
Charlotte2 weeks ago
Senior Data Engineer - Charlotte - Lighthouse Technology Services
Description
*Remote Contract-to-Hire Opportunity*Lighthouse Technology Services is partnering with our client to fill their Senior Data Engineer (AWS / Python / SQL / Snowflake) position This is a 6+ month contract-to-hire opportunity. This role can be remote within the United States with quarterly travel to Charlotte, NC. This role will be a W2 employee of Lighthouse Technology Services.
Position Overview
We are looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing, building, and maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, and optimizing performance.
What You'll Be Doing:
Questions about any of our jobs? Email us
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Freelance Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
IT - Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte
-
Data Engineer
Only for registered members Charlotte