- Your expertise in Python, PySpark, ETL processes and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.
- Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
- Implement ETL processes to extract, transform, and load data from various sources.
- Ensure data quality, integrity, and consistency throughout the ETL pipeline.
- Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
- Optimize code for performance and scalability, keeping up to date with the latest industry best practices.
- Integrate data from different systems and sources to provide a unified view for analytical purposes.
- Collaborate with data analysts to implement solutions that meet their data integration needs.
- Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
-
Systems Engineer
2 weeks ago
B4Corp McLean, United StatesDescription: · Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. · The Customer's organization provides technical solutions and capabilities that enable a cadre of analysts to make critical assessments, including a platform to conduct enterprise search, digital ...
-
Financial Model Engineer, Tech Lead
4 days ago
Freddie Mac McLean, United States Full timeJOB DESCRIPTION At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. · Position Overview: · Freddie Mac's Investments ...
-
Systems Engineer STAR2265
6 days ago
Sabree Software Services McLean, United States Full timeJob Description · The Sponsor is seeking support for the DevOps operations that include migration of legacy data, development of new system capabilities, extension and maintenance of bulk data pipeline and enhancements for multiple mission applications in the Sponsor's cloud comp ...
-
Lead Specialist, Federal Cloud Engineer
5 days ago
KPMG McLean, United StatesThe KPMG Advisory practice is currently our fastest growing practice. We are seeing tremendous client demand, and looking forward we don't anticipate that slowing down. In this ever-changing market environment, our professionals must be adaptable and thrive in a collaborative, te ...
-
Systems Engineer
3 weeks ago
00100 LEIDOS, INC. McLean, United States Full timeJoin us at Leidos, where your most important work is ahead · At Leidos, everything we do is built on our commitment to do the right thing for our customers, our employees, and our communities. Our mission is to make the world safer, healthier, and more efficient through informat ...
-
Systems Engineer
2 days ago
00100 LEIDOS, INC. McLean, United States Full timeSystems Engineer · Are you looking for an opportunity to make an impact? · At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' success. We empower our teams, contribute to our communities, and ope ...
-
Systems Engineer
3 weeks ago
Avolinq, LLC McLean, United StatesJob Description · Job DescriptionOur client is seeking a Systems Engineer to support a federal agency in McLean, VA. · Job description · 1. (Mandatory) Demonstrated experience utilizing big data processing tech such as Spark, Pyspark, and Python. · 2. (Mandatory) Demonstrated exp ...
-
Senior Systems Engineer
2 weeks ago
The Swift Group McLean, United StatesJob Description · Job DescriptionThe Swift Group is seeking a Senior Systems Engineer to automate the processing of large forensic images, extract and enrich metadata, and display resulting information in meaningful ways for analysts to conduct their assessments. This position is ...
-
Data Engineer TMC-011-005
1 day ago
TMCI McLean, United StatesJob Description · Job DescriptionThe TMCI Data Quality Group is seeking a talented and experienced Data Engineer to join our dedicated team. As a Healthcare IT Data Engineer, you will play a pivotal role in designing, developing, and maintaining data pipelines, databases, and ana ...
-
Systems Engineer
3 weeks ago
Integrated Intel Solutions McLean, United StatesJob Description · Job DescriptionSystems Engineer · Summary · The Sponsor is seeking support for the migration of legacy data, development of new capabilities, and extension and maintenance of bulk data pipeline · Job Description · The Sponsor is seeking support for the DevOps ...
-
Systems Engineer
2 weeks ago
The Swift Group McLean, United StatesJob Description · Job DescriptionThe Swift Group is seeking a Systems Engineer to support DevOps operations that include the migration of legacy data, development of new system capabilities, and extension and maintenance of the bulk data pipeline. This position is onsite in McLea ...
-
Systems Engineer
2 weeks ago
ManpowerGroup Public Sector McLean, United StatesPosition Title: Systems Engineer · Location: McLean, VA · PTFT: Full-Time · Clearance: TS/SCI with Poly (from IC) · Position Summary: · MGPS is seeking a Systems Engineer to support a program that automates processing large forensic images, extracting and enriching metadata, a ...
-
Freddie Mac McLean, United States Full timeAt Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. · Employees, contingent workers and visitors are no longer required ...
-
Risk Systems Development
2 weeks ago
Freddie Mac McLean, United States Full timeAt Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. · As part of Freddie Mac's return to the office pilot, all employee ...
ETL Developer with Pyspark - McLean, United States - Excelon Solutions
Description
Job Description
Job DescriptionJob Description
