- Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
- Develop data models and schema designs to optimize data storage and retrieval.
- Implement ETL processes to extract, transform, and load data from various sources.
- Ensure data quality, integrity, and consistency throughout the ETL pipeline.
- Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
- Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices.
- Integrate data from different systems and sources to provide a unified view for analytical purposes.
- Collaborate with data scientists and analysts to implement solutions that meet their data integration needs.
- Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
- Develop batch processing workflows for large-scale data processing and analysis.
- Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines using Jenkins or GitHub Actions.
- Automate testing, code deployment, and monitoring processes to ensure the reliability of data pipelines.
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer or similar role.
- Strong programming skills in Python and expertise in PySpark for both batch and streaming data processing.
- Hands-on experience with ETL tools and processes.
- Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
- Solid understanding of data modeling, database design, and data warehousing concepts.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with version control systems (e.g., Git).
- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Understanding of data security and privacy best practices.
-
Data Engineers
1 week ago
Nerd Up Staffing McLean, United StatesWant to work on cutting-edge data engineering projects, grow in your career, leverage the latest technologies and make a real impact? If you're ready to dive into a world of data-driven innovation, we want to learn about your for this special opportunity. · Responsibilities · Des ...
-
Data Engineer
3 weeks ago
Hexaware Technologies McLean, United StatesHexaware is hiring Data Engineers, candidates need to work onsite at McLean, VA (Hybrid Model). · Data Engineer · Job Type: Fulltime/Contract · Job Location: McLean, VA · Need candidates who are Local to McLean OR willing to relocate to McLean. · Work Model: Onsite from Day1 – Hy ...
-
Data Engineer
5 days ago
QinetiQ US Mc Lean, United StatesCompany Overview · We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fie ...
-
Data Engineer
1 week ago
Ascendion Inc. Mclean, United StatesAbout Ascendion · Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent so ...
-
Data Engineer
1 week ago
Leidos McLean, United States· Are you interested in improving and shaping the transportation industry with a group of intelligent and motivated individuals? Consider joining the Leidos team operating the Federal Highway Administration (FHWA)'s Saxton Transportation Operations Laboratory (STOL), a USDOT res ...
-
Data Engineer
2 weeks ago
Tandym Group McLean, United StatesAn education tech services company in Virginia is currently seeking a new Data Engineer for a promising opportunity with their growing staff. In this role, the Data Engineer will be responsible for the design, structure, and maintenance of data. · ***This is a Hybrid opportunity ...
-
Data Engineer
2 weeks ago
Mindlance McLean, United StatesSoftware Engineer responsible for developing and maintaining data processing application which will handle data from small to large volumes in terabytes of business critical enterprise data. Must have 4+ years of developing data centric application using Spark/Scala or Python run ...
-
Data Engineer
2 weeks ago
Guidehouse McLean, United StatesJob Family: · Data Science Consulting · Travel Required: · Up to 10% · Clearance Required: · Ability to Obtain Public Trust · What You Will Do: · Guidehouse is seeking a Data Engineer to join our Defense and Security Segment, where the individual will: · Design, develop, and ...
-
Data Engineer
2 weeks ago
Sky Solutions LLC McLean, United StatesJoin Sky Solutions, LLC - Pioneering Digital Transformation Excellence · Welcome to Sky Solutions, LLC, a dynamic Digital Transformation Firm nestled in the vibrant heart of the Washington D.C. Metro Area. We specialize in empowering leading organizations in the Financial Servic ...
-
Data Engineer
2 weeks ago
Infinitive McLean, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technolog ...
-
Data Engineer
2 weeks ago
Infinitive McLean, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technolog ...
-
Data Engineer
1 week ago
ManTech McLean, United States Full timeSecure our Nation, Ignite your Future · Can you protect and defend the most coveted targets in the world and ensure the safety of information systems assets and protect systems from intentional or inadvertent access or destruction? Join ManTech and help protect our national secur ...
-
Data Engineer
1 week ago
QinetiQ US Mc Lean, United StatesCompany OverviewWe are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields ...
-
Data Engineer
3 weeks ago
Hexaware Technologies McLean, United StatesHexaware is hiring Data Engineers, candidates need to work onsite at McLean, VA (Hybrid Model). · Considering making an application for this job Check all the details in this job description, and then click on Apply. · Data Engineer · Job Type: Fulltime/Contract · Job Locatio ...
-
Data Engineer
5 days ago
QinetiQ Mc Lean, United StatesCompany Overview · We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fie ...
-
Data Engineer
2 weeks ago
Aireon LLC McLean, United StatesCompany Overview · Aireon deployed the world's first global space-based air traffic surveillance system, providing real-time aircraft monitoring capabilities around the world, including over the poles, over the oceans and in remote areas. · Aireon data enables safer, more effic ...
-
Data Engineer
1 week ago
Cyrten McLean, United StatesData Engineer/Scientist · Location: McLean, VA · Onsite/Remote/Hybrid: 100% Onsite (non-negotiable) · Clearance: TS/SCI Full Scope Poly (active) · In Bid/Vacant: In Bid · Type: Direct Hire · Skill Level: Any · Open: Available Immediately · Introduction: · Our client is s ...
-
Data Engineer
2 weeks ago
General Dynamics Information Technology McLean, United StatesJob Description: · Type of Requisition: · Regular · Clearance Level Must Currently Possess: · Top Secret SCI + Polygraph · Clearance Level Must Be Able To Obtain: · Top Secret SCI + Polygraph · Suitability: · Public Trust/Other Required: · Job Family: · Data Science · ...
-
Lead Data Engineer
1 week ago
Ascendion McLean, United StatesAbout Ascendion · Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent so ...
-
Wireless Data Engineer
1 week ago
Foxhound Federal McLean, United StatesBenefits:401(k) · Competitive salary · Dental insurance · Flexible schedule · Health insurance · Paid time off · Vision insurance · Join our dynamic team at DGS, a cutting-edge data solutions company, for wireless networks, where innovation meets excellence in the realm of Radio ...
Data Engineer - McLean, United States - Infinitive
Description
*Candidates must be local to the Washington D.C. metro area.
About Infinitive:
Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.
Infinitive has been named "Best Small Firms to Work For" by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post "Top Workplace", Washington
Business Journal "Best Places to Work", and Virginia Business "Best Places to Work."
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.
Responsibilities:
Data Architecture and Design:
ETL Development:
Python and PySpark Development:
Data Integration:
Streaming and Batch Workflows:
CI/CD Implementation:
Qualifications:
Preferred Skills:
Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is an Equal Opportunity Employer.