- Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
- Develop data models and schema designs to optimize data storage and retrieval.
- Implement ETL processes to extract, transform, and load data from various sources.
- Ensure data quality, integrity, and consistency throughout the ETL pipeline.
- Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
- Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices.
- Integrate data from different systems and sources to provide a unified view for analytical purposes.
- Collaborate with data scientists and analysts to implement solutions that meet their data integration needs.
- Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
- Develop batch processing workflows for large-scale data processing and analysis.
- Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines using Jenkins or GitHub Actions.
- Automate testing, code deployment, and monitoring processes to ensure the reliability of data pipelines.
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer or similar role.
- Strong programming skills in Python and expertise in PySpark for both batch and streaming data processing.
- Hands-on experience with ETL tools and processes.
- Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
- Solid understanding of data modeling, database design, and data warehousing concepts.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with version control systems (e.g., Git).
- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Understanding of data security and privacy best practices.
-
Data Engineer
6 days ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operational ...
-
Data Engineer
3 weeks ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technol ...
-
Data Center Engineer
6 days ago
Technical Global Solutions Ashburn, United StatesData Centre Engineer · Location: Virginia, Ashburn · Salary: $60,000 - $65,000 per annum · Position Overview · We are seeking skilled Data Centre Engineers to join our team, responsible for cabling infrastructure and network hardware support at client sites. This role involves va ...
-
Data Engineer Data Fabric
1 week ago
Ernst & Young Washington, United StatesJob Description · En EY, tendrás la oportunidad de construir una carrera tan única como tú, con alcance global, apoyo, una cultura de inclusión y tecnología para convertirte en la mejor versión de ti. Contamos con tu talento y perspectiva para que EY también sea mucho mejor. Únet ...
-
Data Visualization Engineer
20 hours ago
Dev Technology Group N/A, N/A, United StatesData Visualization Engineer, #722 · Clearance: Active Public Trust in DHS or a component of DHS · What You'll Be Doing · The Data Visualization Engineer will work with an established team to create meaningful dashboards that support our customer's decision-making. This will inc ...
-
Azure Data Engineer
2 weeks ago
AEG Ashburn, United StatesJob Title: Azure Data Engineer / Azure Cloud Data Engineer · Overview:We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server ...
-
Cloud Migration/Data Engineer
3 weeks ago
ManTech Ashburn, United States Full timeSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative project ...
-
Data Visualization Engineer
12 hours ago
Dev Technology Group Ashburn, United StatesData Visualization Engineer, #722 · Clearance: · Active Public Trust in DHS or a component of DHS · What You'll Be Doing · The Data Visualization Engineer will work with an established team to create meaningful dashboards that support our customer's decision-making · . This will ...
-
Data Center Engineer
3 weeks ago
ConvergeOne Ashburn, United StatesC1 Company Overview: · C1: 1 Contact, 1 Connection, 1 Choice · C1 is the foremost, single-source provider of advanced communications and data technology for business. That means if it's digital, we connect our customers to it -- from phone systems and hardware to computer netwo ...
-
Data Engineer
3 weeks ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technolo ...
-
Data Engineer
1 week ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to mod ...
-
Data Engineer
3 weeks ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
-
Cloud Migration/Data Engineer
1 week ago
ManTech Ashburn, United StatesSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative projec ...
-
Data Center Operations Engineer
11 hours ago
Comcast Ashburn, United StatesMake your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning tec ...
-
Staff Data Center Engineer
1 week ago
SiriusXM Ashburn, United StatesWho We Are: · SiriusXM and its brands (Pandora, SiriusXM Media, AdsWizz, Simplecast, and SiriusXM Connect) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listenersin the ...
-
Data Engineer
3 weeks ago
ManTech Herndon, United States Full timeSecure our Nation, Ignite your Future · Can you protect and defend the most coveted targets in the world? Are you a "data-focused" person who is passionate about data driven innovation? Join ManTech and become part of a team of cyber experts that help protect our national securit ...
-
Data Engineering Manager
1 week ago
CareFirst BlueCross BlueShield Reston, United States**Resp & Qualifications** · **PURPOSE**: · Sets organizational goals and fosters a culture of innovation within a team of engineers and data scientists. Bridges the gap between strategic management and technical staff. Collaborates with senior management to develop team goals and ...
-
Data Engineer
3 weeks ago
Eclipse Enterprises Cabin John, United StatesBe Yourself - and Develop Your Talent · At INFOMOTION, our focus is on extracting the maximum value from data - and soon for you too, if you are passionate about data and understand your digital craft. Just like us. · With almost two decades of experience, we are one of the leadi ...
-
Product Design Engineer, Data Center Engineering
3 weeks ago
Amazon Data Services, Inc. Dulles Town Center, United StatesAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment ...
-
Data Center Operations Engineer
2 weeks ago
Comcast Corporation Ashburn, United StatesMake your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning tec ...
Data Engineer - Ashburn, United States - Infinitive Inc
Description
Job Description
Job Description*Candidates must be local to the Washington D.C. metro area.
About Infinitive:
Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.
Infinitive has been named "Best Small Firms to Work For" by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post "Top Workplace", Washington Business Journal "Best Places to Work", and Virginia Business "Best Places to Work."
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.
Responsibilities:
Data Architecture and Design:
ETL Development:
Python and PySpark Development:
Data Integration:
Streaming and Batch Workflows:
CI/CD Implementation:
Qualifications:
Preferred Skills:
Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa. Infinitive is an Equal Opportunity Employer.
Powered by JazzHR
PFf62d86bB