- Design, develop, and maintain data pipelines using ELK Stack and Databricks to ingest, process, and transform data from various sources.
- Collaborate with data scientists and analysts to understand their data requirements and ensure the data engineering infrastructure can support their needs.
- Optimize data pipelines for efficiency, scalability, and performance to meet business objectives.
- Troubleshoot and resolve issues related to data processing and pipeline failures.
- Ensure data security and compliance with relevant data protection regulations.
- Document data engineering processes and procedures for future reference and knowledge sharing.
- Stay up-to-date with the latest trends and best practices in data engineering and cloud-based data processing technologies.
- Bachelor's degree in computer science, information technology, or a related field. A master's degree is a plus.
- Proven experience as a data engineer with a focus on data processing and integration.
- Strong knowledge and hands-on experience with Elasticsearch.
- Proficiency in Databricks for data analytics, ETL, and data engineering.
- Familiarity with big data technologies such as Apache Spark is a plus.
- Solid understanding of data warehousing concepts and relational databases.
- Strong programming skills in languages such as Python, Java, or Scala.
- Knowledge of data modeling and data warehouse design principles.
- Excellent problem-solving and debugging skills.
- Strong teamwork and communication skills to collaborate effectively with cross-functional teams.
- AWS Certified Data Analytics - Specialty or relevant certifications.
- Experience working with data streaming technologies like Apache Kafka or Amazon Kinesis.
- Knowledge of DevOps practices for CI/CD pipelines.
- Familiarity with data governance and data quality best practices.
- Experience with version control systems like Git.
-
Data Engineer
6 days ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operational ...
-
Data Engineer
3 weeks ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technol ...
-
Data Center Engineer
6 days ago
Technical Global Solutions Ashburn, United StatesData Centre Engineer · Location: Virginia, Ashburn · Salary: $60,000 - $65,000 per annum · Position Overview · We are seeking skilled Data Centre Engineers to join our team, responsible for cabling infrastructure and network hardware support at client sites. This role involves va ...
-
Data Engineer Data Fabric
1 week ago
Ernst & Young Washington, United StatesJob Description · En EY, tendrás la oportunidad de construir una carrera tan única como tú, con alcance global, apoyo, una cultura de inclusión y tecnología para convertirte en la mejor versión de ti. Contamos con tu talento y perspectiva para que EY también sea mucho mejor. Únet ...
-
Azure Data Engineer
2 weeks ago
AEG Ashburn, United StatesJob Title: Azure Data Engineer / Azure Cloud Data Engineer · Overview:We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server ...
-
Data Visualization Engineer
20 hours ago
Dev Technology Group Ashburn, United StatesData Visualization Engineer, #722 · Clearance: · Active Public Trust in DHS or a component of DHS · What You'll Be Doing · The Data Visualization Engineer will work with an established team to create meaningful dashboards that support our customer's decision-making · . This will ...
-
Data Center Engineer
3 weeks ago
ConvergeOne Ashburn, United StatesC1 Company Overview: · C1: 1 Contact, 1 Connection, 1 Choice · C1 is the foremost, single-source provider of advanced communications and data technology for business. That means if it's digital, we connect our customers to it -- from phone systems and hardware to computer netwo ...
-
Cloud Migration/Data Engineer
3 weeks ago
ManTech Ashburn, United States Full timeSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative project ...
-
Data Visualization Engineer
1 day ago
Dev Technology Group N/A, N/A, United StatesData Visualization Engineer, #722 · Clearance: Active Public Trust in DHS or a component of DHS · What You'll Be Doing · The Data Visualization Engineer will work with an established team to create meaningful dashboards that support our customer's decision-making. This will inc ...
-
Data Engineer
3 weeks ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technolo ...
-
Data Engineer
1 week ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to mod ...
-
Data Engineer
3 weeks ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
-
Data Centre Network Engineer- Onsite
4 weeks ago
Cognizant Ashburn, United States Full timeRole: Data Centre Network Engineer Location: Ashburn, Virginia Roles & Responsibilities: · This position will work in a Network Lab managing different equipment deployed in the Visa Network environment. The candidate will perform various functions listed below to keep the operat ...
-
Data Center Operations Engineer
19 hours ago
Comcast Ashburn, United StatesMake your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning tec ...
-
Cloud Migration/Data Engineer
1 week ago
ManTech Ashburn, United StatesSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative projec ...
-
Staff Data Center Engineer
1 week ago
SiriusXM Ashburn, United StatesWho We Are: · SiriusXM and its brands (Pandora, SiriusXM Media, AdsWizz, Simplecast, and SiriusXM Connect) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listenersin the ...
-
Data Engineer
2 weeks ago
NT Concepts Herndon, United StatesOVERVIEW · We are seeking a Data Engineer to join our team. Working at NT Concepts means that you are part of an innovative, agile company dedicated to solving the most critical challenges in National Security. We're looking for the best and the brightest to join us in supporting ...
-
Data Engineer
3 weeks ago
ManTech Herndon, United States Full timeSecure our Nation, Ignite your Future · Can you protect and defend the most coveted targets in the world? Are you a "data-focused" person who is passionate about data driven innovation? Join ManTech and become part of a team of cyber experts that help protect our national securit ...
-
Data Engineer
3 weeks ago
Eclipse Enterprises Cabin John, United StatesBe Yourself - and Develop Your Talent · At INFOMOTION, our focus is on extracting the maximum value from data - and soon for you too, if you are passionate about data and understand your digital craft. Just like us. · With almost two decades of experience, we are one of the leadi ...
-
Data Engineering Manager
1 week ago
CareFirst BlueCross BlueShield Reston, United States**Resp & Qualifications** · **PURPOSE**: · Sets organizational goals and fosters a culture of innovation within a team of engineers and data scientists. Bridges the gap between strategic management and technical staff. Collaborates with senior management to develop team goals and ...
Data Engineer - Ashburn, United States - Infinitive Inc
Description
Job Description
Job Description*Candidates must be local to the Washington D.C. metro area.
About Infinitive:
Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.
Infinitive has been named "Best Small Firms to Work For" by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post "Top Workplace", Washington Business Journal "Best Places to Work", and Virginia Business "Best Places to Work."
Job Summary:
We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and be proficient in using the ELK (elastic, kibana, logstash) stack and Databricks for data processing and analytics. This role is critical in helping us manage and optimize our clients data pipelines, ensuring the availability, reliability, and performance of our data infrastructure.
Responsibilities:
Requirements:
Preferred Qualifications:
Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa. Infinitive is an Equal Opportunity Employer.
Powered by JazzHR
9eq2PlbwDb
