- Design, develop, and maintain data pipelines using ELK Stackand Databricks to ingest, process, and transform data from various sources.
- Collaborate with data scientists and analysts to understand their data requirements and ensure the data engineering infrastructure can support their needs.
- Optimize data pipelines for efficiency, scalability, and performance to meet business objectives.
- Troubleshoot and resolve issues related to data processing and pipeline failures.
- Ensure data security and compliance with relevant data protection regulations.
- Document data engineering processes and procedures for future reference and knowledge sharing.
- Stay up-to-date with the latest trends and best practices in data engineering and cloud-based data processing technologies.
- Bachelor's degree in computer science, information technology, or a related field. A master's degree is a plus.
- Proven experience as a data engineer with a focus on data processing and integration.
- Strong knowledge and hands-on experience with Elasticsearch.
- Proficiency in Databricks for data analytics, ETL, and data engineering.
- Familiarity with big data technologies such as Apache Spark is a plus.
- Solid understanding of data warehousing concepts and relational databases.
- Strong programming skills in languages such as Python, Java, or Scala.
- Knowledge of data modeling and data warehouse design principles.
- Excellent problem-solving and debugging skills.
- Strong teamwork and communication skills to collaborate effectively with cross-functional teams.
- AWS Certified Data Analytics - Specialty or relevant certifications.
- Experience working with data streaming technologies like Apache Kafka or Amazon Kinesis.
- Knowledge of DevOps practices for CI/CD pipelines.
- Familiarity with data governance and data quality best practices.
- Experience with version control systems like Git.
-
Data Automation Engineer
1 week ago
GovFirst Herndon, United StatesWe are actively seeking a talented and experienced Data Automation Engineer (Cyber Security Systems) to join our team in supporting our customer's Division level Authorization and Accreditation (A&A) projects. The ideal candidate will have a minimum of 16 years of experience and ...
-
Data Engineer
1 week ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technolo ...
-
Data Engineer
1 week ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
-
Data Engineer
1 week ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
-
Data Engineer
1 week ago
BizFirst Alexandria, United StatesJob Title: Data Engineer · Company: Client of BizFirst · Location: Crystal City/Alexandria, VA (Onsite requirement: 3 days per week) · Employment Type: Full-time W-2 Employee · Contract Length: 5 years · Security Clearance: Secret clearance required; TS/SCI clearance preferred · ...
-
Data Engineer
2 weeks ago
Eclipse Enterprises Cabin John, United StatesBe Yourself - and Develop Your Talent · At INFOMOTION, our focus is on extracting the maximum value from data - and soon for you too, if you are passionate about data and understand your digital craft. Just like us. · With almost two decades of experience, we are one of the leadi ...
-
Data Engineering Fellow
5 days ago
BlueLabs Analytics, Inc. Washington, United States**About BlueLabs** · BlueLabs is a leading provider of analytics services and technology for a variety of industry clients: including government, business, and political campaigns. We help our clients optimize their engagements with individual customers, supporters, and stakehold ...
-
SME Data Engineer
1 week ago
CMCI Ashburn, United StatesJob Description · SME Data Engineer · Location: Ashburn, VA · Why CMCI? · CMCI provides management consulting and IT services that empower enterprises to achieve their business goals in today's highly competitive market. Our goal is to seamlessly integrate into each customer' ...
-
Data Center Engineer
3 weeks ago
Insight Global Ashburn, United StatesThe Engineer-I position is a contributing member to the site level Data Center Operations team assigned to one or more of our data center properties reporting directly to the Manager of Facility Engineering. The Engineer-I will have experience in mission critical infrastructure, ...
-
Azure Data Engineer
5 days ago
AEG Ashburn, United StatesJob Title: Azure Data Engineer / Azure Cloud Data Engineer · Overview:We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server ...
-
Data Center Engineer
2 weeks ago
ConvergeOne Ashburn, United StatesC1 Company Overview: · C1: 1 Contact, 1 Connection, 1 Choice · C1 is the foremost, single-source provider of advanced communications and data technology for business. That means if it's digital, we connect our customers to it -- from phone systems and hardware to computer netwo ...
-
Data Center Engineer
1 week ago
ConvergeOne Ashburn, United StatesC1 Company Overview: · C1: 1 Contact, 1 Connection, 1 Choice · C1 is the foremost, single-source provider of advanced communications and data technology for business. That means if it's digital, we connect our customers to it -- from phone systems and hardware to computer networ ...
-
SME Data Engineer
2 weeks ago
ManTech Ashburn, United States Full timeSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative project ...
-
Data Center Engineering Technician
3 days ago
Amazon Web Services Chantilly, United StatesAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment ...
-
Data Operations Engineer
1 week ago
Comcast Corporation Ashburn, VA, United States Full timeMake your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning tec ...
-
Data Center Engineer
3 weeks ago
RIT Solutions, Inc. Ashburn, United StatesThis is 100% onsite role - Must be local in DMV area · Duration: 6+ months · Must have a valid LinkedIn profile · Extensive layer 1 knowledge · Hardware/ Cable troubleshooting · Racking/stacking/ cabling · Ability to work night shift · ...
-
Azure Data Engineer
2 weeks ago
teamworkonline Ashburn, United StatesJob Title: Azure Data Engineer / Azure Cloud Data Engineer · Overview: We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server ...
-
Cloud Data Engineer
8 hours ago
ManTech Ashburn, United States Paid WorkSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative project ...
-
Remote SME Data Engineer
1 week ago
Shuvel Digital Ashburn, United StatesJob Description: · Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings requ ...
-
Data center site engineer
2 weeks ago
Randstad Ashburn, United Statesjob summary: · Randstad is responsible for the entire day to day management of state of the art data center operations throughout the United States for a multinational banking and financial services holding company. It is the largest of its kind in the United States with total wo ...
Data Engineer - Ashburn, United States - Infinitive
Description
*Candidates must be local to the Washington D.C. metro area.
About Infinitive:
Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.
Infinitive has been named "Best Small Firms to Work For" by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post "Top Workplace", Washington Business Journal "Best Places to Work", and Virginia Business "Best Places to Work."
Job Summary:
We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and be proficient in using the ELK (elastic, kibana, logstash) stack and Databricks for data processing and analytics. This role is critical in helping us manage and optimize our clients data pipelines, ensuring the availability, reliability, and performance of our data infrastructure.
Responsibilities:
Requirements:
Preferred Qualifications:
Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is an Equal Opportunity Employer.
