- Design, develop, and maintain scalable data pipelines and architectures to support data extraction, transformation, and loading (ETL/ELT) processes. Utilize strong SQL skills to perform complex data transformations and optimize database queries, ensuring high performance and efficiency.
- Building comprehensive datasets by aggregating data sourced from various relational databases, facilitating data analysts and data scientists in creating machine learning models, reports, and dashboards.
- Collaborate with cross-functional teams (data analysts, data scientists, and business stakeholders) to understand business requirements and translate them into technical solutions.
- Assist with the implementation of data migration/pipelines from on-prem to cloud/non-relational storage platforms.
- Leverage distributed computing frameworks like Apache Spark to process large volumes of data efficiently.
- Utilizing data analysis, problem-solving, investigative, and creative thinking skills to handle extremely large datasets, transforming them into various formats for diverse analytical products.
- Respond to data queries/analysis requests from various groups within an organization. Create and publish regularly scheduled and/or ad hoc reports as needed.
- Troubleshoot data-related issues, identify root causes, and implement solutions to ensure data integrity and accuracy.
- Implement best practices for data governance, security, and quality supporting the core business applications.
- Responsible for data engineering source code control using GitLab.
- Experience with relational databases and knowledge of query tools and/or BI tools like Power BI or OBIEE and data analysis tools.
- Extensive experience with SQL and proficiency in writing complex queries.
- Solid understanding of data warehousing concepts and platforms such as Oracle and cloud-based solutions.
- Strong experience in automating ETL jobs via UNIX/LINUX shell scripts and CRON jobs.
- Demonstrate a strong practical understanding of data warehousing from a production relational database environment.
- Strong experience using analytic functions within Oracle or similar tools within non-relational (MongoDB, Cassandra etc.) database systems.
- Strong understanding of distributed computing principles and experience with frameworks like Apache Spark
- Hands-on-experience with data lake architectures and technologies in a cloud environment.
- Experience with Atlassian suite of tools such as Jira and Confluence
- Knowledge of Continuous Integration & Continuous Development tools (CI/CD)
- Must be able to multitask efficiently and progressively and work comfortably in an ever-changing data environment.
- Must work well in a team environment as well as independently.
- Excellent verbal/written communication and problem-solving skills; ability to communicate information to a variety of groups at different technical skill levels.
- 5+ years of experience in developing, maintaining, and optimizing complex Oracle PL/SQL packages to aggregate transactional data for consumption by data science/machine learning applications.
- 10+ years of experience in working in data engineering, with a focus on building and optimizing data pipelines and architectures. Must have full life cycle experience in design, development, deployment, and monitoring.
- Experience with one or more relational database systems such as Oracle, MySQL, Postgres, SQL server, with heavy emphasis on Oracle.
- Extensive experience with cloud platforms (e.g. AWS, Google Cloud, etc) and cloud based ETL/ELT tools.
- Experience with Amazon services such as S3, Redshift, EMR and Scala.
- Experience with migrating on-prem legacy database objects and data to the Amazon S3 cloud environment.
- Experience or familiarity with data science/machine learning and development experience for supervised and unsupervised learning with structure and unstructured datasets.
- Certifications in relevant technologies (e.g. AWS Certified Big Data, Google Professional Data Engineer) are a plus.
-
Data Automation Engineer
3 days ago
GovFirst Herndon, United StatesWe are actively seeking a talented and experienced Data Automation Engineer (Cyber Security Systems) to join our team in supporting our customer's Division level Authorization and Accreditation (A&A) projects. The ideal candidate will have a minimum of 16 years of experience and ...
-
Data Engineer
2 days ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technol ...
-
Data Engineer
3 hours ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
-
Data Engineer
2 days ago
Infinitive Ashburn, United States*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technolo ...
-
Data Engineer
3 hours ago
Infinitive Inc Ashburn, United StatesJob Description · Job Description*Candidates must be local to the Washington D.C. metro area. · About Infinitive: · Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We ...
-
Data Engineer
5 days ago
BizFirst Alexandria, United StatesJob Title: Full Stack Developer · Company: Client of BizFirst · Location: Hybrid,Available to work on-site 2-3 days per week in Crystal City/Alexandria, VA; A few positions are full-time On-site. · Employment Type: Full-time W-2 Employee · Contract Length:5 years · Security Cl ...
-
Data Engineer
2 days ago
Eclipse Enterprises Cabin John, United StatesBe Yourself - and Develop Your Talent · At INFOMOTION, our focus is on extracting the maximum value from data - and soon for you too, if you are passionate about data and understand your digital craft. Just like us. · With almost two decades of experience, we are one of the leadi ...
-
SME Data Engineer
6 days ago
CMCI Ashburn, United StatesJob Description · SME Data Engineer · Location: Ashburn, VA · Why CMCI? · CMCI provides management consulting and IT services that empower enterprises to achieve their business goals in today's highly competitive market. Our goal is to seamlessly integrate into each customer' ...
-
Data Center Engineer
1 week ago
Insight Global Ashburn, United StatesThe Engineer-I position is a contributing member to the site level Data Center Operations team assigned to one or more of our data center properties reporting directly to the Manager of Facility Engineering. The Engineer-I will have experience in mission critical infrastructure, ...
-
Data Center Engineer
2 days ago
ConvergeOne Ashburn, United StatesC1 Company Overview: · C1: 1 Contact, 1 Connection, 1 Choice · C1 is the foremost, single-source provider of advanced communications and data technology for business. That means if it's digital, we connect our customers to it -- from phone systems and hardware to computer netwo ...
-
SME Data Engineer
1 day ago
ManTech Ashburn, United States Full timeSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative project ...
-
Data Center Engineer
1 week ago
RIT Solutions, Inc. Ashburn, United StatesThis is 100% onsite role - Must be local in DMV area · Duration: 6+ months · Must have a valid LinkedIn profile · Extensive layer 1 knowledge · Hardware/ Cable troubleshooting · Racking/stacking/ cabling · Ability to work night shift · ...
-
Azure Data Engineer
5 days ago
teamworkonline Ashburn, United StatesJob Title: Azure Data Engineer / Azure Cloud Data Engineer · Overview: We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server ...
-
Data center site engineer
2 days ago
Randstad Ashburn, United Statesjob summary: · Randstad is responsible for the entire day to day management of state of the art data center operations throughout the United States for a multinational banking and financial services holding company. It is the largest of its kind in the United States with total wo ...
-
Data Center, Service Engineer
2 days ago
Knewin Ashburn, United StatesJob Req ID: 23192 · About Supermicro: · Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing ...
-
Cloud Migration/Data Engineer
7 hours ago
ManTech Ashburn, United States Full timeSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International Corporation, you'll help protect our national security while working on innovative project ...
-
Staff Data Center Engineer
2 days ago
SiriusXM Ashburn, United StatesResponsibilities: · Who We Are: · SiriusXM and its brands (Pandora, SiriusXM Media, AdsWizz, Simplecast, and SiriusXM Connect) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experienc ...
-
Big Data Engineer
5 days ago
Laansu Sterling, United StatesJob Description · Job DescriptionLaansu has an engaging opportunity for a talented ETL: / Data Engineer / System · Engineer to build their career and help save lives on the nation's road · infrastructure. You will build and support software products used by the · Department of Tr ...
-
Big Data Engineer
1 day ago
Strongbridge Sterling, United StatesJob Description · Job DescriptionSalary: · *This is a hybrid role* · Strongbridge, LLC has an engaging opportunity for a talented Big Data Engineer to build their career and help save lives on the nation's road infrastructure. You will build and support software products used by ...
-
Data Engineer/Systems Engineer
5 days ago
Strongbridge Sterling, United StatesJob Description · Job DescriptionSalary: · *This is a hybrid role* · Strongbridge, LLC has an engaging opportunity for a talented Data Engineer / System Engineer to build their career and help save lives on the nation's road infrastructure. You will build and support software pr ...
Remote SME Data Engineer - Ashburn, United States - Shuvel Digital
Description
Job Description:Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings require the application of solutions to promote efficient trade and travel. Further, effective solutions help CBP ensure the movement of people, capital, and products is legal, safe, and secure. CBP seeks capable, qualified, and versatile SME Data Engineers to help develop complex data analytical solutions for law enforcement personnel to assess risk of potential threats entering the country.
Responsibilities include, but are not limited to:
