- Interact with designated product owners, system owners, and source system business owners to understand transactional system data models and elicit requirements and logic for ETLs
- Develop ETL workflows/data pipelines to ingest data using AWS Data Migration Service (DMS), Scala, Kafka, Restful APIs, and other technologies as determined by the client from multiple transactional systems to the target (including ODS, data marts, and data lake) according to documented logic and source-to-target mappings
- Troubleshoot data discrepancy and missing data issues resulting from daily ETL loads
- Work with operations team to deploy ETL jobs in integration and production environment and debug / troubleshoot critical production issues.
- Actively participate in Agile release development activities and ceremonies, including sprint planning, sprint grooming, artifact creation, sprint testing, demonstrations and retrospectives and solution releases.
- Document ETL logic, mappings, etc. in a concise and traceable manner to be used as a reference for future development and maintenance
- Execute other activities related to development work, such as participate in meetings, provide briefings, presentations and other support materials that will promote the program, assist in achieving user buy-in, and explain technical concepts to non-technical audiences.
- 5+ years of experience with ETL development ingesting data from diverse and huge data sources
- 5+ years of experience with programming languages such as Java, Scala, Python, R, JSON Schema
- 2+ years of experience producing and consuming Rest APIs.
- 5+ years of experience with relational databases used to support BI analytics
- Experience with Databricks/Apache Spark structured streaming, and/or Kafka experience
- Demonstrated experience in a Data Warehouse/Data Lake and Business Intelligence environment
- Ability to write complex SQL queries and scripts
- Strong teamwork, co-ordination, planning and influencing skills
- Self-driven with the ability to adapt quickly, work in a challenging and fast paced environment within cross-functional teams, and to promote creative problem solving within their team
- Experience with Agile development practices, including Scrum and Kanban, and management tools (e.g., Jira, Confluence)
- Experience with GIT and branching strategies
- Experience with engineering/DevOps tools (i.e., Jenkins)
- Excellent analytical, communication and organizational skills
- Experience working in AWS Cloud environment
- Experience with Microsoft Office Suite including Excel, PowerPoint, and Visio
- Experience with AWS Database Migration Service (DMS)
- Experience with Postgres and Oracle
- Experience with Scaled Agile Framework SAFe
-
Data Engineering Manager
3 days ago
CareFirst BlueCross BlueShield Reston, United States**Resp & Qualifications** · **PURPOSE**: · Sets organizational goals and fosters a culture of innovation within a team of engineers and data scientists. Bridges the gap between strategic management and technical staff. Collaborates with senior management to develop team goals and ...
-
Data Automation Engineer
2 weeks ago
GovFirst Herndon, United StatesWe are actively seeking a talented and experienced Data Automation Engineer (Cyber Security Systems) to join our team in supporting our customer's Division level Authorization and Accreditation (A&A) projects. The ideal candidate will have a minimum of 16 years of experience and ...
-
Release Manager, Data Center Engineering
2 days ago
Amazon Data Services, Inc. Herndon, United States3+ years of technical product or program management experience · - 3+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience · - Experience managing programs across cross functional teams, buildi ...
-
Data Engineer
3 weeks ago
Eclipse Enterprises Cabin John, United StatesBe Yourself - and Develop Your Talent · At INFOMOTION, our focus is on extracting the maximum value from data - and soon for you too, if you are passionate about data and understand your digital craft. Just like us. · With almost two decades of experience, we are one of the leadi ...
-
Data Engineer
3 weeks ago
The Squires Group Reston, United StatesOverview · Our client has a direct hire opening for a CLEAREDData Engineer to join their team in Reston, VA. In this role, you will contribute to the blueprint and design of data platforms, encompassing relevant data platform components. We are searching for innovative engineers ...
-
Data Center Engineering Technician
1 week ago
Amazon Web Services Chantilly, United StatesAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment ...
-
Data Engineer
3 weeks ago
Cordia Resources by Cherry Bekaert Reston, United StatesAs an engineering team member for the big data team, you will be responsible for the technical direction and development of critical data ingestion pipelines that power our client's business. You will be able to provide support and technical direction to a team of highly skilled ...
-
Data Engineer
2 weeks ago
Navstar Reston, United StatesWould you like to perform rewarding work while contributing to the success of an established, growing company? Navstar is an award-winning organization that has a proven track record of successfully providing IT services and solutions both as a prime and sub-contractor on mission ...
-
Data Engineer
3 weeks ago
QinetiQ US Reston, United StatesCompany OverviewWe are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields ...
-
Data Engineer
2 weeks ago
QinetiQ US Reston, United States Full timeCompany Overview · We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fie ...
-
Data Engineer
3 weeks ago
Applied Information Sciences Reston, United StatesAs a Data Engineer , you will u se cutting-edge cloud and data technologies to help global brands and federal agencies solve challenging problems through innovative technology solutions. Work on exciting projects, future-proof your skills and grow into your dream job alongside ...
-
Data Engineer
2 weeks ago
Ageatia Global Solutions Reston, United StatesPURPOSE: · This is a Big Data Administrator Lead position and not a developer position. · The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (e.g., data w ...
-
Data Engineer
3 weeks ago
ManTech Fairfax, United States Full timeSecure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International, you'll help protect our national security while working on innovative projects that offer ...
-
Data Engineer
2 weeks ago
iWorks Corporation Reston, United StatesJob Description · Job DescriptionTitle: Data Engineer · Location: Remote · About iWorks: · iWorks Corporation, founded in 2005, is a leading provider of information technology and professional services to the federal government. We are a recognized leader in personnel security an ...
-
Data Engineer
1 week ago
NS2 Mission Reston, United StatesAre you interested in working in a dynamic environment that offers opportunities for professional growth and new responsibilities by helping clients drive alignment with their business, advising through critical and complex issues, while allowing you to develop personally and pro ...
-
Data Engineer
3 weeks ago
Applied Information Sciences Reston, United StatesAs a Data Engineer, you will use cutting-edge cloud and data technologies to help global brands and federal agencies solve challenging problems through innovative technology solutions. Work on exciting projects, future-proof your skills and grow into your dream job alongside some ...
-
Data Engineer
4 weeks ago
KDA CONSULTING INC Reston, United StatesKDA Consulting is a Disabled Veteran, Woman-Owned, Certified Disadvantaged Small Business, comprised of a diverse team of professionals driven to tackle the demanding National Defense and Intelligence challenges through IT solutions. We emphasize teamwork and focus on achieving g ...
-
Data Engineer
1 week ago
Global InfoTek, Inc. Reston, United StatesClearance Level:TS/SCI US Citizenship:Required Job Classification:Full-time Location: * Pocatello, ID · * Washington, DC · * Clarksburg, WV · * Huntsville, AL · Experience:5-7 years Education:Mastersor equivalent experience in a related field. As a Data Engineer, you will be requ ...
-
Data Engineer
2 weeks ago
KYM Advisors Inc Reston, United StatesKYM Advisors focuses on innovative Solutions that support the ever-volving Mission and Technical environments. We are a team of talented 'Solutioneers' specializing in Information Management, Cybersecurity, DevOps and Program Manager. · KYM Advisors is seeking Junior to Subject M ...
-
Data Engineer
3 weeks ago
Metric5 Reston, United StatesMetric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elemen ...
Data Engineer - Reston, United States - Metric5
Description
Data EngineerDescription
Metric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective and efficient Data Warehouse. You have an eye for spotting data correlations and a desire to dig into large datasets to find technical solutions and deliver business value.
Program Details
The program you will be supporting has a mission to provide development, security, and operations (DevSecOps) support to U.S. Citizenship and Immigration Services (USCIS) with a focus on development, operations, and modernization of the Agency's Enterprise Data Warehouse/Data Lake. The team utilizes open-source, AWS Cloud, and Big Data technologies, agile project management practices, and modern DevSecOps delivery to provide the business intelligence support systems to meet the reporting, data analytics, and machine learning/artificial intelligence needs critical to USCIS leadership, data/business analysts, data scientists, and other decision-makers.
Requirements:
Location: Reston, VA - Currently fully remote due to COVID-19.
Clearance: Must be a US Citizen and be able to obtain a government agency Suitability Clearance. USCIS Entry on Duty (EOD) preferred.