- Take responsibility for the delivery of Data Migration for multiple systems: analysis, design, implementation, testing, validation, and acceptance.
- Assembling large, complex sets of data that meet non-functional and functional business requirements.
- Communicate with key stakeholders to understand the data migration needs and requirements and troubleshoot data inconsistencies that might arise.
- Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
- Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues
- Develop logical and conceptual data models.
- Develop data migration strategies and plans.
- Develop scripts to extract, transform and load data.
- Perform data analysis and cleansing activities to ensure data quality, as needed.
- Troubleshoot and resolve issues related to data migration.
- Participate in data migration testing including data-level validation and application-level validation.
- Document data migration processes, procedures, and outcome.
- 8+ years of work experience with a combination of data modeling, ETL, database operations, data services, data analytics, ETL and data migration tools.
- 5+ years of work experience with coding in one of mainstream programming languages: Python, Java, etc.
- Experience in design and development of ETL process using AWS ETL tools like AWS DMS, Glue, Athena, AWS Aurora PostgreSQL, etc.
- Experience in designing data migration solutions, archival processes, and reconciliation.
- Experience with data quality checks, data de-duplication and data validation processes.
- Perform data migration audit, reconciliation, and exception reporting.
- Experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- Experience operating production workloads on Oracle/PostgreSQL (preferred)
- Solid understanding of data elements and their relationships between the source and target systems
- Experience working on real-time data and streaming applications.
- Experience with NoSQL implementation (DynamoDB, Mongo, Cassandra)
-
Data Engineer
6 days ago
ASCENDING LLC Fairfax, United StatesFull-time, Remote - Location Requirement: Must be located in the Eastern Time Zone · Available for W-2 or 1099 Individual. · Our client, one of the largest Amazon Web Services (AWS) partners for data services, is looking for a true Mid level Big Data Engineer to contribute to ...
-
Data Engineer
6 days ago
NiyamIT Inc. Fairfax, United StatesJoin Our Team at Niyam IT: Embrace Diversity, Excel Together · Are you ready to be part of a dynamic, inclusive, and fearless team that values your well-being and individuality? At Niyam, we're not just a company; we're a close-knit community of experts and leaders dedicated to ...
-
Data Engineer
2 weeks ago
ASCENDING LLC Fairfax, United StatesFull-time, 100% Remote · Available for W-2 or 1099 Individual. · Our client, one of the largest Amazon Web Services (AWS) partners for data services, is looking for a trueMid level Big Data Engineer to contribute to join their team of technologists to build and contribute to lar ...
-
Data Engineer
6 days ago
General Dynamics Information Technology Fairfax, United States Paid WorkReq ID: RQ174972 · Type of Requisition: Regular · Clearance Level Must Be Able to Obtain: Secret · Job Family: Database Analysis/Design · Skills: · Database Architecture,ETL Processing,Oracle Database Migration,Structured Query Language (SQL) · Certifications: · Security + - Comp ...
-
Data Engineer
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Engineer (Junior-Mid Level Python Developer) US Citizenship REQUIRED** · **Category:** Software Development/ Engineering · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI federal i ...
-
Data Engineer
1 week ago
Leidos Falls Church, United States· Are you interested in improving and shaping the transportation industry in a group of intelligent and motivated individuals? Leidos operates the Federal Highway Administration's (FHWA) Saxton Transportation Operations Laboratory (STOL), a USDOT research lab focused on the impr ...
-
Data Engineer
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Engineer (Sr.) - U.S. Citizenship Required** · **Category:** Cyber Security · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI is one of the top 5 largest global IT companies s ...
-
Data Engineer
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Engineer (Junior-Mid Level Python Developer) US Citizenship REQUIRED** · **Category:** Software Development/ Engineering · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI fede ...
-
Data Engineer
6 days ago
CGI Technologies and Solutions, Inc. Fairfax, United StatesData Engineer (Sr.) - U.S. Citizenship Required · Category: Cyber Security · Main location: United States, Virginia, Fairfax · Position ID: J · Employment Type: Full Time · Position Description: · CGI is one of the top 5 largest global IT companies spread across 40 countries wit ...
-
Data Engineer/Big Data Engineer
6 days ago
RIT Solutions, Inc. Fairfax, United StatesMust have skills: · 1. nd ER modeling tools like ER/Studio, Erwin · 2. File Formats : XML, JSON, AVRO, Fixed width, Delimiter Files · 3. NOSQL technologies like Amazon DynamoDB and MongoDB · 4. Traditional DB's: Oracle, SQL Server, DB2 · 5. Search Platforms: Amazon OpenSearch, E ...
-
Computer Systems Engineer-Remote
3 days ago
Shuvel Digital Fairfax, United StatesMust have a working knowledge of data ETL pipelines and cloud environments. · Must know: · Google Cloud Platform: · Cloud Functions · BigQuery · Cloud Run · App Engine · Cloud Build · IAM · Identity-Aware-Proxy · Scripting Language [R and Python] · Docker · Micro Serv ...
-
Data Engineer Advisor
2 weeks ago
NES Associates Falls Church, United StatesType of Requisition: · Regular · Clearance Level Must Currently Possess: · Top Secret SCI + Polygraph · Clearance Level Must Be Able to Obtain: · Top Secret SCI + Polygraph · Suitability: · Public Trust/Other Required: · Job Family: · Data Science · Job Qualifications: ...
-
Data Engineer Senior
6 days ago
General Dynamics Information Technology Falls Church, United StatesReq ID: RQ173835 · Type of Requisition: Regular · Clearance Level Must Be Able to Obtain: Top Secret SCI + Polygraph · Job Family: Data Science · Skills: · Building Architecture,Communication,Data Flows · Experience: · 5 + years of related experience · US Citizenship Required: · ...
-
Data Quality Engineer
1 week ago
CGI Technologies and Solutions, Inc. Fairfax, United StatesData Quality Engineer (Sr.) - U.S. Citizenship Required · Category: Cyber Security · Main location: United States, Virginia, Fairfax · Position ID: J · Employment Type: Full Time · Position Description: · CGI is one of the top 5 largest global IT companies spread across 40 count ...
-
Data Engineer SME
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Engineer SME (Data Collection Engines) - U.S. Citizenship Required** · **Category:** Software Development/ Engineering · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI is one of t ...
-
Data Engineer SME
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Engineer SME (Data Collection Engines) - U.S. Citizenship Required** · **Category:** Software Development/ Engineering · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI is one ...
-
Data Quality Engineer
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Quality Engineer (Sr.) - U.S. Citizenship Required** · **Category:** Cyber Security · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI is one of the top 5 largest global IT companie ...
-
Data Engineer SME
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Engineer SME (Data Collection Engines) - U.S. Citizenship Required** · **Category:** Software Development/ Engineering · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI is one ...
-
Data Quality Engineer
2 weeks ago
CGI Technologies and Solutions, Inc. Fairfax, United States**Data Quality Engineer (Mid) - U.S. Citizenship Required** · **Category:** Business Consulting, Strategy and Digital Transformation · **Main location:** United States, Virginia, Fairfax · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · CGI ...
-
Data Quality Engineer
1 week ago
CGI Technologies and Solutions, Inc. Fairfax, United StatesData Quality Engineer (Mid) - U.S. Citizenship Required · Category: Business Consulting, Strategy and Digital Transformation · Main location: United States, Virginia, Fairfax · Position ID: J · Employment Type: Full Time · Position Description: · CGI is one of the top 5 largest ...
Data Engineer-Remote - Fairfax, United States - Shuvel Digital
Description
Clearance Requirement: Must be US Citizen and should be able to obtain DHS FEMA clearance.Primary Responsibilities