- Support data science team by designing, developing and implementing scalable ETL process for disparate datasets into a Hadoop infrastructure
- Design, develop, implement and maintain data ingestion process from various disparate datasets using StreamSets
- Develop processes to identify data drift and malformed records
- Modernize the data ingestion architecture
- Develop technical documentation and standard operating procedures
- Mentor new and junior data engineers
- Leads technical tasks for small teams or projects
- Working knowledge of entity resolution systems
- Experience with messages systems like Kafka
- Experience with Python
- Experience with NoSQL and/or graph databases like MongoDB or ArangoDB
- Any of the following databases: SQL, MongoDB, Oracle, Postgres
- Working experience with ETL processing
- Working experience with data workflow products like StreamSets or NiFi
- Working experience with Python RESTful API services, JDBC
- Experience with Hadoop and Hive/Impala
- Experience with Cloudera Data Science Workbench is a plus
- Understanding of pySpark Leadership experience
- Creative thinker
- Ability to multi-task
- Excellent use and understanding of data engineering concepts, principles, and theories
-
Data Automation Engineer
1 day ago
GovFirst Herndon, United StatesWe are actively seeking a talented and experienced Data Automation Engineer (Cyber Security Systems) to join our team in supporting our customer's Division level Authorization and Accreditation (A&A) projects. The ideal candidate will have a minimum of 16 years of experience and ...
-
Data Engineer
1 week ago
ARA Chantilly, United StatesARA is seeking a talented Data Engineer to join our team within our Intel Community. You will be responsible for designing and building data pipelines using Python and AWS cloud infrastructure. This role requires a strong understanding of software development and data engineering ...
-
Data Engineer
6 days ago
ARA Chantilly, United StatesARA is seeking a talented Data Engineer to join our team within our Intel Community. You will be responsible for designing and building data pipelines using Python and AWS cloud infrastructure. This role requires a strong understanding of software development and data engineering ...
-
Data Engineer
1 day ago
Executive Recruiting Chantilly, United StatesJob Description · Job DescriptionExciting Opportunity for a Data Engineer at a Leading Tech Firm · Job Overview: · We are on the hunt for a skilled Data Engineer to join our team and push the boundaries of data engineering. You'll have the opportunity to develop innovative tools, ...
-
Data Engineer
1 week ago
Qbase Chantilly, United StatesClearance: ** TS/SCI with POLYGRAPH REQUIRED** · Location: Chantilly, VA ** ONSITE EVERY DAY*** · Data Engineer · Finch AI is a fast-growing, fast-paced software development organization; our mission is to build new ways of interacting with information. We do that by leveragin ...
-
Data Engineer
1 hour ago
Booz Allen Chantilly, United StatesData Engineer · The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal ...
-
Data Engineer
5 days ago
General Dynamics Mission Systems Chantilly, United StatesBasic Qualifications · Bachelor's degree in Engineering, Computer Science, Statistics, Applied Math is required plus a minimum of 2 years relevant experience or Master's degree in a related technical discipline · CLEARANCE REQUIREMENTS: · A TS/SCI security clearance with the a ...
-
Data Engineer
1 week ago
CGI Technologies and Solutions, Inc. Chantilly, United StatesData Engineer (Python Developer) Jr.-Mid Level TS/SCI with Poly REQUIRED · Category: Software Development/ Engineering · Main location: United States, Virginia, Chantilly · Position ID: J · Employment Type: Full Time · Position Description: · CGI federal is seeking a talented Da ...
-
Data Engineer
2 weeks ago
Arena Technical Resources Chantilly, United StatesData Engineer · Location: Chantilly, VA, US · Job ID: 16373 · Job Description · Job · Description: · Title: Data Engineer · Location: Onsite in Chantilly or Herndon, VA or Englewood or Aurora, CO · Citizenship/Clearance Requirement: US Citizen with an activeTS/SCIw/CI Pol ...
-
Data Engineer
5 days ago
Motion Recruitment Partners LLC Chantilly, United StatesData Engineer (Top Secret) · Chantilly, Virginia · Onsite · Contract · $70/hr - $80/hr · A leading provider of technical infrastructures is seeking a Data Engineer (ETL-focused), candidates must hold an active Top Secret. In this role, you would support customers to provide syste ...
-
Data Engineer
1 week ago
Orbis Operations Chantilly, United StatesData Engineer (TS/SCI with Poly) · Department: Federal · Employment Type: Full Time · Location: Chantilly, Virginia · Description · Coverent, an Orbis company, is seeking an innovative Data Engineer with a TS/SCI and polygraph clearance. They will be responsible for interfaci ...
-
Data Engineer
1 week ago
Gridiron IT Chantilly, United StatesGridironIT is seeking aData Engineer local to Chantilly, VA. · Onsite is required. · TS/SCI CI Poly clearance is required. · The Challenge: · Are you looking for an opportunity to develop a data platform that will have an impact on rapid exploitation and sharing of multi-INT i ...
-
Data Engineer
2 weeks ago
DCI Solutions Chantilly, United StatesDCI Job Requirement for · *Data*/*FSR Engineer* · Location: Chantilly, VA · *Job Description* · Serve as an FSR Engineer · Deploy ground breaking technical solutions to solve our customers' hardest problems · Help develop solutions in: · * High-level system design · * Confi ...
-
Data Engineer
5 days ago
Blackspoke IT Chantilly, United StatesOwn your opportunity to serve as a critical component of our nation's safety and security. Make an impact by using your expertise to protect our country from threats. Be part of an exciting opportunity to contribute to one of the nation's most critical intelligence organizations. ...
-
Data Engineer
1 hour ago
Booz Allen Chantilly, United StatesData Engineer · The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal ...
-
Data Engineer
5 days ago
Applied Research Associates Chantilly, United States· ARA is seeking a talented Data Engineer to join our team within our Intel Community. You will be responsible for designing and building data pipelines using Python and AWS cloud infrastructure. This role requires a strong understanding of software development and data engineer ...
-
Data Engineer
1 week ago
DCI Solutions Chantilly, United States Full timeDCI Job Requirement for · *Data*/*FSR Engineer* · Location: Chantilly, VA · *Job Description* · Serve as an FSR Engineer · Deploy ground breaking technical solutions to solve our customers' hardest problems · Help develop solutions in: · * High-level system design · * Con ...
-
Data Engineer
4 days ago
Booz Allen Hamilton Chantilly, United States Full timeJob Number: R0188277 · Data EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big dat ...
-
Data Engineer
5 days ago
Esvee Technologies Chantilly, United States Full timePosition Data Engineer Position Type W2 Location Chantilly VA Experience 5 - 8 YearsResponsibilities● Create and maintain optimal data pipeline architecture● Assemble large complex data sets that meet functional / non-functional business requirements.● Identify design and impleme ...
-
Data Engineer
3 days ago
BizFirst Alexandria, United StatesJob Title: Data Engineer · Company: Client of BizFirst · Location: Crystal City/Alexandria, VA (Onsite requirement: 3 days per week) · Employment Type: Full-time W-2 Employee · Contract Length: 5 years · Security Clearance: Secret clearance required; TS/SCI clearance preferred · ...
Senior Data Engineer - Chantilly, United States - General Dynamics Mission Systems
Description
Basic Qualifications
Bachelor's degree in Engineering, Computer Science, Statistics, Applied Math, or a related technical field is required plus a minimum of 8 years of relevant experience; or Master's degree plus a minimum of 6 years of relevant experience. Agile experience preferred.
CLEARANCE REQUIREMENTS:
A TS/SCI security clearance with the ability to obtain a Polygraph is required at time of hire. Candidates must be able to obtain the Polygraph within a reasonable amount of time from date of hire. Applicants selected will be subject to a U.S. Government security investigation and must meet eligibility requirements for access to classified information. Due to the nature of work performed within our facilities, U.S. citizenship is required.
Responsibilities for this PositionDeveloping mission-critical systems that help keep people safe is what we do. At General Dynamics Mission Systems, you'll be part of the team that helps heroes make a true impact. The work we do is important. The challenges we face are career-defining. The opportunity we can offer is one-of-a-kind.
General Dynamics Mission Systems has an immediate opening for a Senior Data Engineer on our award-winning Insider Threat Detection Team. A Senior Data Engineer will help us expand our insider threat capabilities in automating data integration and collection strategies. The successful candidate will help expand and optimize the data ingestion pipeline architecture, develop strategies for efficient ingestion, processing, storage, structuring, and access. In addition, the Senior Data Engineer will support data analysts, data scientists, and big data engineers in identifying data sources, performing exploratory data analysis, developing data structures, ensuring data cleanliness and accuracy to provide new Insider Threat behavioral insights.
This position provides an opportunity to further advance the cutting-edge technology that supports some of our nation's core defense/intelligence services and systems. General Dynamics Mission Systems employees work closely with esteemed customers to develop solutions that allow them to carry out high-stakes national security missions.
The majority of work will be performed in Chantilly, Virginia, which is located approximately 25 miles west of Washington D.C., near the Dulles International Airport.
REPRESENTATIVE DUTIES AND TASKS:
KNOWLEDGE SKILLS AND ABILITIES:
#CJ3
Company OverviewGeneral Dynamics Mission Systems (GDMS) engineers a diverse portfolio of high technology solutions, products and services that enable customers to successfully execute missions across all domains of operation. With a global team of 13,000+ top professionals, we partner with the best in industry to expand the bounds of innovation in the defense and scientific arenas. Given the nature of our work and who we are, we value trust, honesty, alignment and transparency. We offer highly competitive benefits and pride ourselves in being a great place to work with a shared sense of purpose. You will also enjoy a flexible work environment where contributions are recognized and rewarded. If who we are and what we do resonates with you, we invite you to join our high performance team
General Dynamics is an Equal Opportunity/Affirmative Action Employer that is committed to hiring a diverse and talented workforce.EOE/Disability/Veteran