- Creating a custom ingest pipeline to a Big Data platform with consistent performance and scalability.
- Understanding of programming and data engineering concepts and best practice.
- Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis.
- Ability to manage and organize data while identifying trends and inconsistencies that will impact downstream analytics.
- Ability to work both independently and collaboratively.
- High levels of curiosity, creativity, and problem-solving capabilities.
- Strong written and verbal communication skills.
- Experience with data pipelines or be willing to learn a pipeline from bottom to top.
- Be able to trouble shoot files against an architecture to see where the upload process is failing.
- Be able to understand unit tests and add to them to increase stability to the entire pipeline.
- Be prepared to use GIT, JIRA, Confluence, Anaconda, Spyder, and Microsoft tools.
- Be prepared to express ideas and solutions and walk together with teammates through coding challenges
- A current Top Secret security clearance with SCI eligibility and the ability to obtain a polygraph.
- Six years experience with ETL with experience in following: o Oracle 11g/12c, Sun Solaris OS, Linux (CentOS, Red Hat), and Windows environments o Performing software and scripting engineering for data ingest with Java or Python for ETL o Web services and/or microservices o ETL tools such as NiFi or Informatica o Using software repository tools such as GIT or SVN
- Have knowledge of Databricks, Scala, Python, and PySpark
- Have experience tuning complex SQL queries
- Experience with the AWS and Data Ingest/Transformation processes
- Have worked in an Agile environment.
- You have worked on teams that practice Agile methodologies.
-
IT Security Manager with Security Clearance
5 days ago
Guidehouse Chantilly, United StatesJob Family : · IT Risk & Controls Consulting Travel Required : · Up to 10% Clearance Required : · Active Top Secret SCI with Polygraph What You Will Do : Responsibilities include some or all of the following: Leading a team of IT security auditors performing IT risk and controls ...
-
Trainer with Security Clearance
1 week ago
Booz Allen Hamilton Chantilly, United StatesJob Number: R Trainer · The Opportunity: As a trainer, you're passionate about developing differentiated instruction and delivering it in exciting ways. You know that learning styles vary, and you thrive in helping people grasp new information. Bring your passion for developing a ...
-
Peraton Chantilly, United StatesAbout Peraton Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deli ...
-
Markon Solutions Chantilly, United StatesJob Description Founded in 2007, Markon Solutions is a nationally recognized consulting firm headquartered in Falls Church, Virginia. With employees in seven states and overseas, we support the intelligence community, defense and civilian sectors, as well as commercial clients. M ...
-
Invex Technology Solutions Chantilly, United StatesCyber Security Engineer Location: St. Louis, MO; Chantilly, VA; Gaithersburg, MD, Springfield, VA · Clearance: Top Secret/SCI JOB DESCRIPTION: · Invex is seeking a Cyber Security Engineer to support an IC customer Program focused on the Integration, Operations, and Sustainment of ...
-
McIntire Solutions, LLC Chantilly, United StatesYou will need to login · before you can apply for a job. · Cyber Security Engineer with Security Clearance · Title: Cyber Security Engineer (Mid–Level) Location: WMA – Washington Metropolitan Area McIntire Solutions, LLC is inviting a Cyber Security Engineer (Mid–Level) to join ...
-
Peraton Chantilly, United StatesAbout Peraton Peraton is a next–generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deli ...
-
Software Engineer with Security Clearance
2 weeks ago
Gridiron IT Solutions Chantilly, United StatesGridironIT is seeking numerous Software Engineers local to the Chantilly, VA area. Top Secret Clearance is required. The Opportunity: · As a software engineer, you can resolve a problem with a complete end-to-end solution in a fast, Agile environment. If you're looking for the ch ...
-
Finance Manager with Security Clearance
1 week ago
RDR, Inc. Chantilly, VA, United StatesJob Title Finance Manager Location CORPORATE - Chantilly, VA 20151 US (Primary) Job Type Full-time Category Accounting Job Description Job Overview Come work at one of the leading privately owned companies in the federal contracting industry in the Northern Virginia · We are look ...
-
Systems Engineer with Security Clearance
1 week ago
Markon Solutions Chantilly, United StatesJob Description Founded in 2007, Markon Solutions is a nationally recognized consulting firm headquartered in Falls Church, Virginia. With employees in seven states and overseas, we support the intelligence community, defense and civilian sectors, as well as commercial clients. M ...
-
DevOps Engineer with Security Clearance
1 week ago
NS2 Mission Chantilly, United StatesNS2 Mission is seeking excellent DevOps candidates to join our engineering team in Chantilly, VA working on the next generation of a key software system in the Intelligence Community for defense of vital national assets. Our team has deep experience in this exciting mission space ...
-
DevOps Engineer with Security Clearance
1 week ago
Booz Allen Hamilton Chantilly, United StatesJob Number: R DevOps Engineer · The Opportunity: As a DevOps engineer, you know how to set up cloud environments and provision computer networking, storage, and virtual networks-ultimately, how to "harness the cloud." We're looking for a DevOps infrastructure engineer like you to ...
-
DevOps Engineer with Security Clearance
1 week ago
Booz Allen Hamilton Chantilly, United StatesJob Number: R DevOps Engineer · The Opportunity: As a DevOps engineer, you know how to set up cloud environments and provision computer networking, storage, and virtual networks-ultimately, how to "harness the cloud." We're looking for a DevOps infrastructure engineer like you to ...
-
CACI Chantilly, United StatesDatabase Administrator Job Category: Information Technology Time Type: Full time Minimum Clearance Required to Start: Secret Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Local * * * CACI is hiring engineers to assist in the designing efforts for ...
-
Software Engineer with Security Clearance
1 week ago
Byte Systems, LLC Chantilly, United StatesCandidate MUST possess a TS/SCI clearance with Intel Polygraph The Contractor shall participate in all Lean Agile scrums, sprints and grooming sessions. The Contractor shall consult and coordinate appropriately for problem resolution, task scheduling, new resource requirements, a ...
-
Program Scheduler with Security Clearance
1 week ago
Booz Allen Hamilton Chantilly, United StatesJob Number: R Program Scheduler · The Opportunity: Are you looking for an opportunity to combine your te chn ical knowledge and management skills with big picture thi nk ing to make a mission impact, to support the warfighter? You understand your customer's environment and how to ...
-
Cloud Engineer with Security Clearance
1 week ago
Booz Allen Hamilton Chantilly, United StatesJob Number: R Cloud Engineer · The Opportunity: Everyone is trying to "harness the power of the cloud," but not everyone knows how. As a cloud computing application architect, you know how to build a cloud-based te chn ical architecture that meets client needs and takes advantage ...
-
Software Developer with Security Clearance
2 weeks ago
Apogee Integration LLC Chantilly, United StatesSecurity Clearance: Active TS/SCI with Fullscope Polygraph Clearance Required Position Seeking a Software Developer with current, on the job experience, with Angular/Java/MySQL. Any experience with Spring Boot and STS experience is also preferred and this would be a great role fo ...
-
Systems Integrator with Security Clearance
1 week ago
Booz Allen Hamilton Chantilly, United StatesJob Number: R Systems Integrator · The Opportunity: Everyone knows security needs to be "baked in" to a system architecture, but you know how to bake it in. You can identify and implement ways to harden systems and reduce their attack surface. What if you could us e your cyber en ...
-
Software Engineer with Security Clearance
1 week ago
Cornerstone Defense Chantilly, United StatesTitle: Software Engineer Location: Chantilly, VA *Clearance: *Active TS/SCI w/ Polygraph needed to apply * Company Overview: Cornerstone Defense is the Employer of Choice within the Intelligence, Defense, and Space communities of the U.S. Government. Realizing early on that our m ...
ETL Engineer with Security Clearance - Chantilly, United States - Advantex Consulting
1 week ago
Description
ETL Developer IIILocation:
Chantilly, Virginia (75% Remote)
Clearance Requirements:
Active Top-Secret Clearance (SCI Eligible) Role & Responsibilities We are seeking a Data Engineer who can leverage experience and expertise in data exploration, engineering, and ETL to explore, architect, develop, and deploy scripts for processing structured and unstructured data into usable data formats for long term storage, search, and analysis.
Required Qualifications:
Desired Qualifications: