- Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.)
- Ensure data integrity by performing employing data engineering best practices.
- Maintain database and data pipeline documentation, data dictionaries, and system diagrams.
- Bachelor's Degree and 12+ years of prior relevant experience or master's with 10+ years of prior relevant experience
- Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.
- Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc.
- Experience with DevOps / MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms.
- Must possess an active Secret clearance and the ability to obtain and maintain a TS/SCI with Polygraph
- Experience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.
- Expertise in data profiling techniques and understanding the content from both a data quality and business perspective.
- Experience with data quality and accuracy evaluation techniques.
- Experience with Agile practices.
- Development experience with Python
- Experience in data model development, modification and migration, and maintenance.
- Strong verbal and written communication skills
- Enthusiastic with the ability to work well on a team and a self-starter who can work independently.
- An active TS/SCI clearance
- Experience supporting data teams and data scientists.
- Experience in a production/ enterprise system.
- Experience in air-gapped environments.
- Application development and deployment in an AWS environment
- AWS certifications
591 Data Integration Engineer TS SCI with Security Clearance - Bethesda, United States - Vector Talent Resources
Description
VECTOR JOB OPENING:
Job ID: 591
Job Title:
Data Integration Engineer Job Contact:
Job Clearance Required:
For this job a Top Secret SCI Clearance is Required
Job Practice area:
System Engineering
Location:
Bethesda, MD – We do offer various work schedules: Compressed Schedules and Hybrid; speak to your recruiter about your needs
Pay:
W2 Salaried plus 15 leave days, 11 paid holidays, 7 sick days, benefits plans and 401k/w match and more.
JOB DESCRIPTION FOR Data Integration Engineer - TS/SCI Vector is seeking our next TS/SCI cleared Data Integration Engineer supporting the National Media Exploitation Center (NMEC) under our 10-year Technology Platform contract.
Have impact as part of a mission focused, solutions oriented, and adaptive team that values innovation, collaboration, and professional development.
Your job will be to design, implement, maintain, and monitor data pipelines, both in support of R&D prototypes and production pipelines.
You succeed through effective cross functional collaboration in areas such as, but not limited to, development, product, and QA in a dynamic and fast paced environment.
While most work is conducted on-site at our client location in Bethesda, MD, we offer a flexible schedule and some unclassified development tasks may be performed remotely.
Percentage of remote work will vary based on client requirements/deliverables. Responsibilities