Data Pipeline Engineer - Washington, United States - DCI Solutions

Description

DCI Job Requirement for:
Data Pipeline Engineer


Location:
Washington, D.C.


Job Description:
Serves as a Data Pipeline Engineer
Ensure that customers work with updated and accurate data in Foundry
Be the first to respond to data health failures on key pipelines
Read code to identify fixes and increase stability of data pipelines
Work alongside pipeline engineers from other customer accounts
Maintain and build schedules so that pipelines run effectively
Set up and maintaining health checks on different pipelines
Respond to, triage, and debug pipelines when there is a problem
Read and write code changes and/or modify monitoring set-up
Know and understanding how to navigate the pipelines and documentation
Follow SOPs to contact other teams/providers if data is incorrect
Communicate outages with the end users of a pipeline
Contribute to and monitor tooling improvements (where feasible)


Qualifications:
BS in Computer Science / Engineering (or related career field)

3+ years of experience with the following:
Pipeline Engineering
Data Engineering
Software Engineering

Comfortable reading and writing code in:
SQL, Python, Pyspark and Java

Basic understanding of Spark and familiar with tuning Spark jobs

Practical experience with performing root cause analysis and documentation

Experience working in an agile environment

Active work not _ required _ on weekends or out of hours
Availability is needed to respond to critical outages during assigned "on-call" weeks
After an on-call weekend the engineer will receive 2 days off


Required:
Active DoD Secret Clearance

Job Type:
Full-time


Salary:
$160,000-$200,000


Job Type:
Full-time


Pay:
$160, $200,000.00 per year


Benefits:
401(k)
401(k) matching
Dental insurance
Employee assistance program
Flexible schedule
Flexible spending account
Health insurance
Health savings account
Life insurance
Paid time off
Parental leave
Professional development assistance
Relocation assistance
Retirement plan
Tuition reimbursement
Vision insurance

Compensation package:
1099 contract
Bonus opportunities
Performance bonus

RSU
Signing bonus
Yearly pay

Schedule:
Monday to Friday


Experience:
Data Pipeline Engineering: 3 years (Preferred)

python: 3 years (Preferred)

SQL and Java: 3 years (Preferred)
Data Engineering: 3 years (Preferred)


Security clearance:
Secret (Required)


Work Location:
In person