Data Engineer - Washington, United States - The Job Network

Description

Piper Companies is looking for a Data Engineer to join an elite environmental industrial engineering firm in Washington, DC, to cluster large datasets across various container and data platforms.

Responsibilities of the Data Engineer include:

Achieve and maintain proficiency with cluster and framework sizing, installation, debugging, performance optimization, migration, security and automation
Collaborate with data scientists, analysts, business users, and IT teams to design, implement, and deploy data services and analytics.
Use Continuous Integration/Continuous Delivery (CI/CD) concepts to engineer a standardized data environment
Recommend and advise on optimal data models for data ingestion, integration, and visualization
Integrate data from a variety of data source types

Qualifications for the Data Engineer include:

6 years of experience in data engineering
Experience with Snowflake, Databricks, Spark SQL, PySpark
Expertise with Python
3+ years cloud experience: Azure, AWS, or GCP
Bachelors or Masters Degree in relevant field of study preferred

Compensation for the Data Engineer include:


Salary:
$135,000-145,000

Comprehensive Benefits Package:
Cigna Medical, Cigna Dental, Vision, 401K w/ADP
Pension, Annual Bonus

Keywords; Python, Azure, Data Factory, SSRS, SSIS, SQL Server, SQL, Scala, CICD, CI-CD, DevOps, Mapping, Scientist

#pando

PandoLogic


Keywords:

Data Engineer, Location:
Washington, DC

#J-18808-Ljbffr