Data Engineer - New York, United States - QED National

Description

A leading transportation authority located in New York, NY is looking for a Data Engineer for a 3 month contract.

Please note that this position allows for consultant to work remotely with a very high expectation that consultant will be professional, reliable, reachable and able to work productively while remote. Will come onsite only as needed by their manager/team (at own expense)

Requirements and skills

• Skills and experience programming in Python and SQL – 3+ years
• Skills and experience in using data lake tools and demonstrated ability to learn new tools quickly
• Skills and experience using PowerBI
• Ability to clearly document all work (commented code, readme files, diagrams, etc.) so that work is easily transferred back to internal employees
• Excellent attention to detail and QC skills to ensure errors are found and corrected before outputs are made available
• Good verbal and written communication abilities for internal collaboration
• 4-6 years' experience: Python Scripting
• 1-2 years' experience: Adhoc SQL and Power BI

Responsibilities

• Designing data structures and writing code to collect, combine and transform datasets to meet business needs.
• Developing data lake architecture to automate data extraction and transformation of raw data to more complex and calculation-based tables.
• Documenting work in a thorough manner consistent with team standards so that it can be easily understood by teammates and future users.
• Designing and carrying out testing processes and quality controls on output data for validity, accuracy and usability by the desired audience.
• Generating data visualization outputs