ETL developer - Tulare, United States - Velocity Solutions

Michael Johnson

Posted by:

Michael Johnson

beBee Recruiter


Description

Main Tasks

  • Design, develop, and continuously optimize the data architecture and build a data lake to support efficient data management and utilization.
  • Conceptualize and implement robust ETL and ELT processes to integrate data from various sources into a consolidated data platform and data lake.
  • Ensure high data quality and integrity in databases and data lakes by implementing standards and procedures for data validation and cleansing.
  • Collaborate closely with data scientists, analysts, and business units to transform data from the data lake into usable formats for analysis, machine learning, and BI.
  • Monitor system performance, conduct error analysis, and optimize data processing infrastructure for maximum efficiency and scalability.

Requirements

  • Completed education or degree in computer science, engineering, or a related field.
  • Practical experience working with relational and NoSQL database technologies, as well as in developing, implementing, and managing a data lake.
  • Extensive programming skills in SQL and Python.
  • Practical experience with big data technologies and platforms (e.g. Hadoop, Spark, Kafka) and cloud data solutions (e.g. AWS).
  • Strong analytical skills and the ability to solve complex technical problems and develop effective solution strategies.
  • Excellent communication skills and the ability to effectively communicate technical concepts

More jobs from Velocity Solutions