Data Engineer - Texas City, United States - Apollose

Description

Responsiblities Developing and maintaining scalable reusable data pipelines for both streaming and batch requirements to support continuing increases in data volume and complexity for user accesses via dashboard report self-service data platform to structured and unstructured data.

Data processing & QC checks across multiple layers of data warehouses combination of multiple internal and external data sets. Onboarding consolidating cleansing and structuring data for efficient use in reports analytical applications and machine learning models. Performing data analysis and reconciliation on datasets of varying sizes and complexities. Seeking ways to reduce business as usual application related costs and increase efficiencies of data operations. Guiding and mentoring team made up of data engineers and associate data engineers.
Key Skills SQL Skills. Data Modeling Techniques. Python Skills. Hadoop for Big Data Skills. AWS Cloud Services Skills.