Data Engineer - Houston, United States - Tek Ninjas consulting services

Description

Strong problem-solving skills with an ability to isolate deconstruct and resolve complex data/engineering challenges · Experience in building highly available distributed systems of data extraction ingestion and processing of large data sets.

Experience developing Big Data/Hadoop applications using Spark PySpark Hive Oozie Kafka Hbase. Experience with the Azure storage technologies (Azure Data Lake Azure SQL Data Warehouse Azure SQL Database). Experience with Azure data movement and transformation capabilities (Azure Data Factory Data Lake Analytics Databricks Stream Analytics Azure Functions). Experience in designing NoSQL tables for various use cases using MongoDB/Cassandra/Hbase. Experience in building real-time event processing applications using Kafka Streams and Spark Streaming. Coding proficiency in programming languages Java Scala Python Shell scripting. Familiar with version control and best practices around CI/CD and Docker.