Azure Lead Data Engineer - Alpharetta, United States - Xadel IT Inc

Description

Key Responsibilities:

8 to 10 Years of Max experience
Design, implement, and manage data solutions within the Azure cloud environment.
Develop/analyse/optimize Power Query scripts for efficient data extraction, transformation, and loading (ETL) processes.
Design and implement robust Azure SQL databases to support diverse data needs.
Ensure data integrity, security, and optimal performance within Azure SQL.
Implement & execute SQL optimizations to enhance database performance and query efficiency. - Must Have
Must have a detailed understanding of data warehousing techniques and implementation guidelines.
Analyse/Architect/Implement data pipelines using Azure Data Factory for seamless data orchestration and movement.
Design and maintain Azure Analysis Services models for efficient data analysis and reporting.
Utilize Databricks with a focus on PySpark for big data processing and analytics.
Develop and optimize PySpark scripts for large-scale data transformations and analytics.
Proven experience of using Unity Catalog and other governance techniques.
Develop PowerBI reports based on the requirements, along with DAX optimizations
Implement optimizations for Power BI reports to ensure efficient and responsive data visualization.


Qualifications:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Proven experience as a Lead or Senior Data Engineer.
In-depth expertise in Azure cloud infrastructure and services.
Strong proficiency in Power Query for ETL processes.
Extensive knowledge of Azure SQL, SQL optimizations, and database administration.
Hands-on experience with Azure Data Factory for data pipeline development.
Proficiency in Azure Analysis Services and Databricks with a focus on PySpark.
Strong experience with Power BI for data visualization and reporting.
Strong problem-solving and analytical skills.
Excellent communication and collaboration abilities.


Preferred Skills:
Certification in Azure Data Engineering or related field.
Familiarity with data governance and security best practices.
Experience in implementing and maintaining data lakes on Azure.

This is a remote position.
#J-18808-Ljbffr