Senior Data Engineer - Stamford, United States - Top Prospect Group

Description

Ready to take your expertise in Azure data engineering to the next level? Join our team as a Senior Azure Data Engineer

Direct hire- FT

$150-160K

ONSITE- one of 2 locations-Candidate choice- CT or IL

Skills: SQL, Azure, Data Bricks, Data Lake, ETL, Data Security/Compliance/Governance, Azure DevOps, Data Factory, Big Data Platforms, Microsoft Azure Data Warehouse

We are seeking a highly skilled Senior Data Engineer with expertise in Microsoft Azure and Databricks to join our dynamic team. As a key member of our data engineering department, you will be responsible for designing, implementing, and maintaining scalable data pipelines and analytical solutions on the Azure cloud platform. Your innovative solutions will empower our organization to extract actionable insights from large and complex datasets, driving informed decision-making and business growth.

Responsibilities:

• Design, develop, and deploy robust data pipelines and ETL processes using Azure Data Factory, Databricks, and other related technologies.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
• Implement data security and compliance measures to ensure the integrity and confidentiality of sensitive data.
• Perform data modeling and schema design to support analytical and reporting needs.
• Troubleshoot and resolve performance issues, bottlenecks, and other data-related issues.
• Stay current with emerging technologies and best practices in data engineering, and recommend innovative solutions to enhance efficiency and effectiveness.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred.
• Proven experience as a Data Engineer, with a focus on designing and building data pipelines and solutions on the Azure cloud platform.
• Strong proficiency in Azure services, including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake Storage.
• Proficiency in programming languages such as Python, SQL, and Scala for data manipulation and analysis.
• Experience with data modeling, schema design, and performance tuning in a large-scale data environment.
• Familiarity with DevOps practices and tools for CI/CD, version control, and automated testing.
• Excellent problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment.
• Strong communication skills with the ability to effectively articulate technical concepts to non-technical stakeholders.