Senior Azure Data Engineer/Developer - Plano, United States - Diverse Lynx

Description

Title: Senior Azure Data Engineer/Developer
Location: Plano, TX
Responsibilities:

1. Design, develop, and implement Azure-based data solutions using Databricks, ADLS Gen2, Virtual Machines, Milvus Vector DB, and Python.
2. Collaborate with cross-functional teams to gather requirements and provide recommendations on data architecture and storage solutions.
3. Develop and optimize ETL/ELT processes, data pipelines, and workflows to ensure efficient data ingestion, processing, and querying.
4. Implement and maintain data security, privacy, and compliance best practices in accordance with industry standards and company policies.
5. Develop and implement monitoring, logging, and alerting strategies for data solutions to ensure optimal performance and reliability.
6. Participate in code reviews, design discussions, and documentation efforts to ensure high-quality deliverables.
7. Stay up-to-date with the latest Azure services, tools, and best practices, and provide recommendations for continuous improvement of data solutions.
8. Mentor and guide junior team members in adopting Azure data technologies and best practices.

Must-Have Skills:

1. Strong experience in Azure data technologies, including Databricks, ADLS Gen2, and Virtual Machines.
2. Hands-on experience with Milvus Vector DB and its integration with Azure services.
3. Proficiency in Python programming with API integration.
4. Working Exp on Spark optimizations, Data frame APIs(Not limited Spark SQL)
5. Knowledge of data security, privacy, and compliance best practices in the context of Azure cloud solutions.
6. Excellent problem-solving, analytical, and communication skills.
7. A bachelor's degree in computer science, engineering, or a related field. A master's degree is a plus.

Nice-to-Have Skills:

1. Experience with other Azure services such as Azure Synapse Analytics, Azure Stream Analytics, and Azure Machine Learning.
2. Knowledge of containerization technologies, such as Docker and Kubernetes.
3. Experience in Agile/Scrum methodologies

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.