- Technical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and PaaS)
- Azure Storages like ADLS Gen2, Azure Postgresql .
- CI/CD, Enterprise Github ,
- Azure Kubernetos
- Minimum 9+ years of experience in the IT/Technology and having atleast 3+ years of experience in Azure Databricks
- Hands on experience in development of Azure cloud DWH & datalakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD.
- Strong programming skills in Pyspark, Python, writing complex queries in Postgresql, T-SQL
- 6+ years of experience in coding complex U-SQL, Spark (Scala or Python). T-SQL, postgresql
- Should have experience in Azure Storages like ADLS Gen2, Azure Postgresql
- Design and develop automation to support continuous delivery and continuous integration process when it comes to cloud infrastructure.
- Work closely with the Development and Operations teams to build and maintain CI/CD pipelines to support automated deployment of infrastructure (DevOps) and Infrastructure as Code (IaC) using Terraform and Enterprise Github
- Understanding of Azure Database technologies (both IaaS and PaaS) and options to support the migration process. This will include and not limited to Azure database migration technologies and refactoring options.
- Build effective monitoring, logging and auditing of production systems to ensure compliance with mandated compliance policies (e.g., HIPAA).
- Must have experience in Azure Kubernetes.
- Event hub, Data streaming
- Data Encryption
- Knowledge of SQL Server, Oracle etc. other databases is a plus.
- Azure Certifications are plus
-
Technical Lead Databricks consultant
2 weeks ago
Diverse Lynx Louisville, United StatesTitleTechnical Lead Databricks consultant (Day 1 onsite )Duration6-9 month LocationLouisville, Kentucky (Day 1 onsite ).Mandatory SkillsTechnical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and Paa ...
-
Technical Lead Databricks Consultant
16 hours ago
Diverse Lynx Louisville, United StatesJC/Req ID · Title · Technical Lead Databricks consultant (Day 1 onsite ) · Duration · 6-9 month · Location · Louisville, Kentucky (Day 1 onsite ). · Mandatory Skills · Technical Lead DataBricks - Data Engineering , · U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azu ...
Technical Lead Databricks Consultant - Louisville, United States - Diverse Lynx
Description
JC/Req ID Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory SkillsJob Description :
Required Skills :
Must Have/Mandatory Skills: