DataBricks Technical Lead@Louisville - Diverse Lynx

    Diverse Lynx
    Diverse Lynx Louisville, United States

    3 weeks ago

    Default job background
    Description
    Role : DataBricks Technical Lead
    Location : Louisville ,Kentucky (Day 1 onsite)
    Num of Positions : 1

    Required SKills :

    Must Have/Mandatory Skills:
    • Minimum 9+ years of experience in the IT/Technology and having atleast 3+ years of experience in Azure Databricks
    • Hands on experience in development of Azure cloud DWH & datalakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD.
    • Strong programming skills in Pyspark, Python, writing complex queries in Postgresql, T-SQL
    • 6+ years of experience in coding complex U-SQL, Spark (Scala or Python). T-SQL, postgresql
    • Should have experience in Azure Storages like ADLS Gen2, Azure Postgresql
    • Design and develop automation to support continuous delivery and continuous integration process when it comes to cloud infrastructure.
    • Work closely with the Development and Operations teams to build and maintain CI/CD pipelines to support automated deployment of infrastructure (DevOps) and Infrastructure as Code (IaC) using Terraform and Enterprise Github
    • Understanding of Azure Database technologies (both IaaS and PaaS) and options to support the migration process. This will include and not limited to Azure database migration technologies and refactoring options.
    • Build effective monitoring, logging and auditing of production systems to ensure compliance with mandated compliance policies (e.g., HIPAA).
    • Must have experience in Azure Kubernetos.
    Good to have :
    • Event hub, Data streaming
    • Data Encryption
    • Knowledge of SQL Server, Oracle etc. other databases is a plus.
    • Azure Certifications are plus
    Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.