Senior Databricks Platform Engineer - Minneapolis, United States - ITR Group

    ITR Group
    ITR Group Minneapolis, United States

    2 weeks ago

    Default job background
    Description
    Senior Databricks Platform Engineer on a 3 month contract to hire basis.

    This is an opportunity to work on groundbreaking initiatives in data analytics and AI; contribute to a unified data platform that brings new insights to the organization; and gain exposure to cutting-edge technology and collaboration with a dynamic team.


    Client requirements:
    Work authorization status - US Citizen or GC holderMust be W2 hourly - no C2CLocal to Minneapolis, MN or Denver, COHybrid onsite - Tues/Wed/ThurWHAT YOU'


    LL DO:
    Lead the deployment and support of Databricks patterns within our organization.

    This role requires a seasoned professional with expertise in Databricks on AWS, Terraform, and a strong background in HighSpark, Python, and SQL.

    The ideal candidate will have experience in data lakes, data warehouses, and optimizing queries to minimize costs.

    Lead the implementation and support of Databricks patterns in collaboration with project teams.
    Utilize Terraform to deploy AWS infrastructure supporting Databricks.
    Onboard new users and projects onto the Databricks platform, ensuring adherence to security protocols and efficient data ingestion processes.
    Collaborate with data science and data engineering teams to understand data movement and optimize data workflows.
    Optimize SQL queries for performance and cost efficiency.
    Configure and deploy Databricks clusters and optimize cluster configurations.

    Collaborate with cross-functional teams to explore different options within Databricks for optimal performanceWork closely with the Databricks product owner, project managers, and database services team.


    Technology/Job Requirements:
    Proficiency in configuring and deploying Databricks clusters.
    Experience with Infrastructure as Code (IAC) using Terraform.
    Ability to optimize cluster configurations and SQL queries.
    AWS and Databricks certifications preferred.


    Qualifications:
    2-3 years of experience with Databricks, preferably on AWS.Minimum of 5 years of professional IT experience, 7+ years preferred.
    Strong leadership skills and the ability to work independently.
    Excellent communication skills and the ability to troubleshoot problems effectively.
    Willingness to take initiative and adapt to new technologies.
    Strong communication skillsSelf-management and initiative-taking abilities.
    Leadership experience is highly desirable.


    This role offers an exciting opportunity to spearhead Databricks implementation within the organization and contribute to transformative data analytics initiatives.

    If you are a dynamic professional with a passion for innovation, we encourage you to apply.
    #J-18808-Ljbffr