Databricks Architect - Denver - Nous Infosystems

    Nous Infosystems
    Nous Infosystems Denver

    1 week ago

    Description

    Role: Databricks Lead/Architect

    Location: Denver, CO – Hybrid

    Need only locals

    Job Overview


    We are seeking a highly skilled and experienced Hands‑on Databricks Architect to design, build, and optimize our modern data streaming platform.

    This platform, built on Azure and leveraging the Databricks Lakehouse, is central to our Data Availability Initiative.

    It provides comprehensive data ingestion, real‑time streaming, batch processing, analytics, and AI/ML capabilities.

    The ideal candidate will be a technical lead with deep expertise in Databricks, Azure cloud services, and a strong understanding of data architecture principles like the Medallion Architecture and Data Mesh.

    This role requires a hands‑on approach to implementing solutions, driving robust data governance through Unity Catalog, and integrating advanced AI/ML models.

    Key Responsibilities

    • Lead the architectural design, development, and implementation of scalable and robust data solutions on the Databricks Lakehouse Platform within an Azure environment.
    • Design and implement a robust multi‑workspace strategy by manually configuring and automating the deployment of Development, QA, and Production Databricks environments.
    • Standardize environment setup using Terraform, ensuring consistent, repeatable, and version‑controlled infrastructure across the entire SDLC.
    • Architect and implement data ingestion strategies for real‑time streaming (using Debezium, Apache Kafka, Confluent Platform) and batch processing, leveraging Databricks Lake Flow and Auto Loader.
    • Design and develop data pipelines following the Medallion Architecture (Lead, Bronze, Silver, Gold tiers) using Databricks Delta Live Tables (DLT) and Structured Streaming, ensuring data quality, lineage, and governance.
    • Optimize Databricks clusters, Delta Lake tables, and Spark jobs for performance, scalability, and cost efficiency, including leveraging auto‑scaling, spot instances, compression, and partitioning techniques.
    • Establish and enforce comprehensive data governance, security, and access control policies utilizing Databricks Unity Catalog and Azure Purview across multi‑tenant workspaces and business units.
    • Develop and integrate MLOps pipelines using Databricks MLflow and Azure Machine Learning for model training, serving, and monitoring, including custom Large Language Model (LLM) integrations.
    • Collaborate with business stakeholders to translate complex data requirements into technical designs and scalable solutions.
    • Implement CI/CD practices for Databricks solutions using Databricks Asset Bundles, Terraform, GitHub, and GitHub Actions, ensuring automated deployment and version control.
    • Integrate data from diverse sources including SQL databases (PostgreSQL, SQL Server), MongoDB, Snowflake, and various flat/multimedia files into the data platform.
    • Design and implement API‑first data consumption patterns, serverless functions (Azure Functions), and application integrations for various data products and real‑time services.
    • Provide technical leadership, mentorship, and best practices to data engineering and development teams.
    • Contribute to the continuous evolution of the data platform, incorporating future considerations such as the Databricks Ingestion Gateway, advanced AI integration, and Data Mesh evolution.

    Required Skills


    Databricks Lakehouse, Apache Spark, Delta Live Tables (DLT), Auto Loader, Microsoft Azure, ADLS Gen2, Azure Functions, Azure Machine Learning, Apache Kafka, Confluent Platform, Debezium (CDC), Databricks Unity Catalog, Azure Purview, Python, SQL, Scala (Advantage), Databricks Asset Bundles, Terraform, GitHub Actions, Medallion Architecture, Data Mesh, PostgreSQL, MongoDB, Snowflake, MLOps, LLM Integration, Azure Networking

    Qualifications

    • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related quantitative field.
    • 8+ years of progressive experience in data architecture, data engineering, or a related role within an enterprise environment.
    • 5+ years of hands‑on experience specifically with the Databricks Lakehouse Platform, including designing and implementing complex data solutions.
    • Proven track record of successfully designing and implementing large‑scale, high‑performance, and cost‑optimized data platforms on Microsoft Azure. Databricks Certified Data Engineer (Associate or Professional) and/or Azure Data Engineer Associate (DP‑203) certifications are highly desirable.
    • Excellent communication, presentation, and interpersonal skills with the ability to influence technical and non‑technical stakeholders effectively.

    #J-18808-Ljbffr

  • Databricks Architect

    1 month ago

    Only for registered members Denver

    + Job summary: We are seeking highly skilled Databricks Architect to design, build, and optimize our modern data streaming platform. This platform, built on Azure and leveraging the Databricks Lakehouse, is central to our Data Availability Initiative. · + Qualifications:Bachelor ...

  • Databricks Lead/Architect

    1 month ago

    Only for registered members Denver

    We are seeking highly skilled and experienced Hands-on Databricks Architect to design, · build and optimize our modern data streaming platform. · This platform built on Azure leveraging the Databricks Lakehouse is central to our Data Availability Initiative It provides comprehens ...

  • Databricks Lead/Architect

    2 weeks ago

    Only for registered members Denver

    We are seeking highly skilled and experienced Hands-on Databricks Architect to design, build, and optimize our modern data streaming platform. · This platform, built on Azure and leveraging the Databricks Lakehouse, is central to our Data Availability Initiative. It provides comp ...

  • Databricks + AI Architect

    1 month ago

    Only for registered members Denver

    + AI/ML experience + Transform legacy platform into future-ready, scalable cloud-native Databricks-based architecture + Lead architectural modernization from on-prem/legacy platform to unified Databricks Lakehouse ecosystem · + Design and implement high-performance data pipelines ...

  • Databricks Lead/Architect

    2 weeks ago

    Only for registered members Denver

    We are seeking highly skilled and experienced Hands-on Databricks Architect to design, · build, and optimize our modern data streaming platform. · Lead the architectural design, development, and implementation of scalable and · robust data solutions on the Databricks Lakehouse Pl ...

  • Azure Databricks Architect

    1 month ago

    Only for registered members Denver, CO

    We are seeking an Azure Databricks Architect to design and implement scalable data architectures using Azure Databricks. · Design and implement scalable data architectures using Azure Databricks · Build and optimize ETL/ELT pipelines using Azure Data Factory · ...

  • Databricks Architect with AI/ML

    1 month ago

    Only for registered members Denver

    We are seeking an experienced Databricks Architect with AI/ML enablement expertise to design and implement cloud-native data architectures. · Design and implement cloud-native data architectures. · Develop deep hands-on experience with Apache Spark and Delta Lake. · Pipeline inte ...

  • Azure Databricks Engineer/Architect

    3 days ago

    Only for registered members Denver

    The Azure Databricks Engineer implements and manages the operational aspects of cloud-native and hybrid data platform solutions built with Azure Databricks.Candidates for this role should understand all concepts covered in Azure Data Engineer Associate, Azure Database Administrat ...

  • Databricks Architect with AI/ML

    1 month ago

    Only for registered members Denver, CO

    Databricks Architect with AI/ML experience required · ...

  • Databricks Architect

    2 weeks ago

    Only for registered members Boulder Full time $159,100 - $238,700 (USD)

    The Databricks Architect will be responsible for technical decision-making, code quality, and the successful delivery of complex data projects using Delta Lake, Unity Catalog. · ...

  • Databricks Architect

    2 weeks ago

    Only for registered members Boulder, CO

    The Databricks Architect will be responsible for technical decision-making code quality and successful delivery of complex data projects using Delta Lake Unity Catalog and Mosaic AI. · The Databricks Architect/Lead owns end-to-end strategy for data ingestion storage and analytics ...

  • Data Architect

    3 weeks ago

    Only for registered members Denver

    We are seeking experienced Data Architect with deep expertise in data engineering and architecture for AI/ML enablement. · Transform legacy data platform into future-ready cloud-native Databricks-based architecture. · ...

  • Data Architect

    4 weeks ago

    Only for registered members Denver

    Data Architect with AI/ML and Databricks expertise required for a contract position in Denver. · Design and implement cloud-native data architectures. · Proven ability to design and implement cloud-native data architectures. · ...

  • Enterprise Data Architect

    3 weeks ago

    Only for registered members Denver

    We are seeking a seasoned data architect with deep expertise in Lakehouse architecture and building robust data platform for AI/ML/GenAI enablement to lead a critical data modernization initiative. · ...

  • Data Architect

    3 weeks ago

    Only for registered members Denver

    +12 years in data engineering or architecture with a strong focus on Databricks and AI/ML enablement. Deep hands-on experience with Apache Spark Delta Lake. Proficiency in AI/ML pipeline integration using Databricks MLflow or custom model deployment strategies. · Strong knowledge ...

  • Data Architect

    3 weeks ago

    Only for registered members Denver

    +12 years in data engineering or architecture, · Deep hands-on experience with Apache Spark, · Proficiency in AI/ML pipeline integration using Databricks MLflow or custom model deployment strategies. · Strong knowledge of Apache Airflow, Databricks Jobs, and cloud-native orchestr ...

  • Data Architect

    4 weeks ago

    Only for registered members Denver

    Azure Data Architect – Databricks & AI/ML in Denver · ...

  • Data Architect

    1 month ago

    Only for registered members Denver

    Data Architect ( AI/ML) · Deep hands-on experience with Apache Spark · Proficiency in AI/ML pipeline integration using Databricks MLflow · ...

  • Gen AI Data Architect

    4 weeks ago

    Only for registered members Denver

    Data Architect AI ML Onsite for Client based in Denver CO. · 12+ years in data engineering or architecture, with a strong focus on Databricks (at least 4-5 years) and AI/ML enablement. · ...

  • Data Architect

    2 weeks ago

    Only for registered members Denver

    Data Architect with 12+ years of experience in data engineering or architecture, focusing on Databricks and AI/ML enablement. · ...

  • Software Engineer II

    2 weeks ago

    Only for registered members Denver

    +In this role, you will design, develop and maintain both frontend and backend components of our reporting platform ensuring seamless data flow and intuitive user experiences for clients and internal teams. · ...

Jobs
>
Databricks architect
>
Jobs for Databricks architect in Denver