Lead Databricks Engineer - United States - Abode Techzone LLC

    Abode Techzone LLC
    Abode Techzone LLC United States

    1 day ago

    $120,000 - $150,000 (USD) per year
    Description
    Role : Lead Databricks Engineer
    Location : Iselin, NJ / NY (Hybrid)
    zure Data Engineer with Databricks Expertise
    Job Summary:
    We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize large-scale data pipeline, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions.
    Key Responsibilities:
    • Data Pipeline Development:
    • Build and maintain scalable ETL/ELT pipelines using Databricks.
    • Leverage PySpark/Spark and SQL to transform and process large datasets.
    • Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
    • Collaboration & Analysis:
    • Work Closely with multiple teams to prepare data for dashboard and BI Tools.
    • Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.
    • Performance & Optimization:
    • Optimize Databricks workloads for cost efficiency and performance.
    • Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
    • Governance & Security:
    • Implement and manage data security, access controls and governance standards using Unity Catalog.
    • Ensure compliance with organizational and regulatory data policies.
    • Deployment:
    • Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.
    • Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.
    Technical Skills:
    • Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
    • Proficiency in Azure Cloud Services.
    • Solid Understanding of Spark and PySpark for big data processing.
    • Experience in relational databases.
    • Knowledge on Databricks Asset Bundles and GitLab.
    Preferred Experience:
    • Familiarity with Databricks Runtimes and advanced configurations.
    • Knowledge of streaming frameworks like Spark Streaming.
    • Experience in developing real-time data solutions.
    Certifications:
    • zure Data Engineer Associate or Databricks certified Data Engineer Associate certification. (Optional)

  • Work in company

    Databricks Platform Engineer

    Only for registered members

    About the Opportunity · Are you passionate about enabling advanced analytics, data science, and AI? Do you thrive at the intersection of cloud engineering and transformative business initiatives? If so, the Data Platform Engineering team is seeking an experienced Databricks Platf ...

    United States $90,000 - $114,000 (USD) per year

    22 hours ago

  • Work in company

    Data Engineer- AWS and Databricks

    Only for registered members

    · Tiger Analytics is an advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Various market ...

    United States

    3 days ago

  • Work in company

    Lead Databricks Data Engineer

    Only for registered members

    Description · Perficient is a global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the world's most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of ...

    United States

    3 days ago

  • Work in company Remote job

    Senior Azure Databricks Engineer

    Only for registered members

    Job summaryWe are seeking a forward-thinking Senior Azure Databricks Engineer to lead the design, build, and operation of our data lakehouse that powers analytics and reporting across PNNL Enterprise Systems. · You will be the technical heartbeat of our lakehouse as part of a dat ...

    United States

    2 weeks ago

  • Work in company

    Part-Time Senior Databricks Data Engineer

    Only for registered members

    · Responsibilities · Peraton is seeking a skilled and experienced Senior Databricks Data Engineer / Architect to support high-impact and on-going modernization, data and cloud initiatives. In this role, you will design and build scalable Databricks Lakehouse solutions, lead comp ...

    United States Part time

    3 hours ago

  • Work in company

    Lead Infrastructure Databricks Engineer with Kubernetes and AWS

    Only for registered members

    We're a quickly growing global digital consulting leader transforming the world's largest enterprises biggest brands You'll work with latest technologies expand your skills become part of our global community of talented diverse knowledgeable colleagues. · Perficient currently ha ...

    United States

    2 weeks ago

  • Work in company

    Lead Infrastructure Databricks Engineer with Kubernetes and AWS

    Only for registered members

    Description · Perficient is a global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the world's most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of ...

    United States

    3 days ago

  • Work in company

    Sr. Manager, Field Engineering

    Only for registered members

    The Databricks Field Engineering team activates and accelerates the value our customers get from their data and AI. Major Enterprises in AMER are leveraging the Databricks Data Intelligence Platform to securely deliver AI's potential to every audience, at scale. Our Field Enginee ...

    United States $192,100 - $264,100 (USD) Full time

    2 weeks ago

  • Work in company

    Security Assurance Engineer with Project Management Duties

    Only for registered members

    P-1528 · As a Senior Security Assurance Engineer within the Security Risk Management and Special Projects team, you will lead high-visibility security compliance and risk management initiatives. Reporting directly to the Director, you will serve as a strategic catalyst for these ...

    United States Full time

    5 days ago

  • Work in company

    Lead Specialist Solutions Architect

    Only for registered members

    The Solutions Architect (Lakebase) team executes on Databricks' strategic Product Operating Model that provides enhanced focus on earlier stage, highly prioritized product lines in order to establish product market fit, and set the course for rapid revenue growth. · The Solutions ...

    United States $264,000 - $363,000 (USD) Full time

    1 week ago

  • Work in company

    Senior Manager, Learning Platforms

    Only for registered members

    CSQ127R328 · Senior Manager Learning Platforms · Mission · As Senior Manager Learning Platforms at Databricks, you will apply your experience and expertise in technical enablement, product management, and software engineering to oversee and architect Databricks learning platform ...

    United States $166,200 - $285,800 (USD) Full time

    2 days ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for an experienced Data Engineer to join our data team at MediaRadar. · In this role you will build and maintain scalable high-performance data solutions using Azure Databricks Apache Spark AKS Airflow Postgres and modern data lakehouse architectures. · ...

    United States Full time

    2 weeks ago

  • Work in company

    Sr. Solutions Engineer

    Only for registered members

    FEQ227R18 · As a Sr. Solutions Engineer at Databricks within the Field Engineering org you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth and business knowledge and can drive complex technol ...

    United States

    3 hours ago

  • Work in company

    Sr. Technical Marketing Engineer

    Only for registered members

    We are looking for a Senior Technical Marketing Engineer to help developers and data teams design, build and operate applications using Lakebase and Databricks Apps. · ...

    United States

    1 week ago

  • Work in company

    Sr. Solutions Architect

    Only for registered members

    As a Sr. Solutions Architect at Databricks within the Field Engineering org, you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth and business knowledge, and can drive complex technology discu ...

    United States $130,000 - $210,000 (USD) per year

    3 days ago

  • Work in company Remote job

    Senior Data Engineer

    Only for registered members

    This role is best suited for senior engineers with deep recent ingestion experience particularly in healthcare or other regulated data environments who have built and operated production-grade Databricks pipelines. · Design and build reliable scalable ingestion pipelines on Datab ...

    United States

    4 weeks ago

  • Work in company

    Staff Security Detection Engineer

    Only for registered members

    As part of the Security Detection team at Databricks, you will play a critical role in safeguarding our products, cloud infrastructure, endpoints, and employees from modern cyber threats. Our team combines deep expertise in machine learning, log analysis, cybersecurity, and softw ...

    United States

    3 days ago

  • Work in company

    Staff Project Manager

    Only for registered members

    At Databricks our core principles are at the heart of everything we do creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. · We aim to inspire our customers to make ...

    United States $113,400 - $195,050 (USD) Full time

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    · Position Overview · is seeking a motivated Data Engineer to join our remote team in the United States. In this role, you will support the design, development, and maintenance of data solutions using Databricks, helping clients and internal teams process, transform, and analyze ...

    United States $80,000 - $140,000 (USD) per year

    1 week ago

  • Work in company

    Manager, Field Engineering

    Only for registered members

    Req ID: FEQ426R315 · Location(s):  Eastern US · The Databricks Field Engineering team activates and accelerates the value our customers get from their data and AI.  Major Enterprises in the U.S. are leveraging the Databricks Data Intelligence Platform to securely deliver AI's pot ...

    United States

    3 days ago

  • Work in company

    Gen AI Developer Specialist

    Only for registered members

    Description · Role: Senior Azure GenAI Engineer  · Location: Mount Laurel, NJ · Duration: FTE/C2C · Primary Skills: Azure, Databricks, Pyspark, ADF, GenAI  · We are seeking a highly skilled Senior Azure Data Engineer with expertise in Databricks and PySpark to join our dynamic te ...

    United States

    1 week ago

Jobs
>
Lead databricks engineer