Databricks Engineer - United States - The Computer Merchant

    The Computer Merchant
    The Computer Merchant United States

    1 week ago

    Description

    JOB TITLE:

    DATABRICKS ENGINEER

    JOB LOCATION:
    WASHINGTON, DC (REMOTE)

    WAGE RANGE*:

    PER HOUR

    JOB NUMBER:

    SAIJP

    REQUIRED EXPERIENCE:

    • BS degree in Computer Science or related field and 3+ years or Master's degree with 2+ years of experience
    • 3+ years of experience developing and designing Ingestion flows (structured, streaming, and unstructured data) using cloud platform services with data quality
    • Databricks Data Engineer certification and 2+ years of experience maintaining Databricks platform and development in Spark
    • Ability to work directly with clients and act as front line support for requests coming in from clients. Clearly document and express the solution in form of architecture and interface diagrams.
    • Proficient at Python, Spark and R are essential. .NET based development is a plus.
    • Knowledge and experience with data governance, including metadata management, enterprise data catalog, design standards, data quality governance, and data security.
    • Experience with Agile process methodology, CI/CD automation, and cloudbased developments (Azure, AWS).
    • Not required, but additional education, certifications, and/or experience are a plus: Certifications in Azure cloud, Knowledge of FinOps principles and cost management to be considered US Citizen to be considered

    JOB DESCRIPTION
    Databricks Data Engineer to develop/support new/existing data pipelines, and data analytics environments in Azure cloud-based data lake.

    As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics platform.

    You will support continued maintenance of ETL operations and development of new pipelines ensuring data quality and data management.

    The ideal candidate will bring deep expertise in Databricks, a solid foundation in advanced AI technologies, and applies critical thinking to create innovative functions and solve technical issues by cross-functional team collaboration.

    Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture.

    • Manage ingestion routines for processing multiterabyte datasets efficiently for multiple projects simultaneously, where each project may have multiple Databricks workspaces.
    • Integrate data from various structured and unstructured sources to enable highquality business insights. Proficiency in data analysis techniques for deriving insights from large datasets.
    • Implement effective data management strategies to ensure data integrity, availability, and accessibility. Identify opportunities for cost optimization in data storage, processing, and analytics operations.
    • Monitor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management.
    • Collaborate with the team to enable advanced AIdriven analytics and data science workflows.
    • Integrate with various Azure services including Azure Functions, Storage Services, Data Factory, Log Analytics, and User Management for seamless data workflows.
    • Experience with the above Azure services is a plus.
    Equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities

    • While an hourly range is posted for this position, an eventual hourly rate is determined by a comprehensive salary analysis which considers multiple factors including but not limited to: job-related knowledge, skills and qualifications, education and experience as compared to others in the organization doing substantially similar work, if applicable, and market and business considerations. Benefits offered include medical, dental and vision benefits; dependent care flexible spending account; 401(k) plan; voluntary life/short term disability/whole life/term life/accident and critical illness coverage; employee assistance program; sick leave in accordance with regulation. Benefits may be subject to generally applicable eligibility, waiting period, contribution, and other requirements and conditions. Benefits offered are in accordance with applicable federal, state, and local laws and subject to change at TCM's discretion.

  • Only for registered members United States

    We are seeking an experienced Platform Engineer to help drive our enterprise data modernization strategy. · Architect, implement and optimize Azure Databricks environment. · ...

  • Only for registered members United States

    Job Summary · We are seeking a Data Engineer- AWS and Databricks to join our team.ResponsibilitiesAssess current data access policies, security protocols, and data classification procedures. · Create detailed design of data access control mechanisms within Databricks using approp ...

  • Only for registered members United States Remote job

    Job summaryWe are seeking a forward-thinking Senior Azure Databricks Engineer to lead the design, build, and operation of our data lakehouse that powers analytics and reporting across PNNL Enterprise Systems. · You will be the technical heartbeat of our lakehouse as part of a dat ...

  • Only for registered members United States

    We empower every employee to build AI fluency and actively engage with AI tools to drive innovation and efficiency. · ...

  • Only for registered members United States

    We're a quickly growing global digital consulting leader transforming the world's largest enterprises biggest brands You'll work with latest technologies expand your skills become part of our global community of talented diverse knowledgeable colleagues. · Perficient currently ha ...

  • Only for registered members United States

    Perficient is a global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the world's most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. · ...

  • Only for registered members United States Full time $192,100 - $264,100 (USD)

    The Databricks Field Engineering team activates and accelerates the value our customers get from their data and AI. Major Enterprises in AMER are leveraging the Databricks Data Intelligence Platform to securely deliver AI's potential to every audience, at scale. Our Field Enginee ...

  • Only for registered members United States Remote job

    This role is best suited for senior engineers with deep recent ingestion experience particularly in healthcare or other regulated data environments who have built and operated production-grade Databricks pipelines. · Design and build reliable scalable ingestion pipelines on Datab ...

  • Only for registered members United States

    We are looking for a Senior Technical Marketing Engineer to help developers and data teams design build and operate applications using Lakebase and Databricks Apps. · ...

  • Only for registered members United States

    As a Sr. Solutions Architect at Databricks within the Field Engineering org,you will partner with our customers to design scalable data architectures using Databricks technology and services. · ...

  • Only for registered members United States

    As part of the Security Detection team at Databricks, you will play a critical role in safeguarding our products, cloud infrastructure, endpoints and employees from modern cyber threats. · ...

  • Data Engineer

    1 day ago

    Only for registered members United States Full time

    We are looking for an experienced Data Engineer to join our data team at MediaRadar. · In this role you will build and maintain scalable high-performance data solutions using Azure Databricks Apache Spark AKS Airflow Postgres and modern data lakehouse architectures. · ...

  • Only for registered members United States

    The Databricks Field Engineering team activates and accelerates the value our customers get from their data and AI. · 3+ years of experience building and leading technical pre-sales teams - hiring, onboarding, coaching, and enabling pre-sales professionals · ...

  • Only for registered members United States Full time $113,400 - $195,050 (USD)

    At Databricks our core principles are at the heart of everything we do creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. · We aim to inspire our customers to make ...

  • AI GTM Leader

    2 days ago

    Only for registered members United States

    We're seeking a proven AI Go-To-Market (GTM) Leader to define · build and scale Databricks' global GTM strategy for AI solutions. · This leader will work with customers design and operationalize repeatable field-ready AI programs that accelerate adoption enable sales execution an ...

  • Only for registered members United States

    The Director of Databricks Sales will lead Impetus's go-to-market strategy, business development, and strategic partnerships centered on Databricks. · ...

  • Only for registered members United States

    As a Principal Event Marketing Operations Manager at Databricks, you'll collaborate with the corporate event marketing team and partners to drive and support the strategy and execution of our flagship Data + AI Summit Operations. · ...

  • Only for registered members United States

    We are seeking a highly skilled Senior Azure Data Engineer with expertise in Databricks and PySpark to join our dynamic team. · Design, develop, and optimize data pipelines and workflows using Azure Data Factory, Azure Databricks, and PySpark. · Build and maintain scalable robust ...

  • Only for registered members United States

    The Delivery Solutions Architect will collaborate with sales and field engineering teams to accelerate the adoption and growth of the Databricks platform in customers.This is a hybrid technical and commercial role that requires driving growth in assigned customers and use cases t ...

  • Only for registered members United States

    This role can be remote. At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journe ...

  • Only for registered members United States

    We are seeking a Data Engineer with hands-on experience in Databricks and modern data engineering practices.This role will focus on designing, developing, and maintaining data pipelines ensuring data quality enabling advanced analytics across the enterprise The ideal candidate wi ...

Jobs
>
Databricks engineer