- Data Pipeline Development:
- Build and maintain scalable ETL/ELT pipelines using Databricks.
- Leverage PySpark/Spark and SQL to transform and process large datasets.
- Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
- Collaboration & Analysis:
- Work Closely with multiple teams to prepare data for dashboard and BI Tools.
- Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.
- Performance & Optimization:
- Optimize Databricks workloads for cost efficiency and performance.
- Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
- Governance & Security:
- Implement and manage data security, access controls and governance standards using Unity Catalog.
- Ensure compliance with organizational and regulatory data policies.
- Deployment:
- Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.
- Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.
- Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
- Proficiency in Azure Cloud Services.
- Solid Understanding of Spark and PySpark for big data processing.
- Experience in relational databases.
- Knowledge on Databricks Asset Bundles and GitLab.
- Familiarity with Databricks Runtimes and advanced configurations.
- Knowledge of streaming frameworks like Spark Streaming.
- Experience in developing real-time data solutions.
- zure Data Engineer Associate or Databricks certified Data Engineer Associate certification. (Optional)
-
About the Opportunity · Are you passionate about enabling advanced analytics, data science, and AI? Do you thrive at the intersection of cloud engineering and transformative business initiatives? If so, the Data Platform Engineering team is seeking an experienced Databricks Platf ...
United States $90,000 - $114,000 (USD) per year22 hours ago
-
· Tiger Analytics is an advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Various market ...
United States3 days ago
-
Description · Perficient is a global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the world's most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of ...
United States3 days ago
-
Job summaryWe are seeking a forward-thinking Senior Azure Databricks Engineer to lead the design, build, and operation of our data lakehouse that powers analytics and reporting across PNNL Enterprise Systems. · You will be the technical heartbeat of our lakehouse as part of a dat ...
United States2 weeks ago
-
· Responsibilities · Peraton is seeking a skilled and experienced Senior Databricks Data Engineer / Architect to support high-impact and on-going modernization, data and cloud initiatives. In this role, you will design and build scalable Databricks Lakehouse solutions, lead comp ...
United States Part time3 hours ago
- Work in company
Lead Infrastructure Databricks Engineer with Kubernetes and AWS
Only for registered members
We're a quickly growing global digital consulting leader transforming the world's largest enterprises biggest brands You'll work with latest technologies expand your skills become part of our global community of talented diverse knowledgeable colleagues. · Perficient currently ha ...
United States2 weeks ago
- Work in company
Lead Infrastructure Databricks Engineer with Kubernetes and AWS
Only for registered members
Description · Perficient is a global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the world's most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of ...
United States3 days ago
-
The Databricks Field Engineering team activates and accelerates the value our customers get from their data and AI. Major Enterprises in AMER are leveraging the Databricks Data Intelligence Platform to securely deliver AI's potential to every audience, at scale. Our Field Enginee ...
United States $192,100 - $264,100 (USD) Full time2 weeks ago
- Work in company
Security Assurance Engineer with Project Management Duties
Only for registered members
P-1528 · As a Senior Security Assurance Engineer within the Security Risk Management and Special Projects team, you will lead high-visibility security compliance and risk management initiatives. Reporting directly to the Director, you will serve as a strategic catalyst for these ...
United States Full time5 days ago
-
The Solutions Architect (Lakebase) team executes on Databricks' strategic Product Operating Model that provides enhanced focus on earlier stage, highly prioritized product lines in order to establish product market fit, and set the course for rapid revenue growth. · The Solutions ...
United States $264,000 - $363,000 (USD) Full time1 week ago
-
CSQ127R328 · Senior Manager Learning Platforms · Mission · As Senior Manager Learning Platforms at Databricks, you will apply your experience and expertise in technical enablement, product management, and software engineering to oversee and architect Databricks learning platform ...
United States $166,200 - $285,800 (USD) Full time2 days ago
-
We are looking for an experienced Data Engineer to join our data team at MediaRadar. · In this role you will build and maintain scalable high-performance data solutions using Azure Databricks Apache Spark AKS Airflow Postgres and modern data lakehouse architectures. · ...
United States Full time2 weeks ago
-
FEQ227R18 · As a Sr. Solutions Engineer at Databricks within the Field Engineering org you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth and business knowledge and can drive complex technol ...
United States3 hours ago
-
We are looking for a Senior Technical Marketing Engineer to help developers and data teams design, build and operate applications using Lakebase and Databricks Apps. · ...
United States1 week ago
-
As a Sr. Solutions Architect at Databricks within the Field Engineering org, you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth and business knowledge, and can drive complex technology discu ...
United States $130,000 - $210,000 (USD) per year3 days ago
-
This role is best suited for senior engineers with deep recent ingestion experience particularly in healthcare or other regulated data environments who have built and operated production-grade Databricks pipelines. · Design and build reliable scalable ingestion pipelines on Datab ...
United States4 weeks ago
-
As part of the Security Detection team at Databricks, you will play a critical role in safeguarding our products, cloud infrastructure, endpoints, and employees from modern cyber threats. Our team combines deep expertise in machine learning, log analysis, cybersecurity, and softw ...
United States3 days ago
-
At Databricks our core principles are at the heart of everything we do creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. · We aim to inspire our customers to make ...
United States $113,400 - $195,050 (USD) Full time2 weeks ago
-
· Position Overview · is seeking a motivated Data Engineer to join our remote team in the United States. In this role, you will support the design, development, and maintenance of data solutions using Databricks, helping clients and internal teams process, transform, and analyze ...
United States $80,000 - $140,000 (USD) per year1 week ago
-
Req ID: FEQ426R315 · Location(s): Eastern US · The Databricks Field Engineering team activates and accelerates the value our customers get from their data and AI. Major Enterprises in the U.S. are leveraging the Databricks Data Intelligence Platform to securely deliver AI's pot ...
United States3 days ago
-
Description · Role: Senior Azure GenAI Engineer · Location: Mount Laurel, NJ · Duration: FTE/C2C · Primary Skills: Azure, Databricks, Pyspark, ADF, GenAI · We are seeking a highly skilled Senior Azure Data Engineer with expertise in Databricks and PySpark to join our dynamic te ...
United States1 week ago
Lead Databricks Engineer - United States - Abode Techzone LLC
Description
Role : Lead Databricks EngineerLocation : Iselin, NJ / NY (Hybrid)
zure Data Engineer with Databricks Expertise
Job Summary:
We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize large-scale data pipeline, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions.
Key Responsibilities:
-
Databricks Platform Engineer
Only for registered members United States
-
Data Engineer- AWS and Databricks
Only for registered members United States
-
Lead Databricks Data Engineer
Only for registered members United States
-
Senior Azure Databricks Engineer
Only for registered members United States
-
Part-Time Senior Databricks Data Engineer
Part time Only for registered members United States
-
Lead Infrastructure Databricks Engineer with Kubernetes and AWS
Only for registered members United States
-
Lead Infrastructure Databricks Engineer with Kubernetes and AWS
Only for registered members United States
-
Sr. Manager, Field Engineering
Full time Only for registered members United States
-
Security Assurance Engineer with Project Management Duties
Full time Only for registered members United States
-
Lead Specialist Solutions Architect
Full time Only for registered members United States
-
Senior Manager, Learning Platforms
Full time Only for registered members United States
-
Data Engineer
Full time Only for registered members United States
-
Sr. Solutions Engineer
Only for registered members United States
-
Sr. Technical Marketing Engineer
Only for registered members United States
-
Sr. Solutions Architect
Only for registered members United States
-
Senior Data Engineer
Only for registered members United States
-
Staff Security Detection Engineer
Only for registered members United States
-
Staff Project Manager
Full time Only for registered members United States
-
Data Engineer
Only for registered members United States
-
Manager, Field Engineering
Only for registered members United States
-
Gen AI Developer Specialist
Only for registered members United States