- Configure, deploy and maintain Databricks clusters and workspaces.
- Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources. Ensure consistency and repeatability by treating infrastructure as code
- Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Manage platform feature and software releases and updates.
- Provide technical support to Databricks users, including troubleshooting and issue resolution.
- Conduct training sessions to educate users on platform best practices and capabilities.
- Optimize cluster configurations for performance and cost-effectiveness.
- Monitor and manage auto-scaling to ensure resources are allocated efficiently.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Stay up-to-date with security best practices and compliance requirements.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
- Monitor and manage platform costs, including optimizing resource utilization to control expenses.
- Maintain detailed documentation of configurations, procedures, and best practices.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions
- Bachelor's degree in a relevant field (computer science, data engineering, etc.)
- 7+ years of related professional experience.
- 3 years' experience with Databricks Lakehouse Platform Architecture on AWS
- Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps
- Proficiency in AWS cloud platforms
- Experience in Utility and Energy related business is a plus.
-
Blink Technology Partners Minneapolis, United StatesPosition : AWS Databricks Administrator /Engineer · Location : Onsite (Minneapolis, MN or Denver CO) · Duration : 6 Months+ Contract to hire · Mode of Interview : Telephonic/Video · Job Description: Need at least 10+ years of experience. · Minimum Qualifications: · Bachelor's de ...
-
Database Administrator
1 week ago
Insight Global Minneapolis, United StatesInsight Global is seeking a Sr. Databricks Platform Administrator local to MN, CO, TX or WI to join the Unified Data Platform team at one of our largest Utility Clients. This individual will be the key participant and contributor to the Databricks center of Excellence for Data Pl ...
-
VP, Data Analytics
3 days ago
Player's Minneapolis, United StatesJob Description · Job Description Salary: · VP, Data Analytics & Automation · About Players Health · At Players Health, we are on a mission to create the safest and most accessible environment for an athlete to play the sports that they love. This is not only our mission, but a ...
-
VP, Data Analytics
3 days ago
Player's Minneapolis, United StatesJob Description · Job Description Salary: · VP, Data Analytics & Automation · About Players Health · At Players Health, we are on a mission to create the safest and most accessible environment for an athlete to play the sports that they love. This is not only our mission, but ...
-
Data warehouse Architect
3 weeks ago
Select Source International Minneapolis, United StatesJob Title: Data Warehouse Architect · Location: 1800 Larimer Street Denver Colorado 80202 / Minneapolis, MN (3 days onsite 2 days remote) · Duration: CTH , initially 3 Months contract (will convert Full time after 3 months) · As a Databricks Platform Engineer, your role involves ...
-
Data Warehouse Architect
3 weeks ago
Genesis10 Minneapolis, United StatesGenesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks pla ...
-
Data Warehouse Architect
3 weeks ago
Genesis10 Minneapolis, United StatesGenesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. · Job Description: · As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks ...
-
Data Engineer
6 days ago
Eateam Minneapolis, United States· Mandatory Skills - Azure Cloud, Databricks(pyspark), ADF, ADLS, GIT, DWH · Job Details: · Design, implement, and manage Azure cloud solutions for various projects. · " Develop and maintain data pipelines using Databricks (PySpark) for data ingestion, processing, and analysis ...
-
Sr Data Quality Engineer
3 weeks ago
Veradigm Minneapolis, United StatesWelcome to Veradigm Our Mission is to be the most trusted provider of innovative solutions that empower all stakeholders across the healthcare continuum to deliver world-class outcomes. Our Vision is a Connected Community of Health that spans continents and borders. With the larg ...
-
Data Warehouse Architect
3 weeks ago
Genesis10 Minneapolis, United States Temporary, Full timeGenesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. · Job Description: · As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks ...
-
Data Engineer
3 weeks ago
Marvel Technologies Inc Minneapolis, United StatesJob Description · Job DescriptionLocation: Minneapolis, MN (Hybrid Role) · Rate: Open - best possible rate · Duration: Long Term. · Start Date: · Core skills required · Azure Cloud · Azure Data Factory · Databricks · Azure SQL · Python or same/similar scripting for automation · ...
-
VP, Data Analytics
1 week ago
Players Health Minneapolis, United StatesJob Description · Job DescriptionSalary: · VP, Data Analytics & Automation · About Players Health · At Players Health, we are on a mission to create the safest and most accessible environment for an athlete to play the sports that they love. This is not only our mission, but al ...
-
Sr. Cloud Architect
3 days ago
Fingerhut Eden Prairie, United StatesAt Fingerhut, you will enter a culture that encourages team members to be bold and courageous. A culture that is zealous in pursuit of our mission to help our customers live a better financial life. In this culture, our team members find opportunities to stretch themselves, have ...
-
EpicHealth Informatics Analyst
3 weeks ago
HealthPartners Richfield, United StatesHealthPartners is currently hiring for an Epic Health Informatics Analyst. The analyst is responsible for driving the adoption and use of data and analytic services and products to positively impact the health, costs, and experiences, or our patients and members. It works within ...
-
EpicHealth Informatics Analyst
5 days ago
HealthPartners Richfield, United States Regular, Full timeHealthPartners is currently hiring for an Epic Health Informatics Analyst. The analyst is responsible for driving the adoption and use of data and analytic services and products to positively impact the health, costs, and experiences, or our patients and members. It works within ...
-
Data Governance Platform Administrator
1 week ago
Affinity Plus Federal Credit Union St. Paul, United States Regular, Full time· Position Overview: · The Data Governance Platform Administrator is part of the Enterprise Digital Intelligence (Edi) team and is responsible for administrating Data Governance Platform and on-going adoption of our data governance framework. This role plays a crucial role in en ...
-
Analytics Architect
2 weeks ago
Metropolitan Council St. Paul, United States Regular, Full time· WHO WE ARE · We are the Metropolitan Council, the regional government for the seven-county Twin Cities metropolitan area. We plan 30 years ahead for the future of the metropolitan area and provide regional transportation, wastewater, and housing services. More information abou ...
-
Data Analyst
3 weeks ago
Rose International Wayzata, United StatesDate Posted: 04/04/2024 Hiring Organization: Rose International Position Number: Job Title: Data Analyst Job Location: Wayzata, MN, USA, 55391 Work Model: Hybrid Shift: 8:00-5:00 PM CST Employment Type: Temp to Hire Estimated Duration (In months): 6 Min Hourly Rate($): 45.00 Max ...
-
Data Governance Analyst III x 2
3 weeks ago
C4 Technical Services Wayzata, United StatesData Analyst III · Location:Wayzata, MN (Hybrid - 2 to 3 Days Onsite) · Job Description: · This company's Data Function is transforming their data platform and analytics foundation through the implementation of new data architecture, process, and standards. We are looking for a ...
AWS Databricks Administrator - Minneapolis, United States - Ender-IT
Description
AWS Databricks Administrator /Engineer
Location: Minneapolis, MN
Duration: 3 Months+ Contract to hire
No sponsorship available
AWS Databricks Administrator /Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWSDatabricks platform . You'll handle administration, configuration, and optimization to support data analytics, machine learning, and data engineering activities. Collaborating with data engineers, data scientists, and stakeholders, you'll ensure the platform aligns with requirements while maintaining security and performance standards.
Job Description:
Minimum Qualifications: