- Configure, deploy and maintain Databricks clusters and workspaces
- Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources
- Ensure consistency and repeatability by treating infrastructure as code
- Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance
- Implement and manage access controls and security policies to protect sensitive data
- Manage platform feature and software releases and updates
- Provide technical support to Databricks users, including troubleshooting and issue resolution
- Conduct training sessions to educate users on platform best practices and capabilities
- Optimize cluster configurations for performance and cost-effectiveness
- Monitor and manage auto-scaling to ensure resources are allocated efficiently
- Implement and enforce security policies, access controls, and encryption mechanisms
- Stay up-to-date with security best practices and compliance requirements
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes
- Monitor and manage platform costs, including optimizing resource utilization to control expenses
- Maintain detailed documentation of configurations, procedures, and best practices
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions
- 7+ Years of related professional experience.
- 3 Years' experience with Databricks Lakehouse Platform Architecture on AWS.
- Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps, Databricks Bundles.
- Proficiency in AWS cloud platforms.
- Experience in Utility and Energy related business is a plus.
- We offer our contractors medical, dental, vision, and direct primary care benefits, and contribute towards each contractor's monthly health insurance premium.
- Contractors are also eligible to participate in our 401(k) plan after six months of employment. Our 401(k) plan is matched up to 4% and has 100% vesting immediately.
Databricks Platform Administrator - Denver, United States - The Ash Group
Description
Databricks Platform Administrator
***No C2C or 3rd party candidates***
***Must be able to work W2 without sponsorship***
Pay Rate: 81/Hr W2
Workplace Type: Hybrid
Location: Minneapolis, MN
Employment Type: Contract-to-Hire
Duration: 3-Months
This will be working on building out a new analytics platform for insight to data. The overarching program is a unified platform leveraging cutting-edge technology with AI.
Responsibilities for Databricks Platform Administrator:
Qualifications for Databricks Platform Administrator:
What We Offer:
About The Ash Group:
It's about the right opportunities.
Think success, flexibility, fast track. It can happen when you work with a firm that understands your strengths, goals and the kind of position that meshes perfectly with them. We minimize your search time and maximize the quality of your work experience.
Think integrity, professionalism, responsiveness. That's what you can expect from The Ash Group. We understand that finding the right fit for you is so much more than pattern matching your skills to a set of job requirements. That's why we take the time to listen and learn about you, your life and work styles, your goals and your interests. We put that knowledge to work along with our expertise and connections to help you achieve better work, better life.
U.S. Headquarters
600 17th Street
Suite 2800
Denver, CO 80202