- Setting up and maintaining Databricks in AWS cloud
- Automate and manage provisioning needs, such as Databricks Cluster Policies, Unity Catalog, Secrets Management, Role Based Access Control model and permissions
- Monitoring data pipelines for performance and errors.
- Tune Databricks for performance and cost utilization optimization
- Administering security access to Databricks system
- Troubleshooting user and platform related issues
- Spark tuning and addressing performance issues
- Engaging Databricks vendor support as needed
- Maintaining Infrastructure as code
- Support CICD processes including GITLAB
- Define standards and practices for data retention, backups, and business continuity use cases
- Bachelor's degree or higher in Computer Science or related field
- 5+ years of experience with AWS, including common services like S3, EC2, Airflow and Cloudwatch
- 3+ yrs of hands on experience on Databricks platform administration and Unity Catalog
- Experience maintaining infrastructure as code and IT automation tools (Terraform, Docker, Kubernetes etc)
- Strong experience with Python
- Experience with integrating other platforms like Snowflake, MySQL with Databricks
- A proven track record of administration, engineering, and operationalizing Databricks platform in a production mode at scale for Data Engineering, Data Science or MLOps use cases
- Strong communication skills to keep stakeholders and clients informed and provide excellent quality of service
- Experience with application monitoring technologies (e.g. Prometheus and Grafana)
- Strong aptitude for prototyping and learning new technologies
- HEALTH: Medical, Vision and Dental benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)
- YOURSELF: Generous paid time off policy including paid holidays, sick time and paid days off for your birthday, Free concert tickets
- WEALTH: 401(k) program with company match, Stock Program
- FAMILY: New parent programs & support including caregiver leave and childcare cash, infertility support
- CAREER: Tuition reimbursement, student loan repayment internal growth and development programs & trainings
- OTHERS: Volunteer time off, crowdfunding network
AWS Databricks Administrator - Austin, United States - Live Nation Worldwide, Inc.
Description
THE ROLE
As an AWS Databricks Administrator within this Data Services team, you will be putting your Databricks knowledge and experience to work as you collaborate with teams of Data Engineers, Infrastructure and Product Managers to build and maintain the new data infrastructure platform for all of Live Nation and Ticketmaster. Monitoring, logging, alerting , automating and metric collection to maintain the integrity of our systems will be critical to our success. The support you provide for both analytical and operational functions will aim to create the best possible experience for every one of our fans.
If you meet this description and are interested in working with others who share the same passion in a collaborative, ego-free environment, please apply today
WHAT THIS ROLE WILL DO
WHAT THIS PERSON WILL BRING
BENEFITS & PERKS
Our motto is 'Taking Care of Our Own' through 6 pillars of benefits:
Live Nation's policy regarding vaccinations and masking will evolve based upon updated regulations and factors related to COVID-19. Currently, we strongly encourage employees to be fully vaccinated or have received a negative COVID test within [24] hours of entering an office.