Lead, Data Platform Engineer - Doral, United States - Royal Caribbean Group

Royal Caribbean Group Doral, United States

2 weeks ago

Description

Position Overview

Data Analytics & AI department at RCG is looking for a highly skilled and experienced Data Platform Lead to design, build, and manage our data platform on Azure and Databricks.

The successful candidate will be responsible for managing the end-to-end data platform development process, including data ingestion, processing, storage, and analysis.

This role requires a strong technical background in data platform architecture, cloud computing, and big data technologies.

This role carries primary responsibilities as a Platform Lead / Platform Engineer and Azure Platform Admin, while also contributing to ML Ops.

Responsibilities
Design, build and configure a highly scalable and robust data platform on Azure and Databricks.
Data platform shuld have capabilities of seamless integration & extensibility of existing cloud services to any new program/project initiative.
Develop and implement data ingestion and processing pipelines using Azure services such as Azure Data Factory, Azure Stream Analytics, and Databricks
Collaborate with cross-functional teams to ensure data platform meets business requirements and industry best practices
Manage cloud infrastructure on Azure platform and maintain Azure environment to ensure maxium efficiency, scalability and security.
Develop & implement cloud automation and orchestration using tools auch as Azure resource manager, Azure DevOps etc.
Collaborate with offshore team members with development & deployment activities, per project requirements.

Required Skills

Platform Engineering:
Proficiency in Python, Scala, or SQL.
Expertise in Apache Spark, Hadoop, or Apache Kafka.
Cloud experience in Azure (preferred) or AWS.
Deployment and management of Databricks clusters.
Mastery of Azure Data Factory (ADF) for integration.
Expertise with Databricks workspace, runtime, and Databricks Connect.
Understanding of Databricks Unity Catalog.
Knowledge of Delta Live Tables and Delta Engine.
Familiarity with Delta Lake architecture.
Strong SQL skills.

Azure Platform Administration
Management of Azure Cloud Services, including VMs, Storage Accounts, and networks.
Azure Security Management for policies and access controls.
Knowledge of Azure Active Directory and network security.
Performance monitoring, resource optimization, backup, and recovery.
High Availability (HA), Disaster Recovery (DR), and failover expertise.
Azure Services/Resources cost optimization and monitoring.
Azure DevOps and CI/CD proficiency.
Configure Azure resources, native services, security, and monitoring.
Design platform architecture with Azure Cloud Services and Databricks Delta Lake.
Create and publish guidelines for Data Integration services.
Participate in platform solution architecture, including data architecture.
Implement Databricks workspace, runtime, and Databricks Connect.
Configure Kafka integration services for real-time streaming and batch processing.
Enable Databricks Unity Catalog (UC) for lineage and governance.
Design and implement ML Ops for model deployments and inference pipelines.
Configure Azure DevOps, CI/CD for seamless deployment.
Implement monitoring and logging for Azure Service Groups and system metrics.
Ensure platform security, compliance, and data privacy.

ML Ops
Proficient in Python, R, or Java for ML algorithms.
Experience with TensorFlow, PyTorch, and other ML frameworks.
Efficient code for data processing, model training, and deployment.
Cloud platform experience, preferably Azure.
Familiarity with Azure ML Services and Azure DevOps.
Strong data analytics skills for model training.

Qualifications
Bachelor's degree in Computer Science, Information Technology, or related field.
7+ years of experience in cloud infrastructure management, Azure services, and infrastructure architecture
Strong understanding of Azure services such as Virtual Machines, Virtual Networks, Storage Accounts, and App Services
Experience in monitoring and optimizing Azure infrastructure for performance and efficiency
Proven experience and expertise in the respective role's technical skillsets.
Strong problem-solving skills and ability to work collaboratively.
Excellent communication skills for effective cross-team collaboration.

If you're passionate about leveraging data for informed decisions and thrive in a dynamic, collaborative environment, we invite you to join our team.

#J-18808-Ljbffr

Senior Staff Software Engineer, Platform Ecosystem

1 week ago

Discord Doral, United States

This position is US based only. · Discord is looking for a Senior Staff Engineer to join our Platform Ecosystem team to help lead the next era of Discord's development platform. You will oversee the technical roadmap for Apps and Activities, working across APIs, SDKs, and Develo ...
A Cloud Platform Engineer is a professional who designs, builds, and maintains cloud computing platforms

3 weeks ago

FusionWorks Golden Glades, United States

At Golden Glades, our team Baynes is a perfect blend of experienced developers and fresh new colleagues, creating an all-time high that makes working here so enjoyable. As a Cloud Platform Engineer (d/m/w), you will join our cross-company team and work together with your colleagu ...
Platform Software Engineer

5 days ago

Talentrust Fort Lauderdale, United States

Job Title: Platform Software Engineer (Entry/Mid/Senior) · Company: SRT Group · Location: Sunrise, FL · SR Technologies (SRT), a BlueHalo Company ) is expanding and we're looking for a Platform Software Engineer to join our team We're headquartered in Sunrise, FL where we provid ...
Sr. DevSecOps Platform Engineer

4 days ago

iBusiness Funding Fort Lauderdale, United States

Job Description · Job DescriptionSalary: · iBusiness Funding is a technology company focused on our mission to provide working capital to small and medium-sized businesses in an efficient and transparent manner. We are committed to our four values of success: innovation, integri ...
Staff Software Engineer, Users Platform

2 weeks ago

Carewell Miami, United States

Job Description · Job DescriptionAre you a data-driven problem solver who is passionate about making a difference in the lives of others while contributing to a successful business? Join Carewell and be a part of a team that creates impactful solutions for caregivers and their un ...
Senior Platform Engineer-Product Owner

1 week ago

Raytheon Miami, FL, United States Full time

Date Posted: · Country: · United States of America Location: · CO102: 16800 E Centretech Pkwy,Aurora 16800 East Centretech Pkwy Building S75, Aurora, CO, 80011 USA Position Role Type: · Onsite Position Title: Senior Platform Engineer – Product Owner · At Raytheon, the f ...
Staff Software Engineer, Fulfillment Platform

2 weeks ago

Carewell Miami, United States

Job Description · Job DescriptionAre you a data-driven problem solver who is passionate about making a difference in the lives of others while contributing to a successful business? Join Carewell and be a part of a team that creates impactful solutions for caregivers and their un ...
Lead Software Development Engineer, Developer Platform Team

3 weeks ago

New Relic, Inc. Miami, United States

Lead Software Development Engineer, Developer Platform Team - Golang (Remote) Lead Software Development Engineer, Developer Platform Team - Golang (Remote) Lead Software Engineer Req ID FY|R&D|#5 Location(s) Atlanta, Georgia, USA; Baltimore, Maryland, USA; Charleston, South Caro ...
Senior Platform Engineer

3 weeks ago

Marsh McLennan Agency Fort Lauderdale, United States

Our not-so-secret sauce.Award-winning, inclusive, Top Workplace culture doesn't happen overnight. It's a result of hard work by extraordinary people. More than 10,000 of the industry's brightest talent drive our efforts to deliver purposeful work and meaningful impact every day. ...
Software Engineer, Platform Systems SDV/FNV

2 weeks ago

Ford Motor Company Fort Lauderdale, United States

At Ford Motor Company, we believe freedom of movement drives human progress. We also believe in providing you with the freedom to define and realize your dreams. With our incredible plans for the future of mobility, we have a wide variety of opportunities for you to accelerate yo ...
Site Reliability Engineering Manager

1 week ago

Cybernetic Search Doral, United States

A global hospitality franchise is recruiting leadership for their SRE team. This well-known brand has a nationally distributed team to support a value-driven and high-quality experience to various market segments. They are a leader in safety, regulatory compliance, and environmen ...
System Engineer Sr. Advisor

1 week ago

General Dynamics Information Technology Doral, United States

Job Description Summary: · Transform technology into opportunity as a System Engineer Sr. Advisor with GDIT. A career in enterprise IT means connecting and enhancing the information systems and environments that matter most. At GDIT you'll be at the forefront of innovation and pl ...
Technical Product Support Specialist

1 week ago

NavitsPartners Doral, United States

Technical Product Support Analyst · General Characteristics: · Responsible for providing post-sales technical product support. · This includes, but is not limited to, analyzing customers' business needs and developing technical requirements, preparing technical responses to Req ...
Senior Dynatrace Engineer

2 weeks ago

Apex Systems Doral, United States Contract

Job#: · Job Description: · Apex Systems, a World-Class Technology Solutions Provider, is seeking applicants for the below position on behalf of our client. Please apply if interested and qualified. Please note that only qualified candidates will be contacted. · Position: Dyn ...
Microsoft Dynamics Developer

1 week ago

Independent Purchasing Cooperative Doral, United States

We are seeking a highly skilled and experienced Dynamics 365 CRM Functional Analyst and Developer to join our team. In this role, you will be responsible for designing, developing, customizing, and implementing Dynamics 365 solutions for our clients. You will also serve as a tech ...
Marketing Specialist

1 week ago

GENERAL POWER LIMITED Doral, United States

Base Salary Range: $53, $59,280.00 · Performance Bonus: Up to $ 4,000.00 · Employee Appreciation Bonus: Up to $3,000.00 · Total Compensation Package: Up to $ 66,280.00 · Who WE Are · GENERAL POWER is a Miami, Florida-based OEM, master distributor and authorized dealer specializin ...
Enterprise Cloud Solutions Architect

4 days ago

Government Tactical Solutions, LLC Doral, United States

Job Description · The Enterprise Cloud Solutions Architect will help design and develop architecture strategies for the SOUTHCOM customer's Cloud Adoption, Migration & Operationalization efforts as part of it's overall cybersecurity & IT modernization program (SCITES). The Cloud ...
Senior Construction Inspector

4 days ago

Ardurra Doral, United States Full time

Primary Function · Ideal candidates will have previous experience in site infrastructure projects, observing contractor's construction activities, and reviewing work for compliance with drawings and specifications. · Primary Duties · Positon will report to the Miami Dade Water ...
Sr Software Engineering Manager

2 weeks ago

Apex Systems Doral, United States Full time

Job#: · Job Description: · Apex Systems, a World-Class Technology Solutions Provider, is seeking applicants for the below position on behalf of our client. Please apply if interested and qualified. Please note that only qualified candidates will be contacted. · Position: Sr ...
Enterprise Cloud Solutions Architect

2 weeks ago

GDIT Doral, United States Full time

Job Description: · Job Description · The Enterprise Cloud Solutions Architect will help design and develop architecture strategies for the SOUTHCOM customer's Cloud Adoption, Migration & Operationalization efforts as part of it's overall cybersecurity & IT modernization program ( ...