Senior Data Engineer - Trenton, United States - Mediterranean Shipping Company
Description
This is a fantastic opportunity to join MSC Mediterranean Shipping Company, the global leader in maritime shipping, and play a key role in supporting MSC's strategy for digitalization and business growth.
As a Senior Data Engineer you will be part of MSC's Enterprise Data Hub team, an agile and global team delivering an interconnected data platform to serve business users, products, and data science across business domains.
The successful candidate will be an expert in working with big data.SQL
Python
Spark
Databrick
Data Lake / Data warehouse / Data Lakehouse
Experience working with big data
GIT
Key Responsibilities
Building data ingestion, data transformation pipelines & ensuring they are performant/optimized.
Pipeline/process orchestration – scheduling/triggering, fault-tolerance, retry logic, monitoring/alerting.
Building data quality guarantees into the pipelines, ensures SLAs are met.
Qualifications and Experience
Required:
At least 5 years experience working as a data engineer
Experience with Databricks
Willing to be on call outside office hours a few times a year for support purposes
Preferred:
Experience in implementing medallion data model.
Ingestion from distributed event streaming platform like Kafka.
Building & maintaining data marts. Implementing "fit for purpose" data products to meet specific business needs.
MSC Mediterranean Shipping Company
is a global leader in the shipping and logistics industry.
Founded in 1970 and headquartered in Geneva, Switzerland, MSC is a privately-owned organization led by the Aponte family.
Evolving from a single-vessel operation, MSC is now a globally respected company with a fleet of 760 vessels and over 180,000 employees.
With an integrated international network of road, rail, and sea transport resources, the company prides itself on delivering global service with local knowledge.
Operating in 155 countries, MSC ensures direct communication with its representatives and offers various e-business solutions for digitalized cargo bookings.
In response to customer needs, MSC plays a significant role in driving the development of smart containers in the industry, helping to establish standards for digital shipping.
In 2019, MSC Technology Italy was established as a technological division of MSC with the goal of creating a Center of Excellence to support the MSC Group's business.
MSC Technology Italy is the first division located in the national territory, complementing existing offices in Geneva (the Group's headquarters), Warren (New Jersey, USA), and Chennai (India).
VisitFunzione lavorativa
Informatica
#J-18808-Ljbffr