SR. Data Engineer - Naples, United States - Insight Global

Description

Responsible for leading the documentation, implementation, and deployment of our well-governed data lakehouse platform. They will utilize on-premise and cloud-based resources to support business intelligence, data science, and AI practices within our organization.

This role entails close collaboration with other teams, such as application integrations and front-end analytics, to clarify specifications, provide robust solution architecture, and validate efforts.

Lead and participate in data engineering team activities, focusing on Data Operations within a cross-functional team.

Architect, deliver, manage, and maintain a modern, well-governed data platform, ensuring alignment with the architectural patterns and standards set by the team

Implement data quality checks, performance checks, robust monitoring, and optimizations to ensure accurate and efficient data retrieval from the data platform.

Utilize cloud-based and occasionally on-premises resources to support business intelligence, data science, and AI practices, following established architectural guidelines.

Collaborate closely with the most senior principal developer to ensure data solutions are in line with organizational strategies and standards.

Build and maintain data lakehouse schematics, layouts, architectures, and databases for data platforms, adhering to governance requirements and established architectural patterns.

Deploy, enforce, and advocate robust data governance strategies, ensuring data accuracy, consistency, accessibility, and security, under the guidance of the senior principal developer.

Define and implement data governance policies and frameworks, in consultation with senior technical leadership.

Collaborate with stakeholders to assess, document, and address data-related risks and issues, ensuring alignment with established technical standards.

Mentor team members on data governance importance and best practices, emphasizing adherence to established architectural designs.

Foster a data-driven culture that respects data governance principles and adheres to the technical direction set by senior technical leadership.

Bachelor's degree required.

5 + years of relevant work experience required.

Experience with Azure and/or Databricks lakehouse architecture and Cloud ecosystems.

Proficiency in Python, SQL, and Spark

Deep understanding of ETL, ELT, data ingestion/cleansing, and data engineering skills.

Experience with BI Tools, preferably Power BI, within the framework of established technical standards.

Knowledge of dimensional modeling and data warehousing techniques.

Proven experience in implementing, maintaining, and enforcing data governance frameworks and processes.

Knowledge of data privacy regulations and compliance requirements.

Ability to articulate the importance of data governance to stakeholders and to drive adoption of data governance principles.

Experience working with data governance tools and technologies.

Experience working with Azure DevOps and a solid understanding of Agile-like methods of delivery.

Strong interpersonal and communication skills, creative out-of-the-box thinking, and a highly accountable and dependable nature.