Data Engineer - Montevallo, United States - RiverPoint

RiverPoint Montevallo, United States

2 weeks ago

Description

Job Description

Job DescriptionData EngineerOur client is seeking a skilled and experienced Data Engineer with expertise in the Microsoft technology stack and Pentaho integration to join our dynamic team. The ideal candidate will be passionate about data and possess strong technical skills to design, develop, and maintain data pipelines, databases, and infrastructure using Microsoft technologies while leveraging Pentaho for advanced data integration and analytics. The Data Engineer will collaborate closely with cross-functional teams to ensure efficient data flow, integrity, and accessibility across various systems and platforms.

Responsibilities:

Design and Develop Data Pipelines:

Architect, build, and optimize scalable data pipelines using Microsoft technologies such as Azure Data Factory, Azure Databricks, and SQL Server Integration Services (SSIS), integrating Pentaho components for advanced data transformations, orchestration, and scheduling.

Ingest, process, and transform structured and unstructured data from multiple sources, ensuring reliability, efficiency, and scalability.

Database Management:

Design, implement, and manage databases using Microsoft SQL Server and Azure SQL Database, integrating Pentaho for enhanced data warehouse automation, management, and optimization.

Ensure data integrity, security, and performance optimization.

Data Modeling:

Develop and maintain data models, schemas, and metadata definitions using tools like Azure Data Studio and SQL Server Management Studio, with Pentaho integration for advanced modeling and schema design capabilities to support business requirements and analytical insights.

Implement best practices for data modeling and schema design.

Data Integration:

Integrate data from various internal and external sources using Microsoft technologies such as Azure Data Factory and Azure Logic Apps, augmented with Pentaho for comprehensive data integration, cleansing, enrichment, and synchronization.

Develop connectors and interfaces to facilitate seamless data integration.

Data Transformation and ETL:
Perform data transformation, cleansing, and enrichment tasks using SQL queries, stored procedures, and SSIS packages within the Microsoft stack, with Pentaho integration for advanced ETL (Extract, Transform, Load) processes, data quality checks, and validation mechanisms to ensure accuracy and consistency

Infrastructure Management:
Manage and optimize infrastructure resources using Microsoft Azure services such as Azure Resource Manager (ARM) templates, Azure Virtual Machines, and Azure Kubernetes Service (AKS), incorporating Pentaho components for infrastructure orchestration, scalability, and monitoring

Monitoring and Troubleshooting:

Implement monitoring, logging, and alerting systems using Azure Monitor and Azure Log Analytics to track data pipeline performance within the Microsoft environment, with Pentaho integration for comprehensive monitoring and troubleshooting of Pentaho-based workflows and processes.

Develop and maintain documentation for data engineering processes and systems.

Documentation:

Develop and maintain comprehensive documentation for data engineering processes, systems, and solutions, including architectural diagrams, data flow diagrams, technical specifications, and user guides.

Document configuration details, deployment procedures, and troubleshooting steps for data pipelines, databases, and infrastructure components. Ensure documentation is up-to-date, accessible, and understandable for both technical and non-technical stakeholders. Collaborate with team members to review and refine documentation standards and templates, fostering a culture of documentation excellence.

Collaboration and Communication:

Collaborate closely with data scientists, analysts, software engineers, and stakeholders to understand data requirements, define technical solutions using Microsoft Azure services and Pentaho integration capabilities, and deliver insights-driven products and services.

Communicate effectively with both technical and non-technical stakeholders.

Qualifications:
Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

Proven experience as a Data Engineer or similar role, with a strong focus on building and optimizing data pipelines and infrastructure using the Microsoft technology stack.

Proficiency in programming languages such as SQL, Python, or C#, with experience in Microsoft Azure services and tools.

In-depth knowledge of Microsoft SQL Server, Azure SQL Database, Azure Data Factory, Azure Databricks, and SQL Server Integration Services (SSIS), with proficiency in integrating Pentaho for advanced data integration and analytics.

Experience with Pentaho Data Integration (PDI) tool for designing and executing ETL processes, data integration, and workflow orchestration.

Familiarity with big data technologies and distributed computing frameworks on the Microsoft Azure platform, coupled with Pentaho integration for comprehensive big data analytics and processing.

Strong understanding of data modeling, schema design, and data governance principles, with expertise in leveraging Pentaho for advanced data modeling capabilities.

Excellent analytical, problem-solving, and troubleshooting skills, with a keen attention to detail.
Ability to work independently and collaboratively in a fast-paced environment, with strong communication and interpersonal skills.
Experience with Agile methodologies and DevOps practices is a plus.#IND1

Data Engineer

1 week ago

PANGEATWO Birmingham, United States

Data Engineer · $120,000 - $140,000 · Birmingham, AL · We're searching for a skilled and collaborative Data Engineer to join our client's growing team In this role, you'll play a pivotal role in strengthening and expanding their Business Intelligence infrastructure – ensuring t ...
Data Engineer

5 days ago

System One Birmingham, United States

Job Title: Data Engineer - Advanced Metering Infrastructure (AMI) Analytics** · Location: Alabama Power Company Corporate Headquarters, Birmingham, AL · Job Summary: · The Data Engineer at APC Power Delivery's AMI Analytics team plays a pivotal role in advancing data-driven decis ...
Data Engineer

6 days ago

PangeaTwo Birmingham, United States

Data Engineer · $120,000 - $140,000 · Birmingham, AL · Qualifications, skills, and all relevant experience needed for this role can be found in the full description below. · We're searching for a skilled and collaborative Data Engineer to join our client's growing team In t ...
Data Engineer

3 weeks ago

United IT Solutions birmingham, United States

Only Locals to Birmingham, AL · Role: Data Engineer Location: Birmingham , AL (Onsite) Job Overview:-We are seeking a skilled Data Engineer with a strong background in Data bricks to join our IT team. · ...
Data Engineer

2 weeks ago

Renasant Hoover, United States

· Data Engineer · Job ID · Job Locations · US-AL-Hoover · Overview · The Data Engineer is responsible for assisting with end-to end data consumption, from loading the data into the data warehouse to leveraging statistical models built with that data to gather critical insights ...
Data Engineer

3 weeks ago

LanceSoft Birmingham, United States

Data Engineer · 2 days a week onsite · Location - Birmingham, AL · Primary Responsibilities · Partners with **Technology partners to Design, Build, and Maintain the data-based structures and systems in support of Data and Analytics and Data Product use cases · Builds data pipeli ...
Data Engineer

2 weeks ago

PangeaTwo Birmingham, United States

Data Engineer · $120,000 - $140,000 · Birmingham, AL · We're searching for a skilled and collaborative Data Engineer to join our client's growing team In this role, you'll play a pivotal role in strengthening and expanding their Business Intelligence infrastructure ensuring ...
Data Engineer

2 weeks ago

MAU Workforce Solutions Birmingham, United States

3Ci Solutions Team is seeking three skilled Data Engineers specializing in SQL Server and SSIS for a project with a regional banking Client. The project involves designing, developing, and maintaining data pipelines to move data between a SQL Server database hosted on Azure and a ...
Data Engineer

3 weeks ago

BlueSky Resource Solutions Birmingham, United States

Primary Purpose of the Position: · Do not pass up this chance, apply quickly if your experience and skills match what is in the following description. · The Data Engineer works closely with the Data Architect and Director of IT Integrations to stabilize, improve, and evolve our ...
Data Engineer

3 weeks ago

LanceSoft Birmingham, United States

Data Engineer · 2 days a week onsite · Location - Birmingham, AL · Primary Responsibilities · Partners with **Technology partners to Design, Build, and Maintain the data-based structures and systems in support of Data and Analytics and Data Product use cases · Builds data pip ...
Data Engineer

3 weeks ago

BlueSky Resource Solutions Birmingham, United States

Primary Purpose of the Position: · The Data Engineer works closely with the Data Architect and Director of IT Integrations to stabilize, improve, and evolve our Business Intelligence infrastructure while supporting company reporting needs. · Essential Functions / Duties: · Dat ...
Data Engineer

5 days ago

Johnson Service Group Birmingham, United States JSG Contract

Johnson Service Group (JSG) is a nationally recognized professional staffing and recruiting firm that is currently looking for a contract Data Engineer in the downtown Birmingham area. · NO CORP TO CORP · Job Title: Data Engineer - Advanced Metering Infrastructure (AMI) Analytic ...
Data Engineer

6 days ago

Johnson Service Group Birmingham, United States JSG Contract

Johnson Service Group (JSG) is a nationally recognized professional staffing and recruiting firm that is currently looking for a contract Data Engineer in the downtown Birmingham area. · Job Title: Data Engineer - Advanced Metering Infrastructure (AMI) Analytics** · Location: Bi ...
Azure Data Engineers

2 days ago

Saxon Global Homewood, United States

Next Career Move - Azure Data Engineer · What would motivate you to make a move from your current role? · Company Overview: Our client: One of the largest outpatient Medical Groups in the U.S · This company has nearly 10,000+ employees nationwide and would like add a new membe ...
Senior Data Engineer

1 week ago

Protective Birmingham, United States

The Sr. Data Engineer will work as part of the Enterprise Data Integration team under the direction of the Enterprise Data Integration Manager. The position relies on experience and judgment to support, enhance and create ETL processes, requiring a broad degree of independence, k ...
Architect - Data Engineering

3 weeks ago

Therapy Brands Group Birmingham, United States

Therapy Brands isthe leading healthcare technology partner formental, behavioral, and rehabilitative therapy. Ourpurpose-built and all-in-one practice management, data, and billingsolutions drive exceptional clinical and financialoutcomes. · Thousands of therapy practices rely on ...
Senior Data Engineer

1 week ago

Protective Life Insurance Company Birmingham, United States

The Sr. Data Engineer will work as part of the Enterprise Data Integration team under the direction of the Enterprise Data Integration Manager. The position relies on experience and judgment to support, enhance and create ETL processes, requiring a broad degree of independence, k ...
Diesel Technician/Mechanic II

14 hours ago

Penske Truck Leasing Alabaster, United States Full time

What's the Job? · Ready to move your career forward? As a Technician at Penske, you'll do exactly that. Here, you'll perform preventative maintenance and repairs of all levels on the newest and best maintained fleet of vehicles in the industry. You will help our customers keep th ...
Diesel Mechanic/Technician I

3 days ago

Penske Truck Leasing Alabaster, United States Full time

What's the Job? · Ready to move your career forward? As an experienced Technician at Penske, you'll do exactly that. Here, you'll perform preventative maintenance and repairs of all levels on the newest and best maintained fleet of vehicles in the industry. You will help our cust ...
Diesel Technician/Mechanic III

14 hours ago

Penske Truck Leasing Alabaster, United States Full time

What's the Job? · Ready to accelerate your career while helping our customers move forward? As a Technician at Penske, you'll do exactly that. Here, you'll do preventative maintenance and minor repairs on the newest and best maintained fleet of vehicles in the industry. You will ...