Remote Data Engineer - Macon, United States - Insight Global

Insight Global Macon, United States

2 weeks ago

Description

Insight Global is searching for a remote Data Engineer with proficient technical experience in Azure Databricks, Apache Spark, and cloud data engineering.

The role requires proficiency in designing, implementing, and optimizing data processing workflows on the Azure platform using Databricks. The candidate should have a deep understanding of big data technologies, data analytics, and machine learning concepts.

Responsibilities:
Design, implement, and maintain data processing pipelines using Azure Databricks, Apache Spark, and related technologies.

Collaborate with other data engineers, data scientists, and business stakeholders to understand data requirements and develop solutions that meet business objectives.

Architect scalable and reliable data solutions on the Azure platform, ensuring high performance and availability.
Optimize data processing workflows for performance, cost-effectiveness, and resource utilization.
Develop and deploy machine learning models and algorithms using Azure Databricks for predictive analytics and data-driven insights.
Implement data security and compliance measures to ensure data integrity and regulatory compliance.
Monitor and troubleshoot data processing jobs, identify performance bottlenecks, and implement optimizations to improve efficiency and reliability.
Collaborate with cross-functional teams to integrate data pipelines with downstream systems and applications.
Stay updated with the latest developments in big data technologies, machine learning frameworks, and cloud computing platforms.
Document technical designs, configurations, and best practices for Azure Databricks solutions.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.

We are an equal opportunity/affirmative action employer that believes everyone matters.

Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
.

Required Skills & Experience
-2+ years of Databricks experience in AWS or Azure.

Proven experience in data engineering, big data processing, and analytics.
Strong proficiency in Azure Databricks, Apache Spark, and Scala or Python programming languages.
Experience with building and optimizing data pipelines using Azure services such as Azure Data Lake Storage, and Azure Cosmos DB.
Knowledge of distributed computing concepts and parallel processing techniques.
Familiarity with data modeling, ELT (Extract, Load, Transform) processes, and Delta Data Lake principles
Medallion Architecture.
Experience with version control systems such as Git and CI/CD pipelines for automated deployment.
Strong problem solving skills and the ability to troubleshoot complex data engineering issues.
Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Experience with Agile development methodologies and DevOps practices.
Knowledge of data governance, data privacy, and regulatory compliance standards.

This position requires expertise commensurate with a high-level developer, with at least eight (8) years of experience, and a BS in Computer Science or related field.

Nice to Have Skills & Experience

Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching.

Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Product Development Scientist

1 week ago

First Quality Enterprises, Inc Macon, United States

**First Quality** was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Geo ...
Controls Engineering Technician

1 week ago

First Quality Enterprises, Inc Macon, United States

**First Quality** was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Geo ...
Industrial Electrical Technician

1 week ago

First Quality Enterprises, Inc Macon, United States

**First Quality** was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Geo ...
Controls Technician

1 week ago

First Quality Enterprises, Inc Macon, United States

**First Quality** was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Geo ...
Working student: Network management

1 day ago

Nexus Dynamics Macon, United States

The German Railway offers over 500 professions nationwide and diverse entry opportunities for students and graduates. Every year, more than 1,400 interns, working students, direct entrants, and trainees get to know us as a dynamic and innovative employer. Join us and help us move ...
Entry Level Developer/Coder/Programmer/Data Scientist/Analyst/Engineer

1 week ago

SynergisticIT Macon, United States

The Job Market is Challenging due to almost 300,000 Tech Layoffs since October 2022 due to which thousands of laid off Techies are competing with existing Jobseekers. · Entry level Job seekers struggle to get responses to their applications forget about getting client interviews ...
Support Engineering Data Specialist 2

2 weeks ago

AVA Consulting Warner Robins, United States

Job Description: · The ideal candidate will perform Support Engineering Data Specialist responsibilities for the C-17 Reliability, Maintainability, and Availability (RM&A) team. Typical tasks include but not limited to the following: · Serve as Point of Contact for all Reliabil ...
Data Engineer Senior with Security Clearance

1 week ago

Geo Owl LLC Gordon, United States

Geo Owl is seeking a Data Engineer with knowledge of Army structure and defense level intelligence, · intelligence collection, fusion, analysis, production, and dissemination for intelligence databases and products. Clearance: · TS/SCI Clearance is required. Locations: · Ft. Gord ...
Mission Assurance 2

3 weeks ago

HII Warner Robins, United States

**Date**:May 9, 2024 · **Location**: Warner Robins, GA, Georgia, United States · **Company**:HII's Mission Technologies division · Requisition Number: 18876 · Required Travel: 0 - 10% · Employment Type: Full Time/Salaried/Exempt · Security Clearance: TS/SCI · Level of Experience: ...
Financial Analyst

3 weeks ago

Talon Professional Services Macon, United States

Title: Financial Analyst - Engineering · Type: Direct Hire · Location: Macon, GA · JOB SUMMARY: · Reporting to the Executive Director, Financial Planning & Analysis, this role is responsible for supporting the plant operations function. This position is the primary point of conta ...
Product Development Scientist

2 weeks ago

First Quality Macon, United States

First Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia ...
Controls Engineer

2 weeks ago

First Quality Macon, United States

First Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia ...
Electrical Control Engineer

2 weeks ago

Kelly Science, Engineering, Technology & Telecom Macon, United States

Kelly Engineering is recruiting for a Controls Engineer for our growing client in Macon, GA. This client is doubling their production and need to add to the team As a Controls Engineers you will be responsible for supporting and optimizing our manufacturing processes across multi ...
Product Development Scientist

1 week ago

First Quality Macon, United States

First Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia ...
Packaging Engineer

2 weeks ago

First Quality Macon, United States

First Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia ...
Packaging Engineer

1 week ago

First Quality Macon, United States

irst Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia, ...
Project Engineer

2 weeks ago

First Quality Macon, United States

First Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia ...
Quality Engineer

2 weeks ago

First Quality Macon, United States

First Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia ...
Environmental Health Safety Engineer

2 weeks ago

First Quality Macon, United States

First Quality was founded in 1989 and, in nearly three decades, has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia ...
Information Systems Intern

1 week ago

Blue Bird Macon, United States

About Blue Bird Corporation · Blue Bird (NASDAQ: BLBD) is recognized as a technology leader and innovator of school buses since its founding in 1927. Our dedicated team members design, engineer and manufacture school buses with a singular focus on safety, reliability, and durabi ...