- Bachelor's degree in Computer Science, Engineering, or a related field.
- Minimum of 5 years of experience in big data engineering or a similar role.
- Strong programming skills in languages like Java, Python, or Scala.
- Proficiency in big data technologies such as Hadoop, Spark, Kafka, and Hive.
- Experience with data warehousing concepts and relational databases like Oracle or MySQL.
- Knowledge of data modeling and database design principles.
- Familiarity with cloud platforms like AWS or Azure.
- Excellent problem-solving and analytical skills.
- Ability to work collaboratively in a team environment.
- Strong communication and interpersonal skills.
- Design and develop scalable big data solutions using technologies like Hadoop, Spark, and NoSQL databases.
- Build and maintain data pipelines and ETL processes to collect and transform large volumes of data.
- Optimize and fine-tune the performance of big data systems to ensure efficient data processing and analysis.
- Collaborate with cross-functional teams to gather requirements and identify opportunities for leveraging big data technologies.
- Develop and implement data governance policies and procedures to ensure data integrity and security.
- Troubleshoot and debug issues in big data systems and provide timely resolutions.
- Stay up-to-date with emerging trends and technologies in big data and propose innovative solutions to improve data processing and analysis.
- Conduct performance testing and capacity planning to optimize the performance and scalability of big data systems.
-
A Data Engineer in the Automotive Cloud industry
2 weeks ago
Quantum Ventures Elmdale, United StatesReference number: · Your tasks: · In an agile team, you will support us in the concept development for processing and transferring vehicle-based data to the automotive cloud · You will optimize the storage, processing, and presentation of large amounts of data within the cloud e ...
-
Data Engineer
3 weeks ago
SambaSafety Holdingford, United States Full timeSalary Range: $110, ,000.00 · Who we are: · Hi, we're SambaSafety and we offer the industry's most comprehensive driver monitoring software. Our mission is promoting safer communities by reducing risk through data insights. Companies trust SambaSafety to keep their employees safe ...
-
Lead Data Engineer
2 weeks ago
Wells Fargo North Brunswick, United StatesLead Data Engineer · North Brunswick,NJ · At Wells Fargo, we want to satisfy our customers' financial needs and help them succeed financially. We're looking for talented people who will put our customers at the center of everything we do. Join our diverse and inclusive team wher ...
-
Electrical Engineering Engineer
2 weeks ago
Quantum Ventures Holdingford, United StatesThe Delta Group, founded in 1971, is a strong partner for many successful companies in various industries such as automotive, industrial automation, building automation, data centers, and renewable energy. With approximately employees, Delta has sales offices, production faciliti ...
-
Quality Lab Technician
5 days ago
Actalent Cold Spring, United States Full timeInstead of applying here, send your resume directly to - and mention this job posting to be considered immediately · Description: · Quality Control and Laboratory Functions (50%) · Performs microbiological analysis of products, water and environment to support Pre-Operation sani ...
-
Manufacturing And Lab Associate
1 week ago
Actalent Cold Spring, United States Full timeDescription: · Quality Control and Laboratory Functions (50%) · Performs microbiological analysis of products, water and environment to support Pre-Operation sanitation and HACCP program to ensure food safety. · Accurately collect samples for product testing, including energy dr ...
-
QC Lab Technician
1 week ago
Actalent Cold Spring, United States Full timeDescription: · Quality Control and Laboratory Functions (50%) · Performs microbiological analysis of products, water and environment to support Pre-Operation sanitation and HACCP program to ensure food safety. · Accurately collect samples for product testing, including energy dr ...
-
QC Lab Technician
1 week ago
Actalent Cold Spring, United States Full timeSeeking Laboratory Technicians who want to work with Microbiological Analysis · Description: · Performs microbiological analysis of products, water and environment to support Pre-Operation sanitation and HACCP program to ensure food safety. · Accurately collect samples for produ ...
-
QC Lab Technician
5 days ago
Actalent Cold Spring, United States Full timeHiring for QC technician openings - 1 on day shift, 1 on night shift. · To be considered, please apply and send resume directly to · Description: · Quality Control and Laboratory Functions (50%) · Performs microbiological analysis of products, water and environment to support Pr ...
-
QC Lab Technician
5 days ago
Actalent Cold Spring, United States Full timeDescription: · Quality Control and Laboratory Functions (50%) · Performs microbiological analysis of products, water and environment to support Pre-Operation sanitation and HACCP program to ensure food safety. · Accurately collect samples for product testing, including energy dr ...
-
Technicians & Production Associates
2 days ago
Actalent Saint Cloud, United States Full timeACTIVELY SEEKING QC TECHNICIANS, OPERATORS, PACKAGERS, etc. Who ARE LOOKING FOR INDUSTRY EXPERIENCE · Seeking candidates with who are looking to gain hands-on experience within a manufacturing/production industry. Actalent Services partners with over 100 companies in and around ...
-
QC Lab Tech
1 week ago
Actalent Saint Cloud, United States Full timeDescription: · Performs microbiological analysis of products, water and environment to support Pre-Operation sanitation and HACCP program to ensure food safety. · Accurately collect samples for product testing, including energy drinks, sweetener samples, raw water, treated water ...
-
Production Supervisor 2nd Shift
3 days ago
Kerry Albany, United StatesAbout Kerry · Kerry is the world's leading taste and nutrition company for the food, beverage and pharmaceutical industries. Every day we partner with customers to create healthier, tastier and more sustainable products that are consumed by billions of people across the world. Ou ...
-
Production Supervisor 2nd Shift
2 days ago
Kerry Albany, United StatesAbout Kerry · Kerry is the world's leading taste and nutrition company for the food, beverage and pharmaceutical industries. Every day we partner with customers to create healthier, tastier and more sustainable products that are consumed by billions of people across the world. O ...
-
Titan Innovations Morrison, United StatesAbout Us · At Firebolt, we are leaders in data analytics, providing state-of-the-art cloud data warehouse solutions. Our advanced technology is designed to handle complex data challenges with unmatched speed and efficiency. Join us in our mission to transform data analytics and ...
-
Engineer sensors
2 weeks ago
SilverLinx Gilman, United StatesThe company is a part of the Geely family, one of the largest automotive companies in the world. The location is in the southwest region of Germany, specifically in the Stuttgart area. · We are currently seeking immediate onboarding for several positions at our European subsidiar ...
-
Phoenix Innovations Sauk Rapids, United States InternshipSHIPWELCOME TO THE TEAM · The unit "Global Business Services" supports the business areas of BASF with a cross-functional network and offers modern and customized solutions. As a specialized service unit, we stand for a high customer orientation and shape our services in a partnershi ...
-
Skyline Enterprises Little Falls, United StatesWe are the digitalization partner of the cooperative financial group and combine decades of banking expertise with modern information technology. Our IT solutions and services, specifically tailored to banks, range from data center operations to the banking procedure agree21 to a ...
-
Maintenance Engineer
2 weeks ago
Dow Freeport, United StatesAt Dow, we believe in putting people first and we're passionate about delivering integrity, respect and safety to our customers, our employees and the planet. · Our people are at the heart of our solutions. They reflect the communities we live in and the world where we do busine ...
-
Senior Archaeologist
2 weeks ago
AECOM Fort Valley, United StatesCompany Description · Work with Us. Change the World. · At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thrive. We are the world's tr ...
Big data engineer - Albany, United States - workcog
Description
Company Overview
Workcog is a leading staffing and partnerships company that specializes in providing efficient staffing solutions. Our aim is to offer the best possible partnering experience to our clients by utilizing the most effective staffing practices. We take pride in our quality services and expertise in various industries.
Job Overview
Workcog is seeking a highly skilled Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure and systems. This role requires expert knowledge of big data technologies and the ability to analyze large datasets to extract valuable insights. The ideal candidate has extensive experience in managing big data projects and a strong understanding of data warehousing concepts.
Qualifications and Skills
Roles and Responsibilities
Skills: BIg data , data bricks, data factory, azure delta lake, selinium, AWS, hadoop
