- Design and implement scalable and efficient data pipelines using AWS and Data Lakehouse Platform services. Leverage AWS cloud services like S3, Redshift, EMR, Glue, Lambda, and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics. Collaborate with cross-functional teams to understand business needs and translate them into technical solutions. Utilize Databricks for big data processing and streaming analytics.
- Develop and maintain data lakes and data warehouses on AWS and Data Lakehouse Platform, ensuring data integrity and accessibility. Optimize data storage and processing for performance and cost efficiency. Automate data workflows and ensure high data quality and reliability. Monitor, troubleshoot, and resolve data pipeline issues.
- Organizing and managing data within the environment, ensuring stored efficiently, securely, and in a manner that supports easy access and analysis. Monitor the performance of data processes and queries and optimize for efficiency and speed.
- Ensure high standards of data quality and implement data governance practices. Stay current with emerging trends and technologies in cloud computing, big data, and data engineering.
- Provide ongoing support for the platform, troubleshoot any issues that arise, and ensure high availability and reliability of data infrastructure.
- Create documentation for the platform infrastructure and processes, and train other team members or users in platform effectively.
- BS in Computer Science, IT, Software or Computer Engineering, Data Science or Analytics, Mathematics or related field
- 3-5 years of data engineering experience
- Experience in designing, building, and maintaining data warehouses. Understanding of data modeling, data warehousing, and data lake concepts.
- Proficiency in programming languages such as Python, Java, Scala, and scripting languages like Bash or PowerShell.
- Experience with big data technologies, such as Apache Hadoop, Spark, Kafka, and others.
- Proficiency in AWS cloud services and Databricks.
- Proficiency in SQL and experience with relational databases.
- Experience in building and optimizing big data pipelines, architectures, and data sets.
- Familiarity with ETL tools, processes, and data integration techniques.
- Excellent communication and team collaboration skills.
- Must be authorized to work in the U.S.
- AWS and Databricks certifications.
- Experience in implementing machine learning algorithms in big data environments.
- Familiarity with GitHub, DevOps practices and CI/CD pipelines in a cloud environment.
- Health insurance plans (medical, dental, vision)
- HSA and flexible spending accounts
- 401(k)
- Incentive opportunity*
- Life insurance
- Short and long-term disability insurance
- Paid vacation and holidays*
- Employee Assistance Program
- Employee discounts
- Tuition reimbursement*
- Adoption assistance*
- Share this job on your Social Network|More )
-
Senior Data Engineer
3 weeks ago
Xometry Lexington, United StatesXometry (NASDAQ: XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives manufacturers the critical resources they need to grow their business while also making ...
-
Lead Data Engineer, US RDBU
3 weeks ago
Takeda Lexington, United States Full timeBy clicking the "Apply" button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda's Privacy Notice and Terms of Use. I further attest that all information I subm ...
-
Co-op Student: Biomedical Image Processing and
3 weeks ago
MIT Lincoln Laboratory Lexington, United StatesThe Human Health & Performance Systems Group develops human-centered technologies to overcome operational challenges and to enhance human capability in domains of interest to national security. Our research programs focus on innovative and objective solutions in the areas of inte ...
-
MIT Lincoln Laboratory Lexington, United StatesThe Mechanical Engineering Group provides innovative mechanical solutions for a wide range of advanced technologies. Our work has been in the areas of laser communication, high-energy lasers, telescopes, biomechanical materials, hypersonics, and radars, for systems deployed on gr ...
-
Data Scientist
3 weeks ago
MIT Lincoln Laboratory Lexington, United States**The Bioanalytics Systems and Technologies Group focuses on driving analytics to take advantage of vast and rapidly expanding biological datasets to address national security needs. The Group's efforts include developing software architectures and systems, bioinformatics tools, ...
-
Associate Director
3 weeks ago
Novo Nordisk Lexington, United States**About the Department** · Our Boston Research & Development hub, anchored in the greater Boston area, brings together the best minds in life science innovation. The teams located in facilities in Lexington, Watertown and Cambridge reflect the full R&D continuum, from early resea ...
-
Research Associate
2 weeks ago
X2logics Lexington, United States**Duration: 7+ Months**: · - **Schedule: Monday-Friday, 8:30 AM-5:00 PM**: · - **May need to work outside of standard hours sometimes (evenings/weekends)** · **Description** · Industry experience doesn't matter. · Pharma experience is a plus. · Degree can be any, Biology, Biochem ...
-
Business Development Director, Imaging
3 weeks ago
ANDURIL INDUSTRIES Lexington, United StatesAnduril Industries is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century's most innovative companies to the defense industry, Anduri ...
-
Titan Innovations Lexington, United StatesAbout 1000hands AG: · We are Germany's largest service provider for building surveying. Since 2000, we have surveyed, drawn, visualized, and calculated over 200 million square meters of building space throughout Europe. · Our project teams consist of surveying engineers and tec ...
-
ZephyrTech East Lexington, United StatesWELCOME TO THE TEAM · The global Engineering Services Division contributes to shaping a sustainable future with outstanding technical expertise. With our dedicated, interdisciplinary teams, we support BASF business areas in growing together with our customers and markets. We impl ...
-
Machining Technician
6 days ago
Nebula Technologies Lexington, United StatesFor our client, an internationally operating company in mechanical engineering with a location in Wolfertschwenden, we are currently looking for a full-time Machinist (m/f/d) specializing in milling technology to start as soon as possible. · AUGUSTA Personaldienstleistungen GmbH ...
-
Assistant Staff-engineering
1 week ago
MIT Lincoln Laboratory Lexington, United StatesThe Tactical Defense Systems Group works to understand air defense issues, in particular, air vehicle survivability, vulnerability of U.S. Air Force (USAF) aircraft to weapons systems, electronic countermeasures, and air surveillance for homeland defense. The group focuses on und ...
-
Assistant, Admin
1 week ago
Recombia Biosciences, Inc. Lexington, United States Part time#Recombia Biosciences, a wholly owned subsidiary of the Lesaffre Group, is #hiring in the fields of #Synthetic Biology, #Metabolic Engineering, Yeast and Bacteria Genome Engineering and #Precision_fermentation, at various experience levels: a part-time Administrative Assistant po ...
-
Entry Level Researcher
1 day ago
MIT Lincoln Laboratory Lexington, United StatesThe Quantum Information and Integrated Nanosystems Group at MIT Lincoln Laboratory develops quantum systems, including theory, engineering, and control, to address critical future technology needs. Areas of focus include superconducting qubits, trapped ions, integrated photonics, ...
-
Construction Engineering Inspector
1 week ago
Consulting Services Incorporated Lexington, United StatesConstruction Engineering Inspector - Geology · You will be performing construction testing and inspections on construction projects throughout Kentucky, Ohio and possible other States. Testing and inspection procedures may include: performing inspection of construction activities ...
-
Research Scientist
1 week ago
Riverside Research Institute Lexington, United StatesRiverside Overview: Riverside Research is an independent National Security Nonprofit dedicated to research and development in the national interest. We provide high-end technical services, research and development, and prototype solutions to some of the country's most challenging ...
-
Associate Ventures Officer
1 week ago
MIT Lincoln Laboratory Lexington, United StatesThe Technology Ventures Office (TVO) facilitates and oversees technology transfer to government and industry, fosters collaborative research with the private sector, and manages the Laboratory's Intellectual Property (IP) portfolio. In order to support the creation of increased t ...
-
Intelligence Specialist
1 week ago
MIT Lincoln Laboratory Lexington, United States**Who we are & what we do** · The group's staff are the key to the group's national impact. They are skilled scientists, engineers, and specialists who have demonstrated deep technical backgrounds and the ability to quickly learn and understand new technologies. Our priority for ...
-
Life Science Account Manager
2 days ago
Genedata Lexington, United StatesGenedata transforms data into intelligence with innovative software solutions that incorporate extensive biopharma R&D domain knowledge. Multinational biopharmaceutical organizations and cutting-edge biotechs around the globe rely on Genedata to digitalize and automate data-rich ...
-
Manufacturing Associate
1 day ago
ARIAD Lexington, United StatesSmall Molecules · - Biologics · - Plasma · - Cell and Gene · As part of the GMS team, you'll have the opportunity to pursue unique experiences and build new skills, and you'll know that the work you do every day makes an impact — on our patients, our people, our planet, and on yo ...
Cloud Data Engineer - Lexington, United States - Valvoline Global
Description
Overview
Why Valvoline Global Operations?
Valvoline Global is a worldwide leader in automotive and industrial solutions, creating future-ready products and best-in-class services for partners around the globe. Established in 1866, we introduced the world's first branded motor oil, claiming our position as The Original Motor Oil.
As an affiliate of Aramco, one of the world's largest integrated energy and chemicals companies, we continue to invest strategically and expand globally, driving unparalleled product innovation and sustainable business solutions.
Our corporate values of care , integrity , passion , and excellence shape everything we do. Living out our values is what makes our company, our employees, our partners, our customers, and the communities we serve great.
When you join Valvoline Global, you join a culture that is committed to: treating all people with care, operating with integrity, striving for excellence in everything we do, and showing passion about delivering on our commitments.
Careers for the Driven
Valvoline has a rewarding opportunity as a Cloud Data Engineer. We whole-heartedly adopt a 'never idle' mindset. We also know that outstanding service begins and ends with our employees. So, we're looking for good people to join our team. You bring your skills, talents, and drive. We will give you a great place to work, a competitive salary and benefits, and the resources and support to develop and advance within our global company.
The Cloud Data Engineer plays a crucial role in designing, implementing, and managing advanced data solutions using both AWS and Data Lakehouse platforms. This position requires a blend of skills in cloud computing, data engineering, and analytics. Responsible for optimizing performance, ensuring security and compliance, and providing support and troubleshooting. Collaboration with data scientists and analysts is also key, ensuring the platform meets analytics needs while staying updated with the latest technologies and practices in the field.
How You'll Make an Impact
What You'll Need
What Will Set You Apart
Benefits That Drive Themselves
*Terms and conditions apply, and benefits may differ depending on position.
Valvoline provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Are you good at what you do? Join us.
The Company endeavors to make its recruitment process accessible to any and all users. Reasonable accommodations will be provided, upon request, to applicants with disabilities in order to facilitate equal opportunity throughout the recruitment and selection process. Please contact Human Resources at 1-800-Valvoline or email 1- to make a request for reasonable accommodation during any aspect of the recruitment and selection process. The contact information is for accommodation requests only; do not use this contact information to inquire about the status of applications.
#LI-DS1
Job Locations US-Remote
Job Post Information : Posted Date* 2 days ago(5/6/2024 1:59 PM)
Division Global Operations
Requisition #
# of Openings 1
