Jobs
>
Saint Albans

    Tech Lead Data Engineer - St Albans, United States - Coherent Solutions

    Coherent Solutions
    Coherent Solutions St Albans, United States

    3 weeks ago

    Default job background
    Description
    Tech Lead Data Engineer (Food and Beverage Manufacturing)

    Locations

    Bulgaria
    Georgia
    Lithuania
    Mexico
    Moldova
    Poland
    Ukraine
    Company Background

    The customer holds a top position in the food and beverage sphere.

    As a global player with operations across five continents and with annual sales of more than $7 billion, they partner with leading retailers, restaurants, and distributors.

    Technologies

    PySpark

    SQL
    Python
    What You'll Do

    Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake;
    Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks;
    Developing scalable and re-usable frameworks for ingesting of data sets;
    Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms;
    Working with event based / streaming technologies to ingest and process data;
    Provide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phases;
    Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution;
    Job Requirements

    8 to 10 years of IT experience;
    Experience working with Azure Databricks;
    Familiarity with PySpark;
    Mastery of
    SQL;
    Experience with Python programming language used for data Engineering purpose;
    Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows;
    Experience in data visualization/exploration tools;
    Providing Technical leadership and guidance to Teams;
    Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions;
    Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders;
    Level of English - from Upper-Intermediate (written/spoken);
    Desired Skills

    Experience preparing data for Data Science and Machine Learning;
    Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development;
    What Do We Offer


    The global benefits package includes:
    Technical and non-technical training for professional and personal growth;
    Internal conferences and meetups to learn from industry experts;
    Support and mentorship from an experienced employee to help you professional grow and development;
    Internal startup incubator;
    Health insurance;
    Sports activities to promote a healthy lifestyle;
    Flexible work options, including remote and hybrid opportunities;
    Referral program for bringing in new talent;
    Work anniversary program and additional vacation days.
    Share vacancy

    We will be glad to see you

    First Name
    Last Name
    Email
    Referral

    Add the name of our employee (e.g. John Smith)
    Comments
    Attach file
    Attach file

    Formats (3 MB): doc, docx, pdf, txt, rtf
    I have acknowledged and agree that Coherent Solutions will process my submitted personal data pursuant to Privacy Policy for Job Applicants

    and understand that due to international presence of Coherent Solutions my personal data may be transferred to third countries.

    I also give consent to Coherent Solutions to process my personal data for 3 (three) years for the purpose to notify me about future job openings.

    I am informed that I can withdraw my consent anytime by submitting a request to

    In such case my personal data will be deleted from a candidates database.

    #J-18808-Ljbffr
  • Equifax

    Senior Manager: Data Engineering Leader

    3 weeks ago

    Equifax St Albans, United States

    Seeking a thought leader and organizational change agent for Equifax's Data Fabric platform. This individual will be passionate about end-user experience and best in class engineering excellence to lead the data operations and support function. As a leader in Data Operations, you ...

  • Brown & Brown

    Data Solutions Engineer

    2 weeks ago

    Brown & Brown St Albans, United States

    Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers. · It's an exciting time to join Brown & Brown Our business is growing both in North America and internationally which emphasizes the need to ...

  • OnLogic

    Data Engineer

    2 weeks ago

    OnLogic South Burlington, United States

    We are seeking a talented and motivated Data Engineer that will play a critical role in designing, building, and maintaining the data infrastructure supporting our business intelligence, reporting and AI initiatives. You will work closely with data scientists, machine learning en ...

  • OnLogic

    Data Engineer

    5 days ago

    OnLogic South Burlington, United States

    We are seeking a talented and motivated Data Engineer that will play a critical role in designing, building, and maintaining the data infrastructure supporting our business intelligence, reporting and AI initiatives. You will work closely with data scientists, machine learning en ...

  • OnLogic

    Data Engineer

    2 weeks ago

    OnLogic South Burlington, United States

    Job Description · Job DescriptionWe are seeking a talented and motivated Data Engineer that will play a critical role in designing, building, and maintaining the data infrastructure supporting our business intelligence, reporting and AI initiatives. You will work closely with dat ...

  • OnLogic, Inc.

    Data Engineer

    1 week ago

    OnLogic, Inc. South Burlington, United States

    We are seeking a talented and motivated Data Engineer that will play a critical role in designing, building, and maintaining the data infrastructure supporting our business intelligence, reporting and AI initiatives. You will work closely with data scientists, machine learning en ...

  • Milliman

    Senior Data Engineer

    4 days ago

    Milliman South Burlington, United States Full time

    Company Overview: · Leading with our core values of Quality, Integrity, and Opportunity, MedInsight is one of the healthcare industry's most trusted solutions for healthcare intelligence. Our company purpose is to empower easy, data-driven decision-making on important healthcare ...

  • InsideHigherEd

    Research Data Visualization Engineer

    2 weeks ago

    InsideHigherEd Burlington, United States

    Advertising/Posting Title:Research Data Visualization Engineer · Diversity Statement:The University is especially interested in candidates who can contribute to the diversity and excellence of the institution. Applicants are encouraged to include in their cover letter information ...

  • The Ladders

    BI Data Engineer

    3 days ago

    The Ladders Burlington, United States

    Gerrie Electric is one of the largest independent electrical distributors, with 24 key Ontario locations and over 400 employees. We are a proud family owned, Canadian company and are headquartered in Burlington, ON. We are proud to be a Platinum Club winner of Canada's Best Manag ...

  • Northwestern Medical Center

    Quality Spec Phy Svc

    2 days ago

    Northwestern Medical Center Saint Albans City, United States

    Quality Specialist · Northwestern Medical Group · Northwestern Medical Center, where you can be the difference. · Come join the NMC family, where we focus on high reliability, ensuring a constant emphasis on safety, quality, and improvement as we pursue our mission of exception ...

  • Teknor Apex Company

    Plant Manager TPE

    2 days ago

    Teknor Apex Company St. Albans, United States Full time

    Overview · ESSENTIAL FUNCTIONS · On a daily basis, reviews individual department results to ensure overall profit, quality and EH&S objectives are met. · On a regular basis ensures that all facility staff have the proper training to perform their responsibilities. · On a quarter ...

  • CACI International

    OSINT Lead Analyst

    3 weeks ago

    CACI International Saint Albans City, United States

    Minimum Clearance Required to Start: TS/SCIEmployee Type: RegularPercentage of Travel Required:Type of Travel:CACI is seeking an Open Source Intelligence (OSINT) Lead Analyst, to lead a team of analysts and provide intelligence support to the C5ISR Center (formerly the Intelligen ...

  • Flagship Biosciences

    Data Engineer II

    1 month ago

    Flagship Biosciences Morrisville, United States Remote job Full time

    Our Cultural Values:Smart and Hungry: We simplify complex problems. We are never satisfied and we love to learn. · Find a Way: We find solutions for any problem. We must collaborate to win. · Get the Right Stuff Done: The right strategy and execution to positively impact patient ...

  • Gilder Search Group

    Consultant - Project Manager

    6 days ago

    Gilder Search Group St Albans, United States

    Hybrid: 2 days in onsite · Long-term contract · Pharma b/g is a big plus · We have an immediate need to for seasoned Consultant with a technical background and good SQL and ETL skills. In this position, you will be working with the Business and will be the point of contact to th ...

  • Crelative Technologies

    Senior/Lead Software Engineer

    5 days ago

    Crelative Technologies St Albans, United States

    Crelative Technologies is seeking a · seasoned Senior/Lead Software Engineer · to play a vital role in our cross-disciplinary team, collaborating closely with software engineers, product managers, data analysts, UX/UI designers, and business partners. · Responsibilities: · Buil ...

  • Effwa Infra & Research

    Sr. Electrical Engineer

    4 weeks ago

    Effwa Infra & Research St Albans, United States

    Sr. Electrical Engineer · (Electrical, Instrumentation & Automation) · B.E. Electrical · (NOTE: In addition to Educational Background, we will be giving preference based on locations. Candidates living between Kalyan & Dadar travelling on central line are welcome to apply.) · ...

  • Avyatech

    Senior SEO Executive

    1 week ago

    Avyatech St Albans, United States

    At Avya Technology Pvt. Ltd., the Senior SEO Executive plays a pivotal role in driving the company's online visibility and organic growth. Their job is to manage SEO strategies, keep up with the latest trends, and make our online stuff better for search engines. · Key Responsibil ...

  • Healthcare Businesswomen's Association

    Automation Engineer

    4 weeks ago

    Healthcare Businesswomen's Association St Albans, United States

    About the role · Location: · Puurs #Hybrid · We are seeking an Automation Engineer who will be in charge of supporting the design, implementation, and maintenance of automation systems in projects and site operations, to join our team at the Puurs site. · Key Responsibilities: ...

  • Actalent

    Lab Technician

    1 week ago

    Actalent Saint Albans, United States

    : · * Set up, adjust, maintain, and clean medical laboratory equipment. · * Analyze the results of tests and experiments to ensure conformity to specifications, using special mechanical and electrical devices. · * Gather, and record test data to issue reports that use charts, gra ...

  • Actalent

    Lab Technician

    6 days ago

    Actalent SAINT ALBANS, United States

    : · + Set up, adjust, maintain, and clean medical laboratory equipment. · + Analyze the results of tests and experiments to ensure conformity to specifications, using special mechanical and electrical devices. · + Gather, and record test data to issue reports that use charts, gra ...