Jobs
>
Chicago

    Data Engineer - Chicago, United States - Sky Consulting Inc

    Sky Consulting Inc
    Sky Consulting Inc Chicago, United States

    2 weeks ago

    Default job background
    Description

    Job Description

    Job Description

    This is a full time role in Chicago, IL Hybrid role 3 days/week. Open for candidates who are ready to relocate Day 1. No C2C enquires please

    Position: Data Engineer

    Location: Chicago, IL (Hybrid 3 Days/ week)

    Duration: Full Time

    Key Skills: Snowflake, Databricks, Python, SQL

    Key Responsibilities:

    Data Integration:

    Implement and maintain data synchronization between on-premises Oracle databases and Snowflake using Kafka and CDC tools.

    Support Data Modeling:

    Assist in developing and optimizing the data model for Snowflake, ensuring it supports our analytics and reporting requirements.

    Data Pipeline Development:

    Design, build, and manage data pipelines for the ETL process, using Airflow for orchestration and Python for scripting, to transform raw data into a format suitable for our new Snowflake data model.

    Reporting Support:

    Collaborate with data architect to ensure the data within Snowflake is structured in a way that supports efficient and insightful reporting.

    Technical Documentation:

    Create and maintain comprehensive documentation of data pipelines, ETL processes, and data models to ensure best practices are followed and knowledge is shared within the team.

    Tools and Skillsets:

    Data engineering: proven track record of developing and maintaining data pipelines and data integration projects

    Databases: Strong experience with Oracle, Snowflake, and Databricks.

    Data Integration Tools: Proficiency in using Kafka and CDC tools for data ingestion and synchronization.

    Orchestration Tools: Expertise in Airflow for managing data pipeline workflows.

    Programming: Advanced proficiency in Python and SQL for data processing tasks.

    Data Modeling: Understanding of data modeling principles and experience with data warehousing solutions.

    Cloud Platforms: Knowledge of cloud infrastructure and services, preferably Azure, as it relates to Snowflake and Databricks integration.

    Collaboration Tools: Experience with version control systems (like Git) and collaboration platforms.

    CI/CD Implementation: Utilize CI/CD tools to automate the deployment of data pipelines and infrastructure changes, ensuring high-quality data processing with minimal manual intervention.

    Communication: Excellent communication and teamwork skills, with a detail-oriented mindset.

    Strong analytical skills, with the ability to work independently and solve complex problems.

  • Verano

    Data Engineer

    2 weeks ago

    Verano Chicago, United States

    Verano is seeking an innovative Data Engineer to join our team within IT Applications. You will be responsible for designing and building data pipelines using Python and Google cloud infrastructure. This role requires a strong understanding of data engineering principles and the ...

  • Tiger Analytics

    Data Engineer

    2 weeks ago

    Tiger Analytics Chicago, United States Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our bu ...

  • SPECTRAFORCE

    Data Engineer

    3 weeks ago

    SPECTRAFORCE Chicago, United States

    Job Title: Data Engineer · Duration: 6-month Contract to Hire possibility · Location: Chicago, IL Must be onsite 3 days per week · Day to day: · The client is seeking a highly skilled and motivated Data Engineer to join the team. · The ideal candidate will have expertise in dat ...

  • CapTech

    Data Engineer

    2 weeks ago

    CapTech Chicago, United States Full time

    Job Description · CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and ...

  • The Judge Group

    Data Engineer

    4 days ago

    The Judge Group Chicago, United States

    Job Title: Data Engineer - Model Validation Group · Location: Chicago, IL · Responsibilities: · Maintain and service servers for the Model Validation Group. · Design and maintain data manipulation and visualization systems to support model backtesting. · Implement and manage dat ...

  • Spectraforce Technologies

    Data Engineer

    1 week ago

    Spectraforce Technologies Chicago, United States

    Job Title: Data Engineer · Duration: 6-month Contract to Hire possibility · Location: Chicago, IL 60604; must be onsite 3 days per week · Day to day: · The client is seeking a highly skilled and motivated Data Engineer to join the team. · The ideal candidate will have expert ...

  • HonorVet Technologies

    Data Engineer

    1 week ago

    HonorVet Technologies Chicago, United States

    Title: Data Engineer · Location: Chicago, IL · Duration: 12+ months · Seeking a contractor who has extensive experience as a Data Engineer. Data Engineer will be responsible for using SQL and other programming languages to pull data from a variety sources into a central data pl ...

  • Illinois Secretary of State

    Data Engineer

    19 hours ago

    Illinois Secretary of State Chicago, United States

    Office of the Illinois Secretary of State Alexi Giannoulias · Job Title: Data Engineer - Information Systems · Division: Administrative · Union: N/A · Location: 115 S LaSalle St,Chicago, IL - Cook County · Salary: Salary Commensurate with experience. · Overview: · Responsi ...

  • Adyen

    Data Engineer

    1 week ago

    Adyen Chicago, United States

    This is Adyen · Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition. · For our teams, we creat ...

  • The LaSalle Group

    Data Engineer

    1 week ago

    The LaSalle Group Chicago, United States

    Want to grow your career with one of the fastest growing industries? LaSalle Network is partnered with a top Chicago-based client looking to hire a Data Engineer their team. · The Data Engineer will be responsible for delivering strategic and tangible solutions through data. We a ...

  • Olenick

    Data Engineer

    1 week ago

    Olenick Chicago, United States

    Press Tab to Move to Skip to Content Link · Select how often (in days) to receive an alert: · Date: · 8 May 2024 · Company: · Qualitest Group · Are you interested in working with the World's leading AI-powered Quality Engineering Company? Ready to advance your career, team up w ...

  • eTek IT Services, Inc.

    Data Engineer

    1 week ago

    eTek IT Services, Inc. Chicago, United States

    Job Description · Job DescriptionRole : Data EngineerLocation : Chicago ILExperience : 10+years& "W2 Contract" · JD :Job DescriptionOverviewSeeking a contractor who has extensive experience as a Data Engineer. Data Engineer will be responsible for using SQL and other programming ...

  • United Airlines

    Data Engineer

    1 week ago

    United Airlines Chicago, United States

    · Our Marketing and Loyalty team is the strategic force behind United's industry-leading brand and experience, supporting revenue growth by turning customers into lifelong United flyers. Our marketing communications, market research and brand teams drive travelers' familiarity a ...

  • McDonald's Corporation

    Data Engineer

    1 week ago

    McDonald's Corporation Chicago, United States

    Company Description · McDonald's evolving Accelerating the Arches growth strategy puts our customers and people first and demonstrates our competitive advantages to strengthen our brand. We are recognized on lists like Fortune's Most Admired Companies and Fast Company's Most Inn ...

  • NinjaTrader

    Data Engineer

    1 week ago

    NinjaTrader Chicago, United States

    NinjaTrader is an investor-backed, growth-stage FinTech company with an award-winning platform and over 1 million users. We are building products and services which empower active traders to easily analyze and react to data from the world's leading financial markets. Located in C ...

  • Collabera

    Data Engineer

    8 hours ago

    Collabera Chicago, United States

    Home · Search Jobs · Job Description · Data Engineer · Contract: Chicago, Illinois, US · Salary: $64.00 Per Hour · Job Code: · End Date: · Days Left: 24 days, 3 hours left · Apply · Must Haves:Experience working in Hadoop/Big Data environment · Experience in end-to-end d ...

  • Northwestern Medicine

    Data Engineer

    1 week ago

    Northwestern Medicine Chicago, United States Full time

    Company Description · At Northwestern Medicine, every patient interaction makes a difference in cultivating a positive workplace. This patient-first approach is what sets us apart as a leader in the healthcare industry. As an integral part of our team, you'll have the opportunity ...

  • AbbVie

    Data Engineer

    1 week ago

    AbbVie Chicago, United States

    Company Description · AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic area ...

  • Verano

    Data Engineer

    5 days ago

    Verano Chicago, United States

    Verano is seeking an innovative Data Engineer to join our team within IT Applications. You will be responsible for designing and building data pipelines using Python and Google cloud infrastructure. This role requires a strong understanding of data engineering principles and the ...

  • Rush Hospital

    Data Engineer

    1 week ago

    Rush Hospital Chicago, United States

    Location: · Chicago, IL · Hospital: · RUSH University Medical Center · Department: · ORA Administration · Work Type: · Full Time (Total FTE between 0.9 and 1.0) · Shift: Shift 1 · Work Schedule: · 8 Hr (8:00:00 AM - 5:00:00 PM) · Summary: · The Data Engineer is respons ...