Jobs
>
Chicago

    Data Engineer - Chicago, United States - Brooksource

    Brooksource
    Brooksource Chicago, United States

    Found in: Lensa US 4 C2 - 3 days ago

    Default job background
    Contract
    Description
    *Senior Data Engineer**6+ Month Contract

    *Chicago, Boston, Dallas, or Washington, DC Area**Summary:

    We are seeking a highly experienced Senior Data Engineer with a deep understanding of PySpark using Databricks or AWS Glue or AWS EMR and cloud-based databases such as Snowflake.

    Proficiency in workflow management tools like Airflow a is essential. Healthcare industry experience is a significant advantage.

    The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines, while ensuring the highest levels of performance, security, and data quality.

    *Responsibilities:
    • Design, develop, and maintain scalable, reliable, and secure data pipelines to process large volumes of structured and unstructured healthcare data using PySpark and cloud-based databases.
    • Collaborate with data architects, data scientists, and analysts to understand data requirements and implement solutions that meet business and technical objectives.
    • Leverage AWS or Azure cloud services for data storage, processing, and analytics, optimizing cost and performance.
    • Utilize tools like Airflow for workflow management and Kubernetes for container orchestration to ensure seamless deployment, scaling, and management of data processing applications.
    • Develop and implement data ingestion, transformation, and validation processes to ensure data quality, consistency, and reliability across various healthcare datasets.
    • Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to minimize downtime and ensure optimal performance.
    • Establish and enforce data engineering best practices, ensuring compliance with data privacy and security regulations specific to the healthcare industry.
    • Continuously evaluate and adopt new tools, technologies, and frameworks to improve the data infrastructure and drive innovation.
    • Mentor and guide junior data engineers, fostering a culture of collaboration, learning, and growth within the team.
    • Collaborate with cross-functional teams to align data engineering efforts with broader organizational goals and strategies.
    • Is familiar with SOC 2 compliance and its impact on company policies and processes.
    • Understands importance of adhering to SOC 2 requirements and maintains an effort to do so.
    • Reviews and understands the Employee Handbook, and internal policies that define individual security responsibilities, and maintains segregation of duties in accordance to their role requirements
    *Requirements:
    • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
    • 5+ years of experience in data engineering, with a strong background in Apache Spark and cloud-based databases such as Snowflake.
    • Strong Knowledge in Big Data Technologies, PySpark, thorough in one or more programming language like Python
    • Proven experience with AWS or Azure cloud services for data storage, processing, and analytics.
    • Expertise in workflow management tools like Airflow and container orchestration systems such as Kubernetes.
    • Strong knowledge of SQL and NoSQL databases, as well as data modeling and schema design principles.
    • Familiarity with healthcare data standards, terminologies, and regulations, such as HIPAA and GDPR, is highly desirable.
    • Excellent problem-solving, communication, and collaboration skills, with the ability to work effectively in cross-functional teams.
    • Demonstrated ability to manage multiple projects, prioritize tasks, and meet deadlines in a fast-paced environment.
    • A strong desire to learn, adapt, and contribute to a rapidly evolving data landscape.


    _Eight Eleven Group provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, national origin, age, sex, citizenship, disability, genetic information, gender, sexual orientation, gender identity, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state, and local laws.

    _


    Job Type:
    Contract


    Pay:
    From $70.00 per hour

    Expected hours: 40 per week


    Benefits:

    • Dental insurance
    • Health insurance
    • Vision insurance

    Schedule:

    • 8 hour shift
    • Monday to Friday

    Ability to Relocate:

    • Chicago, IL: Relocate before starting work (Required)

    Work Location:
    In person
  • Planet Technology

    Data Engineer

    Found in: Appcast US C2 - 7 hours ago

    Planet Technology Chicago, United States

    No Sponsorship Available · No C2C available · We are working with our Chicago based client who is embarking on a greenfield data migration to Azure. They are searching for a talented Azure Data Engineer with like experience to join the project from the beginning. There is an oppo ...

  • Dexian - Signature Consultants

    Data Engineer

    Found in: Appcast US C2 - 2 days ago

    Dexian - Signature Consultants Chicago, United States

    Job Summary: · Dexian is seeking a Data Engineer for an opportunity with a client located in Chicago, IL. · Responsibilities: · Analyze and organize raw data · Build data systems and pipelines · Evaluate business needs and objectives · Interpret trends and patterns · Conduct com ...

  • EPITEC

    Data Engineer

    Found in: Appcast US C2 - 6 days ago

    EPITEC Chicago, United States

    Typical task breakdown: · Develop datasets and microservices in support of new monitoring solutions and automations to accelerate issue detection and correction. · Transformation of data to enable machine learning and/or monitoring of anomalies. · Consumption of metadata to enabl ...

  • Dexian - Signature Consultants

    Data Engineer

    Found in: Appcast US C2 - 1 day ago

    Dexian - Signature Consultants Chicago, United States

    Job Summary: · Dexian is seeking a Data Engineer for an opportunity with a client located in Chicago, IL. · Responsibilities: · Direct programmers and analysts to make changes to existing databases and database management systems · Direct others in coding logical and physical dat ...

  • The Kraft Heinz Company

    Data Engineer

    Found in: Lensa US 4 C2 - 3 days ago

    The Kraft Heinz Company Chicago, United States

    General informationAll posting locations Chicago, Illinois, United States of AmericaJob Function 16 - DigitalDate Published 22-Jan-2024Ref # R-78605Description & RequirementsDutiesThe Data Engineer works closely with a multidisciplinary agile team to build high quality data pipel ...

  • Waltz Health

    Data Engineer

    Found in: Lensa US 4 C2 - 3 days ago

    Waltz Health Chicago, United States

    We are a Chicago-based technology startup that is leading a new way forward for prescription care. We're rethinking the pharmaceutical supply chain, introducing AI-driven marketplaces that drive down costs, and new consumer tools that guide decisions on care. Led by a team of ind ...

  • Tovala

    Data Engineer

    Found in: Lensa US 4 C2 - 4 days ago

    Tovala Chicago, United States

    [Full Time] Data Engineer at Tovala (United States) | BEAMSTART Jobs · Data Engineer · Tovala United States · Date Posted · 14 Jul, 2022 · Work Location · Chicago, IL, United States · Salary Offered · Not Specified · Job Type · Full Time · Experience Required · 3+ years · Remot ...

  • International Executive Service Corps

    Data Engineer

    Found in: Lensa US 4 C2 - 4 days ago

    International Executive Service Corps Chicago, United States

    About Anuvu · For over a decade, our clients in aviation and maritimehave usedour technology-driven products and services to keep their passengers entertained and connected to the things they love, from anywhere in the world.Brands such as Southwest Airlines, Norwegian Cruise Lin ...

  • Apidel Technologies

    Data Engineer

    Found in: Lensa US 4 C2 - 4 days ago

    Apidel Technologies Chicago, United States

    Role Overview · We are looking for a go getter person who can define: · Analytic strategies to meet the demands of business requirements · Technical requirements of the analytic solutions · Data requirements of the analytic solution processes · The person will be part of the ...

  • HexawareAvance Consulting

    Data Engineer

    Found in: Lensa US 4 C2 - 4 days ago

    HexawareAvance Consulting Chicago, United States

    The data engineer considers themselves an expert in data management with cloud technologies. The data engineer leads the definition and implementation of data pipelines, data storage, and data access/security for a complex Azure hosted application environment. They are responsibl ...

  • Waltzhealth

    Data Engineer

    Found in: Lensa US 4 C2 - 3 days ago

    Waltzhealth Chicago, United States

    We are on the hunt for a passionate Data Engineer to join our dynamic team. This role is perfect for those who possess an innate curiosity and a relentless drive to learn, offering a unique opportunity to contribute significantly to the healthcare sector within a vibrant startup ...

  • Baker Tilly Virchow Krause

    Data Engineer

    Found in: Lensa US 4 C2 - 5 days ago

    Baker Tilly Virchow Krause Chicago, United States

    As a Data Engineer, you will be a vital team member of the digital Product Solutions team focused on developing data driven products and analytics to drive new product development, and service offerings. You will work closely with other teams to deve Data Engineer, Engineer, Prod ...

  • EPITEC

    Data Engineer

    Found in: Lensa US 4 C2 - 2 days ago

    EPITEC Chicago, United States

    Typical task breakdown: · Develop datasets and microservices in support of new monitoring solutions and automations to accelerate issue detection and correction. · Transformation of data to enable machine learning and/or monitoring of anomalies. · Consumption of metadata to en ...

  • Hilco Global

    Data Engineer

    Found in: Lensa US 4 C2 - 3 days ago

    Hilco Global Chicago, United States

    Job Description: · This position reports into the AA&AT practice area and is responsible for supporting data acquisition, cleansing, data warehousing and governance. Work will include designing data warehouse to house data required to support Getzler Henrich clients and internal ...

  • Keller Postman LLC

    Data Engineer

    Found in: Lensa US 4 C2 - 4 days ago

    Keller Postman LLC Chicago, United States

    Keller Postman LLC is a national law firm that represents a broad array of clients as plaintiffs in complex litigation at the trial and appellate levels. We act for plaintiffs in federal and state court across a variety of claims and practice areas. We take on complicated cases—f ...

  • Trajektory

    Data Engineer

    Found in: Lensa US 4 C2 - 5 days ago

    Trajektory Chicago, United States

    Based in downtown Chicago, IL, Trajektory is an innovative data insights and valuation technology start-up with a unique take on how to leverage and value data throughout the sports, media, and entertainment industries. Trajektory was founded by a group of former industry executi ...

  • TransUnion

    Data Engineers

    Found in: Lensa US 4 C2 - 3 days ago

    TransUnion Chicago, United States

    TransUnion's Job Applicant Privacy Notice · Personal Information We Collect · Your Privacy Choices · Job Description · We'd Love to See: · Data Engineers for Chicago, IL location. Enable new software application features and optimize strategic analytics software platforms. C ...

  • Lawrence Harvey

    Data Engineer

    Found in: Lensa US 4 C2 - 3 days ago

    Lawrence Harvey Chicago, United States

    Data Engineer (Energy) · Our client is a leading Energy Storage company, developing sustainable solutions focused on energy trading, grid, and batteries. · Data Engineer (Energy) responsibilities: · Full ETL Data Pipeline: onboarding for projects and setting up data pipeline f ...

  • McDonald's Corporation

    Data Engineer

    Found in: Lensa US 4 C2 - 3 days ago

    McDonald's Corporation Chicago, United States

    Company Description · McDonald's evolving Accelerating the Arches growth strategy puts our customers and people first, and uses our competitive advantages to strengthen our brand. We are recognized on lists like Fortune's Most Admired Companies and Fast Company's Most Innovative ...

  • Optomi

    Data Engineer

    Found in: Lensa US 4 C2 - 5 days ago

    Optomi Chicago, United States

    Optomi, is in partnership with an Enterprise Automotive Repair Company, is seeking a Mid-Senior Level Data Engineer to join and grow the Data/BI Team in the Chicago Area. · All potential candidates should read through the following details of this job with care before making an ...