Jobs
>
Chicago

    Principal Consultant-Senior Data Engineer SRE - Chicago, United States - Genpact

    Default job background
    Technology / Internet
    Description

    Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitoring for data pipelines, and automating repetitive data-oriented tasks.

    Responsibilities:


    • Automate data tasks on GCP.


    • Work with data domain owners, data scientists and other stakeholders to that data is consumed effectively on GCP.


    • Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP.


    • Measure and monitor the quality of data on GCP data platforms.


    • Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to incidents promptly to minimize downtime and data loss.


    • Develop automation scripts and tools to streamline data operations and make them scalable to ensure accommodate growing data volumes and user traffic.


    • Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance.


    • Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements.


    • Ensure data security and compliance with data protection regulations. Implement best practices for data access controls and encryption.


    • Collaborate with data engineers, data scientists, and software engineers to understand data requirements, troubleshoot issues, and support data-driven initiatives.


    • Continuously assess and improve data infrastructure and data processes to enhance reliability, efficiency, and performance.


    • Maintain clear and up-to-date documentation related to data systems, configurations, and standard operating procedures.

    Qualifications we seek in you

    Minimum Qualifications / Skills:


    • Bachelor's or master's degree in computer science, Software Engineering, Data Science or related field, or equivalent practical experience

    Preferred Qualifications/ Skills:


    • Proficiency in data technologies, such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure).


    • Strong programming skills in languages like Python (numpy, pandas, pyspark), Java (Core Java, Spark with Java, functional interface, lambda, java collections), or Scala, with experience in automation and scripting.


    • Experience with containerization and orchestration tools like Docker and Kubernetes is a plus.


    • Experience with data governance (data plex), data security, and compliance best practices on GCP.


    • Solid understanding of software development methodologies and best practices, including version control (e.g., Git) and CI/CD pipelines.


    • Strong background in cloud computing and data-Intensive applications and services, with a focus on Google Cloud Platform.


    • Experience with data quality assurance and testing on GCP.


    • Proficiency with GCP data services (BigQuery; Dataflow; Data Fusion; Dataproc; Cloud Composer; Pub/Sub; Google Cloud Storage).


    • Strong understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc.


    • Knowledge of AI and ML tools is a plus.


    • Google Associate Cloud Engineer or Data Engineer certification is a plus.


    • Experience in data engineering or data science on GCP.


  • Cynet Systems

    Lead SRE Engineer

    23 hours ago


    Cynet Systems Chicago, United States

    Job Description: We (Digital Payments hiring team) are looking for full stack engineers who can build and release reliable software systems at scale. · Potential new hire should have a holistic view of their technical and industry (payments preferred) experience to design elegan ...


  • Gusto Chicago, United States

    About Gusto · Gusto is a modern, online people platform that helps small businesses take care of their teams. On top of full-service payroll, Gusto offers health insurance, 401(k)s, expert HR, and team management tools. Today, Gusto offices in Denver, San Francisco, and New York ...


  • Tempus Labs, Inc. Chicago, United States

    Passionate about precision medicine and advancing the healthcare industry? · Recent advancements in underlying technology have finally made it possible for AI to impact clinical care in a meaningful way. Tempus' proprietary platform connects an entire ecosystem of real-world evi ...


  • Nexient Chicago, United States

    Req ID: · 281699 · NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. · We are currently seeking a Azure Cloud SRE Enginee ...


  • Georgia IT Inc Chicago, United States

    Role: Machine Learning Engineer/SRE · Location: Chicago, IL or Remote · Duration: 12 Months · Rate: DOE · US Citizens and Green cards & GC-EAD Only. No Third-party C2C available for this job · Job Description · We are seeking a highly skilled and motivated Machine Learning ...

  • Crate&Barrel

    SRE/DevOps Engineer

    1 week ago


    Crate&Barrel Northbrook, United States

    We inspire purpose-filled living that brings joy to the modern home. With a team of more than 8,000 associates spanning 130 store and distribution locations across the U.S. and Canada, we achieve together, drive results and innovate to inspire. Drawn together by a shared passion ...

  • Crate and Barrel

    SRE/DevOps Engineer

    2 weeks ago


    Crate and Barrel Northbrook, United States

    We inspire purpose-filled living that brings joy to the modern home. With a team of more than 8,000 associates spanning 130 store and distribution locations across the U.S. and Canada, we achieve together, drive results and innovate to inspire. Drawn together by a shared passion ...

  • Crate&Barrel

    SRE/DevOps Engineer

    2 weeks ago


    Crate&Barrel Northbrook, United States

    We inspire purpose-filled living that brings joy to the modern home. With a team of more than 8,000 associates spanning 130 store and distribution locations across the U.S. and Canada, we achieve together, drive results and innovate to inspire. Drawn together by a shared passion ...


  • Grainger Lake Forest, United States

    W.W. Grainger, Inc. is seeking a Lead DevOps/SRE Engineer in Lake Forest, IL with the following requirements: Master's degree in Computer Science and Engineering or related field plus 5 years related experience. Prior experience must include: Develop Performance Testing Framework ...

  • Crate and Barrel

    SRE/DevOps Engineer

    2 weeks ago


    Crate and Barrel Northbrook, United States

    We inspire purpose-filled living that brings joy to the modern home. With a team of more than 8,000 associates spanning 130 store and distribution locations across the U.S. and Canada, we achieve together, drive results and innovate to inspire. Drawn together by a shared passion ...

  • Crate&Barrel

    SRE/DevOps Engineer

    2 weeks ago


    Crate&Barrel Northbrook, United States

    We inspire purpose-filled living that brings joy to the modern home. With a team of more than 8,000 associates spanning 130 store and distribution locations across the U.S. and Canada, we achieve together, drive results and innovate to inspire. Drawn together by a shared passion ...

  • Northern Trust Corporation

    Director, SRE

    3 days ago


    Northern Trust Corporation Chicago, United States Full time

    About Northern Trust: · Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. · Northern Trust is proud to provide innovative financial services and guidance to the world's most succ ...


  • DASH2 Chicago, United States

    The Senior/Principal Site Reliability Engineer is responsible for ensuring our SaaS products are fast, stable and optimized for our customers. SRE's here take on availability, performance, managing change, monitoring, response and are guardians of non-functional requirements. · Y ...


  • Brooksource Chicago, United States Contract

    Apply Now · << Database Administrator/Site Reliability Engineer · Contract · Remote · Description: · This Healthcare client is looking for an energetic and highly motivated SRE to join the team. If you are a Systems Engineer who loves automation, or a Software Developer who loves ...


  • Brooksource Chicago, United States Contract

    Apply Now · << Database Administrator/Site Reliability Engineer · Contract · Remote · Description: · This Healthcare client is looking for an energetic and highly motivated SRE to join the team. If you are a Systems Engineer who loves automation, or a Software Developer who loves ...


  • MethodHub Chicago, United States

    Job Title: Site Reliablity Engineer (Performance Monitoring) · Location: Remote · Duration: Long Term (W2 Only) · Client: Direct · Job Description: · Experience of 6-8 Professional experience as a Site Reliability Engineer (SRE) · Software development "hands on" engineer with exc ...


  • New York Technology Partners Chicago, United States

    Job Title: Site Reliability Engineer · Location: Chicago, IL (Hybrid) · Position: Contract · Job Description: · Skills Required: · SRE with Kubernetes and OCP expertise · 7+ years of experience in implementing and supporting Microservices solutions on OCP platform. · Expertise in ...


  • TechClub Inc Chicago, United States

    (Digital Payments hiring team) are looking for full stack engineers who can build and release reliable software systems at scale. Potential new hire should have holistic view of their technical and industry (payments preferred) experience to design elegant solutions and strategiz ...


  • Stash Talent Services Chicago, United States

    Job Description: · • Build, maintain, and operate IaaS and PaaS infrastructure in Azure commercial and government clouds · • Work closely with dev teams to identify and measure SLOs, SLAs and SLIs · • Act a strong contributor to development of platform services including architec ...


  • EPITEC Chicago, United States

    JOB TYPE: · W2,Contract · LOCATION: · Chicago, IL · JOB SUMMARY FOR DEVOPS ENGINEER: · The Goals Driven Wealth Management (GDWM) platform is a showcase product for the Management business providing holistic advice on wealth management to high-net-worth and ultra-high-net-worth cl ...