MLOps Quality Engineer - Pittsburgh, United States - Mastech Digital

    Default job background
    Banking / Loans
    Description

    Mastech Digital Inc. is a (certified) Minority owned business certified by NMSDC. Public traded firm under MHH at NYSE, Established in 1986. Headquartered in Pittsburgh, PA our operations are spread across 11 Global Recruiting & Sales offices across US.

    Role: Quality Engineer

    Location: Pittsburgh PA/Cleveland OH

    Duration: Full Time

    Employment Type: Hybrid (3 days per week)

    Job Description:

    • Hands on Quality Engineering experience in developing and executing test strategies for AWS Sagemaker, data / code pipeline integrations, with a focus on machine learning operations.
    • In depth knowledge of MLOps best practices, especially around ML / model testing and deployment.
    • Ability to take a project from scoping the requirements and building the test cases.
    • Experience in automating testing of AI/ML models and evaluation of the model/data quality and statistical properties.
    • Ability to analyze results from the test set and create defects based on result patterns.
    • Work with developers to design specific testing strategies for features being developed and automate them.
    • Business context and experience within Fraud, AML modeling ecosystems and related model scenarios a major plus
    • Proficiency in programming languages such as Java, Python, knowledge of machine learning frameworks and familiarity with tools (Jenkins/GIT/Bitbucket) for continuous integration and deployment (CI/CD) and automated testing tools such as selenium, Cucumber, Karate
    • On hands testing experience in Big Data/Hadoop preferred.
    • Good exposure to using Anaconda, Jupyter notebook preferred.
    • Proficiency in data analysis using complex SQL joins.

    Quality Assurance Expertise:

    • Strong understanding of quality assurance principles and methodologies, including testing strategies for machine learning models and data pipelines.
    • Hands on experience on Test managers such as Jira- Jira Xray
    • Bachelors in computer science / computer engineering or related subjects with 4+ years of work experience.
    • Relevant AWS/ Cloud Computing/ ML certifications preferred.