Jobs
>
San Francisco

    Quality Infrastructure Manager - San Francisco, CA, United States - Scale AI, Inc.

    Default job background
    Description

    Humans are essential in providing the best training data for these models, and Scale operates the largest network of humans in the world to provide this training data.

    As the Head of Quality Operations, you will be responsible for ensuring that our training data quality is as useful for customers as possible.

    You will own ideating what high-quality training means and looks like across various projects, driving thought leadership with our customers about data quality, developing the entire contributor training program, creating our "golden datasets" to programmatically evaluate taskers, and more.

    The role involves a combination of strategic thinking, data analysis, roll-up-your-sleeves operations, and cross-functional collaboration. Work with linguists, academics, and researchers to ensure Scale stays at the forefront of the definition of data quality
    Own communication and thought leadership around data quality with key customers and stakeholders
    Oversee the training materials and curriculum for our entire contributor base
    Oversee the creation of our "golden datasets" to ensure we have a quality signal on our contributors in a scalable way

    Work with project teams to understand the nuances and challenges of developing good training data, come up with perspectives on how those edge cases should be handled, and relay that perspective to our customers.

    Lead a team of 6-8 people, including a training team, a golden-set-creation team, and a quality-ideation team
    A relentless attitude of testing and iterating
    ~ The base salary range for this full-time position in our hub locations of San Francisco, New York, or Seattle, is $200,000 - $225,000 .

    The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training.

    Scale employees are also granted Stock Options that are awarded upon board of director approval.
    Comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO.

    At Scale, we believe that the transition from traditional software to AI is one of the most important shifts of our time.

    Our products power the world's most advanced LLMs, generative models, and computer vision models.

    We are trusted by generative AI companies such as OpenAI, Meta, and Microsoft, government agencies like the U.We are expanding our team to accelerate the development of AI applications.

    We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.

    We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities.

    If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at .


    PLEASE NOTE:

    We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates.

    We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants' needs, provide our services, and comply with applicable laws.

    Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data.

    #


  • Stellar Enterprises West Valley City, United States

    Learning is and will remain a central part of our working world. DB Training, Learning & Consulting is the center for qualification for over employees of Deutsche Bahn. Support us in our goal to be digital, innovative and flexible, and create new learning spaces for the DB Group. ...


  • University of California San Francisco, United States

    · Manager, Network Infrastructure · IT - Network Engineering · Full Time · 77337BR · Job Summary · The Manager, Network Infrastructure will report to the Director, Network Services who serves as the senior network leader for information technology at UCSF. The Manager, Netwo ...


  • University of California San Francisco, United States

    Manager, Network Infrastructure · IT - Network Engineering · Full Time · 77337BR · Job Summary · The Manager, Network Infrastructure will report to the Director, Network Services who serves as the senior network leader for information technology at UCSF. The Manager, Network Inf ...


  • Tonal San Francisco, United States

    Who We Are · Tonal is the smartest home gym and personal trainer. It has completely revolutionized the way people work out at home, with its sleek design and advanced A.I. technology. Weve united a diverse team of experts and decades of research to reinvent strength training, ma ...


  • Pilot San Francisco, United States

    The Role · Pilot is a successful startup, and we're hiring an engineering manager to lead our Infrastructure engineering team. · All of our teams have unique charters to collectively build the software, services and systems that enable Pilot to deliver a high-quality experience ...


  • ZIP San Francisco, United States

    [Full Time] Engineering Manager, Infrastructure at Zip (United States) | BEAMSTART Jobs · Engineering Manager, Infrastructure · Zip United States · Date Posted · 18 Nov, 2022 · Work Location · San Francisco, United States · Salary Offered · $190000 — $240000 yearly · Job Type · ...


  • Pilot San Francisco, United States

    The Role · Pilot is a successful startup, and we're hiring an engineering manager to lead our Infrastructure engineering team. · All of our teams have unique charters to collectively build the software, services and systems that enable Pilot to deliver a high-quality experience ...


  • Hunt Electric West Valley City, United States

    Job Description · Job Description Salary: · Traffic & Infrastructure Division Manager: · As our new · Traffic & Infrastructure Division Manager , your results-oriented approach will drive the continued success of our T&I operations across multiple branches. Pairing your analyti ...


  • Karkidi San Francisco, United States

    Anthropics Finetuning Infrastructure team builds the systems that support our large-scale distributed finetuning runs. As manager of the team, youll support a team of machine learning and distributed systems experts, with the goal of making these systems highly efficient, support ...


  • Reddit San Francisco, United States

    Our mission is to bring community and belonging to everyone in the world. Reddit is a community of communities where people can dive into anything through experiences built around their interests, hobbies, and passions. With more than 50 million people visiting 100,000+ communiti ...


  • Arup San Francisco, United States

    Senior Manager, Infrastructure Advisory · Americas Region · ? · SAN0000VNRequisition # · Dedicated to sustainable development, Arup is a collective of designers, advisors and experts working across 140 countries. Founded to be both humane and excellent, we collaborate with ou ...


  • Karkidi San Francisco, United States

    Anthropic's Finetuning Infrastructure team builds the systems that support our large-scale distributed finetuning runs. As manager of the team, you'll support a team of machine learning and distributed systems experts, with the goal of making these systems highly efficient, suppo ...


  • Arup San Francisco, CA, United States

    Senior Manager, Infrastructure Advisory · Americas Region · ? · SAN0000VNRequisition # · Dedicated to sustainable development, Arup is a collective of designers, advisors and experts working across 140 countries. Founded to be both humane and excellent, we collaborate with our ...


  • Platinum Global Talent Solutions Ltd. San Francisco, United States

    Job Description · Job DescriptionPlatinum Global Talent Solutions is delighted to be recruiting for a Pre-Construction Manager where you'll oversee preconstruction activities for various infrastructure project pursuits. This dynamic role offers growth opportunities and involves c ...


  • Webber San Francisco, United States

    Job Description · Job DescriptionPosition SummaryProvides administrative, financial, procurement, 3rd party claims support to project. · Compensation range: $25-$35 per hour · Primary Duties and ResponsibilitiesResponsible for new hire process to include new hire paperwork, payro ...


  • Flexport San Francisco, United States

    About Flexport: · At Flexport, we believe global trade can move the human race forward. That's why it's our mission to make global commerce so easy there will be more of it. We're shaping the future of a $8.6T industry with solutions powered by innovative technology and exception ...


  • Crusoe San Francisco, United States

    Job Description · Job DescriptionCrusoe Energy is on a mission to unlock value in stranded energy resources through the power of computation. · Take a look at what we do - · We aim to align the long term interests of the climate with the future of global computing infrastructur ...


  • Flexport San Francisco, United States

    About Flexport: · At Flexport, we believe global trade can move the human race forward. That's why it's our mission to make global commerce so easy there will be more of it. We're shaping the future of a $8.6T industry with solutions powered by innovative technology and excepti ...


  • Crusoe Energy Inc San Francisco, United States

    Crusoe Energy is on a mission to unlock value in stranded energy resources through the power of computation. · Take a look at what we do - · We aim to align the long term interests of the climate with the future of global computing infrastructure. As data centers consume an expo ...


  • Ripple San Francisco, United States Full time

    At Ripple, we're building a world where value moves like information does today. It's big, it's bold, and we're already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and crea ...