Jobs
>
San Francisco

    Research Scientist, Model Safety - San Francisco, United States - OpenAI

    Default job background
    Description
    About the Team


    The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.


    The Model Safety Research team aims to fundamentally advance our capabilities for precisely implementing robust, safe behavior in AI models, and to leverage these advances to make OpenAI's deployed models safe and beneficial.

    This requires a breadth of new ML research to address the growing set of safety challenges as AI becomes more powerful and used in more settings.

    Key focus areas include how to enforce nuanced safety policies without trading off helpfulness and capabilities, how to make the model robust to adversaries, how to address privacy and security risks, and how to make the model trustworthy in safety-critical domains.


    We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.

    About the Role

    OpenAI is seeking a senior researcher with passion for AI safety and experience in safety research.

    Your role will set directions for research to enable and empower safe AGI and work on research projects to make our AI systems safer, more aligned and more robust to adversarial or malicious use cases.

    You will play a critical role in shaping how a safe AI system should look like in the future at OpenAI, making a significant impact on our mission to build and deploy safe AGI.


    In this role, you will:

    • Conduct state-of-the-art research on AI safety topics such as RLHF, adversarial training, robustness, and more.
    • Implement new methods in OpenAI's core model training and launch safety improvements in OpenAI's products.
    • Set the research directions and strategies to make our AI systems safer, more aligned and more robust.
    • Coordinate and collaborate with cross-functional teams, including T&S, legal, policy and other research teams, to ensure that our products meet the highest safety standards.
    • Actively evaluate and understand the safety of our models and systems, identifying areas of risk and proposing mitigation strategies.

    You might thrive in this role if you:

    • Are excited about OpenAI's mission of building safe, universally beneficial AGI and are aligned with OpenAI's charter
    • Demonstrate a passion for AI safety and making cutting-edge AI models safer for real-world use.
    • Bring 4+ years of experience in the field of AI safety, especially in areas like RLHF, adversarial training, robustness, fairness & biases.
    • Hold a Ph.
    D. or other degree in computer science, machine learning, or a related field.


    • Possess experience in safety work for AI model deployment
    • Have an in-depth understanding of deep learning research and/or strong engineering skills.
    • Are a team player who enjoys collaborative work environments.
    About OpenAI

    OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.

    We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.

    AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.


    We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.


    For US Based Candidates:
    Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

    We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

    OpenAI Global Applicant Privacy Policy


    At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared.

    Join us in shaping the future of technology.


  • Zoox San Mateo, CA, United States

    Foster City, CASystem Design and Mission Assurance – Systems Engineering - Safety /Full-time /HybridAs a safety research engineer focused on human factors modeling, you will help Zoox to continuously update and evolve our understanding of safety-critical road user behavior, and c ...


  • OpenAI San Francisco, United States Full time

    About the Team · The team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. · The Safety Reasoning Research team is poised at the intersection of short-term pragmatic proje ...


  • Arcadis San Francisco, United States Part time

    Arcadis is seeking an Environmental Scientist, Geologist, or Engineer to join our Environment Resiliency team in the United States. This is a position for a dynamic individual looking for career growth in environmental consulting. · In this role, you willassist Project Managers ...


  • Databricks San Francisco, United States

    Company Description · At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI platform, so our customers can focus on ...


  • Recruits Lab (We're hiring) San Francisco, United States

    Are you ready to pioneer groundbreaking precision medicine therapies in the field of oncology? Our client, a leading clinical-stage precision medicine oncology company, is seeking a visionary · Director/Senior Director of Pharmacokinetics and Clinical Pharmacology to join their ...


  • Red Oak Technologies San Francisco, United States

    Red Oak Technologies is a leading provider of comprehensive resourcing solutions across a variety of industries and sectors including IT, Marketing, Finance, Business Operations, Manufacturing and Engineering. We specialize in quickly acquiring and efficiently matching top-tier p ...


  • Jenner & Block San Francisco, United States

    ABOUT JENNER & BLOCK · Jenner & Block LLP is a law firm with global reach, with offices in Century City, Chicago, London, Los Angeles, New York, San Francisco, and Washington, DC. The firm is known for its prominent and successful litigation practice, global investigations practi ...


  • HOK San Francisco, United States Full time

    We are currently seeking an Interior Design Professional to join our team. As an Interior Design Professional, you are responsible for basic interior design assignments and working with the project team to assist overall effort of completing various project phases. · Modifies an ...


  • Unreal Gigs San Francisco, United States Full time

    Overview · Join our dynamic team as a Machine Learning Engineer to pioneer solutions that transform industries. Your role involves developing sophisticated machine learning models and deploying scalable AI systems. You'll be at the forefront of innovation, turning visionary ideas ...

  • Suffolk Construction

    Digital Engineer

    3 weeks ago


    Suffolk Construction San Francisco, United States Regular Full time

    Overview · About Suffolk · Suffolk is a national enterprise that builds, innovates and invests. Suffolk is an end-to-end business that provides value throughout the entire project lifecycle by leveraging its core construction management services with vertical service lines that ...


  • Morrison Foerster San Francisco, United States

    Morrison Foerster LLP, an Am Law 50 law firm with 18 offices worldwide, has an opening for a Litigation Legal Secretary within our Legal Secretaries Department in our San Francisco office · The Opportunity · Guided by department objectives and priorities, performs a variety of ...

  • Luna Physical Therapy

    Physical Therapist

    5 days ago


    Luna Physical Therapy San Francisco, CA, United States

    Job Description · We're inviting exceptional PTs to join our "Elite" team - a special group of therapists delivering 20 or more visits per week to patients in their homes in San Francisco, CA, and nearby areas. As a Luna Elite therapist, you will receive competitive pay and great ...


  • Barry-Wehmiller San Francisco, United States Full time

    Description · : Electrical Engineer, PE · **This job is located in our Fort Worth office.** · **Relocation assistance will be considered on a case by case basis.** · Who You'll Work With · You will join one of our 45 offices in the US, be part of a committed team of over 1500 ...


  • Jefferson County, Colorado San Francisco, United States

    Description · : Hiring salary starts at $64,052.56 · Salary will be determined based on education, licensure, and experience; Relatable Master's and Licenses will receive additional salary in addition to base salary. Details will be discussed during the interview process. · B ...

  • State of California

    utilities engineer

    2 weeks ago


    State of California San Francisco, United States

    Job Posting: Renewable Energy Engineer · Public Utilities Commission · JC Renewable Energy Engineer · UTILITIES ENGINEER $6, $11,567.00 per Month · Final Filing Date: 6/18/2024 · Application Methods: Electronic (Using your CalCareer Account) By Mail Drop-off Job Descript ...


  • Spencer Ogden California City, United States

    This company develops, invests, and delivers solar photovoltaic (PV) and battery energy storage systems (BESS) projects through Engineering, Procurement, Construction (EPC) services in North America. · The company brings a decade of global leadership in solar PV to deliver utilit ...


  • Rippling San Francisco, United States

    About Rippling Rippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. For the first time ever, you can manage and automate eve ...

  • RAMS

    Peer Counselor

    3 weeks ago


    RAMS San Francisco, United States Full time

    Essential Job Duties may include, but are not limited to, any combination of these duties as required by the assigned department/unit: · As part of the BEST Neighborhoods team, provide trauma-informed, culturally aligned, and person-centered peer counseling services for individu ...


  • OpenAI San Francisco, United States Full time

    About the Team · We bring OpenAI's technology to the world through products like ChatGPT and the OpenAI API. · We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to u ...

  • Public Utilities Commission

    utilities engineer

    1 week ago


    Public Utilities Commission San Francisco, United States

    Job Description and Duties · Individuals interested in applying for this vacancy must have eligibility. If you are new to state service or need to gain eligibility to this classification, please to open the examination bulletin and follow the instructions on "How to apply". · Th ...