Jobs
>
San Francisco

    Research Engineer, Collective Alignment - San Francisco, United States - OpenAI

    OpenAI
    OpenAI San Francisco, United States

    Found in: Lensa US 4 C2 - 6 days ago

    Default job background
    Description
    About the team

    OpenAI's mission is to ensure that artificial general intelligence benefits all of humanity. OpenAI's Collective Alignment Team works on technical approaches to ensure that AGI is shaped democratically. We plan to do so by implementing a system for collecting and encoding public input on model behavior into our systems. While OpenAI has existing efforts to solve technical alignment, we also need systems to help us determine the answer to the question "What do we align to?"

    Regulatory bodies are building up capacity to manage such systems, but may not be up-to-speed on the latest technology. Our best bet is to find more ways to ensure that we are appropriately managing risk and harms that our technologies may pose, including by increasing our ability to make good decisions about system development and deployment.

    One way to increase our ability to make good decisions is to have input from the broader public. We are encouraged by the phenomenal work done by the recipients of our Democratic Inputs to AI grant that we launched in May, which was aimed at exploring and building in the space of governing AI behavior democratically. We selected 10 teams (out of nearly 1000 applicants) who were each awarded $100,000 to build, test, and share learnings from projects that explore how we can use democratic methods to decide the rules that govern AI systems.

    We're excited to combine our research with ideas and prototypes developed by these teams in the coming months. We will implement a system that can find representative participants to provide their perspectives on a given topic, enable discussion and deliberation, and aggregate inputs into policies that are used to change our model behavior. And we're looking for excellent, highly motivated Research Engineers to help us.

    About the role

    We are seeking Research Engineers to help design and implement experiments for collective alignment research. Responsibilities may include:
    • Writing performant and clean code for ML training.
    • Independently running and analyzing ML experiments to diagnose problems and understand which changes are real improvements.
    • Writing clean non-ML code, for example when building interfaces to let workers and participants interact with our models or pipelines for managing human data.
    • Collaborating closely with a small team to balance the need for flexibility and iteration speed in research with the need for stability and reliability in a complex long-lived project.
    • Understanding our high-level research roadmap to help plan and prioritize future experiments.
    • Implement experiments to measure the effectiveness of different preference learning techniques, including RLHF
    • Examine the impact of different aggregation methodologies on model behavior
    • Curate large datasets of prompts and investigate coverage of boundary cases
    • Exploring methods to understand and predict model behaviors, such as finding inputs causing anomalous circuits or catastrophic outputs
    • Designing novel approaches for using LLMs in democratic inputs to AI research
    You might thrive in this role if you
    • Are excited about OpenAI's mission of building safe, universally beneficial AGI and are aligned with OpenAI's charter
    • Want to use your engineering skills to push the frontiers of what state-of-the-art language models can accomplish
    • Possess a strong curiosity about the sociotechnical challenges around aligning and understanding ML models, and are motivated to use your career to address this challenge
    • Enjoy fast-paced, collaborative, and cutting-edge research environments
    • Have experience implementing ML algorithms (e.g., PyTorch)
    • Can develop data visualization or data collection interfaces (e.g., JavaScript, Python)
    • Want to ensure that humanity can shape future powerful AI systems
    About OpenAI

    OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

    We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.

    For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

    We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

    OpenAI Global Applicant Privacy Policy

    At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

  • Wellington Management Company, LLP

    Relationship Analyst

    Found in: One Red Cent US eFC C2 - 3 weeks ago


    Wellington Management Company, LLP San Francisco, United States Full time

    About Us · Wellington Management offers comprehensive investment management capabilities that span nearly all segments of the global capital markets. Our investment solutions, tailored to the unique return and risk objectives of institutional clients in more than 60 countries, d ...

  • Solomon Page

    Marketing Manager

    Found in: Appcast Linkedin GBL C2 - 10 hours ago


    Solomon Page San Francisco, United States

    Our client, a global e-Commerce company in San Francisco, is looking for a Marketing Manager to join their collectibles team for a long-term contract. In this position, you will play a pivotal role in driving the success of our marketing efforts within this niche market. You will ...

  • SFMoMA

    Collections Information Manager

    Found in: Lensa US 4 C2 - 4 days ago


    SFMoMA San Francisco, United States

    The San Francisco Museum of Modern Art is one of the largest museums of modern and contemporary art in the United States and a thriving cultural center for the Bay Area. We cannot imagine life without art; it inspires and connects us every day. Now more than ever, these connectio ...

  • SFMoMA

    Collections Information Manager

    Found in: Lensa US 4 C2 - 5 days ago


    SFMoMA San Francisco, United States

    The San Francisco Museum of Modern Art is one of the largest museums of modern and contemporary art in the United States and a thriving cultural center for the Bay Area. We cannot imagine life without art; it inspires and connects us every day. Now more than ever, these connectio ...

  • Generate Capital

    Associate, Compensation

    Found in: MyJobHelper US C2 - 1 week ago


    Generate Capital San Francisco, United States Full time

    You will play a vital role in translating Generate's compensation philosophy into world-class programs that attract, motivate, and retain top talent. Partnering with Finance, Legal, the People Team, and external consultants, you will ensure our compensation programs are market-dr ...

  • Botrista, Inc.

    Marketing Program Manager for Partnership

    Found in: Appcast Linkedin GBL C2 - 1 day ago


    Botrista, Inc. San Francisco, United States

    Position Summary · As the Marketing Program Manager for Partnership, you will play a pivotal role in driving the efficiency and effectiveness of our marketing operations for specific partners while fostering strategic alliances with external parties. Collaborating closely with ou ...

  • eTeam Inc.

    Product Manager

    Found in: Lensa US 4 C2 - 5 days ago


    eTeam Inc. San Francisco, United States

    Role: Product ManagerLocation: HybridDuration: 6+ MonthsThe OpportunityThe Product Manager will lead the partnership with the internal customers to understand their processes/ pain points and collect and prioritize key business requirements in support of the technology solution r ...

  • Zazzle

    Senior Manager, SEM

    Found in: Lensa US P 2 C2 - 3 weeks ago


    Zazzle San Francisco, United States Full time

    Zazzle is a premier online marketplace that connects millions of customers with independent designers and makers to create custom, one-of-a-kind products. From personalized wedding invitations and custom holiday cards to unique home décor, Zazzle empowers personal expression and ...

  • OpenAI

    Technical Program Manager, Human Data

    Found in: Click to Hired US C2 - 2 days ago


    OpenAI San Francisco, United States

    About the TeamThe Human Data team is focused on empowering AI teachers to train OpenAI's models to solve complex problems in order to provide value to humanity. We believe that highly skilled AI teachers are the key to unlocking the potential of our models to be as accurate and h ...

  • eTeam Inc.

    Product Manager

    Found in: Lensa US 4 C2 - 12 hours ago


    eTeam Inc. San Francisco, United States

    Role: Product Manager · Location: Hybrid · Duration: 6+ Months · The Opportunity · The Product Manager will lead the partnership with the internal customers to understand their processes/ pain points and collect and prioritize key business requirements in support of the technolo ...

  • Diligente Technologies

    Sr. Network Engineer

    Found in: Appcast US C2 - 10 hours ago


    Diligente Technologies San Francisco, United States

    Title- Sr. Network Engineer · Duration: 12+ Months · Location- San Francisco, CA · Day-to-day responsibilities will involve · Performs network and network security engineering, administration and support functions within the enterprise network infrastructure. The position is acco ...

  • Salesforce

    Event Senior Manager

    Found in: Lensa US 4 C2 - 6 days ago


    Salesforce San Francisco, United States

    We are seeking a dynamic and expert Senior Manager, Event Content (Strategy) to join our Strategic Events team. This role is responsible for crafting the content strategy, ensuring alignment with core business priorities, and maintaining high standards of quality, accountability ...

  • Loom

    Diversity, Equity, Inclusion, and Influence Business Partner

    Found in: Click to Hired US C2 - 2 days ago


    Loom San Francisco, United States

    Overview · Join the TEAM We are a fast-paced tech company where innovation thrives, and individuals have the opportunity to do their best work. We believe diversity, equity, and inclusion are not only fundamental values but also strategic imperatives. We are committed to fosterin ...

  • RadNet

    Patient Service Representative

    Found in: Lensa US 4 C2 - 4 days ago


    RadNet San Francisco, United States

    Overview: · Artificial Intelligence; Advanced Technology; The very best in patient care. With decades of expertise, we are Radiology Forward. With dynamic cross-training and advancement opportunities in a team-focused environment, the core of our success is its people with the c ...

  • DocMatter Inc.

    clinical engagement lead

    Found in: MyJobHelper US C2 - 1 day ago


    DocMatter Inc. San Francisco, CA , USA, United States

    DocMatter is an ambitious, growth-stage company that is changing the face of collaboration for the medical community and is hiring exceptional individuals that want to contribute to that mission. We are fast becoming a household name among clinicians worldwide who consistently re ...

  • Figma

    Manager, Credit and Collections

    Found in: Lensa US 4 C2 - 3 days ago


    Figma San Francisco, United States

    As the Manager, Credit and Collections, you'll play a critical role in establishing the newest pillar of Figma's revenue operations team. You will have the opportunity to build our credit and collections process from scratch and form a new team to support your vision. We have som ...

  • Net Impact

    Senior Employee and Labor Relations Partner

    Found in: Lensa US 4 C2 - 1 day ago


    Net Impact San Francisco, CA, United States

    Senior Employee and Labor Relations Partner · Tides · About Tides · Tides is a nonprofit and philanthropic organization committed to advancing social justice. We work across the social sector to shift power to communities of color and other groups historically denied power. · ...

  • FRAME

    Part-time Sales Associate, Weekends

    Found in: Appcast Linkedin GBL C2 - 6 hours ago


    FRAME San Francisco, United States Part time

    FRAME is currently looking to hire a Part-Time Associate for our Fillmore Retail Store · FRAME is a brand that bridges the heritage and quality of manufacturing in Los Angeles with a distinctly European aesthetic. Its collections take inspiration from a French way of "dressed up ...

  • Ursus Inc

    Marketing Manager III

    Found in: Lensa US 4 C2 - 6 days ago


    Ursus Inc San Francisco, United States

    JOB TITLE: Marketing Manager III · LOCATION: San Francisco, CA (hybrid) · DURATION: 8 months · PAY RANGE: $ $43.00 · TOP 3 SKILLS:Bachelor's degree in Marketing, Business, or a related field. · 4+ years of experience in marketing, with a focus on campaign execution and cross- ...

  • BayOne Solutions

    SAP S/4 Hana Architect

    Found in: Appcast US C2 - 10 hours ago


    BayOne Solutions San Francisco, United States

    SAP S/4 Hana Central Finance – Architect · Location: 100% remote work · Duration: 6+ months · Job Description: · We are seeking a highly skilled SAP S/4 Hana Finance Architect with extensive experience in SAP ECC and S/4 HANA Central Finance implementation to join our team. As a ...