Jobs
>
San Francisco

    Software Engineer, Model Inference - San Francisco, United States - OpenAI

    Default job background
    Description
    About the Team

    Our team brings OpenAI's most capable technology to the world through our products. Most recently, we released ChatGPT, GPT-4, the Whisper API, and DALL-E. We empower consumers and developers alike to use and access our start-of-the-art AI models, allowing them to do things that they've never been able to before.

    Across all product lines, we ensure that these powerful tools are used responsibly. This is a key part of OpenAI's path towards safely deploying broadly beneficial Artificial General Intelligence (AGI). Safety is more important to us than unfettered growth.

    About the Role

    We're looking for an engineer to join our team at OpenAI to help us scale up our critical inference infrastructure, which efficiently services every customer request to use our state-of-the-art AI models, including GPT-4 and Dall-E.

    In this role, you will:
    • Improve the reliability, security, scalability, and observability of our distributed inference infrastructure.
    • Build tools to give us visibility into our bottlenecks and sources of instability and then design and implement solutions to address the highest priority issues.
    • Ensure the most efficient use of a constellation of different state-of-the-art AI models deployed on a large, heterogeneous fleet of Azure VMs under Kubernetes.
    You might thrive in this role if you:
    • Have experience with high-throughput scheduling as a service, particularly at supercomputing scale.
    • Are proficient in testing, debugging, and maintaining systems written in low-level systems languages, particularly C++ or Go.
    • Either know or can quickly learn the fundamentals of modern AI architectures.
    • Have at least 3 years of professional software engineering experience.
    • Know network technologies inside and out from L1 to L7.
    • Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done.
    • Have a good intuition for when off-the-shelf solutions will work, and build tools to accelerate your own workflow quickly if they won't.
    • Have the ability to move fast in an environment where things are sometimes loosely defined and may have competing priorities or deadlines.
    About OpenAI

    OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

    We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.

    For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

    We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

    OpenAI Global Applicant Privacy Policy

    At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.


  • Amgen San Francisco, United States

    **HOW MIGHT YOU DEFY IMAGINATION?** · If you feel like you're part of something bigger, it's because you are. At Amgen, our shared mission—to serve patients—drives all that we do. It is key to our becoming one of the world's leading biotechnology companies. We are global collabor ...


  • Amazon Services LLC San Francisco, United States

    PhD in economics or equivalent · The Global Cross-Channel and Cross · - Category Marketing (XCM) org are seeking an experienced Economist to join our team. XCM's mission is to be the most measurably effective and creatively breakthrough marketing organization in the world in orde ...

  • Uber

    Staff Scientist

    3 days ago


    Uber San Francisco, United States

    **About the Role** · The Airports team strives to create the best possible experience for our Riders, Drivers, and Airport Partners. We work across Uber's entire tech stack, including Pricing, Matching, Maps, and Rider/Driver Experience, and are looking for a Staff Scientist who ...


  • Disney Entertainment & ESPN Technology San Francisco, United States

    Engineering Manager, Production ML · The vision of the Machine Learning (ML) Engineering team at Disney is to drive and enable ML usage across several domains in heterogeneous language environments and at all stages of a project's life cycle, including ad-hoc exploration, prepari ...


  • hims & hers San Francisco, United States

    Hims & Hers Health, Inc. (better known as Hims & Hers) is the leading health and wellness platform, on a mission to help the world feel great through the power of better health. We are revolutionizing telehealth for providers and their patients alike. Making personalized solution ...


  • UC San Francisco Academic San Francisco, United States

    **Application Window**: · **Open date**:May 1, 2024 · **Next review date**: Thursday, May 16, 2024 at 11:59pm (Pacific Time) · **Final date**:Saturday, Nov 1, 2025 at 11:59pm (Pacific Time) · Applications will continue to be accepted until this date, but those received after the ...


  • Genentech San Francisco, United States

    **The Position**: · **The Position** · A healthier future. It's what drives us to innovate. To continuously advance science and ensure everyone has access to the healthcare they need today and for generations to come. Creating a world where we all have more time with the people w ...


  • Afterpay San Francisco, United States

    **Company Description**: · - It all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay ...


  • Cash App San Francisco, United States

    **Company Description** · It all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay/Cl ...


  • Thomson Reuters San Francisco, United States Full time

    Principal Research Engineer · We are seeking a highly skilled and experienced Principal Research Engineer to join our team at Thomson Reuters Labs. As a leader in our organization's generative AI journey, you will have the opportunity to shape the future of our company and make ...


  • Strativ Group San Francisco, United States

    Senior Machine Learning Engineer · -> up to $225k base + ~1% equity · We are currently partnered with a well-backed Seed-stage startup who are revolutionizing the landscape of language models (LLMs) through intelligence and optimization, enabling businesses and individuals to uti ...


  • OpenAI San Francisco, United States Full time

    About the Team · Our mission at OpenAI is to discover and enact the path to safe, beneficial AGI. To do this, we believe that many technical breakthroughs are needed in generative modeling, reinforcement learning, large scale optimization, active learning, among other topics. · ...


  • DoorDash San Francisco, United States

    About the Role · As a Machine Learning Engineer, you will have the opportunity to leverage our robust data and machine learning infrastructure to develop ML models that impact millions of users across our three audiences and tackle our most challenging business problems. You will ...


  • Thumbtack San Francisco, United States Full time

    About the Role · As a Marketing Senior Data Scientist at Thumbtack, you'll be expected to leverage your analytical expertise, marketing knowledge, and interpersonal skills to drive a variety of high-impact projects. You will embed directly with a growth marketing team to help op ...


  • circle labs San Francisco, United States

    Company Description · We let anyone build AI friends with social intelligence. The work you do will touch hundreds of thousands of people. · We've raised $5m by Lightspeed, Nat Friedman/AI Grant, & the founders of Riot Games, Rubrik, and Behance. · If you are passionate about usi ...


  • DoorDash San Francisco, United States

    About the Role · We're looking for a passionate Applied Machine Learning expert to join our team. As a Senior Machine Learning Engineer, you'll be conceptualizing, designing, implementing, and validating algorithmic improvements to the growth and personalization experiences at th ...


  • Databricks San Francisco, United States

    RDQ225R416 · At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best dat ...


  • Hermès San Francisco, United States Full time

    The Team: · The Hermès San Francisco Boutique opened in 1987 and focuses on providing extraordinary service to clients as a part of the Western Region. This position will report to the Floor Director and will work collaboratively with the sales team and selling support teams to ...


  • InsideHigherEd San Francisco, United States Faculty Jobs ,

    · Lecturer - Data Science - School of Information · Position overview Position title: Lecturer · Salary range: The starting, full-time equivalent annual salary rate is currently $130,851. Appointments are typically from one to three sections per term for up to three terms per y ...


  • Together AI San Francisco, United States

    Role · As a Systems Research Engineer specialized in Machine Learning Systems, you will play a crucial role in researching and building the next generation AI platform at Together. Working closely with the modeling, algorithm, and engineering teams, you will design large-scale d ...