Jobs
>
San Francisco

    Engineering Manager, AI Inference Systems - San Francisco, CA, United States - Genai Works

    Genai Works
    Genai Works San Francisco, CA, United States

    2 weeks ago

    Default job background
    Description

    About the Team

    The Applied AI team safely brings OpenAI's technology to the world. We released ChatGPT, Plugins, DALL·E, and the APIs for GPT-4, GPT-3, embeddings, and fine-tuning. We also operate inference infrastructure at scale. There's a lot more on the immediate horizon.

    We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.

    We serve end-users directly through ChatGPT, and serve developers through our APIs, which power product features that were never before possible.

    About the Role

    Model inference at OpenAI is powered through a single service we call our "Engine". The Engine wraps the PyTorch transformers which are GPT-4 and ChatGPT. We are looking for an engineering manager to help lead some of the critical work for this service and grow the team.

    In this role, you will:

    • Own substantial portions of our inference stack
    • Ensure we have the ability to run GPT-4, ChatGPT, and future models at increasingly high scale with increasing efficiency
    • Hire world-class AI systems engineers in one of the most competitive hiring markets
    • Coordinate the inference needs of OpenAI's teams and products
    • Create a diverse, equitable, and inclusive culture that makes all feel welcome while enabling radical candor and the challenging of group think

    You might thrive in this role if you:

    • Have 3+ years of experience in engineering management and 7+ years as an IC working with high scale distributed systems and ML systems.
    • Have experience with ML systems, particularly high scale distributed inference for modern LLMs.
    • Have experience with highly available, reliable, production grade systems at scale
    • Have familiarity with the latest AI research and working knowledge of how these systems are efficiently implemented
    • Care deeply about diversity, equity, and inclusion, and have a track record of building inclusive teams
    • Have experience closing extremely competitive candidates for your team, and the ability to craft and convey compelling visions of the future
    • Have a voracious and intrinsic desire to learn and fill in missing skills—and an equally strong talent for sharing learnings clearly and concisely with others
    • Are comfortable with ambiguity and rapidly changing conditions. You view changes as an opportunity to add structure and order when necessary

    As technical context: at the heart of our infrastructure is a large-scale deployment of GPU nodes running in dozens of Kubernetes clusters across regions. Some core technologies we build with include Python, PyTorch, CUDA, Triton, Redis, Infiniband, NCCL, NVLink

    This role is exclusively based in our San Francisco HQ. We offer relocation assistance to new employees.

    About OpenAI

    OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

    We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.

    For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

    We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link .

    At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

    #J-18808-Ljbffr
  • Money Fit by DRS

    Engineering Manager, AI Inference Systems

    2 weeks ago

    Money Fit by DRS San Francisco, CA, United States

    Location · San Francisco, CA · Type · Full time · Department · Applied AI · Compensation · $350K – $500K · In addition to the salary range listed above, total compensation also includes generous equity and benefits. · Medical, dental, and vision insurance for you and you ...

  • AbbVie

    Manager, Statistics

    4 days ago

    AbbVie South San Francisco, United States

    **Company Description** · **Job Description** Key Responsibilities** · - Develop statistical methodology for protocols with details for programming implementation. · - Provide expertise for design, analysis & reporting of clinical trials & other scientific research studies. Imple ...

  • University of California Berkeley

    Staff Research Associate 1

    2 days ago

    University of California Berkeley Berkeley, United States

    Staff Research Associate C), Helen Wills Neuroscience Institute About Berkeley · At the University of California, Berkeley, we are committed to creating a community that fosters equity of experience and opportunity, and ensures that students, faculty, and staff of all backgrounds ...

  • Rivian

    Onboard Model Optimization and Integration Lead

    2 days ago

    Rivian Palo Alto, United States

    About Rivian: · Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. · As a company, we constantly challenge what's possible, never simply accepti ...

  • Genai Works

    Platform ML Engineering Manager, Inference

    2 weeks ago

    Genai Works San Francisco, CA, United States

    About the Team · The Platform ML team builds the ML side of our state-of-the-art internal training framework used to train our cutting-edge models. We work on distributed model execution as well as the interfaces and implementation for model code, training, and inference. · Our ...

  • Together AI

    Systems Research Engineer, Machine Learning Systems

    1 week ago

    Together AI San Francisco, United States

    Role · As a Systems Research Engineer specialized in Machine Learning Systems, you will play a crucial role in researching and building the next generation AI platform at Together. Working closely with the modeling, algorithm, and engineering teams, you will design large-scale d ...

  • Genai Works

    Principal - Platform Engineering

    2 weeks ago

    Genai Works San Francisco, CA, United States

    The Platform ML team builds the ML side of our state-of-the-art internal training framework used to train our cutting-edge models. We work on distributed model execution as well as the interfaces and implementation for model code, training, and inference. · Our priorities are to ...

  • Money Fit by DRS

    Platform ML Engineering Manager, Inference

    2 weeks ago

    Money Fit by DRS San Francisco, CA, United States

    Location · San Francisco, CA · Type · Full time · Department · Research · Compensation · $440K – $530K · In addition to the salary range listed above, total compensation also includes generous equity and benefits. · Medical, dental, and vision insurance for you and your ...

  • Together AI

    Systems Research Engineer, Machine Learning Systems

    2 weeks ago

    Together AI San Francisco, CA, United States

    Role · As a Systems Research Engineer specialized in Machine Learning Systems, you will play a crucial role in researching and building the next generation AI platform at Together. Working closely with the modeling, algorithm, and engineering teams, you will design large-scale d ...

  • Surya Systems, Inc

    Data Scientist

    1 day ago

    Surya Systems, Inc San Francisco, United States

    Title: Data Scientist · Location : SFO, CA (Remote) · Duration: Long Term contract · About you · • You are passionate about solving complex problems within the Trust & Safety domain with data & insights; adding a new perspective to existing solutions and making business decisio ...

  • Surya Systems, Inc

    Data Scientist

    5 days ago

    Surya Systems, Inc San Francisco, United States

    Title: Data Scientist · Location : SFO, CA (Remote) · Duration: Long Term contract · Remote · About you · • You are passionate about solving complex problems within the Trust & Safety domain with data & insights; adding a new perspective to existing solutions and making busines ...

  • Deepscribe

    Lead Software Engineer

    5 days ago

    Deepscribe San Francisco, United States Full time

    Our Mission · At DeepScribe, we are bringing the joy of care back to medicine by helping AI and healthcare professionals work in harmony. Today, we are leveraging ambient AI to automate documentation - allowing clinicians to focus on providing care, not documenting it. Trained u ...

  • Ritual

    Remote - Machine Learning Engineer - Remote

    2 weeks ago

    Ritual San Francisco, CA, United States

    About Ritual · Ritual is the network for open AI infrastructure. We build groundbreaking, new architecture on a crowdsourced governance layer aimed to handle safety, funding, alignment, and model maintenance. · Join us on the journey to decentralize AI · About the role · We ar ...

  • Hireio, Inc.

    Tech lead, senior software engineer,AR/VR

    1 week ago

    Hireio, Inc. San Francisco, United States

    Job Description · Job DescriptionLanguage:bilingual · Requirements · B.Sc/M.Sc/PhD in Computer Science or in a related field · - 5+ years of industrial C/C++ experience, solid CS fundamentals (algorithms, data structures, OOD/DOD, TDD) and problem-solving skills · - Solid algori ...

  • Cohere

    Senior Staff Software Engineer

    4 days ago

    Cohere San Francisco, United States

    Who are we? Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our ...

  • Hyperbolic Labs

    AI Engineer

    5 days ago

    Hyperbolic Labs San Francisco, United States

    Who We Are: · Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By making better use of idle computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that ...

  • Acceler8 Talent

    Principal Machine Learning Infrastructure Engineer

    2 weeks ago

    Acceler8 Talent San Francisco, United States

    Introduction: · Join a pioneering team at the forefront of AI and ML technology, where human-computer collaboration is not just a concept but a reality. Our team is dedicated to revolutionizing user experiences by innovating at every level, from user interfaces down to the most e ...

  • Adobe

    Machine Learning Engineer

    4 days ago

    Adobe San Francisco, United States

    Our Company · Changing the world through digital experiences is what Adobe's all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We're passionate about empowering people to create beautiful ...

  • Acceler8 Talent

    Principal Machine Learning Infrastructure Engineer

    1 day ago

    Acceler8 Talent San Francisco, United States

    Introduction: · Join a pioneering team at the forefront of AI and ML technology, where human-computer collaboration is not just a concept but a reality. Our team is dedicated to revolutionizing user experiences by innovating at every level, from user interfaces down to the most e ...

  • HireIO Inc

    Tech lead, senior software engineer,AR/VR

    21 hours ago

    HireIO Inc San Francisco, United States

    Language:bilingual · Requirements · - B.Sc/M.Sc/PhD in Computer Science or in a related field · - 5+ years of industrial C/C++ experience, solid CS fundamentals (algorithms, data structures, OOD/DOD, TDD) and problem-solving skills · - Solid algorithm system design and implem ...