Jobs
>
San Francisco

    Engineering Manager, Data Platform - San Francisco, United States - Anthropic Limited

    Default job background
    Description


    We are looking for an Engineering Manager to lead the "Tokens: Data Platform" team, which owns the data platform responsible for creating the datasets used by our largest training runs.

    Most of Anthropic's research and product builds on top of the best pretrained models that we can produce, which in turn rely on the best pretraining data.

    These datasets drive the quality of the model and are therefore critical to get right.

    The team's responsibilities are as follows:

    • Own our largest data pipelines required for turning raw data into datasets, in turn used to train our models
    • Ensure that data processing happens seamlessly across petabyte scale and across a broad set of use cases
    • Innovate by creating "data primitives", collaborating with our data research efforts, to create the composable building blocks of data transformations at Anthropic

    Responsibilities:
    Grow, coach and support your reports in understanding, and pursuing, their professional growth

    Prioritize the team's work to make sure data processing is never the bottleneck in generating pretraining data required to launch new training runs

    Design processes (e.g. postmortem review, incident response, on-call rotations) that help the team operate effectively

    Run the team's recruiting efforts efficiently, ensuring we can grow as quickly as we need through a period of rapid growth

    You may be a good fit if you:

    Believe that advanced AI systems could have a transformative effect on the world, and are interested in helping make sure that transformation goes well

    Are interested in distributed data processing for building the best pretraining datasets, in turn used to build the best LLMs

    Are an experienced manager and actively enjoy people management

    Have at least 1 year of prior engineering management or equivalent experience (e.g. as a tech lead)

    Strong candidates may also have:

    Strong people management experience:
    Coaching, performance evaluation, mentorship, career development

    Have built a large scale data platform (100s of jobs running concurrently processing data at the petabyte scale)

    Technical expertise:
    Quickly understanding systems design tradeoffs, keeping track of rapidly evolving software systems

    Solid project management skills:
    Prioritization, communicating across team/org boundaries

    Experience recruiting for your team:
    Predicting staffing needs, designing interview loops, evaluating candidates and closing them

    Familiarity with Python

    Deadline to apply:
    None. Applications will be reviewed on a rolling basis.

    #J-18808-Ljbffr


  • Activision San Francisco, United States

    **Job Title**: Principal Product Manager, Data Platforms - Activision Blizzard Media · **Reporting to**: Senior Director, Product Management · **Location**:San Francisco, CA · **Your Role Within the Kingdom**: · Want to empower the world's best games? Interested in defining the f ...


  • Hispanic Technology Executive Council San Francisco, CA, United States

    Company Overview DocuSign helps organizations connect and automate how they agree. What you'll do As the Director of Product Management for our Agreement Data Platform team, you will spearhead the development and execution of our strategy to capture, define, structure and leverag ...


  • DocuSign, Inc. San Francisco, CA, United States

    DocuSign helps organizations connect and automate how they agree. As the Director of Product Management for our Agreement Data Platform team, you will spearhead the development and execution of our strategy to capture, define, structure and leverage agreement data effectively. Ag ...


  • Vir Biotechnology, Inc. San Francisco, United States

    Vir Biotechnology, Inc. is an immunology company focused on combining cutting-edge technologies to treat and prevent infectious diseases and other serious conditions. Vir has assembled two technology platforms that are designed to stimulate and enhance the immune system by exploi ...


  • Vir Biotechnology, Inc. San Francisco, United States

    Vir Biotechnology, Inc. is an immunology company focused on powering the immune system to transform lives by treating and preventing infectious diseases and other serious conditions, including viral-associated diseases. Vir has assembled two technology platforms that are designed ...


  • WeightsBiases San Francisco, United States

    At Weights & Biases, our mission is to build the best developer tools for AI developers. Weights & Biases is a series C company with $250 million in funding and a rapidly growing user base. Our platform is an essential piece of the daily work for machine learning engineers, from ...


  • Rippling San Francisco, CA, United States

    Rippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. With Rippling, you can hire a new employee anywhere in the world and set ...


  • WeightsBiases San Francisco, United States

    At Weights & Biases, our mission is to build the best developer tools for machine learning. Weights & Biases is a series C company with $250 million in funding and a rapidly growing user base. Our platform is an essential piece of the daily work for machine learning engineers, fr ...


  • Retool San Francisco, United States

    ABOUT RETOOL: · Nearly every company in the world runs on custom software: Gartner estimates that up to 50% of all code is written for internal use. This is the operational software for refunding orders, underwriting loans, onboarding employees, analyzing transactions, and prov ...


  • Socotra San Francisco, United States

    At Lyft, our mission is to improve people's lives with the world's best transportation. To do this, we start with our own community by creating an open, inclusive, and diverse organization. · We are seeking a talented Software Engineer to join our dynamic Streaming Compute Team. ...


  • Everyday Agents San Francisco, United States Full time

    About Woven · Consumer Travel is Ripe for Disruption · Today's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from techno ...


  • Woven San Francisco, United States Full time

    About Woven · Consumer Travel is Ripe for Disruption · Today's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from techno ...


  • Notion San Francisco, United States Full time

    About Us: · We're on a mission to make it possible for every person, team, and company to be able to tailor their software to solve any problem and take on any challenge. Computers may be our most powerful tools, but most of us can't build or modify the software we use on them ev ...


  • Everyday Agents San Francisco, United States Full time

    About Woven · Consumer Travel is Ripe for Disruption · Today's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from techno ...


  • Weights & Biases San Francisco, California, United States Full time

    At Weights & Biases, our mission is to build the best developer tools for machine learning. Weights & Biases is a series C company with $250 million in funding and a rapidly growing user base. Our platform is an essential piece of the daily work for machine learning engineers, fr ...


  • Weights & Biases San Francisco, California, United States Full time

    At Weights & Biases, our mission is to build the best developer tools for machine learning. Weights & Biases is a series C company with $250 million in funding and a rapidly growing user base. Our platform is an essential piece of the daily work for machine learning engineers, fr ...


  • Remix San Francisco, United States

    [Full Time] Senior Backend Engineer, Data Platform at Remix (United States) | BEAMSTART Jobs · Senior Backend Engineer, Data Platform · Remix United States · Date Posted · 31 Oct, 2022 · Work Location · San Francisco, United States · Salary Offered · Not Specified · Job Type · ...


  • Salesforce San Francisco, United States

    The Salesforce Marketing Cloud Database Management Plane team consists of inquisitive and tenacious engineers dedicated to excellence through platform expertise and steadfast integrity. While we understand that delivery is important, we consider quality to be our highest priority ...


  • Avanade West Valley City, United States

    CO Salary Range: USD 174, ,750.00 per year · Azure Data Platform Solution Architect · Harness the power of data to drive business success as an Azure Data Platform Solution Architect at Avanade, where every insight paves the way for innovation. · Come join us: · Embark on a j ...


  • Wells Fargo San Francisco, United States

    About this role: · Wells Fargo is seeking a Lead Business Execution Consultant to join the Commercial Bank's Capital Management & Pricing Strategy org within the new pricing platform implementation team. This is an exciting opportunity to own the implementation of the data, analy ...