Jobs
>
San Francisco

    Senior Staff Software Engineer - San Francisco, United States - Cohere

    Default job background
    Description
    Who are we? Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.
    We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what's best for our customers.
    Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.
    Join us on our mission and shape the future
    Why this role? Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for Senior Staff Software Engineers to join the Model Serving team at Cohere. The team is responsible for developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. In this role, you will work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. You will also get the opportunity to interface with customers and create customized deployments to meet their specific needs.
    We are looking for candidates with a range of experiences for multiple roles, from senior to staff-level engineers.
    Please Note: We have offices in Toronto, Palo Alto, and London but embrace being remote-first There are no restrictions on where you can be located for this role.

    You may be a good fit if you have:

    • Experience with serving ML models.
    • Experience designing, implementing, and maintaining a production service at scale.
    • Familiarity with inference characteristics of deep learning models, specifically, Transformer based architectures.
    • Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or Inferentia), especially how they influence latency and throughput of inference.
    • Strong understanding or working experience with distributed systems.
    • Experience in performance benchmarking, profiling, and optimization.
    • Experience with cloud infrastructure (e.g. AWS, GCP).
    • Experience in Golang (or, other languages designed for high-performance scalable servers).
    If some of the above doesn't line up perfectly with your experience, we still encourage you to apply If you consider yourself a thoughtful worker, a lifelong learner, and a kind and playful team member, Cohere is the place for you.
    We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants of all kinds and are committed to providing an equal opportunity process. Cohere provides accessibility accommodations during the recruitment process. Should you require any accommodation, please let us know and we will work with you to meet your needs.
    Our Perks: An open and inclusive culture and work environment Work closely with a team on the cutting edge of AI research Weekly lunch stipend, in-office lunches & snacks Full health and dental benefits, including a separate budget to take care of your mental health 100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement Remote-flexible, offices in Toronto, Palo Alto, San-Francisco and London and co-working stipend 6 weeks of vacation
    Note: This post is co-authored by both Cohere humans and Cohere technology.

  • LinkedIn Dev Sandbox

    Software Engineer

    4 weeks ago


    LinkedIn Dev Sandbox San Francisco, United States

    Job Description · Job DescriptionTest job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job descrip ...


  • Dedge Security San Francisco, United States

    Dedge Security es una startup de ciberseguridad que nace de la mano de Rubén y Paco, una pareja de fundadores muy experimentados que tras vender su anterior empresa a un gran fabricante de Silicon Valley, ahora inician este nuevo proyecto, con el fin de asegurar el desarrollo y d ...

  • BHO Tech

    Software Engineer

    4 weeks ago


    BHO Tech San Francisco, United States Full time

    With us, we uniquely provide "Air Traffic Control" for data in motion. We are disrupting legacy data integration technologies, and helping enterprises reign in the complexity of their Cloud and Big Data platforms. Our customers range from mid-size enterprises to the world's large ...

  • Understanding Recruitment

    Software Engineer

    5 days ago


    Understanding Recruitment San Francisco, United States

    Deliver world-class Full Stack AI-driven products? · I am looking for talented Front End software engineers to join a SF-based team. Having received over $50m in their Series A funding, the team are looking to expand their software division. · You will be working on complex UI t ...

  • Boku Inc

    Software Engineer

    2 weeks ago


    Boku Inc San Francisco, United States

    POSITION SUMMARY: · The Payments Product team at Boku is expanding and we are looking for an experienced Software Engineer to join us. This position is based in the San Francisco Bay Area. As part of the Payments Product team, you will be responsible for end-to-end development o ...

  • BHO Tech

    Software Engineer

    5 days ago


    BHO Tech San Francisco, United States Full time

    About Us · We're on a mission to make it simple to buy and sell homes. The traditional process is broken, with an average home taking over 90 days to sell and costing thousands of dollars. We make buying and selling a home stress-free and instant. We've built an exceptional team, ...

  • Gusto

    Software Engineer

    2 weeks ago


    Gusto San Francisco, United States

    About Gusto · Gusto is a modern, online people platform that helps small businesses take care of their teams. On top of full-service payroll, Gusto offers health insurance, 401(k)s, expert HR, and team management tools. Today, Gusto offices in Denver, San Francisco, and New York ...

  • Ambient

    Software Engineer

    2 weeks ago


    Ambient San Francisco, United States Full time

    Position Overview: · In this role, you will get a unique opportunity to work on new industry-defining applications in the Smart Building space. In this cross-functional role, you will get broad exposure to other engineering stakeholders, business teams, and customers. Specifical ...

  • SS&C Technologies Holdings

    Software Engineer

    5 days ago


    SS&C Technologies Holdings San Francisco, United States Full time

    Job Description · Software Engineer /Sr. Software Engineer · Location(s): San Francisco, CA · Get To Know The Team · You will be working on a highly skilled, long tenured team across time zones modernizing APX, SSNC/Advent's portfolio accounting system. The team is embarking on a ...

  • Heliux

    Software Engineer

    3 weeks ago


    Heliux San Francisco, United States

    About Heliux · Heliux is building an all-in-one, AI-powered enterprise operating system for hardware engineering and manufacturing companies. Our platform enables our partners to manage their cross-functional teams and operations across engineering, supply chain, manufacturing, a ...

  • Atomus

    Software Engineer

    2 weeks ago


    Atomus San Francisco, United States

    This is a full-time on-site US Citizen backend-heavy role for a Software Engineer at Atomus located in San Francisco, CA. · Company Description · Atomus' mission is to provide world class cybersecurity for the world's most critical organizations. We build security compliance soft ...

  • Boku

    Software Engineer

    3 weeks ago


    Boku San Francisco, United States

    Boku Inc. (BOKU.L) is the leading global provider of local mobile-first payments solutions. Global brands including Amazon, DAZN, Meta, Google, Microsoft, Netflix, Sony, Spotify, and Tencent rely on Boku to reach millions of new paying consumers who do not use credit cards with o ...

  • Amazon

    Software Engineer

    6 days ago


    Amazon San Francisco, United States

    If you are interested in this position, please apply on Twitch's Career site About Us:Twitch is the world's biggest live streaming service, with global communities built around gaming, entertainment, music, sports, coo Software Engineer, Software, Engineer, Content Creator · ...

  • Elementl

    Software Engineer

    1 day ago


    Elementl San Francisco, United States

    About us · Were an early stage, well-funded startup team with a proven track record of shipping open source software with global adoption. We put a premium on respectful, clear, and complete communication, and we expect each other to be creative, curious, effective, and empathet ...

  • Group Nine LLC

    Software Engineer

    3 weeks ago


    Group Nine LLC San Francisco, United States

    Software Engineer · San Diego, CA · Position Summary: · The Software Engineer works within the Application Development & Support team to provide software programming for new software, production support and maintenance for existing software, as well as ad-hoc support of key depa ...

  • Finley Inc

    Software Engineer

    1 day ago


    Finley Inc San Francisco, United States

    Background · At Finley, we believe that todays most innovative companies deserve financial infrastructure that can move as quickly as they can. · Startups in finance, real estate, and transportation rely on debt capital to extend loans, purchase homes, and finance vehicle fleet ...

  • SingleStore

    Software Engineer

    3 weeks ago


    SingleStore San Francisco, United States

    Position Overview · SingleStore Software Engineers are at the forefront of real-time technology that's revolutionizing how companies run their businesses everyday. With release cycles throughout the year, our engineers are accustomed to moving quickly in a rapid production envir ...

  • Talent Software Services

    Software Engineer

    1 day ago


    Talent Software Services San Francisco, United States

    About The Job · This is a unique opportunity to grow as an engineer. You will work closely with lots of product development teams, operations teams, and leadership inside the org and outside the organization to design and build tools and infrastructure to empower engineers to de ...

  • Cypress HCM

    Software Engineer

    1 week ago


    Cypress HCM San Francisco, United States

    Job Description · Job Description · Software EngineerDescription:We are looking for a Software Engineer to develop and operate mission critical services and applications that are used customers and employees worldwide. · Responsibilities:Lead the technical design, implementation, ...

  • Group Nine LLC

    Software Engineer

    1 day ago


    Group Nine LLC San Francisco, United States

    Software Engineer · San Diego, CA · Position Summary: · The Software Engineer works within the Application Development & Support team to provide software programming for new software, production support and maintenance for existing software, as well as ad-hoc support of key dep ...