- Experience with serving ML models.
- Experience designing, implementing, and maintaining a production service at scale.
- Familiarity with inference characteristics of deep learning models, specifically, Transformer based architectures.
- Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or Inferentia), especially how they influence latency and throughput of inference.
- Strong understanding or working experience with distributed systems.
- Experience in performance benchmarking, profiling, and optimization.
- Experience with cloud infrastructure (e.g. AWS, GCP).
- Experience in Golang (or, other languages designed for high-performance scalable servers).
-
Software Engineer
4 weeks ago
LinkedIn Dev Sandbox San Francisco, United StatesJob Description · Job DescriptionTest job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job description Test job descrip ...
-
Senior Software Engineer
3 weeks ago
Dedge Security San Francisco, United StatesDedge Security es una startup de ciberseguridad que nace de la mano de Rubén y Paco, una pareja de fundadores muy experimentados que tras vender su anterior empresa a un gran fabricante de Silicon Valley, ahora inician este nuevo proyecto, con el fin de asegurar el desarrollo y d ...
-
Software Engineer
4 weeks ago
BHO Tech San Francisco, United States Full timeWith us, we uniquely provide "Air Traffic Control" for data in motion. We are disrupting legacy data integration technologies, and helping enterprises reign in the complexity of their Cloud and Big Data platforms. Our customers range from mid-size enterprises to the world's large ...
-
Software Engineer
5 days ago
Understanding Recruitment San Francisco, United StatesDeliver world-class Full Stack AI-driven products? · I am looking for talented Front End software engineers to join a SF-based team. Having received over $50m in their Series A funding, the team are looking to expand their software division. · You will be working on complex UI t ...
-
Software Engineer
2 weeks ago
Boku Inc San Francisco, United StatesPOSITION SUMMARY: · The Payments Product team at Boku is expanding and we are looking for an experienced Software Engineer to join us. This position is based in the San Francisco Bay Area. As part of the Payments Product team, you will be responsible for end-to-end development o ...
-
Software Engineer
5 days ago
BHO Tech San Francisco, United States Full timeAbout Us · We're on a mission to make it simple to buy and sell homes. The traditional process is broken, with an average home taking over 90 days to sell and costing thousands of dollars. We make buying and selling a home stress-free and instant. We've built an exceptional team, ...
-
Software Engineer
2 weeks ago
Gusto San Francisco, United StatesAbout Gusto · Gusto is a modern, online people platform that helps small businesses take care of their teams. On top of full-service payroll, Gusto offers health insurance, 401(k)s, expert HR, and team management tools. Today, Gusto offices in Denver, San Francisco, and New York ...
-
Software Engineer
2 weeks ago
Ambient San Francisco, United States Full timePosition Overview: · In this role, you will get a unique opportunity to work on new industry-defining applications in the Smart Building space. In this cross-functional role, you will get broad exposure to other engineering stakeholders, business teams, and customers. Specifical ...
-
Software Engineer
5 days ago
SS&C Technologies Holdings San Francisco, United States Full timeJob Description · Software Engineer /Sr. Software Engineer · Location(s): San Francisco, CA · Get To Know The Team · You will be working on a highly skilled, long tenured team across time zones modernizing APX, SSNC/Advent's portfolio accounting system. The team is embarking on a ...
-
Software Engineer
3 weeks ago
Heliux San Francisco, United StatesAbout Heliux · Heliux is building an all-in-one, AI-powered enterprise operating system for hardware engineering and manufacturing companies. Our platform enables our partners to manage their cross-functional teams and operations across engineering, supply chain, manufacturing, a ...
-
Software Engineer
2 weeks ago
Atomus San Francisco, United StatesThis is a full-time on-site US Citizen backend-heavy role for a Software Engineer at Atomus located in San Francisco, CA. · Company Description · Atomus' mission is to provide world class cybersecurity for the world's most critical organizations. We build security compliance soft ...
-
Software Engineer
3 weeks ago
Boku San Francisco, United StatesBoku Inc. (BOKU.L) is the leading global provider of local mobile-first payments solutions. Global brands including Amazon, DAZN, Meta, Google, Microsoft, Netflix, Sony, Spotify, and Tencent rely on Boku to reach millions of new paying consumers who do not use credit cards with o ...
-
Software Engineer
6 days ago
Amazon San Francisco, United StatesIf you are interested in this position, please apply on Twitch's Career site About Us:Twitch is the world's biggest live streaming service, with global communities built around gaming, entertainment, music, sports, coo Software Engineer, Software, Engineer, Content Creator · ...
-
Software Engineer
1 day ago
Elementl San Francisco, United StatesAbout us · Were an early stage, well-funded startup team with a proven track record of shipping open source software with global adoption. We put a premium on respectful, clear, and complete communication, and we expect each other to be creative, curious, effective, and empathet ...
-
Software Engineer
3 weeks ago
Group Nine LLC San Francisco, United StatesSoftware Engineer · San Diego, CA · Position Summary: · The Software Engineer works within the Application Development & Support team to provide software programming for new software, production support and maintenance for existing software, as well as ad-hoc support of key depa ...
-
Software Engineer
1 day ago
Finley Inc San Francisco, United StatesBackground · At Finley, we believe that todays most innovative companies deserve financial infrastructure that can move as quickly as they can. · Startups in finance, real estate, and transportation rely on debt capital to extend loans, purchase homes, and finance vehicle fleet ...
-
Software Engineer
3 weeks ago
SingleStore San Francisco, United StatesPosition Overview · SingleStore Software Engineers are at the forefront of real-time technology that's revolutionizing how companies run their businesses everyday. With release cycles throughout the year, our engineers are accustomed to moving quickly in a rapid production envir ...
-
Software Engineer
1 day ago
Talent Software Services San Francisco, United StatesAbout The Job · This is a unique opportunity to grow as an engineer. You will work closely with lots of product development teams, operations teams, and leadership inside the org and outside the organization to design and build tools and infrastructure to empower engineers to de ...
-
Software Engineer
1 week ago
Cypress HCM San Francisco, United StatesJob Description · Job Description · Software EngineerDescription:We are looking for a Software Engineer to develop and operate mission critical services and applications that are used customers and employees worldwide. · Responsibilities:Lead the technical design, implementation, ...
-
Software Engineer
1 day ago
Group Nine LLC San Francisco, United StatesSoftware Engineer · San Diego, CA · Position Summary: · The Software Engineer works within the Application Development & Support team to provide software programming for new software, production support and maintenance for existing software, as well as ad-hoc support of key dep ...
Senior Staff Software Engineer - San Francisco, United States - Cohere
Description
Who are we? Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what's best for our customers.
Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.
Join us on our mission and shape the future
Why this role? Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for Senior Staff Software Engineers to join the Model Serving team at Cohere. The team is responsible for developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. In this role, you will work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. You will also get the opportunity to interface with customers and create customized deployments to meet their specific needs.
We are looking for candidates with a range of experiences for multiple roles, from senior to staff-level engineers.
Please Note: We have offices in Toronto, Palo Alto, and London but embrace being remote-first There are no restrictions on where you can be located for this role.
You may be a good fit if you have:
We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants of all kinds and are committed to providing an equal opportunity process. Cohere provides accessibility accommodations during the recruitment process. Should you require any accommodation, please let us know and we will work with you to meet your needs.
Our Perks: An open and inclusive culture and work environment Work closely with a team on the cutting edge of AI research Weekly lunch stipend, in-office lunches & snacks Full health and dental benefits, including a separate budget to take care of your mental health 100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement Remote-flexible, offices in Toronto, Palo Alto, San-Francisco and London and co-working stipend 6 weeks of vacation
Note: This post is co-authored by both Cohere humans and Cohere technology.