Software Engineer, Web Crawling - San Francisco, California

Only for registered members San Francisco, California, United States

2 days ago

Default job background
Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it. We also own a $5M ...
Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Work in company

    Software Engineer, Web Crawling

    Only for registered members

    Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it. We also own a $5M ...

    San Francisco, California

    2 days ago

  • Work in company

    Research Engineer, Generalist

    Only for registered members

    Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it. We also own a $5M ...

    San Francisco, California

    2 days ago

  • Work in company Remote job

    Software Engineer

    Only for registered members

    MixRank processes petabytes of data every month from web crawling. · We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, · across industries Sales Marketing Finance Security Team is 47+ full-time full-remote · from 20+ coun ...

    San Francisco, CA

    1 month ago

  • Work in company

    Software Engineer, Distributed Data Systems

    Only for registered members

    Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it. We also own a $5M ...

    San Francisco, California

    2 days ago

  • Work in company

    Software Engineer

    Only for registered members

    +MixRank procesa petabytes de datos cada mes mediante web crawling. Somos una empresa creciente, rentable y propiedad de los empleados. Los solicitantes procedentes de todos los países y culturas son bienvenidos. · +Desarrollar software para aplicaciones web.Diseñar e implementar ...

    San Francisco

    1 month ago

  • Work in company

    Research Scientist

    Only for registered members

    We are bringing a new web to life: it's built with by and for AIs Our work spans innovations across crawling indexing ranking retrieval and reasoning systems. · You will answer the question how to train and scale a model that can serve a web index? · ...

    San Francisco

    1 month ago

  • Work in company

    Data Scientist

    Only for registered members

    Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapid ...

    San Francisco $85,000 - $150,000 (USD) per year

    1 week ago

  • Work in company

    Full-Stack Software Engineer

    Only for registered members

    · Responsibilities · Build new features on our website and mobile app. (Our stack is Javascript (Typescript): modern React on the web, React Native on mobile, and on the server.) · Design and decide what to build based on what would help travelers and drive growth. You wont be ...

    San Francisco, California, United States $80,000 - $150,000 (USD) per year

    1 week ago

  • Work in company

    Member of Technical Staff

    Only for registered members

    Our Mission · Reflection's mission is to · build open superintelligence and make it accessible to all · . · We're developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI ...

    San Francisco, CA

    4 days ago

  • Work in company

    Software Engineer, Intern

    Only for registered members

    Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it. We also own a $5M ...

    San Francisco, California $64,000 - $96,000 (USD) per year

    5 days ago

  • Work in company

    Member of Technical Staff, Front-end

    Only for registered members

    We are bringing a new web to life: it's built with by and for AIs. Our first product is a set of APIs for AIs to do more with web data. · ...

    San Francisco

    1 month ago

  • Work in company

    Member of Technical Staff, Back-end

    Only for registered members

    We are bringing a new web to life: it's built with, by, and for AIs. Our work spans innovations across crawling, indexing, ranking. · You will build and maintain our backend that already handles millions of custom requests daily. · ...

    San Francisco

    1 month ago

  • Work in company

    Member of Technical Staff

    Only for registered members

    We are building open superintelligence and making it accessible to all. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond. · You will own the machinery that acquires, extracts, normalizes, versions, ...

    San Francisco Full time

    1 month ago

  • Work in company

    Product Designer

    Only for registered members

    We want to talk to you if you are someone who can bring us closer to living our aspirational values: Own customer impact - It's on us to ensure real-world outcomes for our customers. · Obsess over craft - Perfect every detail because quality compounds. · Accelerate change - Ship ...

    San Francisco

    1 month ago

  • Work in company

    Software Engineer, Backend

    Only for registered members

    Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it. We also own a $5M ...

    San Francisco, California $90,000 - $160,000 (USD) per year

    2 days ago

  • Work in company

    Member of Technical Staff

    Only for registered members

    Caddie is hiring on behalf of a stealth-mode AI company building the taste layer for artificial intelligence. · ...

    San Francisco

    1 month ago

  • Work in company

    Research, ML

    Only for registered members

    Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in Rust to search over it. We also own a $5M ...

    San Francisco, California

    2 days ago

  • Work in company

    Member of Technical Staff

    Only for registered members

    This is an early Member of Technical Staff role with a strong product engineering focus. You'll span backend systems, AI workflows, and user-facing product experiences. · Familiarity with AI- or LLM-powered systems. · Experience building or maintaining CI/CD systems and developer ...

    San Francisco, CA

    1 month ago

  • Work in company

    Senior Software Engineer, Data Acquisition

    Only for registered members

    Overview · The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations. Our team manages web crawling and GPTBot services and works closely with Data Processing, Architecture, a ...

    San Francisco, CA

    1 week ago

  • Work in company

    Senior Software Engineer, Data Acquisition

    Only for registered members

    +The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations.+ · +Own and lead engineering projects in the area of data acquisition including web crawling, data ingestion, and s ...

    San Francisco, CA

    1 month ago