Web Crawler

We are seeking an experienced Web Crawler and Data Engineer to develop a robust system for aggregating power outage data from various sources. · The ideal candidate will have expertise in web scraping, data processing, and data storage. · Your role will involve designing a web c ...

We're building a grant-matching platform for African NGOs and purpose-driven organisations. We've already built an initial crawler in-house but we're not extracting all relevant data reliably at scale. We're looking for an experienced specialist to improve extend or partially red ...

+We re building a grant-matching platform for African NGOs and purpose-driven organisations. · +Review and improve an existing crawler · Strengthen deep web discovery for African grant & funding data · Extract and normalize structured data (deadlines, eligibility, regions, sector ...

We are seeking a skilled developer to complete and polish our existing web crawler built with NestJS.The project involves refining the current setup to match our full specification, · ensuring seamless integration with BullMQ, · Redis, · and Postgres. · ...

I need a simple web crawler to extract agent data from an agency directory website. · Navigation: ~4 clicks per agency page to reach the data · No captcha · Mandatory skills: , vibe coding, Python Script Please include: · ...

We are building two web-based AI visibility tools to be hosted on · 1. AI Search Crawler Simulation Tool · 2. GEO (Generative Engine Optimisation) Content Check Tool · ...

+ Automation I need someone to create a script that will run daily which searches business broker websites, and then within parameters, · send me a blurb about the listing and a link to the listing. · No home service companies ie hvac electrician construction roofing pool etc. · ...

Need a senior web crawler engineer. · Retrieve the product information details from the GET_PC interface for logged-in users and return it as JSON. · Risk control issues need to be investigated and addressed to exceed the crawling limit per account. · The business process obtains ...

Create a search engine web crawler and scraping application. Overtime develop a web crawler for search engine. · Data ScrapingWeb CrawlingJavascriptRust.TypeScript ...

I am looking for an experienced Python developer to help build a general-purpose website mapping crawler (or "site mapper") for primary use on National Statistical Office (NSO) websites and similar large institutional sites that publish open data. · ...

Automatically monitor appointment availability on BLS Spain and Portugal to detect new slots. Notify immediately or assist in starting booking quickly. Stable system reducing manual refreshing. ...

We are looking for an experienced LiteSpeed Enterprise + cPanel administrator to diagnose and resolve a LiteSpeed crawler issue on a production WordPress site. · ...

We are seeking an experienced developer to help us implement measures to block affiliate link scanner tools such as Integrishield and Mfilterit. · The ideal candidate will have prior experience in link protection, affilaite marketing or adtech solutions. · Web Development · HTML ...

We are seeking a skilled developer to create a data crawler that will extract valuable information from ClassCentral and YouTube. · ...

I'm looking for someone to build a script to automatically pull data from public websites. · ...

Extract prospective data from LinkedIn emails and numbers. · ...

We are looking for a skilled developer to create an automated web scraper/crawler that can extract information and records related to real estate transactions and ownership history from a specified website. · Data Scraping · Data Mining · Data Extraction Python · ...

We need someone to diagnose and fix our website's issue with LLM crawlers not being able to access our site due to blocking by WordPress plugin. · Current Situation: · Claude AI cannot access our site (receives "Verifying that you are not a robot" message) · Our content is not ap ...

Create a virtual background for Zoom presentations with a dark blue theme and logo. · ...

This position involves generating enriched leads from sales nav data. · ...