The best and simplest free open source web page change detection, website watcher, restock monitor and notification service. Restock Monitor, change detection. Designed for simplicity - Simply moni…

Scrapy, a fast high-level web crawling & scraping framework for Python.

Create agents that monitor and act on your behalf. Your agents are standing by!

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…

Software stack with latest Scrapy and updated deps

Python logging made (stupidly) simple

Declarative web scraping

Elegant Scraper and Crawler Framework for Golang

A service daemon to run Scrapy spiders

Extract embedded metadata from HTML markup

JMESPath is a query language for JSON.

A python script that finds endpoints in JavaScript files

Fast web fuzzer written in Go

A fast, simple, recursive content discovery tool written in Rust.

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.