Scrapy Training companion code

💫 Industrial-strength Natural Language Processing (NLP) in Python

WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.

Convert Javascript code to an XML document

Visual scraping for Scrapy

Blog crawler for the blogforever project.

MessagePack serializer implementation for Java / msgpack.org[Java]

A client interface for Scrapinghub's API

Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 instead

Erlang LSM BTree Storage

Erlang/OTP application for accessing Amazon S3

Python wrapper for extended filesystem attributes

sworkflow born inside mydeco to help us solve data processing flows quickly. It's a library to help you create data workflows using Tasks.

A pure-python HTML screen-scraping library

Python library of web-related functions

Python bindings for the snappy google library

Prospective search for python

Scrapy crawler for the average weather conditions of cities on the BBC Weather Centre

MochiWeb is an Erlang library for building lightweight HTTP servers.

Scrapy, a fast high-level web crawling & scraping framework for Python.

Erlang/OTP application for accessing Amazon S3

a Map/Reduce framework for distributed computing