一个爬虫程序，基于Gevent库
可同时运行多个抓取任务。 每个任务可以自定义设置最大并行下载数，http头等。 可自定义个任务的运行时间
依赖的第三方库： gevent lxml pymomgo
forked from icaicai/gevent-crawler
-
Notifications
You must be signed in to change notification settings - Fork 0
ThinkComb/gevent-crawler
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
爬虫，基于Gevent库
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published