- 利用scrapy从东方财富网抓取龙虎榜数据.
- 实现了增量更新.
- 利用pipeline处理中间数据.
- 利用peewee简化数据更新操作.
- 运行请进入项目所在路径,并运行命令:scrapy crawl get_content
- 项目中从数据库中读取了工作日对应的日期数据,如需使用请自行改接其他数据源
-
Notifications
You must be signed in to change notification settings - Fork 12
donadonny/get_longhubang
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
抓取东方财富网龙虎榜
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published