File tree Expand file tree Collapse file tree 2 files changed +21
-6
lines changed Expand file tree Collapse file tree 2 files changed +21
-6
lines changed Original file line number Diff line number Diff line change @@ -3,8 +3,15 @@ scrapy-webdriver
3
3
4
4
Scrape using Selenium webdriver.
5
5
6
+ Installation
7
+ =============
8
+
9
+ For now, nothing's on pypi, but this should work:
10
+
11
+ pip install https://github.com/sosign/scrapy-webdriver/archive/master.zip
12
+
6
13
Configuration
7
- -------------
14
+ =============
8
15
9
16
Add something like this in your scrapy project settings:
10
17
@@ -17,11 +24,19 @@ Add something like this in your scrapy project settings:
17
24
'scrapy_webdriver.middlewares.WebdriverSpiderMiddleware': 543,
18
25
}
19
26
20
- WEBDRIVER_BROWSER = 'PhantomJS'
27
+ WEBDRIVER_BROWSER = 'PhantomJS' # Or any other from selenium.webdriver
21
28
22
29
Usage
23
- -----
30
+ =====
31
+
32
+ In order to have webdriver handle your downloads, use the provided
33
+ class ` scrapy_webdriver.http.WebdriverRequest ` in place of the stock scrapy
34
+ ` Request ` .
35
+
36
+ Hacking
37
+ =======
24
38
25
- In order to have webdriver handle your downloads, use the provided class
26
- ` scrapy_webdriver.http.WebdriverRequest ` in place of the stock scrapy ` Request ` .
39
+ Pull requests much welcome. Just make sure the tests still pass, and add to
40
+ them as necessary:
27
41
42
+ python setup.py test
Original file line number Diff line number Diff line change @@ -44,7 +44,7 @@ def run_tests(self):
44
44
maintainer_email = metadata .emails [0 ],
45
45
url = metadata .url ,
46
46
description = metadata .description ,
47
- long_description = read ('README.rst ' ),
47
+ long_description = read ('README.md ' ),
48
48
download_url = metadata .url ,
49
49
classifiers = [
50
50
'Development Status :: 3 - Alpha' ,
You can’t perform that action at this time.
0 commit comments