Skip to content

Commit

Permalink
v0.2.5
Browse files Browse the repository at this point in the history
zhegexiaohuozi committed Dec 23, 2015
1 parent a00a2ce commit e6933a6
Showing 2 changed files with 4 additions and 4 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -23,12 +23,12 @@ SeimiCrawler是一个敏捷的,支持分布式的爬虫开发框架,希望

# 快速开始 #

添加maven依赖(中央maven库最新版本0.2.4):
添加maven依赖(中央maven库最新版本0.2.5):
```
<dependency>
<groupId>cn.wanghaomiao</groupId>
<artifactId>SeimiCrawler</artifactId>
<version>0.2.4</version>
<version>0.2.5</version>
</dependency>
```

@@ -81,7 +81,7 @@ public class Boot {

# Change log #

## v0.2.5-SNAPSHOT doing ##
## v0.2.5 ##
- 增加请求遭遇严重异常时重新打回队列处理机制
当一个请求在经历网络请求异常的重试机制后依然出现非预期异常,那么这个请求会在不超过开发者设置的或是默认的最大重新处理次数的情况下被打回队列重新等待被处理,如果被打回次数达到了最大限制,那么seimi会调用开发者自行覆盖实现的`BaseSeimiCrawler.handleErrorRequest(Request request)`来处理记录这个异常的请求。重新打回等待处理机制配合delay功能使用可以在很大程度上避免因访问站点的反爬虫策略引起的请求处理异常,并丢失请求的记录的情况。
- 优化去重判断
2 changes: 1 addition & 1 deletion project/pom.xml
Original file line number Diff line number Diff line change
@@ -7,7 +7,7 @@
</parent>
<groupId>cn.wanghaomiao</groupId>
<artifactId>SeimiCrawler</artifactId>
<version>0.2.5-SNAPSHOT</version>
<version>0.2.5</version>
<modelVersion>4.0.0</modelVersion>
<packaging>jar</packaging>
<name>SeimiCrawler</name>

0 comments on commit e6933a6

Please sign in to comment.