edit readme

atiqsu · Jan 28, 2017 · 36a9d28 · 36a9d28
1 parent 4f3907e
commit 36a9d28
Show file tree

Hide file tree

Showing 2 changed files with 8 additions and 0 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -2,6 +2,9 @@
 
 All Notable changes to `spatie/crawler` will be documented in this file.
 
+## 2.1.0 - 2017-01-27
+- add `CrawlInternalUrls`
+
 ## 2.0.7 - 2016-12-30
 - make sure the passed client options are being used
 

diff --git a/README.md b/README.md
@@ -75,6 +75,11 @@ an objects that implements the `Spatie\Crawler\CrawlProfile`-interface:
 public function shouldCrawl(Url $url): bool;
 ```
 
+This package comes with two `CrawlProfiles` out of the box:
+
+- `CrawlAllUrls`: this profile will crawl all urls on all pages including urls to an external site. 
+- `CrawlInternalUrls`: this profile will only crawl the internal urls on the pages of a host.
+
 ## Setting the number of concurrent requests
 
 To improve the speed of the crawl the package concurrently crawls 10 urls by default. If you want to change that number you can use the `setConcurrency` method.