Skip to content

Commit a2d9ddd

Browse files
authored
Remove warning about WhitespaceTokenizer (RasaHQ#5643)
* Remove warning about WhitespaceTokenizer This commit is to remove the outdated warning about white space tokenizer * add change log for issue 4605 * Remove warning whitespace tokenizer in doc
1 parent e0e4cfa commit a2d9ddd

File tree

2 files changed

+2
-1
lines changed

2 files changed

+2
-1
lines changed

changelog/4605.doc.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
Remove outdated whitespace tokenizer warning in Testing Your Assistant documentation.

docs/user-guide/testing-your-assistant.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -198,7 +198,7 @@ to the left of the plot.
198198
is that an entity cannot stop or start inside a token.
199199
For example, if you have an example for a ``name`` entity
200200
like ``[Brian](name)'s house``, this is only valid if your tokenizer splits ``Brian's`` into
201-
multiple tokens. A whitespace tokenizer would not work in this case.
201+
multiple tokens.
202202

203203

204204
Response Selection

0 commit comments

Comments
 (0)