Skip to content

Commit b8fcae1

Browse files
committed
revert scale loss to False in Embeddingintent
1 parent 1ce2476 commit b8fcae1

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

changelog/5717.improvement.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
Change default values for hyper-parameters in ``EmbeddingIntentClassifier`` and ``DIETClassifier``
22

3-
Use ``scale_loss=False`` in both classifiers. Additionally, reduce the number of dense dimensions for sparse features of text from 512 to 256 in ``EmbeddingIntentClassifier``.
3+
Use ``scale_loss=False`` in ``DIETClassifier``. Reduce the number of dense dimensions for sparse features of text from 512 to 256 in ``EmbeddingIntentClassifier``.

docs/nlu/components.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -908,7 +908,7 @@ EmbeddingIntentClassifier
908908
| | | over incorrect intent labels, used only if 'loss_type' is |
909909
| | | set to 'margin'. |
910910
+---------------------------------+------------------+--------------------------------------------------------------+
911-
| scale_loss | False | Scale loss inverse proportionally to confidence of correct |
911+
| scale_loss | True | Scale loss inverse proportionally to confidence of correct |
912912
| | | prediction. |
913913
+---------------------------------+------------------+--------------------------------------------------------------+
914914
| regularization_constant | 0.002 | The scale of regularization. |

rasa/nlu/classifiers/embedding_intent_classifier.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ def required_components(cls) -> List[Type[Component]]:
115115
# incorrect intent labels, used only if 'loss_type' is set to 'margin'.
116116
USE_MAX_NEG_SIM: True,
117117
# Scale loss inverse proportionally to confidence of correct prediction
118-
SCALE_LOSS: False,
118+
SCALE_LOSS: True,
119119
# ## Regularization parameters
120120
# The scale of regularization
121121
REGULARIZATION_CONSTANT: 0.001,

0 commit comments

Comments
 (0)