Skip to content

Commit 92125c0

Browse files
authored
Merge pull request RasaHQ#5710 from RasaHQ/revert-5626-bug-activation
Revert "Move activation to transformer block"
2 parents 50536ac + a1a6887 commit 92125c0

File tree

1 file changed

+1
-4
lines changed

1 file changed

+1
-4
lines changed

rasa/nlu/classifiers/diet_classifier.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1250,10 +1250,7 @@ def _create_sequence(
12501250
outputs = self._tf_layers[f"{name}_transformer"](
12511251
transformer_inputs, 1 - mask, self._training
12521252
)
1253-
1254-
if self.config[NUM_TRANSFORMER_LAYERS] > 0:
1255-
# apply activation
1256-
outputs = tfa.activations.gelu(outputs)
1253+
outputs = tfa.activations.gelu(outputs)
12571254

12581255
return outputs, inputs, seq_ids, lm_mask_bool
12591256

0 commit comments

Comments
 (0)