Minor fix: Lengths argument was not passed correctly in MultiHeadAtte…

…ntion. (awslabs#282) This is not a big deal as currently in the code the masking is only done through the bias and not the lengths argument.
sxjscience · Jan 29, 2018 · dc12c35 · dc12c35
1 parent 073f88c
commit dc12c35
Showing 1 changed file with 2 additions and 1 deletion.
diff --git a/sockeye/layers.py b/sockeye/layers.py
@@ -513,7 +513,8 @@ def __call__(self,
         return self._attend(queries,
                             keys,
                             values,
-                            bias=bias)
+                            bias=bias,
+                            lengths=memory_lengths)
 
 
 class ProjectedDotAttention: