Skip to content

Commit

Permalink
Fix a mistake in autograd docs
Browse files Browse the repository at this point in the history
  • Loading branch information
apaszke authored and soumith committed Jan 16, 2017
1 parent 95f0fa8 commit df79631
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/source/autograd.rst
Original file line number Diff line number Diff line change
Expand Up @@ -60,10 +60,10 @@ under heavy memory pressure, you might never need to use them.
There are two reasons that limit the applicability of in-place operations:

1. Overwriting values required to compute gradients. This is the main reason
why variables don't support ``exp_`` and ``log_``. Their gradient formulas
require the original input, and while it could be possible to recreate it
by taking the inverse operation, it is numerically unstable, and requires
additional work that often defeats the purpose of using these functions.
why variables don't support ``log_``. Its gradient formula requires the
original input, and while it is possible to recreate it by doing the
inverse operation, it is numerically unstable, and requires additional
work that often defeats the purpose of using these functions.

2. Every in-place operation actually requires the implementation to rewrite the
computational graph. Out-of-places version simply allocate new objects and
Expand Down

0 comments on commit df79631

Please sign in to comment.