Back to Pytorch

Cudnn Rnn Determinism

docs/source/cudnn_rnn_determinism.md

2.13.0466 B
Original Source

:::{warning} There are known non-determinism issues for RNN functions on some versions of cuDNN and CUDA. You can enforce deterministic behavior by setting the following environment variables:

Set environment variable (note the leading colon symbol) CUBLAS_WORKSPACE_CONFIG=:16:8 or CUBLAS_WORKSPACE_CONFIG=:4096:2

See the cuDNN 8 Release Notes for more information. :::