U <ºcã@s0ddlmZdaedd„ƒZdd„Zdd„Zd S) é)ÚcontextmanagerFccst}|az dVW5|aXdS)aÇ A context manager to tag tensors in the forward pass of DDP to be ``ReplicatedTensor``. This can be used by ReplicatedTensor inter-op during the forward pass to perform appropriate optimizations. This context manager needs to wrap DDP creation and modifying the underlying module passed into DDP after leaving this context manager would cause inconsitencies and the changes will not be picked up during the forward pass. N©Ú_DDP_WITH_REPLICATED_TENSOR)ÚvalZold_val©rúR/tmp/pip-unpacked-wheel-gikjz4vx/torch/nn/parallel/_replicated_tensor_ddp_utils.pyÚ_ddp_replicated_tensors  rcCstS©NrrrrrÚ#_ddp_with_replicated_tensor_enabledsr cCs|adSr r)ÚvaluerrrÚ_set_ddp_with_replicated_tensorsr N)Ú contextlibrrrr r rrrrÚs