U JºcIã@sHddlmZddlmZmZmZmZmZmZm Z m Z m Z ddl m Z dS)é)Ú FlatParameter) ÚBackwardPrefetchÚ CPUOffloadÚFullStateDictConfigÚFullyShardedDataParallelÚLocalStateDictConfigÚMixedPrecisionÚOptimStateKeyTypeÚShardingStrategyÚ StateDictType)ÚParamExecOrderWrapPolicyN)Z flat_paramrZfully_sharded_data_parallelrrrrrrr r r Úwrapr ©rrúC/tmp/pip-unpacked-wheel-gikjz4vx/torch/distributed/fsdp/__init__.pyÚs ,