U Jºcüã@sZddlZddlmZddlmZejeeeeejdœdd„Zejeejdœdd „ZdS) éN)Ú ShardMetadata)ÚSequence)ÚtensorÚoffsetsÚsizesÚreturncCs@|}tt||ƒƒD](\}\}}|| |¡kr| |||¡}q|S)zC Narrow the tensor according to ``offsets`` and ``sizes``. )Ú enumerateÚzipÚsizeZnarrow)rrrZnarrowed_tensorÚidxÚoffsetr ©r úC/tmp/pip-unpacked-wheel-gikjz4vx/torch/distributed/_shard/_utils.pyÚnarrow_tensor_by_indexsýr)rÚmetadatarcCst||j|jƒS)z5 Narrow the tensor according to the metadata )rZ shard_offsetsZ shard_sizes)rrr r rÚ narrow_tensorsr) ZtorchZ!torch.distributed._shard.metadatarÚtypingrZTensorÚintrrr r r rÚs