U <ºci ã@s\ddlZddlmZmZddlZdddgZdd„Zd d „Zdd d„Zdd d„Z dd d„Z dS)éNé)ÚScatterÚGatherÚscatterÚscatter_kwargsÚgathercCst d¡t|ƒS)NzAis_namedtuple is deprecated, please use the python checks instead)ÚwarningsÚwarnÚ_is_namedtuple©Úobj©r úD/tmp/pip-unpacked-wheel-gikjz4vx/torch/nn/parallel/scatter_gather.pyÚ is_namedtuples rcCst|tƒot|dƒot|dƒS)NÚ_asdictÚ_fields)Ú isinstanceÚtupleÚhasattrr r r rr sÿr cs(‡‡‡fdd„‰z ˆ|ƒ}W5d‰X|S)zŸ Slices tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. csÞtˆtjƒrt ˆdˆˆ¡Stˆƒr@‡fdd„ttˆˆƒŽDƒStˆtƒrht ˆƒdkrht ttˆˆƒŽƒStˆt ƒr–t ˆƒdkr–dd„ttˆˆƒŽDƒStˆt ƒrÌt ˆƒdkṙfdd„ttˆˆ  ¡ƒŽDƒS‡fdd„ˆDƒS)Ncsg|]}tˆƒ|Ž‘qSr ©Útype)Ú.0Úargsr r rÚ sz0scatter..scatter_map..rcSsg|] }t|ƒ‘qSr )Úlist©rÚir r rr!scsg|]}tˆƒ|ƒ‘qSr rrr r rr#scsg|]}ˆ‘qSr r )rÚtargetsr r rr$s) rÚtorchÚTensorrÚapplyr ÚzipÚmaprÚlenrÚdictÚitemsr ©ÚdimÚ scatter_mapÚ target_gpusr rr(s  zscatter..scatter_mapNr )Úinputsr)r'Úresr r&rrs  cCsª|rt|||ƒng}|r$t|||ƒng}t|ƒt|ƒkr^| dd„tt|ƒt|ƒƒDƒ¡n4t|ƒt|ƒkr’| dd„tt|ƒt|ƒƒDƒ¡t|ƒ}t|ƒ}||fS)z*Scatter with support for kwargs dictionarycss|] }dVqdS)r Nr ©rÚ_r r rÚ 7sz!scatter_kwargs..css|] }iVqdS©Nr r,r r rr.9s)rr#ÚextendÚranger)r*Úkwargsr)r'r r rr2s&$cs(‡‡‡fdd„‰z ˆ|ƒ}W5d‰X|S)zz Gathers tensors from different GPUs on a specified device. Use 'cpu' for CPU to avoid a deprecation warning. cs¬ˆd‰tˆtjƒr&tjˆˆfˆžŽSˆdkr2dStˆtƒrvt‡fdd„ˆDƒƒsZtdƒ‚tˆƒ‡‡fdd„ˆDƒƒSt ˆƒr–tˆƒ  t ˆt ˆŽƒ¡Stˆƒt ˆt ˆŽƒƒS)Nrc3s|]}tˆƒt|ƒkVqdSr/)r#©rÚd)Úoutr rr.Ksz-gather..gather_map..z+All dicts must have the same number of keysc3s(|] ‰ˆˆ‡fdd„ˆDƒƒfVqdS)csg|] }|ˆ‘qSr r r3©Úkr rrMsz8gather..gather_map...Nr )r)Ú gather_mapÚoutputsr6rr.Msÿ) rrrrr r$ÚallÚ ValueErrorrr Ú_maker"r!)r9©r'r8Ú target_device)r5r9rr8Ds  ÿzgather..gather_mapNr )r9r>r'r+r r=rr?s  )r)r)r) rZ _functionsrrrÚ__all__rr rrrr r r rÚs