U Jºc ã@snUdZddlmZmZmZmZddlmZddlm Z gZ ee e d<Gdd„dƒZ eeje d œd d „Zd S) z8Static skip connection layout of ``@skippable`` modules.é)ÚDictÚIterableÚListÚTuple)Únné)Ú NamespaceÚ__all__c@s¦eZdZUdZeeeefeeeffe d<e e eeeefe d<eeeeefeeeffddœdd„Z ee eeeefdœd d „Z eeed œd d „ZdS)Ú SkipLayoutz6Represents a skip connection layout across partitions.Ú by_ns_nameÚ by_partitionN)Únum_partitionsÚ skip_routesÚreturncCsb||_dd„t|ƒDƒ|_| ¡D]&\\}}\}}|j| |||f¡q"|jD] }| ¡qPdS)NcSsg|]}g‘qS©r)Ú.0Ú_rrúO/tmp/pip-unpacked-wheel-gikjz4vx/torch/distributed/pipeline/sync/skip/layout.pyÚ sz'SkipLayout.__init__..)r Úranger ÚitemsÚappendÚsort)Úselfr rÚnsÚnameÚprev_jÚnext_jÚprrrÚ__init__s  zSkipLayout.__init__)rrccs0|j|D] \}}}||krq |||fVq dS)züGenerates skip routes for the given destination partition number. The skip routes are sorted by source partition number in ascending order. Yields: Each tuple of (source partition number, namespace, name). N)r )rrrrrrrrÚ copy_policy's zSkipLayout.copy_policy)rrrcCs|j ||fd¡\}}||kS)zbWhether the given namespace and name requires partition-to-partition copy or not. )éÿÿÿÿr!)r Úget)rrrrrrrrÚ requires_copy8szSkipLayout.requires_copy)Ú__name__Ú __module__Ú __qualname__Ú__doc__rrrÚstrÚintÚ__annotations__rrrr Úboolr#rrrrr s  * r )Ú partitionsrcsnddlm‰i‰i‰t|ƒD]B\‰}‡‡‡‡fdd„}t|tjƒrV|D] }||ƒqFq||ƒqtt|ƒˆƒS)z.inspect_layer)Z skippabler-Ú enumerater.rÚ Sequentialr Úlen)r,Ú partitionr3r0rr1rÚinspect_skip_layout@s    r8N)r'ÚtypingrrrrZtorchrÚ namespacerr r(r*r r5r8rrrrÚs   /