U <ºcDã@slddlZddlmmZddlmZddlmZm Z m Z ddl m Z m Z eejƒGdd„dejjƒƒZdS)éNé)Úimplements_per_sample_grads)Úforward_helperÚset_grad_sample_if_existsÚ unpack_expanded_weight_or_tensor)ÚListÚOptionalc@s$eZdZedd„ƒZedd„ƒZdS)ÚLinearPerSampleGradcGspt|djƒdkr*tdt|djƒ›ƒ‚dt|ƒdkr@|dndi}|dd…}ttj||ƒ}||_||_|S)NrrzgInput does not have a batch dimension. Expanded Weights expected input of at least rank 2, got of rank Úbiaséé)ÚlenÚshapeÚ RuntimeErrorrÚFÚlinearÚargsÚkwargs)ÚctxÚ_Ú__Zexpanded_args_and_kwargsZexpanded_kwargsZ expanded_argsÚoutput©rú\/tmp/pip-unpacked-wheel-gikjz4vx/torch/nn/utils/_expanded_weights/linear_expanded_weights.pyÚforward s zLinearPerSampleGrad.forwardcs|j\‰}|jd}g}| d¡| d¡ˆjrH| ˆ t|ƒ¡¡n | d¡| dgd¡t|‡‡fdd„ƒt|‡fdd„ƒt|ƒS)Nr r cst dˆˆ¡S)Nzn...i,n...j->nij©ÚtorchZeinsum©r©Ú grad_outputÚinputrrÚ%óz.LinearPerSampleGrad.backward..cs t dˆ¡S)Nz n...k->nkrr)rrrr!&r") rrÚappendZ requires_gradÚmatmulrÚextendrÚtuple)rrZweightr ÚresultsrrrÚbackwards     zLinearPerSampleGrad.backwardN)Ú__name__Ú __module__Ú __qualname__Ú staticmethodrr(rrrrr s r )rZtorch.nn.functionalÚnnZ functionalrZexpanded_weights_implrZexpanded_weights_utilsrrrÚtypingrrrZautogradZFunctionr rrrrÚs