U <ºc3ã@sdddlZddlmmmZddlmmmZddl mm Z Gdd„dej ej ƒZdS)éNcsHeZdZdZejZd ‡fdd„ Zdd„Ze ‡fdd „ƒZ d d „Z ‡Z S) Ú LinearReLUa_ A LinearReLU module fused from Linear and ReLU modules, attached with FakeQuantize modules for weight, used in quantization aware training. We adopt the same interface as :class:`torch.nn.Linear`. Similar to `torch.nn.intrinsic.LinearReLU`, with FakeQuantize modules initialized to default. Attributes: weight: fake quant module for weight Examples:: >>> # xdoctest: +SKIP >>> m = nn.qat.LinearReLU(20, 30) >>> input = torch.randn(128, 20) >>> output = m(input) >>> print(output.size()) torch.Size([128, 30]) TNcstt|ƒ ||||¡dS©N)ÚsuperrÚ__init__)ÚselfÚ in_featuresÚ out_featuresÚbiasZqconfig©Ú __class__©úN/tmp/pip-unpacked-wheel-gikjz4vx/torch/nn/intrinsic/qat/modules/linear_relu.pyrszLinearReLU.__init__cCst t || |j¡|j¡¡Sr)ÚFÚreluÚlinearZweight_fake_quantÚweightr )rÚinputr r r Úforward#szLinearReLU.forwardcstt|ƒ |¡Sr)rrÚ from_float)ÚclsÚmodr r r r&szLinearReLU.from_floatcCsftj |j|j|jdk ¡}tj |j ¡¡|_|jdk rLtj |j ¡¡|_tj  ¡}tjj   ||¡Sr) ÚtorchÚnnÚLinearrrr Ú ParameterrÚdetachZReLUÚ intrinsicr)rrrr r r Úto_float*s   zLinearReLU.to_float)TN) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚnnirZ _FLOAT_MODULErrÚ classmethodrrÚ __classcell__r r r r rsÿr)rZtorch.ao.nn.qatZaorZqatZnnqatZtorch.ao.nn.intrinsicrr"Ztorch.nn.functionalZ functionalrrZ _FusedModulerr r r r Ús