U <c@sTddlZddlmmmmZddlmmmZ Gdddej Z dS)NcsjeZdZdZejZdejffdd Z ej ej dddZ dd Z e fd d Ze fd d ZZS) LinearReLUa. A LinearReLU module fused from Linear and ReLU modules that can be used for dynamic quantization. Supports both, FP16 and INT8 quantization. We adopt the same interface as :class:`torch.ao.nn.quantized.dynamic.Linear`. Attributes: Same as torch.ao.nn.quantized.dynamic.Linear Examples:: >>> m = nn.intrinsic.quantized.dynamic.LinearReLU(20, 30) >>> input = torch.randn(128, 20) >>> # xdoctest: +SKIP >>> output = m(input) >>> print(output.size()) torch.Size([128, 30]) Tcst||||dSN)super__init__)selfZ in_featuresZ out_featuresZbiasdtype __class__\/tmp/pip-unpacked-wheel-gikjz4vx/torch/nn/intrinsic/quantized/dynamic/modules/linear_relu.pyrszLinearReLU.__init__)xreturncCs`|jjtjkr(tjjj||jjdd}n,|jjtjkrLtjj||jj}nt d| |jS)NT)Z reduce_rangez3Unsupported dtype on dynamic quantized linear relu!) Z_packed_paramsrtorchqint8ops quantizedZlinear_relu_dynamicZfloat16Zlinear_relu_dynamic_fp16 RuntimeErrorto)rr Yr r r forwardszLinearReLU.forwardcCsdS)NZDynamicQuantizedLinearReLUr )rr r r _get_name*szLinearReLU._get_namecstt||Sr)rr from_float)clsmodrr r r-szLinearReLU.from_floatcst|dS)Nr)rfrom_reference)rZref_qlinear_relurr r r1szLinearReLU.from_reference)__name__ __module__ __qualname____doc__nnirZ _FLOAT_MODULErrrZTensorrr classmethodrr __classcell__r r rr rs r) rZtorch.ao.nn.quantized.dynamicZaonnrZdynamicZnnqdZtorch.ao.nn.intrinsicZ intrinsicrZLinearrr r r r s