U Kºc`ã@s~ddlmZddlmmZddlmZddlmZddl m Z m Z m Z ddgZ Gdd„dejeƒZGd d„dejeƒZdS) éN)ÚTensoré)ÚReferenceQuantizedModule)ÚOptionalÚDictÚAnyÚ EmbeddingÚ EmbeddingBagc sveZdZdZdeeeeeeeeeeeee e e fddœ ‡fdd„ Z dd „Z eed œd d „Zed d„ƒZ‡ZS)raR A reference quantized Embedding module that fits into the FX Graph Mode Quantization workflow, activation will be floating point Tensor, we will store floating point weight as well in the module, but in forward we'll quantize and dequantize the weight before running the floating point functional embedding operator. Nç@F) Únum_embeddingsÚ embedding_dimÚ padding_idxÚmax_normÚ norm_typeÚscale_grad_by_freqÚsparseÚ_weightÚweight_qparamsÚreturnc s.tƒ ||||||||| | ¡ | | | ¡dS©N©ÚsuperÚ__init__Z_init_weight_qparams) Úselfr r r rrrrrÚdeviceÚdtyper©Ú __class__©úR/tmp/pip-unpacked-wheel-gikjz4vx/torch/ao/nn/quantized/reference/modules/sparse.pyrsÿzEmbedding.__init__cCsdS©NzQuantizedEmbedding(Reference)r©rrrrÚ _get_nameszEmbedding._get_name)Úinputrc Cs(| ¡}t |||j|j|j|j|j¡Sr)Ú get_weightÚFZ embeddingr rrrr)rr#Úweight_quant_dequantrrrÚforwardsþzEmbedding.forwardc Cs4||j|j|j|j|j|j|j|j|jj|jj |ƒ Sr) r r r rrrrÚweightrr©ÚclsÚmodrrrrÚ from_float"sõzEmbedding.from_float) NNr FFNNNN)Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚintrÚfloatÚboolrrÚstrrrr"r'Ú classmethodr,Ú __classcell__rrrrr s.ü ü csˆeZdZdZdeeeeeeeeee eeeee ee fddœ ‡fdd„ Z d d „Z de ee ee e d œd d „Zedd„ƒZ‡ZS)r aU A reference quantized EmbeddingBag module that fits into the FX Graph Mode Quantization workflow, activation will be floating point Tensor, we will store floating point weight as well in the module, but in forward we'll quantize and dequantize the weight before running the floating point functional embedding operator. Nr FÚmean) r r rrrÚmoderrÚinclude_last_offsetr rrcs2tƒ ||||||||| | | | ¡ | | | ¡dSrr)rr r rrrr8rrr9r rrrrrrr8sþzEmbeddingBag.__init__cCsdSr rr!rrrr"CszEmbeddingBag._get_name)r#ÚoffsetsÚper_sample_weightsrc Cs4| ¡}t ||||j|j|j|j|j||j|j ¡ Sr) r$r%Z embedding_bagrrrr8rr9r )rr#r:r;r&rrrr'Fs üzEmbeddingBag.forwardcCs<||j|j|j|j|j|j|j|j|j|j |jj |jj |ƒ Sr) r r rrrr8rr(r9r rrr)rrrr,NsózEmbeddingBag.from_float) Nr Fr7FNFNNNN)NN)r-r.r/r0r1rr2r3r4rrrrr"r'r5r,r6rrrrr 1s8ûû )Ztorch.nnÚnnZtorch.nn.functionalZ functionalr%ZtorchrÚutilsrÚtypingrrrÚ__all__rr rrrrÚs   (