U &ºc¡ã@sædZddlZddlmZddlmZddlmZmZm Z m Z m Z e  e ¡Zddd d d d d œZdZedeƒGdd„de ƒƒZedeƒGdd„deƒƒZedeƒGdd„de ƒƒZedeƒGdd„deƒƒZedeƒGdd„de ƒƒZdS)zPyTorch XLM-RoBERTa model. éNé)ÚXLMRobertaConfig)Úadd_start_docstrings)ÚRobertaForMaskedLMÚRobertaForMultipleChoiceÚ RobertaForSequenceClassificationÚRobertaForTokenClassificationÚ RobertaModelz=https://cdn.huggingface.co/xlm-roberta-base-pytorch_model.binz>https://cdn.huggingface.co/xlm-roberta-large-pytorch_model.binzVhttps://cdn.huggingface.co/xlm-roberta-large-finetuned-conll02-dutch-pytorch_model.binzXhttps://cdn.huggingface.co/xlm-roberta-large-finetuned-conll02-spanish-pytorch_model.binzXhttps://cdn.huggingface.co/xlm-roberta-large-finetuned-conll03-english-pytorch_model.binzWhttps://cdn.huggingface.co/xlm-roberta-large-finetuned-conll03-german-pytorch_model.bin)zxlm-roberta-basezxlm-roberta-largez)xlm-roberta-large-finetuned-conll02-dutchz+xlm-roberta-large-finetuned-conll02-spanishz+xlm-roberta-large-finetuned-conll03-englishz*xlm-roberta-large-finetuned-conll03-germanat This model is a PyTorch `torch.nn.Module `_ sub-class. Use it as a regular PyTorch Module and refer to the PyTorch documentation for all matter related to general usage and behavior. Parameters: config (:class:`~transformers.XLMRobertaConfig`): Model configuration class with all the parameters of the model. Initializing with a config file does not load the weights associated with the model, only the configuration. Check out the :meth:`~transformers.PreTrainedModel.from_pretrained` method to load the model weights. zeThe bare XLM-RoBERTa Model transformer outputting raw hidden-states without any specific head on top.c@seZdZdZeZeZdS)ÚXLMRobertaModelzŸ This class overrides :class:`~transformers.RobertaModel`. Please check the superclass for the appropriate documentation alongside usage examples. N©Ú__name__Ú __module__Ú __qualname__Ú__doc__rZ config_classÚ(XLM_ROBERTA_PRETRAINED_MODEL_ARCHIVE_MAPZpretrained_model_archive_map©rrúE/tmp/pip-unpacked-wheel-ymerj3tt/transformers/modeling_xlm_roberta.pyr 9sr z:XLM-RoBERTa Model with a `language modeling` head on top. c@seZdZdZeZeZdS)ÚXLMRobertaForMaskedLMz¥ This class overrides :class:`~transformers.RobertaForMaskedLM`. Please check the superclass for the appropriate documentation alongside usage examples. Nr rrrrrGsrzšXLM-RoBERTa Model transformer with a sequence classification/regression head on top (a linear layer on top of the pooled output) e.g. for GLUE tasks. c@seZdZdZeZeZdS)Ú#XLMRobertaForSequenceClassificationz³ This class overrides :class:`~transformers.RobertaForSequenceClassification`. Please check the superclass for the appropriate documentation alongside usage examples. Nr rrrrrTsrz£XLM-RoBERTa Model with a multiple choice classification head on top (a linear layer on top of the pooled output and a softmax) e.g. for RocStories/SWAG tasks. c@seZdZdZeZeZdS)ÚXLMRobertaForMultipleChoicez« This class overrides :class:`~transformers.RobertaForMultipleChoice`. Please check the superclass for the appropriate documentation alongside usage examples. Nr rrrrrcsrz¡XLM-RoBERTa Model with a token classification head on top (a linear layer on top of the hidden-states output) e.g. for Named-Entity-Recognition (NER) tasks. c@seZdZdZeZeZdS)Ú XLMRobertaForTokenClassificationz° This class overrides :class:`~transformers.RobertaForTokenClassification`. Please check the superclass for the appropriate documentation alongside usage examples. Nr rrrrrrsr)rÚloggingZconfiguration_xlm_robertarZ file_utilsrZmodeling_robertarrrrr Ú getLoggerr ÚloggerrZXLM_ROBERTA_START_DOCSTRINGr rrrrrrrrÚsL   ú  þ ÿ ý ý ý