U 9%e S @sddlZddlmZddlmZddlmZddlmZm Z m Z m Z m Z ddl ZddlmZmZddlmZdd lmZmZmZmZd d lmZerdd lmZdd lmZerddlm Z erddl!m"Z"ddl#m$Z$ddl%m&Z&e'e(Z)edZ*edddZ+d+e ddee,ede-e e e-e e-fdddZ.d,e ddee,ede e e-e e-fdd d!Z/d-e de d"ee,ede-e e e-e e-fdd#d$Z0d.ee de d"ee e-e1dd%d&d'Z2e d"e e-e e3e e-fd(d)d*Z4dS)/N) signature)chain)Path) TYPE_CHECKINGIterableListTupleUnion)Versionparse)PreTrainedTokenizerBase) TensorTypeis_tf_availableis_torch_availablelogging) OnnxConfig)PreTrainedModel)is_torch_less_than_1_11)TFPreTrainedModel)FeatureExtractionMixin)ProcessorMixin)PreTrainedTokenizerz1.4.0)minimum_versioncCsXz6ddl}t|j}|tkr4td|jd|dWntk rRtdYnXdS)z Check onnxruntime is installed and if the installed version match is recent enough Raises: ImportError: If onnxruntime is not installed or too old version is found rNz*We found an older version of onnxruntime (z&) but we require onnxruntime to be >= zp to enable all the conversions options. Please update onnxruntime by running `pip install --upgrade onnxruntime`zonnxruntime doesn't seem to be currently installed. Please install the onnxruntime by running `pip install onnxruntime` and relaunch the conversion.) onnxruntimer __version__ORT_QUANTIZE_MINIMUM_VERSION ImportError)rrZ ort_versionrX/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/transformers/onnx/convert.pycheck_onnxruntime_requirements6s r!cpu)rrrrr) preprocessormodelconfigopsetoutput tokenizerdevicereturnc st|tr|dk rtd|dk r||| f|'t#|j("|t)t*|j(|j$d|d|/W5QRX||fS)a Export a PyTorch model to an ONNX Intermediate Representation (IR) Args: preprocessor: ([`PreTrainedTokenizer`], [`FeatureExtractionMixin`] or [`ProcessorMixin`]): The preprocessor used for encoding the data. model ([`PreTrainedModel`]): The model to export. config ([`~onnx.config.OnnxConfig`]): The ONNX configuration associated with the exported model. opset (`int`): The version of the ONNX operator set to use. output (`Path`): Directory to store the exported ONNX model. device (`str`, *optional*, defaults to `cpu`): The device on which the ONNX model will be exported. Either `cpu` or `cuda`. Returns: `Tuple[List[str], List[str]]`: A tuple with an ordered list of the model's inputs, and the named inputs from the ONNX configuration. NKYou cannot provide both a tokenizer and a preprocessor to export the model.tThe `tokenizer` argument is deprecated and will be removed in version 5 of Transformers. Use `preprocessor` instead.SOverwriting the `preprocessor` argument with `tokenizer` to generate dummmy inputs.r)exportzUsing framework PyTorch: T Overriding  configuration item(s) -  ->  frameworkcudac3s(|] }t|jr|ndVqdSN isinstanceZTensorto.0xr)torchrr sz!export_pytorch..cs$g|]}tfdd|DqS)c3s(|] }t|jr|ndVqdSr6r7r:r=rr r?sz,export_pytorch...)tuple)r;tr=rr sz"export_pytorch..z%Model and config inputs doesn't match)f input_names output_names dynamic_axesdo_constant_foldinguse_external_data_formatZenable_onnx_checker opset_versionzExporting model exceed maximum protobuf size of 2GB. Please call torch.onnx.export without setting use_external_data_format parameter.zExporting model exceed maximum protobuf size of 2GB. Please call torch.onnx.export without setting use_external_data_format parameter or try with torch 1.10+.)rCrDrErFrGrI)0r8r ValueErrorwarningswarn FutureWarningloggerinfo issubclasstyperr>Z torch.onnxr.rZno_gradr% return_dictevalvalues_overridelenitemssetattrgenerate_dummy_inputsrPYTORCHr)r5Z is_availabler9rr@r$ensure_model_and_config_inputs_matchkeyslistoutputsZ patch_opsras_posixinputsdictrrHZnum_parameters RuntimeErrorstr restore_ops)r#r$r%r&r'r(r)Z onnx_exportoverride_config_keyoverride_config_value model_inputsZmodel_inputs_devicekv inputs_matchmatched_inputs onnx_outputserrmessagerr=r export_pytorchSs                rn)rrr)r#r$r%r&r'r(r*cs2ddl}ddlddl}t|tr2|dk r2td|dk rTtdtt d|}d|j _ |j dk rt dt|j d|j D],\}} t d |d | t|j || q|j|tjd } t|| \} } t|j} fd d | D}|jj|||d\}}||||| | fS)a Export a TensorFlow model to an ONNX Intermediate Representation (IR) Args: preprocessor: ([`PreTrainedTokenizer`] or [`FeatureExtractionMixin`]): The preprocessor used for encoding the data. model ([`TFPreTrainedModel`]): The model to export. config ([`~onnx.config.OnnxConfig`]): The ONNX configuration associated with the exported model. opset (`int`): The version of the ONNX operator set to use. output (`Path`): Directory to store the exported ONNX model. Returns: `Tuple[List[str], List[str]]`: A tuple with an ordered list of the model's inputs, and the named inputs from the ONNX configuration. rNzIYou cannot provide both a tokenizer and preprocessor to export the model.r,r-Tr/r0r1r2r3cs*g|]"\}}jdg|j|j|dqS)N)dtypename)Z TensorSpecndimro)r;keyZtensortfrr rBsz%export_tensorflow..)r&)onnxZ tensorflowtf2onnxr8r rJrKrLrMrNrOr%rRrTrUrVrWrXr TENSORFLOWrZr[r\r]convertZ from_kerassaver^rc)r#r$r%r&r'r(rurvrdrerfrirjrkZinput_signature onnx_model_rrsr export_tensorflows8   r|)rrc Cstststdtr4t|tr4|dkr4tdt|trN|dk rNtd|dk rpt dt t d|}trdd l m}|jst d |jd |trtt|trt|||||||d Strtt|trt||||||d SdS)a Export a Pytorch or TensorFlow model to an ONNX Intermediate Representation (IR) Args: preprocessor: ([`PreTrainedTokenizer`], [`FeatureExtractionMixin`] or [`ProcessorMixin`]): The preprocessor used for encoding the data. model ([`PreTrainedModel`] or [`TFPreTrainedModel`]): The model to export. config ([`~onnx.config.OnnxConfig`]): The ONNX configuration associated with the exported model. opset (`int`): The version of the ONNX operator set to use. output (`Path`): Directory to store the exported ONNX model. device (`str`, *optional*, defaults to `cpu`): The device on which the ONNX model will be exported. Either `cpu` or `cuda`. Only PyTorch is supported for export on CUDA devices. Returns: `Tuple[List[str], List[str]]`: A tuple with an ordered list of the model's inputs, and the named inputs from the ONNX configuration. zrCannot convert because neither PyTorch nor TensorFlow are not installed. Please install torch or tensorflow first.r5z1`tf2onnx` does not support export on CUDA device.Nr+r,r-r )get_torch_versionz@Unsupported PyTorch version for this model. Minimum required is z, got: )r(r))r()rrrr8rrar rJrKrLrMrNrOutilsr}Zis_torch_support_availablewarningZtorch_onnx_minimum_versionrPrQrrnr|)r#r$r%r&r'r(r)r}rrr r.s2   r.)r%r#reference_modelrzonnx_named_outputsatolr(c CsTddlm}m}tdt|tr4|dk r4td|dk rVt dt td|}t rt t |tr|j||jd|jdtjd} n |j||jd|jdtjd} |} ||| d gd } t rt t |tr|d |f| } i} | D]F\}}|d krd }t|ttfr8|||}| |q|| |<q|| }i}|D]L\}}t|ttfr|||}|dd|Dn |||<qX| ||}t| t|}}|!|std|d|td|"|ntd|dt#||D]0\}}t rPt t |trP| |$}n | |}td|d|j%|j%kstd|j%d|j%td|j%d|j%dntd|j%d|j%t&j'|||ds:t&(t&j)|||d}td|dtd t&*t&+||d!||d"||ntd#|dqdS)$Nr)InferenceSessionSessionOptionszValidating ONNX model...zUYou cannot provide both a tokenizer and a preprocessor to validate the model outputs.r,r-r)Z batch_sizeZ seq_lengthr4ZCPUExecutionProvider) providersr"Zpast_key_valuesZpresentcSsi|]\}}||qSr)numpy)r;Z tensor_nameZ pt_tensorrrr sz*validate_model_outputs..z -[x] ONNX model output names z do not match reference model zGOutputs doesn't match between reference model and ONNX exported model: u7 -[✓] ONNX model output names match reference model ()z! - Validating ONNX Model output "z":z -[x] shape z doesn't match zQOutputs shape doesn't match between reference model and ONNX exported model: Got z (reference) and z (ONNX)u -[✓] z matches )rz& -[x] values not close enough (atol: znOutputs values doesn't match between reference model and ONNX exported model: Got max absolute difference of: z for z vs u! -[✓] all values close (atol: ),rrrrNrOr8r rJrKrLrMrrPrQrrXZdefault_fixed_batchZdefault_fixed_sequencerrYrwr^r9rVr\r@Z"flatten_output_collection_propertyupdateZ!generate_dummy_inputs_onnxruntimerrunsetr[issubset differencezipdetachshapenpZallcloseZ logical_notiscloseZamaxabs)r%r#rrzrrr(rrZreference_model_inputsoptionssessionZ ref_outputsZref_outputs_dictrpvalueZ"reference_model_inputs_onnxruntimeZ onnx_inputsrkZref_outputs_setZonnx_outputs_setZ ort_valueZ ref_valueZ bad_indicesrrr validate_model_outputs_s              ,r)r$rfr*csttr"tt|tr"t|jj}n t|jj}t|}t| }| |}| |fdd| D}||fS)z> :param model_inputs: :param config_inputs: :return: csg|]}|kr|qSrr)r;Z parameterZmatching_inputsrr rBsz8ensure_model_and_config_inputs_match..) rrPrQrrforward parameterscallrr[r intersection)r$rfZforward_parametersZmodel_inputs_setZforward_inputs_setZis_okZordered_inputsrrr rZs    rZ)Nr")N)Nr")N)5rKinspectr itertoolsrpathlibrtypingrrrrr rrZpackaging.versionr r Ztokenization_utils_baser r~rrrrr%rZmodeling_utilsrZ pytorch_utilsrZmodeling_tf_utilsrZfeature_extraction_utilsrZprocessing_utilsrZtokenization_utilsrZ get_logger__name__rNrr!intrbrnr|r.floatrboolrZrrrr s            #  H I |