U 9%e|S)N[]) isinstancetorchZTensornpmaxabsnumpy enumerater2) Zpt_outZtf_outZ differences attr_nameZtensor_differenceZ root_nameiZpt_item branch_nameZtf_item_find_pt_tf_differencesr$r%rEs    zEPTtoTFCommand.find_pt_tf_differences.._find_pt_tf_differences)r+)setkeys ValueError) pt_outputs tf_outputsZ pt_out_attrsZ tf_out_attrsr$rDr%find_pt_tf_differencess  z$PTtoTFCommand.find_pt_tf_differences)rrrrr r!r"r#c GsRtd|_||_|r|n tjd||_||_||_ ||_ ||_ ||_ ||_ dS)Nztransformers-cli/pt_to_tfz/tmp)rZ get_logger_logger _model_nameospathjoin _local_dir _max_error _new_weights_no_pr_push_extra_commit_description_override_model_class) selfrrrrr r!r"r#rr$r$r%__init__s zPTtoTFCommand.__init__cCs6dd}t|j}|tkrHt|j}|tkr|jjdkr|jj |j_nd|t kr^t |j}nN|t krtt |j}n8|tkrt|j}|jdkr|j |_ntd|dtt|jj}i}d|kr|ddgd d d d |krtd d ddddd} |d| id|krxt|jj} d| krb| dj} | dk r\| dk r\| } nd } nd } ||| dd|kr||d d|f|ddi} |f|ddi}|jst|drt|dsd|kr.tjdgdggtd|jjpd }| dt !|i|dt"#|i| |fS)!zQ Returns the right inputs for the model, based on its signature. cSs@tdddd}|dtdddd}dd |D}|S) Nz)hf-internal-testing/librispeech_asr_dummycleanZ validationsplitidraudiocSsg|] }|dqS)arrayr$).0xr$r$r% szFPTtoTFCommand.get_inputs.._get_audio_input..)rsortselectrange)ZdsZspeech_samplesZ raw_samplesr$r$r%_get_audio_inputs z2PTtoTFCommand.get_inputs.._get_audio_inputNz1Unknown data processing type (model config type: r7Z input_idsz Hi there!z@I am a batch with more than one row and different input lengths.T)textpaddingZ truncationZ pixel_valuesZcifar10 plain_texttestr[rZimgZimagesZinput_featuresrhF)r^rhZ input_valuesZreturn_tensorspttfencoderdecoderdecoder_input_idsr)Zdtyper)$r)configr rfrom_pretrainedrQr Z tokenizerZ pad_tokenZ eos_tokenrr rr rrHrFinspect signatureforward parametersrGupdaterZfeature_extractorr,Zis_encoder_decoderhasattrr<ZasarrayintZdecoder_start_token_idr;ZtensorrlZconvert_to_tensor)rXpt_modeltf_dummy_inputsrprfZmodel_config_class processorZmodel_forward_signatureZprocessor_inputsZ sample_imagesZfeature_extractor_signatureZdefault_strategyZpadding_strategypt_inputtf_inputror$r$r% get_inputssh          $zPTtoTFCommand.get_inputsc! sttjtdkr tdnddlm}m}ddlm}|j j d}t j }|j }jdk rjdrjddg}njg}zttd |d}Wn&tk rtd jd YnXzttd d|d}Wn(tk rtd jd YnXn|dkrHttd d }ttd d}jdnt|dkrftd|djd|dttd |d}zttd d|d}Wn*tk rtd|ddYnX||} | j} ~ | j } | | | |\} } t| f| ddi}W5QRX~ |j j dd} | f| ddd}||}dd|D}dd|D}t|dkr|dk rtd|d|rt| nd }t| }|j!ks|j!krFtd!d"j!d#d$"fd%d&|Dd'j!d#d$"fd(d&|Dt#j$"j t%}t#j$"j t&}t#j$'|st#j$'|rj(r| )j ~ | j }|f| ddi}||}d)d|D}d*d|D}t|dkr|dk rtd|d|r t| nd }t| }|j!ksH|j!krtd+d"j!d#d$"fd,d&|Dd'j!d#d$"fd-d&|Dj(rd.nd/}j*r|j+dd0|,||j-dd1jd2j nj.sjd3d4|d5d6|d5d7|d5d8|d5d9 }j!t/krL|d:j!d;7}j0rb|d<j07}t#j$'|r|t&|d=g}t1j2j34j d>D] }||t#j$5||d=g7}qn|t%|d=g}|j |||d?dd@j6} jdA| dS)BNz0.9.0zrThe huggingface_hub version must be >= 0.9.0 to use this command. Please update your huggingface_hub installation.r) Repository create_commit)CommitOperationAdd)rZ clone_fromZTFrZ transformersz Model class z not found in transformers.zTF model class TFZ AutoModelZ TFAutoModelz5No detected architecture, using AutoModel/TFAutoModelrzAMore than one architecture was found, aborting. (architectures = r7zDetected architecture: zThe TensorFlow equivalent of z doesn't exist in transformers.output_hidden_statesT)Zfrom_ptF)rZtrainingcSsi|]\}}d|kr||qSZhiddenr$r`kvr$r$r% Nsz%PTtoTFCommand.run..cSsi|]\}}d|kr||qSrr$rr$r$r%rOsz;Something went wrong -- the config file has architectures (zF), but no model head output was found. All outputs start with 'hidden'gzOThe cross-loaded TensorFlow model has different outputs, something went wrong! z9 List of maximum output differences above the threshold (z):  cs*g|]"\}}|jkr|d|dqSz: .3erRrrXr$r%rb[s z%PTtoTFCommand.run..z@ List of maximum hidden layer differences above the threshold (cs*g|]"\}}|jkr|d|dqSrrrrr$r%rb]s cSsi|]\}}d|kr||qSrr$rr$r$r%rkscSsi|]\}}d|kr||qSrr$rr$r$r%rlszLThe converted TensorFlow model has different outputs, something went wrong! cs*g|]"\}}|jkr|d|dqSrrrrr$r%rbxs cs*g|]"\}}|jkr|d|dqSrrrrr$r%rbzs zUpdate TF weightszAdd TF weights)Zauto_lfs_track)blockingzTF weights pushed into z&Uploading the weights into a new PR...aModel converted by the [`transformers`' `pt_to_tf` CLI](https://github.com/huggingface/transformers/blob/main/src/transformers/commands/pt_to_tf.py). All converted model outputs and hidden layers were validated against its PyTorch counterpart. Maximum crossload output difference=rz,; Maximum crossload hidden layer difference=z'; Maximum conversion output difference=z-; Maximum conversion hidden layer difference=z; zB CAUTION: The maximum admissible error was manually increased to !z )Z path_in_repoZpath_or_fileobjz/tf_model-*.h5model)Zrepo_id operationscommit_messageZcommit_descriptionZ repo_typeZ create_prz PR open in )7rparsehuggingface_hub __version__ ImportErrorrrZhuggingface_hub._commit_apirrQrMr rq architecturesrW startswithgetattrrAttributeErrorrHrLwarninglen from_configZ dummy_inputsevalr~r;Zno_gradrKitemsr=valuesrRrPrNrOrrexistsrSZsave_pretrainedrUZgit_addZ git_commitZgit_pushrTr4rVrlioZgfileglobbasenameZpr_url)!rXrrrreporprZpt_classZtf_classZtf_from_pt_modelrzryr|r}rIZtf_from_pt_outputsZcrossload_differencesZoutput_differencesZhidden_differencesZmax_crossload_output_diffZmax_crossload_hidden_diffZtf_weights_pathZtf_weights_index_pathZtf_modelrJZconversion_differencesZmax_conversion_output_diffZmax_conversion_hidden_diffrZcommit_descritionrZ shard_pathZ hub_pr_urlr$rr%run s              $           $    zPTtoTFCommand.runN) __name__ __module__ __qualname__ staticmethodrr6rKr2r3boolrYr~rr$r$r$r%rKs> ' Fr))rrrNargparserr importlibrrr?r< packagingrr+rrr r r r r rrrrrutilsrrrrZ tensorflowrlrpZ experimentalZ enable_tensor_float_32_executionr;Zdatasetsrr4r&rr$r$r$r%s&  8