U 9%e@sddlZddlZddlmZddlmZddlmZddlZddl m Z m Z e e ZdZGdd d eZGd d d eZGd d d eZGdddeZGdddeZeeedddZdS)N)ABC)deepcopy)Optional)add_start_docstringsloggingaK Args: input_ids (`torch.LongTensor` of shape `(batch_size, sequence_length)`): Indices of input sequence tokens in the vocabulary. Indices can be obtained using [`AutoTokenizer`]. See [`PreTrainedTokenizer.encode`] and [`PreTrainedTokenizer.__call__`] for details. [What are input IDs?](../glossary#input-ids) scores (`torch.FloatTensor` of shape `(batch_size, config.vocab_size)`): Prediction scores of a language modeling head. These can be scores for each vocabulary token before SoftMax or scores for each vocabulary token after SoftMax. kwargs (`Dict[str, Any]`, *optional*): Additional stopping criteria specific kwargs. Return: `bool`. `False` indicates we should continue, `True` indicates we should stop. c@s.eZdZdZeeejeje dddZ dS)StoppingCriteriazTAbstract base class for all stopping criteria that can be applied during generation. input_idsscoresreturncKs tddS)Nz'StoppingCriteria needs to be subclassed)NotImplementedErrorselfr r kwargsrh/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/transformers/generation/stopping_criteria.py__call__'szStoppingCriteria.__call__N) __name__ __module__ __qualname____doc__r"STOPPING_CRITERIA_INPUTS_DOCSTRINGtorch LongTensor FloatTensorboolrrrrrr$src@sDeZdZdZd eeedddZeee j e j e dddZ dS) MaxLengthCriteriaa This class can be used to stop generation whenever the full generated number of tokens exceeds `max_length`. Keep in mind for decoder-only type of transformers, this will include the initial prompted tokens. Args: max_length (`int`): The maximum length that the output sequence can have in number of tokens. max_position_embeddings (`int`, `optional`): The maximum model length, as defined by the model's `config.max_position_embeddings` attribute. N max_lengthmax_position_embeddingscCs||_||_dSNr)rrr rrr__init__8szMaxLengthCriteria.__init__r cKsD|jd}||jk}|jdk r@|s@||jkr@td|jd|S)NzrThis is a friendly reminder - the current text generation call will exceed the model's predefined maximum length (zb). Depending on the model, you may observe exceptions, performance degradation, or nothing at all.)shaperr loggerZ warning_once)rr r rcur_lenZis_donerrrr<s   zMaxLengthCriteria.__call__)N)rrrrintrr"rrrrrrrrrrrr,s rc@s>eZdZdZeedddZeeej ej e dddZ dS) MaxNewTokensCriteriaa This class can be used to stop generation whenever the generated number of tokens exceeds `max_new_tokens`. Keep in mind for decoder-only type of transformers, this will **not** include the initial prompted tokens. This is very close to `MaxLengthCriteria` but ignores the number of initial tokens. Args: start_length (`int`): The number of initial tokens. max_new_tokens (`int`): The maximum number of tokens to generate. ) start_lengthmax_new_tokenscCs2td||dt||_||_|||_dS)NzYThe class `MaxNewTokensCriteria` is deprecated. Please use `MaxLengthCriteria(max_length=z=)` with `max_length = start_length + max_new_tokens` instead.)warningswarn FutureWarningr)r*r)rr)r*rrrr"VszMaxNewTokensCriteria.__init__r cKs|jd|jkS)Nr#)r$rrrrrraszMaxNewTokensCriteria.__call__N) rrrrr'r"rrrrrrrrrrrr(Is  r(c@sDeZdZdZd eeedddZeee j e j e dddZ dS) MaxTimeCriteriaa This class can be used to stop generation whenever the full generation exceeds some amount of time. By default, the time will start being counted when you initialize this function. You can override this by passing an `initial_time`. Args: max_time (`float`): The maximum allowed time in seconds for the generation. initial_time (`float`, *optional*, defaults to `time.time()`): The start of the generation allowed time. N)max_timeinitial_timestampcCs ||_|dkrtn||_dSr!)r/timer0)rr/r0rrrr"sszMaxTimeCriteria.__init__r cKst|j|jkSr!)r1r0r/rrrrrwszMaxTimeCriteria.__call__)N)rrrrfloatrr"rrrrrrrrrrrr.fs r.c@s@eZdZeeejejedddZ e e e dddZ dS)StoppingCriteriaListr c stfdd|DS)Nc3s|]}|VqdSr!r).0criteriar r rr sz0StoppingCriteriaList.__call__..)anyrrr6rr}szStoppingCriteriaList.__call__)r cCs6|D],}t|tr|jSt|tr|jSqdSr!) isinstancerrr()rZstopping_criteriumrrrrs     zStoppingCriteriaList.max_lengthN)rrrrrrrrrrpropertyrr'rrrrrr3|sr3)stopping_criteriarr cCsH|j}t|}|dk r,||kr,tdtn|dkrD|t|d|S)NzOYou set different `max_length` for stopping criteria and `max_length` parameter)r)rrr+r, UserWarningappendr)r;rZstopping_max_lengthZnew_stopping_criteriarrrvalidate_stopping_criteriasr>)r1r+abcrcopyrtypingrrutilsrrZ get_loggerrr%rrrr(r.listr3r'r>rrrrs