U
-e\ @ sv d Z ddlZddlZddlmZmZmZmZmZmZm Z m
Z
ddl m Z ddl
mZ ejejej
ejejdZej
Zdd Zed d
d Zejd d d
Zdd ddZdd ddZd1e e ejdddZed ddZeddddZ dd Z d d Z d d Z d d! Z dd d"d#Z!dd d$d%Z"e G d&d' d'Z#d(a$G d)d* d*Z%e% Z
e&d d+d,Z'd-d. Z(d/d0 Z)dS )2z Logging utilities. N)CRITICALDEBUGERRORFATALINFONOTSETWARNWARNING)Optional)auto)debuginfowarningerrorcriticalc C sH t dd} | rD| tkr t| S t d| ddt tS )z
If DATASETS_VERBOSITY env var is set to one of the valid choices return that as the new default level.
If it is not - fall back to ``_default_log_level``
ZDATASETS_VERBOSITYNz"Unknown option DATASETS_VERBOSITY=z, has to be one of: z, ) osgetenv
log_levelslogging getLoggerr joinkeys_default_log_level)Z
env_level_str r W/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/datasets/utils/logging.py_get_default_logging_level, s r )returnc C s t dd S )N.r )__name__splitr r r r _get_library_name= s r c C s t t S N)r r r r r r r _get_library_root_loggerA s r" c C s$ t } | t | t d S r! )r"
addHandlerr
StreamHandlersetLevelr Zlibrary_root_loggerr r r _configure_library_root_loggerE s r' c C s t } | tj d S r! )r" r% r r r& r r r _reset_library_root_loggerL s r( )namer c C s | dkrt } t| S )z_Return a logger with the specified name.
This function can be used in dataset scripts.
N)r r r )r) r r r
get_loggerQ s r* c C s
t S )a Return the current level for the HuggingFace datasets library's root logger.
Returns:
Logging level, e.g., `datasets.logging.DEBUG` and `datasets.logging.INFO`.
HuggingFace datasets library has following logging levels:
- `datasets.logging.CRITICAL`, `datasets.logging.FATAL`
- `datasets.logging.ERROR`
- `datasets.logging.WARNING`, `datasets.logging.WARN`
- `datasets.logging.INFO`
- `datasets.logging.DEBUG`
)r" getEffectiveLevelr r r r
get_verbosityZ s r, ) verbosityr c C s t | dS )zSet the level for the Hugging Face Datasets library's root logger.
Args:
verbosity:
Logging level, e.g., `datasets.logging.DEBUG` and `datasets.logging.INFO`.
N)r" r% )r- r r r
set_verbositym s r. c C s t tS )zSet the level for the Hugging Face datasets library's root logger to `INFO`.
This will display most of the logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.INFO)`.
)r. r r r r r set_verbosity_infov s r/ c C s t tS )zSet the level for the Hugging Face datasets library's root logger to `WARNING`.
This will display only the warning and errors logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.WARNING)`.
)r. r r r r r set_verbosity_warning s r0 c C s t tS )zSet the level for the Hugging Face datasets library's root logger to `DEBUG`.
This will display all the logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.DEBUG)`.
)r. r r r r r set_verbosity_debug s r1 c C s t tS )zSet the level for the Hugging Face datasets library's root logger to `ERROR`.
This will display only the errors logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.ERROR)`.
)r. r r r r r set_verbosity_error s r2 c C s dt _dS )zjDisable propagation of the library log outputs.
Note that log propagation is disabled by default.
FNr" propagater r r r disable_propagation s r5 c C s dt _dS )zEnable propagation of the library log outputs.
Please disable the Hugging Face datasets library's default handler to prevent double logging if the root logger has
been configured.
TNr3 r r r r enable_propagation s r6 c @ s8 e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd S )
EmptyTqdmz%Dummy tqdm which doesn't do anything.c O s |r |d nd | _ d S )Nr ) _iteratorselfargskwargsr r r __init__ s zEmptyTqdm.__init__c C s
t | jS r! )iterr8 r: r r r __iter__ s zEmptyTqdm.__iter__c C s dd }|S )zReturn empty function.c _ s d S r! r )r; r< r r r empty_fn s z'EmptyTqdm.__getattr__..empty_fnr )r: _rA r r r __getattr__ s zEmptyTqdm.__getattr__c C s | S r! r r? r r r __enter__ s zEmptyTqdm.__enter__c C s d S r! r )r: type_value tracebackr r r __exit__ s zEmptyTqdm.__exit__N) r
__module__ __qualname____doc__r= r@ rC rD rH r r r r r7 s r7 Tc @ s2 e Zd ZddddZdd Zdd Zd d
Zd S ) _tqdm_clsF)disablec O s" t r|stj||S t||S d S r! ) _tqdm_activetqdm_libtqdmr7 )r: rM r; r< r r r __call__ s z_tqdm_cls.__call__c O s d | _ trtjj||S d S r! )_lockrN rO rP set_lockr9 r r r rS s z_tqdm_cls.set_lockc C s t rtj S d S r! )rN rO rP get_lockr? r r r rT s z_tqdm_cls.get_lockc C s6 z | j |= W n$ tk
r0 |dkr,t|Y nX dS )z;fix for https://github.com/huggingface/datasets/issues/6066rR N)__dict__KeyErrorAttributeError)r: attrr r r __delattr__ s
z_tqdm_cls.__delattr__N)r rI rJ rQ rS rT rY r r r r rL s rL c C s t tS )zCReturn a boolean indicating whether tqdm progress bars are enabled.)boolrN r r r r is_progress_bar_enabled s r[ c C s da dS )zEnable tqdm progress bar.TNrN r r r r enable_progress_bar s r] c C s da dS )zDisable tqdm progress bar.FNr\ r r r r disable_progress_bar s r^ )N)*rK r r r r r r r r r r typingr
rP r rO r r r strr Loggerr" r' r( r* intr, r. r/ r0 r1 r2 r5 r6 r7 rN rL rZ r[ r] r^ r r r r sD (