U 0-e@spddlmZddlZddlmZmZddlmZmZddl m Z dZ d ed fe e d d d ZddZddZdS))PathN)is_npu_availableis_xpu_available) ClusterConfigdefault_json_config_file)SubcommandHelpFormatterzFCreate a default config file for Accelerate with only a few flags set.noF) save_locationuse_xpucCsXt|}|jjddd|r4td|ddS|}|dkrRtd|d|d }tj rtj }||d <d|d <|d krd |d<nd|d<nt r|rtj }||d <d|d <|d krd|d<nd|d<n\t rtj }||d <d|d <|d krd|d<nd|d<nd}d|d <d |d <d|d<d|d<tf|}|||S)aA Creates and saves a basic cluster config to be used on a local machine with potentially multiple GPUs. Will also set CPU if it is a CPU-only machine. Args: mixed_precision (`str`, *optional*, defaults to "no"): Mixed Precision to use. Should be one of "no", "fp16", or "bf16" save_location (`str`, *optional*, defaults to `default_json_config_file`): Optional custom save location. Should be passed to `--config_file` when using `accelerate launch`. Default location is inside the huggingface cache folder (`~/.cache/huggingface`) but can be overriden by setting the `HF_HOME` environmental variable, followed by `accelerate/default_config.yaml`. use_xpu (`bool`, *optional*, defaults to `False`): Whether to use XPU if available. T)parentsexist_okz Configuration already exists at zZ, will not override. Run `accelerate config` manually or pass a different `save_location`.F)r fp16bf16Zfp8zL`mixed_precision` should be one of 'no', 'fp16', 'bf16', or 'fp8'. Received Z LOCAL_MACHINE)Zcompute_environmentmixed_precisionZ num_processesZuse_cpurZ MULTI_GPUZdistributed_typeNOZ MULTI_XPUZ MULTI_NPUrdebug)rparentmkdirexistsprintlower ValueErrortorchcudaZ is_availableZ device_countrZxpurZnpurZ to_json_file)rr r pathconfigZnum_gpusZnum_xpusZnum_npusrc/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/accelerate/commands/config/default.pywrite_basic_configsX               r cCsN|jd|ttd}|jdtddd|jddd d gtd dd |jtd |S)Ndefault)r helpformatter_classz --config_fileaTThe path to use to store the config file. Will default to a file named default_config.yaml in the cache location, which is the content of the environment `HF_HOME` suffixed with 'accelerate', or if you don't have such an environment variable, your cache directory ('~/.cache' or the content of `XDG_CACHE_HOME`) suffixed with 'huggingface'.r )r!r"destz--mixed_precisionr rrzWhether or not to use mixed precision training. Choose between FP16 and BF16 (bfloat16) training. BF16 training is only supported on Nvidia Ampere GPUs and PyTorch 1.10 or later.)choicestyper"r!)func) add_parser descriptionr add_argumentrstr set_defaultsdefault_config_command)parserr rrrdefault_command_parser_s   r/cCs$t|j|j}|r td|dS)Nz"accelerate configuration saved at )r rr r)args config_filerrrr-zsr-)pathlibrrutilsrrZ config_argsrrZ config_utilsr r)r+boolr r/r-rrrrs  B