U 0-e@sbdZddlZddlZddlZddlZddlmZmZddZe e ddd Z de e d d d ZdS)z A collection of utilities for ensuring that training can always occur. Heavily influenced by the [toma](https://github.com/BlackHC/toma) library. N)is_npu_availableis_xpu_availablecGsft|tst|}tt|D] }d||<qttrFtj nt rXtj n tj |S)aN Releases memory from `objects` by setting them to `None` and calls `gc.collect()` and `torch.cuda.empty_cache()`. Returned objects should be reassigned to the same variables. Args: objects (`Iterable`): An iterable of objects Returns: A list of `None` objects to replace `objects` Example: ```python >>> import torch >>> from accelerate.utils import release_memory >>> a = torch.ones(1000, 1000).cuda() >>> b = torch.ones(1000, 1000).cuda() >>> a, b = release_memory(a, b) ``` N) isinstancelistrangelengccollectrtorchxpu empty_cachernpucuda)objectsirX/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/accelerate/utils/memory.pyrelease_memorys     r) exceptionreturncs<dddg}ttr8tjdkr8tfdd|DSdS)z Checks if `exception` relates to CUDA out-of-memory, CUDNN not supported, or CPU out-of-memory Args: exception (`Exception`): An exception zCUDA out of memory.z(cuDNN error: CUDNN_STATUS_NOT_SUPPORTED.z*DefaultCPUAllocator: can't allocate memoryrc3s|]}|jdkVqdS)rN)args).0errrrr Osz+should_reduce_batch_size..F)r RuntimeErrorrrany)rZ _statementsrrrshould_reduce_batch_sizeAs r)functionstarting_batch_sizecs,dkrtjt|dS|fdd}|S)a A basic decorator that will try to execute `function`. If it fails from exceptions related to out-of-memory or CUDNN, the batch size is cut in half and passed to `function` `function` must take in a `batch_size` parameter as its first argument. Args: function (`callable`, *optional*): A function to wrap starting_batch_size (`int`, *optional*): The batch size to try and fit into memory Example: ```python >>> from accelerate.utils import find_executable_batch_size >>> @find_executable_batch_size(starting_batch_size=128) ... def train(batch_size, model, optimizer): ... ... >>> train(model, optimizer) ``` N)r!c sFttrtjntr,tjn tjt t j }t|t|dkrdddt|dd|ddD}tdjdjd|dd krtd zf||WStk r>}zTt|r,ttrtjntrtjn tjd nW5d}~XYqXqdS) Nrz, cSsg|]\}}|d|qS)=r)rargvaluerrr szAfind_executable_batch_size..decorator..zBatch size was passed into `zS` as the first argument when called.Remove this as the decorator already does so: `(z)`rz-No executable batch size found, reached zero.)r r rr r r rrrrinspect signature parameterskeysrjoinzip TypeError__name__r Exceptionr)rkwargsparamsZarg_streZ batch_sizer rr decoratorss4   *     z-find_executable_batch_size..decorator) functoolspartialfind_executable_batch_size)r r!r5rr4rr8Ss #r8)Nr)__doc__r6r r(r Zimportsrrrr0boolrcallableintr8rrrrs$