U 9%e @sUdZddlZddlmZeejdddZdaejje d<ejjd d d Z dd d d Z ed ddZ eddddZ eddddZdd ddZdd ddZdd ddZed ddZed ddZd d!lmZd d"lmZddddd ddddd#d$g ZdS)%ag This package enables an interface for accessing MPS (Metal Performance Shaders) backend in Python. Metal is Apple's API for programming metal GPU (graphics processor unit). Using MPS means that increased performance can be achieved, by running work on the metal GPU(s). See https://developer.apple.com/documentation/metalperformanceshaders for more details. N)TensorZ_mps_is_in_bad_forkcCsdS)NFrrrQ/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/torch/mps/__init__.py r_default_mps_generator)returncCstdkrtjatS)N)rtorch_CZ_mps_get_default_generatorrrrr_get_default_mps_generators r cCs tjS)zAWaits for all kernels in all streams on a MPS device to complete.)r r Z_mps_deviceSynchronizerrrr synchronizesr cCs tS)z:Returns the random number generator state as a ByteTensor.)r Z get_staterrrr get_rng_statesr) new_stater cCs|jtjd}t|dS)zoSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state )Z memory_formatN)cloner Zcontiguous_formatr Z set_state)rZnew_state_copyrrr set_rng_state sr)seedr cCs$tjjs dSt|}t|dS)zbSets the seed for generating random numbers. Args: seed (int): The desired seed. N)r r Z_has_mpsintr manual_seed)rrrrr*s rcCstdS)z?Sets the seed for generating random numbers to a random number.N)r rrrrrr:srcCstjdS)zReleases all unoccupied cached memory currently held by the caching allocator so that those can be used in other GPU applications. N)r r Z_mps_emptyCacherrrr empty_cache?srcCsBt|tstd|dks"|dkr2td|dtj|dS)aSet memory fraction for limiting process's memory allocation on MPS device. The allowed value equals the fraction multiplied by recommended maximum device memory (obtained from Metal API device.recommendedMaxWorkingSetSize). If trying to allocate more than the allowed value in a process, it will raise an out of memory error in allocator. Args: fraction(float): Range: 0~2. Allowed memory equals total_memory * fraction. .. note:: Passing 0 to fraction means unlimited allocations (may cause system failure if out of memory). Passing fraction greater than 1.0 allows limits beyond the value returned from device.recommendedMaxWorkingSetSize. z3Invalid type for fraction argument, must be `float`rrzInvalid fraction value: z. Allowed range: 0~2N) isinstancefloat TypeError ValueErrorr r Z_mps_setMemoryFraction)fractionrrrset_per_process_memory_fractionFs  rcCs tjS)zReturns the current GPU memory occupied by tensors in bytes. .. note:: The returned size does not include cached allocations in memory pools of MPSAllocator. )r r Z_mps_currentAllocatedMemoryrrrrcurrent_allocated_memory_srcCs tjS)zReturns total GPU memory allocated by Metal driver for the process in bytes. .. note:: The returned size includes cached allocations in MPSAllocator pools as well as allocations from MPS/MPSGraph frameworks. )r r Z_mps_driverAllocatedMemoryrrrrdriver_allocated_memoryisr)profiler)Eventr r)__doc__r rgetattrr Z_is_in_bad_forkr Generator__annotations__r r rrrrrrrrrreventr __all__rrrrs8