U *-e @sDUdZddlmZddlmZmZmZmZddlZddddd d d d d ddg Z ee e d<GdddZ e Z eejje fZejedddZejedddZejedddZeejedddd Zeeedddd Zeejddd Zeedddd Zejedddd ZeedddZeejjdd dZdS)!zWUtilities for eliminating boilerplate code to handle abstract streams with CPU device. )contextmanager) GeneratorListUnioncastN CPUStreamType new_streamcurrent_streamdefault_stream use_device use_stream get_device wait_stream record_streamis_cudaas_cuda__all__c@s eZdZdS)rN)__name__ __module__ __qualname__rrg/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/torch/distributed/pipeline/sync/stream.pyrs)devicereturncCs|jdkrtStj|S)z3Creates a new stream for either CPU or CUDA device.cuda)type CPUStreamtorchrStreamrrrrrs cCs|jdkrtStj|S)z@:func:`torch.cuda.current_stream` for either CPU or CUDA device.r)rrrrr rrrrr &s cCs|jdkrtStj|S)z@:func:`torch.cuda.default_stream` for either CPU or CUDA device.r)rrrrr rrrrr -s )NNNc cs6|jdkrdVdStj| dVW5QRXdS)z8:func:`torch.cuda.device` for either CPU or CUDA device.rN)rrrrrrrrr 4s  )streamrc cs8t|sdVdStjt| dVW5QRXdS)z8:func:`torch.cuda.stream` for either CPU or CUDA stream.N)rrrr rr rrrr ?s cCst|rt|jStdS)z(Gets the device from CPU or CUDA stream.cpu)rrrrr!rrrr Js )sourcetargetrcCs4t|r0t|r$t|t|n t|dS)z:meth:`torch.cuda.Stream.wait_stream` for either CPU or CUDA stream. It makes the source stream wait until the target stream completes work queued. N)rrrZ synchronize)r#r$rrrrQs)tensorr rcCs0t|r,|dg|}|t|dS)zA:meth:`torch.Tensor.record_stream` for either CPU or CUDA stream.rN)rZ new_emptyset_Z_typed_storagerr)r%r rrrr`s cCs|tk S)zs6