U Å9%e®ã@sHddlmZddlmZmZdgZdejeeeeedœdd„ZdS)é)Únn)ÚListÚOptionalÚpartition_modelN)ÚmoduleÚbalanceÚdevicesc Cszd}d}g}|D]^}g}t|ƒD]}| ||¡|d7}q |dkrH|n||} | tj|Ž | ¡¡|d7}qtj|ŽS)a, Given an :class:`nn.Sequential ` module, partitions the model across multiple GPU devices according the provided ``balance`` and ``devices``. Args: module (:class:`nn.Sequential `): Sequential model representing the pipe. balance (List[int]): List indicating the number of layers in each partition. devices (List[int], optional): List indicating the device to use for each partition. Defaults to ``range(len(balance))`` réN)ÚrangeÚappendrÚ SequentialÚto) rrrZ device_idxZpipe_idxZ balanced_pipeZ num_layersZlayersÚiZdevice©rúd/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/torch/distributed/pipeline/sync/utils.pyrs   )N) ZtorchrÚtypingrrÚ__all__r ÚintrrrrrÚs ý ý