U ×9%eàã@s ddlmZdd„Zdd„ZdS)é)ÚceilcsÎttd|ƒƒ‰dd„t| ¡ƒDƒ‰g}ˆD]$}ˆ |¡dkr,||kr,| |¡q,‡fdd„ˆDƒ}‡fdd„ˆDƒ}t|ƒdkr’tdt|ƒƒ‚t|ƒdkr®tdt|ƒƒ‚t|ƒdkrÊtd t|ƒƒ‚dS) NrcSsg|]}|D]}|‘q qS©r)Ú.0ZsublistÚitemrrúf/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/transformers/utils/model_parallel_utils.pyÚ sz%assert_device_map..écsg|]}|ˆkr|‘qSrr©rÚi)Údevice_map_blocksrrrscsg|]}|ˆkr|‘qSrrr )ÚblocksrrrszœDuplicate attention blocks specified in device_map. Attention blocks must be specified to one device. These attention blocks were specified more than once: zŽThere are attention blocks for this model that are not specified in the device_map. Add these attention blocks to a device on the device_map: zdThe device_map contains more attention blocks than this model has. Remove these from the device_map:)ÚlistÚrangeÚvaluesÚcountÚappendÚlenÚ ValueErrorÚstr)Z device_mapZ num_blocksZduplicate_blocksr Zmissing_blocksZ extra_blocksr)r r rÚassert_device_maps4  ÿÿ ÿÿ ÿÿrcsJtt|ƒƒ‰tt|t|ƒƒƒ‰‡‡fdd„td|ˆƒDƒ}tt||ƒƒS)zEReturns a dictionary of layers distributed evenly across all devices.csg|]}ˆ||ˆ…‘qSrrr ©ZlayersZn_blocksrrr6sz"get_device_map..r)r rÚintrrÚdictÚzip)Zn_layersZdevicesZ layers_listrrrÚget_device_map2s rN)ÚmathrrrrrrrÚs