U Å9%e% ã@sdUddlmZmZddlmZgZeeed<eedœdd„Zeeeee e e e fdœdd „Z d S) é)ÚListÚTuple)ÚChunkStorageMetadataÚ__all__)Úshard1Úshard2cCsdt|jƒ}t|ƒD]L}|j||j||j|kr:dS|j||j||j|krdSqdS)z' Checks if two shards overlap. FT)ÚlenÚoffsetsÚrangeÚsizes)rrZndimsÚi©r úf/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/torch/distributed/checkpoint/resharding.pyÚ"_check_shard_metadata_pair_overlap s  r)Ú saved_shardÚ current_shardÚreturnc Csˆg}tt|j|j|j|jƒƒD]d\}\}}}}t||||ƒ}|t||ƒ} ||krdd} ||} n ||} d} | || | | f¡q|S)aZ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r)Ú enumerateÚzipr r ÚminÚmaxÚappend) rrZnarrowsÚdimZsaved_shard_offsetZcurrent_shard_offsetZsaved_shard_sizeZcurrent_shard_sizeZ min_range_endÚlengthZoffset_for_saved_tensorZoffset_for_current_tensorr r rÚ+_shards_get_overlap_region_wrt_saved_tensors: üÿû  þÿ ÿrN) ÚtypingrrZ%torch.distributed.checkpoint.metadatarrÚstrÚ__annotations__rÚintrr r r rÚs þ