U -e@sVddlZddlZddlZddlmZddlmZGdddeZddZd d d Z dS)N)MutableMapping) url_to_fsc@seZdZdZd#ddZddZd$d d Zd d Zd dZddZ ddZ d%ddZ d&ddZ ddZ ddZddZddZdd Zd!d"ZdS)'FSMapaWrap a FileSystem instance as a mutable wrapping. The keys of the mapping become files under the given root, and the values (which must be bytes) the contents of those files. Parameters ---------- root: string prefix for all the files fs: FileSystem instance check: bool (=True) performs a touch at the location, to check for write access. Examples -------- >>> fs = FileSystem(**parameters) # doctest: +SKIP >>> d = FSMap('my-data/path/', fs) # doctest: +SKIP or, more likely >>> d = fs.get_mapper('my-data/path/') >>> d['loc1'] = b'Hello World' # doctest: +SKIP >>> list(d.keys()) # doctest: +SKIP ['loc1'] >>> d['loc1'] # doctest: +SKIP b'Hello World' FNcCs||_||d|_|t|ddd|_|dkrFttt f}||_ ||_ ||_ |rt|j |st|j||r|j |std||j|d|j|ddS)N/xz@Path %s does not exist. Create with the ``create=True`` keywordz/a)fsZ_strip_protocolrstriproot posixpathjoin_root_key_to_strFileNotFoundErrorIsADirectoryErrorNotADirectoryErrormissing_exceptionscheckcreateexistsmkdir ValueErrortouchrm)selfr r rrrrO/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/fsspec/mapping.py__init__%s.   zFSMap.__init__cCs4z"|j|jd|j|jWn YnXdS)z0Remove all keys below root - empties out mappingTN)r rr rrrrrclear>s z FSMap.clearraisec sfdd|D}dkrnd}z*jj||dttrJ|diWn*jk rv}z t|W5d}~XYnXfdd Dfd d t||DS) aFetch multiple items from the store If the backend is async-able, this might proceed concurrently Parameters ---------- keys: list(str) They keys to be fetched on_error : "raise", "omit", "return" If raise, an underlying exception will be raised (converted to KeyError if the type is in self.missing_exceptions); if omit, keys with exception will simply not be included in the output; if "return", all keys are included in the output, but the value will be bytes or an exception instance. Returns ------- dict(key, bytes|exception) csg|]}|qSr _key_to_str.0krrr Zsz"FSMap.getitems..r return)on_errorrNcs(i|] \}}|t|jr tn|qSr) isinstancerKeyErrorr$r%vrrr bsz"FSMap.getitems..cs0i|](\}}dks"t|ts||qS)r')r) BaseException)r$keyZk2)r(outrrr-fs )r catr)bytesrr*itemszip)rkeysr(keys2Zoeer)r(r0rrgetitemsFs   zFSMap.getitemscs&fdd|D}j|dS)zSet the values of multiple items in the store Parameters ---------- values_dict: dict(str, bytes) cs i|]\}}|t|qSr)r" maybe_convertr+rrrr-ssz"FSMap.setitems..N)r3r pipe)rZ values_dictvaluesrrrsetitemslszFSMap.setitemscsjfdd|DdS)z#Remove multiple keys from the storecsg|]}|qSrr!r#rrrr&xsz"FSMap.delitems..N)r r)rr5rrrdelitemsvszFSMap.delitemscCs>t|ts0tdtt|tr(t|}t|}|j|S)zGenerate full path for the keyzAfrom fsspec 2023.5 onward FSMap non-str keys will raise TypeError)r)strwarningswarnDeprecationWarninglisttuplerrr/rrrr"zs  zFSMap._key_to_strcCs|t|jddS)zStrip path of to leave key nameNr)lenr lstrip)rsrrr _str_to_keyszFSMap._str_to_keycCsN||}z|j|}Wn.|jk rH|dk r<|YSt|YnX|S)z Retrieve dataN)r"r r1rr*)rr/defaultr%resultrrr __getitem__s zFSMap.__getitem__cCs0|||}z ||=Wntk r*YnX|S)zPop data)rKr*)rr/rIrJrrrpops   z FSMap.popcCs8||}|jj|j|dd|j|t|dS)zStore value in keyT)exist_okN)r"r Zmkdirs_parentZ pipe_filer9)rr/valuerrr __setitem__s zFSMap.__setitem__csfddjjDS)Nc3s|]}|VqdSN)rH)r$rrrr sz!FSMap.__iter__..)r findr rrrr__iter__szFSMap.__iter__cCst|j|jSrQ)rEr rSr rrrr__len__sz FSMap.__len__cCs,z|j||WntYnXdS)z Remove keyN)r rr"r*rDrrr __delitem__szFSMap.__delitem__cCs"||}|j|o |j|S)zDoes key exist in mapping?)r"r risfile)rr/pathrrr __contains__s zFSMap.__contains__cCst|j|jdd|jffS)NF)rr r rrrrr __reduce__szFSMap.__reduce__)FFN)r )N)N)__name__ __module__ __qualname____doc__rrr8r<r=r"rHrKrLrPrTrUrVrYrZrrrrr s   &   rcCsFt|tjst|drBt|dr6|jjdkr6|d}tt|}|S)NZ __array__dtypeZMmZint64)r)arrayhasattrr_kindviewr2 memoryview)rOrrrr9s   r9Fc Ks2t|f|\}}|dk r|n|}t|||||dS)aCreate key-value interface for given URL and options The URL will be of the form "protocol://location" and point to the root of the mapper required. All keys will be file-names below this location, and their values the contents of each key. Also accepts compound URLs like zip::s3://bucket/file.zip , see ``fsspec.open``. Parameters ---------- url: str Root URL of mapping check: bool Whether to attempt to read from the location before instantiation, to check that the mapping does exist create: bool Whether to make the directory corresponding to the root before instantiating missing_exceptions: None or tuple If given, these exception types will be regarded as missing keys and return KeyError when trying to read data. By default, you get (FileNotFoundError, IsADirectoryError, NotADirectoryError) alternate_root: None or str In cases of complex URLs, the parser may fail to pick the correct part for the mapper root, so this arg can override Returns ------- ``FSMap`` instance, the dict-like key-value store. N)r)rr) urlrrrZalternate_rootkwargsr Zurlpathr rrr get_mappers'rh)reFFNN) r`r r?collections.abcrcorerrr9rhrrrrs  3