U 9%e=@sPddlZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl Z z ddl ZWn ek re sddlZYnXddlmZddlmZddlmZmZmZddlmZmZmZed ZGd d d eZd d Z ddZ!ddZ"Gdddej#j$Z%Gdddej#j&Z'ddZ(Gdddej#j)Z*GdddeZ+dS)N) lru_cache) TYPE_CHECKING)AsyncFileSystem)_DEFAULT_CALLBACK) filesystemopensplit_protocol) isfilelikemerge_offset_ranges other_pathszfsspec.referencecs$eZdZfddZddZZS)ReferenceNotReachablecstj|||_||_dSN)super__init__ referencetarget)selfrrargs __class___/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/fsspec/implementations/reference.pyrs zReferenceNotReachable.__init__cCsd|jd|jS)Nz Reference "z" failed to fetch target )rrrrrr__str__!szReferenceNotReachable.__str__)__name__ __module__ __qualname__rr __classcell__rrrrr s r cCst|dSNr)listvalues)drrr_first%sr#cCs<||}t|ttfr8|dr0t|ddS|dSdSr)get isinstancer tupler )path referencesrefrrr_prot_in_references)s r*cCsHt|trt|||giSi}|D] }t||}||g|q"|Sr)r%strr* setdefaultappend)pathsr(outr'protocolrrr_protocol_groups/s  r1c@seZdZddZdS)RefsValuesViewccs|jjD]}t|Vq |jjEdH|jD]@}|j|}t |dkrl|j|dVq>|j |EdHq>dS)Nr/0) _mapping zmetadatar!jsondumpsencode_itemslistdir_get_chunk_sizeslen_generate_all_records)rvalfield chunk_sizesrrr__iter__:s  zRefsValuesView.__iter__NrrrrArrrrr29sr2c@seZdZddZdS) RefsItemsViewcCst|j|jSr)zipr4keysr!rrrrrAGszRefsItemsView.__iter__NrBrrrrrCFsrCcCsHd}d}t|ddd|dddD]\}}|||7}||9}q&|S)Nr)rD)idxsizesr>Zmultisrrrravel_multi_indexKs &  rLc@seZdZdZeddZeddZd9d d Zed d Z d:ddZ d;ddZ ddZ e dddZddZddZddZddZd d!Zd"d#Ze d$d%d&Zd'd(Zed)d*Zd+d,ZdLazyReferenceMapperzVInterface to read parquet store as if it were a standard kerchunk references dict.cCs ddl}|Sr)numpy)rnprrrrOYszLazyReferenceMapper.npcCs ddl}|Sr)pandas)rpdrrrrQ_szLazyReferenceMapper.pdN c s|_i_i_d_|dkr*tdn|_jdjdgd}| jd<W5QRXt jd}|d_ |d_ jd_|pj_|_t|d fd d }|_dS) a Parameters ---------- root : str Root of parquet store fs : fsspec.AbstractFileSystem fsspec filesystem object, default is local filesystem. cache_size : int Maximum size of LRU cache, where cache_size*record_size denotes the total number of references that can be loaded in memory at once. Nfile/ .zmetadatarb record_sizemetadataz/{field}/refs.{record}.parq)maxsizec sPjj||d}j|}jj|ddW5QRXfddjD}|S)zcached parquet file loader)r?record fastparquet)enginecsi|]}||jqSr)r!.0cdfrr szCLazyReferenceMapper.__init__..open_refs..)urlformatfsrrQZ read_parquetcolumns)r?r[r'frefsrrar open_refss z/LazyReferenceMapper.__init__..open_refs)rootr@r9dirsfsspecrrfrjoinreadr6loadsrXr5rdout_root cat_threshrrj) rrkrfrq cache_sizeZcategorical_thresholdrhmetrjrrrres      zLazyReferenceMapper.__init__cKs8i|d}|d|dgt|t||f|S)NrYrXrUrV)pipernr6r7r8rM)rXrkrfkwargsrtrrrcreates  zLazyReferenceMapper.createTcCsF|jdkr*dd|jD}dd|D|_|j}|rBdd|D}|S)zList top-level directoriesNcSsg|]}|dddqS)rUrFr)splitr_prrr sz/LazyReferenceMapper.listdir..cSsh|]}|r|ds|qS). startswithrzrrr s z.LazyReferenceMapper.listdir..cSsg|]}tj|qSr)osr'basename)r_r'rrrr|s)rlr5)rrrlZlistingrrrr:s zLazyReferenceMapper.listdirc s4s}tdgddjDddjD}|dkrP||t|Sdd|D}fdd|D}t||dd d Sd d }t|d krtd |d}tfddjDfddjD}fdd|D} |} |dkrt |t | S |} ddt | | D} || S)zShortcut file listingsrVcSsg|]}d|kr|qSrUrr_namerrrr|sz*LazyReferenceMapper.ls..cSsg|]}d|kr|qSrrrrrrr|sFcSsg|]}|dddqS) directoryrrtypesizerrrrrr|sc s<g|]4}|dt|jkr(tj|nj|dqSrTrr<r5r6r7r9rrrrr|s cSs|dS)Nrr)rKrrrz(LazyReferenceMapper.ls..keyrUrFz(Cannot list within directories right nowrcs g|]}|dr|qSrr~rr'rrr|scs g|]}|dr|qSrr~rrrrr|sc s<g|]4}|dt|jkr(tj|nj|dqSrrrrrrr|s cSs(g|] \}}|dr|d|ddqS)rrTrGrr)r_rZrecrrrr|s) r:setr5r9updatesortedryr<FileNotFoundError_keys_in_fieldr r=rD) rr'detaildirnamesZothersZdirinfoZfileinfopartsr?rEZrecsZrecinforr'rrlssN         zLazyReferenceMapper.lsc sf||jkr|j|S||jkr2t|j|Sd|ksD||rLt||d\}}||\}}}|j ||fi |d}|dkrtn|r|Sz.||\}}|dkrWdS| ||Wn"t t t fk rt|YnXdddd g}fd d |D} | d } | dk r"| S| ddkr8td | ddddgkrZ| ddS| ddS)zfGet the reference for one key Returns bytes, one-element list or three-element list. rUFNrrr'offsetrrawcs$g|]}|kr|ndqSrrr^ririrrr|sz5LazyReferenceMapper._load_one_key..rGzThis reference has been deletedrF)r9r5r6r7r8_is_metaKeyErrorry_key_to_recordr$rj ValueError TypeErrorr) rrr?Zsub_keyr[_maybe chunk_sizergZ selectionrrrr _load_one_keys<      z!LazyReferenceMapper._load_one_keyic Csh|d\}}||}t|dkr(dSdd|dD}t||}||j}||j}||t|fS)z3Details needed to construct a reference for one keyrUr)rrrcSsg|] }t|qSr)intr^rrrr| sz6LazyReferenceMapper._key_to_record..r})ryr;r<rLrX) rrr?chunkr@Z chunk_idxZ chunk_numberr[rrrrrs     z"LazyReferenceMapper._key_to_recordcCsJ||jkr@|j|d}ddt|d|dD}||j|<|j|S)z6The number of chunks along each axis for a given fieldz/.zarraycSsg|]\}}t||qSr)mathceil)r_rKr`rrrr|sz8LazyReferenceMapper._get_chunk_sizes..shapechunks)r@r5rD)rr?ZzarrayZ size_ratiorrrr;s  z$LazyReferenceMapper._get_chunk_sizescCs\|||}tt|}t|dkr6dd|DSt|dkrJ|dSdd|DSdS)z8The references for a given parquet file of a given fieldrcss|]}t|VqdSrr r_trrr !sz7LazyReferenceMapper._generate_record..rFrcss.|]&}|dst|ddn|dVqdS)rNrrrrrr'sN)rjiterrDr!r<)rr?r[riitrrr_generate_records   z$LazyReferenceMapper._generate_recordccsPd}||D] }||9}qt||j}t|D]}|||EdHq4dS)zJLoad all the references within a field by iterating over the parquet filesrFN)r;rrrXranger)rr?Znrecchr[rrrr=)s   z)LazyReferenceMapper._generate_all_recordscCst|Sr)r2rrrrr!2szLazyReferenceMapper.valuescCst|Sr)rCrrrritems5szLazyReferenceMapper.itemscCst|Sr)idrrrr__hash__8szLazyReferenceMapper.__hash__cCs ||Sr)r)rrrrr __getitem__;szLazyReferenceMapper.__getitem__c Csd|krf||sf|d\}}||\}}}|j||fi}|||<t||jkr|||n,||j|<t t |t r| n||j |<dSNrU)rryrr9r,r<rXwriter6rpr%bytesdecoder5) rrvaluer?rr[rJrsubdictrrr __setitem__?s zLazyReferenceMapper.__setitem__cCs|dpd|kS)N.zz/.zr~rrrrrNszLazyReferenceMapper._is_metacCs||jkr|j|=n||jkr(|j|=npd|kr||s|d\}}||\}}}|j||fi}d||<t||jkr|||n d|j|<dSr) r9r5rryrr,r<rXr)rrr?rr[rrrrr __delitem__Rs    zLazyReferenceMapper.__delitem__c Csddl}ddl}ddl}|j||f}|p.|jd|d|d} |j|j|jdd} |j|jdd} |j|jdd} |j|j|jdd} d}d}| D]d\}}t |t r|d7}|d| |<t |dkr|d| |<|d | |<q|d7}|j || |<q|j| | | | d d d }|j|jp.d|jkrL|d d|d <ddd}d dg}|jj|pn|jd|dd|j| d|pt|jdddd d ||d||j||fdS)NrrUz/refs.z.parqO)ZdtypeZint64rFr)r'rrrF)copyr'categoryrutf8)rr'rTexist_okr\storage_optionsZzstd)r]r compressionindexstatsobject_encoding has_nulls)Z kerchunk.dfrNrPr9rqfullrXnanZzerosrr%r r<rbZ _proc_rawZ DataFramer'countZnuniquerrZastyperfZmkdirsZ to_parquetgetattrclearpop)rr?r[base_urlrZkerchunkrOrQ partitionfnr.offsetsrIZrawsZnrawnpathjdatarbrrrrrrcs\     " "  zLazyReferenceMapper.writecCst|jD](}t|tr |\}}|j||||dq t|jD],}|dkr>d|kr>t|j||j|<q>|j|j d}t | |jd<|j d|p|jdg|jd|jdS)zOutput any modified or deleted keys Parameters ---------- base_url: str Location of the output )rrrVrrurUN)r r9r%r&rr6rprr5rXr7r8rfrvrnrqrj cache_clear)rrrthingr?r[krtrrrflushs&  zLazyReferenceMapper.flushcCsdd}|D]6}|dr$|d7}q ||}|j|}||7}q |t|j7}|t|j7}|S)Nrr}rF)r:rr;rOproductr<r5r9)rrr?r@Znchunksrrr__len__s      zLazyReferenceMapper.__len__ccsRt|j}||j|D]}t|tr|Vq|D]}||EdHq8dSr)rr5rr9r%r+r:r)rZmetasbitr?rrrrAs    zLazyReferenceMapper.__iter__cCs,z||WdStk r&YdSXdS)NTF)rr)ritemrrr __contains__s  z LazyReferenceMapper.__contains__ccsd||}t|dkr$|dVdStjdd|D}|D]"}|dddd |DVq.rUr}cSsg|] }t|qSr)r+r^rrrr|sz6LazyReferenceMapper._keys_in_field..)r;r< itertoolsrrn)rr?r@Zindsindrrrrs   z"LazyReferenceMapper._keys_in_field)NNrRrS)T)rT)NN)NN)rrr__doc__propertyrOrQr staticmethodrxr:rrrrr;rr=r!rrrrrrrrrrArrrrrrrMTsF   *  <)      : ! rMc seZdZdZdZdCfdd ZdDd d ZdEd d ZdFddZddZ ddZ e fddZ dGddZ dHddZdIddZddZdJd d!Zd"d#Zd$d%Zd&d'ZdKd)d*ZdLd+d,Zd-d.Zd/d0Zd1d2ZdMd3d4ZdNfd5d6 Zd7d8Zd9d:Zd;d<Zd=d>Zd?d@Z dAdBZ!Z"S)OReferenceFileSystemaView byte ranges of some other file as a file system Initial version: single file system target, which must support async, and must allow start and end args in _cat_file. Later versions may allow multiple arbitrary URLs for the targets. This FileSystem is read-only. It is designed to be used with async targets (for now). This FileSystem only allows whole-file access, no ``open``. We do not get original file details from the target FS. Configuration is by passing a dict of references at init, or a URL to a JSON file containing the same; this dict can also contain concrete data for some set of paths. Reference dict format: {path0: bytes_data, path1: (target_url, offset, size)} https://github.com/fsspec/kerchunk/blob/main/README.md rNT@BrRc stjf|||_| |_| |_i|_i|_i|_| |_| |_ t |t rt f|pV|pVid|i}t jj|f|\}}||rt j|df|}td|t|}W5QRX||| qtd|t||| d|_n ||| t |t r(dd|D|_d|jkr$td |jd<dS|dk rZt |jtrJ|jd n|j}||j|<|dkr|jD]T}t|r|}t j|\}}|rn||jkrnt|f|pi}||j|<qn|dkrH|jD]n}t|r|}t |t r|d rt j|d \}}||jkrt|f|p0i}||j|<qHq|rv||jkrvt|f|phi}||j|<|ptd |jd<dS) a Parameters ---------- fo : dict or str The set of references to use for this instance, with a structure as above. If str referencing a JSON file, will use fsspec.open, in conjunction with target_options and target_protocol to open and parse JSON at this location. If a directory, then assume references are a set of parquet files to be loaded lazily. target : str For any references having target_url as None, this is the default file target to use ref_storage_args : dict If references is a str, use these kwargs for loading the JSON file. Deprecated: use target_options instead. target_protocol : str Used for loading the reference file, if it is a path. If None, protocol will be derived from the given path target_options : dict Extra FS options for loading the reference file ``fo``, if given as a path remote_protocol : str The protocol of the filesystem on which the references will be evaluated (unless fs is provided). If not given, will be derived from the first URL that has a protocol in the templates or in the references, in that order. remote_options : dict kwargs to go with remote_protocol fs : AbstractFileSystem | dict(str, (AbstractFileSystem | dict)) Directly provide a file system(s): - a single filesystem instance - a dict of protocol:filesystem, where each value is either a filesystem instance, or a dict of kwargs that can be used to create in instance for the given protocol If this is given, remote_options and remote_protocol are ignored. template_overrides : dict Swap out any templates in the references file with these - useful for testing. simple_templates: bool Whether templates can be processed with simple replace (True) or if jinja is needed (False, much slower). All reference sets produced by ``kerchunk`` are simple in this sense, but the spec allows for complex. max_gap, max_block: int For merging multiple concurrent requests to the same remote file. Neighboring byte ranges will only be merged when their inter-range gap is <= ``max_gap``. Default is 64KB. Set to 0 to only merge when it requires no extra bytes. Pass a negative number to disable merging, appropriate for local target files. Neighboring byte ranges will only be merged when the size of the aggregated range is <= ``max_block``. Default is 256MB. cache_size : int Maximum size of LRU cache, where cache_size*record_size denotes the total number of references that can be loaded in memory at once. Only used for lazily loaded references. kwargs : passed to parent class r0rWzRead reference from URL %sz$Open lazy reference dict from URL %s)rfrscSs:i|]2\}}|t|tr2tj|dddf|n|qS):rFr)r%dictrmrry)r_roptsrrrrcgs z0ReferenceFileSystem.__init__..NrTr)!rrrtemplate_overridessimple_templates templatesfssZ _dircachemax_gap max_blockr%r+rrmcoreZ url_to_fsisfilerloggerinfor6load_process_referencesrMr(rrr0r&r!callabler r )rforZref_storage_argsZtarget_protocolZtarget_optionsZremote_protocolZremote_optionsrfrrrrrsrwZdicZref_fsZfo2rhtextr)r0rrrrrszI                   zReferenceFileSystem.__init__c Csv||}td|z|j|}Wntk rDt|YnXt|trX|}t|t rtd|d| drt |dd}|ddfSt |dkrtd|d||d}||}}n|\}}} td|d |d |d | || } |dk r,|dkr"||}n| |}n|}|dk rX|dkrN||}n| |}n| }|dkrl|j}|||fS) Nzcat: z Reference: z , type bytesbase64:rFz, whole file => rz => z , offset z, size )_strip_protocolrdebugr(rrr%r+r8rrbase64 b64decoder<r) rr'startendpartrdZstart1Zend1start0rend0rrr _cat_commonsB        "         zReferenceFileSystem._cat_commonc s|j|||d\}}}t|tr,|||St|\}} z |j|j|||dIdHWn.tk r} zt||| W5d} ~ XYnXdSN)r r )rr%rr r _cat_file Exceptionr rr'r r rwZ part_or_urlr r r0rerrrrs    zReferenceFileSystem._cat_filec Ks|j|||d\}}}t|tr,|||St|\}} z|j|j|||dWStk r~} zt||| W5d} ~ XYnXdSr)rr%rr rcat_filerr rrrrrs   zReferenceFileSystem.cat_filecKs||j|<dS)z2Temporarily add binary data or reference as a fileNr()rr'rrrrr pipe_fileszReferenceFileSystem.pipe_filec sL||rtj|ddS||IdH}t|d}||W5QRXdSNTrwb)isdirrmakedirsrrr)rrpathlpathrwrrhrrr _get_files   zReferenceFileSystem._get_filec Ksz||rtj|ddS|j|f|}|t|t|rH||n t|d}||W5QRX| t|dSr) rrrrZset_sizer<r rrZabsolute_update)rrrcallbackrwrrhrrrget_files   zReferenceFileSystem.get_fileFc  s|rdj||d}tjddd}t||}|rRfdd|D}n |}t||D] \}} ||krf|| ||qfdS)Nr) recursiverTT)Z auto_mkdircsg|]}|s|qSr)r)r_rrrrr|s z+ReferenceFileSystem.get..)rZ expand_pathrmrr catrDr) rrrr rwrftargetsrremotelocalrrrr$s   zReferenceFileSystem.getraisec# Kst|tr|rtt|tr6|s2tdd|Dr6tt||j}i}|D]\}}|j|} ggg} } } |D]t} z2| | \}}}| || || |Wqvt k r}z|dkrȂ|dkr||| <W5d}~XYqvXqvg}g}g}g}t }t | | | |D]`\}}}} t|tr2||| <n<|dkr||| || || || | qt | | | |D]J\}}}} |dk r||kr| || || || | qtt|t|t|d|j|jd\}}}| |||}t | | | |D]\}}}} | |kr,qt ||||D]\}}}}||kr|dksd|dkrt|trz||| <n||||| <nR||kr:||kr:||kr:t|tr||| <n|||||pd|| <q:qqN|D]b\}} t| tr||jkr||}!t||j|}"|!|"_|dkrB|"n|dkr|"||<qt|dkrt|trd|krt|S|S) Ncss|]}d|kVqdS)*Nrrzrrrrsz*ReferenceFileSystem.cat..r&ZomitT)sortrrrFr')r%r+NotImplementedErrorr anyr1r(rrrr-rrrDraddr rrZ cat_rangesrrr __cause__r<r#)#rr'r Zon_errorrwZ proto_dictr/protor.rfurlsZstartsZendsr{urKrerrZurls2Zstarts2Zends2Zpaths2Z whole_filesZ new_pathsZ new_startsZnew_endsZ bytes_outrOnsnebrvexZnew_exrrrr"s                     (   $zReferenceFileSystem.catcCsJ|dd}|dkr ||n&|dkr8|j||dntd|dS)NversionrF)rz Unknown reference spec version: )r$_process_references0_process_references1r)rr(rversrrrrUs   z'ReferenceFileSystem._process_referencescCs ||_dS)z&Make reference dict for Spec Version 0Nr)rr(rrrr7`sz(ReferenceFileSystem._process_references0cs.jr jrddli_|ditdfdd}|diD]\}}t|t r| drt |ddj|<|j|<qRjr|d}d |kr؈jr| d d  d d jfj}n||}t|d kr|gn||d |dgj|<qR|j|<qRj|dgdS)Nrrics|jfjSr)Templaterenderr)r/jinja2rrr _render_jinjajsz?ReferenceFileSystem._process_references1.._render_jinjarizbase64:r{{{z}}}rFrgen)rrr=r(_process_templatesr$rrr%r+rrrreplacerer<r _process_gen)rr(rr>rr4r/rr<rr8ds4     , z(ReferenceFileSystem._process_references1csdi|_|jdk r||j|D]:\}}d|krTddl|ffdd |j|<q$||j|<q$dS)Nr?rcs|jf|Sr)r:r;)temprwr=rrrsz8ReferenceFileSystem._process_templates..)rrrrr=)rtmprr4rrGrrCs  z&ReferenceFileSystem._process_templatesc si}|D]}dd|dDfddtjD}|D]}ddl}||djf||j}||djf||j}d |krd |krt||d jf||j} t||d jf||j} || | g||<qDd |kd |kArt d qD|g||<qDq|S) Nc Ss@i|]8\}}|t|tr|nt|dd|d|ddqS)r rstopsteprF)r%r rr$)r_rr4rrrrcs z4ReferenceFileSystem._process_gen.. dimensionsc3s |]}tt|VqdSr)rrDrE)r_r! dimensionrrrsz3ReferenceFileSystem._process_gen..rrrdrlengthz^Both 'offset' and 'length' are required for a reference generator entry if either is provided.) rrrr!r=r:r;rrr) rZgensr/rBZproductsprr=rrdrrNrrLrrEs4    z ReferenceFileSystem._process_genc Csdgi|_|j}|D]\}}t|ttfr8t|}nt|dkrJd}n |\}}}d|krl|dddnd}|}|r||jkrg|j|<|jd|kr|dddndg |ddd| |}qt|j| |d|dqdS)NrrFrUrrrrT) dircacher(rr%rr+r<rsplitr,r-_parent) rrr'r rrr parZpar0rrr_dircache_from_itemss(         z(ReferenceFileSystem._dircache_from_itemsrWcKs||}t|Sr)rioBytesIO)rr'mode block_sizeZ cache_optionsrwrrrr_opens zReferenceFileSystem._opencKs||}t|jtrLz|j||WStk r:YnXtd|d|jsZ|| |}|dkrtt||r||Sdd|DS)N'z' is not a known keycSsg|] }|dqSrrr_orrrr|sz*ReferenceFileSystem.ls..) rr%r(rMrrrrPrT_ls_from_cache)rr'rrwr/rrrrs   zReferenceFileSystem.lscKs||p||Sr)rrrr'rwrrrexistsszReferenceFileSystem.existscsH|jr|jkSt|jtr,|jdkStfdd|jDSdS)Nrc3s|]}|dVqdS)rUNr~)r_rrrrrsz,ReferenceFileSystem.isdir..)rPr%r(rMr:r*rr'rrrrs   zReferenceFileSystem.isdircCs ||jkSrrrarrrrszReferenceFileSystem.isfilecs|j||f|Sr)r)rr'rrwrrr_lsszReferenceFileSystem._lsc s~|r tjf|||d|SrHtfddjD}n tj}|rvjsdfdd|DS|SdS)N)maxdepthwithdirsrc3s|]}|r|VqdSrr~r_rrrrrs z+ReferenceFileSystem.find..csi|]}||dqS)r)r^rerrrrcsz,ReferenceFileSystem.find..)rfindrrr(rPrT)rr'rcrdrrwr!rrrrfs&  zReferenceFileSystem.findc s|j}|dk r^t|ttfr2dt|dSt|dkrNd|ddSdddg}n.|d}fdd|D}|sdd dS|d d dkrt|jd \}}|j| |jd |d d <|d S) NrTrrFrTcsg|]}|dkr|qSr[rr\rrrr|s z,ReferenceFileSystem.info..rrr) r(r$r%r+rr<rr rr)rr'rwr/Zout0Zprotrrrrrs    "zReferenceFileSystem.infocs ||Sr)rr_rrr_infoszReferenceFileSystem._infocs|j|d|jdSr)r(rrPrr_rrr_rm_files zReferenceFileSystem._rm_filecs||j|<|jdSr)r(rPr)rr'rrrr _pipe_file!s zReferenceFileSystem._pipe_filec s2t|d}||j|<W5QRX|jdS)NrW)rror(rPr)rrrrhrrr _put_file&s zReferenceFileSystem._put_filec Ksi}|jD]Z\}}t|tr`z|d||<Wqhtk r\dt|||<YqhXq|||<qtj |df| }| t d|d W5QRXdS)z+Write modified references into new locationasciirrrF)r6riN)r(rr%rrUnicodeDecodeErrorr b64encodermrrr6r7r8)rrdrr/rr4rhrrr save_json,s  zReferenceFileSystem.save_json) NNNNNNNNTrrrR)NN)NN)NN)F)Fr&)N)N)rWNN)T)T)NFF)#rrrrr0rrrrrrrrr$r"rr7r8rCrErTrYrr`rrrbrfrrgrhrirjrnrrrrrrsV *   \  #    r),r collectionsrUrloggingrr functoolsrtypingrZ fsspec.corermZujsonr6 ImportErrorZasynr callbacksrrrrr utilsr r r getLoggerr RuntimeErrorr r#r*r1abc ValuesViewr2 ItemsViewrCrLMutableMappingrMrrrrrs>