U MfL1@sddlZddlZddlZddlZddlZddlZddlZ ddl m Z m Z m Z mZmZmZmZe ddde ddddZd d Zd d d ZdS)N)IDENTITY NO_DEFAULTLazyListdeprecation_warningis_iterable_liketry_callvariadicTF)default expected_typeget_all casesense is_user_inputtraverse_stringc s|tk rtdddttr0fdd n fdd  fdddd  fd d fd d t|dD].\}} || |t|kd} | dk r| SqtkrdSS)a4 Safely traverse nested `dict`s and `Iterable`s >>> obj = [{}, {"key": "value"}] >>> traverse_obj(obj, (1, "key")) 'value' Each of the provided `paths` is tested and the first producing a valid result will be returned. The next path will also be tested if the path branched but no results could be found. Supported values for traversal are `Mapping`, `Iterable`, `re.Match`, `xml.etree.ElementTree` (xpath) and `http.cookies.Morsel`. Unhelpful values (`{}`, `None`) are treated as the absence of a value and discarded. The paths will be wrapped in `variadic`, so that `'key'` is conveniently the same as `('key', )`. The keys in the path can be one of: - `None`: Return the current object. - `set`: Requires the only item in the set to be a type or function, like `{type}`/`{type, type, ...}/`{func}`. If a `type`, return only values of this type. If a function, returns `func(obj)`. - `str`/`int`: Return `obj[key]`. For `re.Match`, return `obj.group(key)`. - `slice`: Branch out and return all values in `obj[key]`. - `Ellipsis`: Branch out and return a list of all values. - `tuple`/`list`: Branch out and return a list of all matching values. Read as: `[traverse_obj(obj, branch) for branch in branches]`. - `function`: Branch out and return values filtered by the function. Read as: `[value for key, value in obj if function(key, value)]`. For `Iterable`s, `key` is the index of the value. For `re.Match`es, `key` is the group number (0 = full match) as well as additionally any group names, if given. - `dict`: Transform the current object and return a matching dict. Read as: `{key: traverse_obj(obj, path) for key, path in dct.items()}`. - `any`-builtin: Take the first matching object and return it, resetting branching. - `all`-builtin: Take all matching objects and return them as a list, resetting branching. `tuple`, `list`, and `dict` all support nested paths and branches. @params paths Paths which to traverse by. @param default Value to return if the paths do not match. If the last key in the path is a `dict`, it will apply to each value inside the dict instead, depth first. Try to avoid if using nested `dict` keys. @param expected_type If a `type`, only accept final values of this type. If any other callable, try to call the function on each result. If the last key in the path is a `dict`, it will apply to each value inside the dict instead, recursively. This does respect branching paths. @param get_all If `False`, return the first matching result, otherwise all matching ones. @param casesense If `False`, consider string dictionary keys as case insensitive. `traverse_string` is only meant to be used by YoutubeDL.prepare_outtmpl and is not part of the API @param traverse_string Whether to traverse into objects as strings. If `True`, any non-compatible object will first be converted into a string and then traversed into. The return value of that path will be a string instead, not respecting any further branching. @returns The result of the object traversal. If successful, `get_all=True`, and the path branches at least once, then a list of results is returned instead. If no `default` is given and the last path branches, a `list` of results is always returned. If a path ends on a `dict` that result will always be a `dict`. z=The is_user_input parameter is deprecated and no longer workscSst|tr|S|SN) isinstancestrcasefold)kr:/tmp/pip-unpacked-wheel-zk9bgjdq/yt_dlp/utils/traversal.pyYztraverse_obj..cst|r|SdSr)rvalr rrr\rcstpt|fdS)Nargs)rrrrrrr^rc sd}d}dkr: r:dks.ts.ttr6d}d}ndkrJ}nttrtt}tdksvt|trtddDst tt r}nt |fd}ntt t frd}t jfd dD}ndkrd}ttjjrtjjd ttjjr0}nRtsLttjjjrR}n0ttj rj!}n r~d}t"}nd}nJtrnd}ttjjrtjjd ttjjrЈ#}nxtsttjjjrt$}nRttj r,t t$%f!&#}n rDd}t$t"}nd}fd d|D}|sd '|}nbttrfd d#D}fdd|Dpd}n ttjjr,ttjjrtjjd st j(fdr t j)fdntfdd#Dd}nttj rtt*sLrnt+,t-%}W5QRXn.tt"rtfdd&#Dd}n0tt*tfrttjj.tjjjfrtt}t+,t-}W5QRXn( rt+,t-t"}W5QRXnttjjjrtt"rЈ/d\}}0dsl1dsl}d|0drd|}n|r|0dsd|}fdd} |rt t2| 3|}n| }||r|n|ffS)NF.Trrcss|]}t|tVqdSr)rtype.0itemrrr osz2traverse_obj..apply_key..rc3s|]}|dVqdS)rNr)r branch) apply_pathis_lastobjrrr"ws)keyvaluec3s&|]\}}t||fdr|VqdS)rN)rr rv)r'rrr"sc3s$|]\}}||dfVqdS)FNrr)) _traverse_objr%r&rrr"scs2i|]*\}}|dk stk r||dk r*|nqSr)rr))r rr s z3traverse_obj..apply_key..c3s"|]\}}|kr|VqdSrrr)rr'rrr"s c3s"|]\}}|kr|VqdSrrr)r.rrr"s /@z().z./cs^dkr |Sdkr|jSdr>t|jjddfdSdkrL|jStddS)Nr0rrztext()z#apply_specials is missing case for )attrib startswithrgettext SyntaxError)element)specialrrapply_specialss z7traverse_obj..apply_key..apply_specials)4callablerslicesetnextiterlenrallAssertionErrortuplerlist itertoolschain from_iterablehttpcookiesMorseldictr'r( collectionsabcMappingvaluesrxmletree ElementTreeElementreMatchgroupsritems enumerategroup groupdictjoin __contains__r4int contextlibsuppress IndexErrorSequence rpartitionr3endswithmapiterfind) r'r&r% branchingresultr!Ziter_objZxpath_r9)r,r$rr r r)r%r'r&r8r apply_key`s              (  &       ztraverse_obj..apply_keycssDt|}t|t}|tkrdS|D]}d|fV|}q"d|fVdS)NFT)r>r=r)iterableiteratorprevr!rrr lazy_lasts  ztraverse_obj..lazy_lastc s|f}d}d}t|ttttfD]\}}sBt|trB|}|ttfkrd}dd|D}|tkrvt |df}q$t |f}q$t |rt |ddg}|D]&} || |\} } || O}|| qtj|}q$|rt|tt tfst|}||t|tfS)NFcss|]}|difkr|VqdSrr)r r&rrrr"s z3traverse_obj..apply_path..T)r rbytesrJr<rranyr@r=rCr:inspect signaturebindappendrDrErFrBrc) Z start_objpath test_typeobjs has_branchedr'lastZ filtered_objsZnew_objsr&reresults)rhr rl type_testrrr$s0    z traverse_obj..apply_pathcsl|||\}}}tdd|D}rP|rP|r8|S|rLtkrHgSSdS|r\|dS|rh|rhiSdS)Ncss|]}|difkr|VqdSrrrrrrr" s z6traverse_obj.._traverse_obj..r)rZexhaustr)r&rsZ allow_emptyrtrxrvZis_dict)r$r r rrr, sz#traverse_obj.._traverse_objrTN)rrrrrWr?) r&r r r r rrpathsindexrsrfr) r,rhr$rr r r r rlrryr traverse_objsB  | #  r|cOs"t|fdd|D|ddiS)Ncss|]}dt|VqdS).N).)r )r keysrrrr" szget_first..r F)r|)r&rzkwargsrrr get_firstsrcCs2t|jt|D]}|dk r|s$|s|Sq|Sr)rcr4r )dZ key_or_keysr Zskip_false_valuesrrrrdict_get#s r)NT)collections.abcrKr] http.cookiesrGrorDrSxml.etree.ElementTreerO_utilsrrrrrrr r|rrrrrrs$$