U -eX@sddZddlmZddlmZddlmZddlZedddd d d gZd d Z dddZ dddZ dS)zToken-related utilities) namedtuple)StringIO) iskeywordNTokentokentextstartendlineccs8zt|D] }|Vq Wntjk r2YdSXdS)z(wrap generate_tokens to catch EOF errorsN)tokenizegenerate_tokens TokenError)readlinerrX/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/IPython/utils/tokenutil.pyr s  r cCsRd}|d}|D]2}|t|}|ds4|d7}||kr@qJ|}qd}||fS)aReturn the line in a cell at a given cursor position Used for calling line-based APIs that don't support multi-line input, yet. Parameters ---------- cell : str multiline block of text cursor_pos : integer the cursor position Returns ------- (line, offset): (string, integer) The line with the current cursor, and the character offset of the start of the line. rT ) splitlineslenendswith)cell cursor_posoffsetlinesr next_offsetrrrline_at_cursors   rcCsg}g}g}ddi}tt|jD]}t|}|j\}} |j\} } | d|kr|jd} t| |dD](\} }| |krj|| dt ||| <qj||}| dkr|dn|}|| |krq|j t j kr0t |js0|r"|r"|dj t jkr"|djdkr"d|d|jf|d<n ||jnh|j t jkr|jdkrZ|rZ|d|jdkr||r|||dn|jd kr|r|d|||| | |kr"qq"|r|dS|r|dSd Sd S) azGet the token at a given cursor Used for introspection. Function calls are prioritized, so the token for the callable will be returned if the cursor is anywhere inside the call. Parameters ---------- cell : unicode A block of Python code cursor_pos : int The location of the cursor in the block where the token should be found rrT.z%s.%s=()rN)r rrrrr r r enumeraterrr NAMErrOPappendpop)rrnamestokensZ call_namesoffsetstuptok start_lineZ start_colend_lineZend_colrlinenor rboundaryrrrtoken_at_cursor9sH     .   r0)r)r) __doc__ collectionsriorkeywordrr rr rr0rrrrs    !