U 祡cv @sdZddlZddlZddlmZddlmZmZmZm Z ddl m Z dddgZ Gd ddeZ Gd ddeZiZed ZGd ddeZdS) z pygments.lexers.special ~~~~~~~~~~~~~~~~~~~~~~~ Special lexers. :copyright: Copyright 2006-2022 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. N)Lexer)TokenErrorTextGeneric)get_choice_opt TextLexer OutputLexer RawTokenLexerc@s:eZdZdZdZdgZdgZdgZdZddZ d d Z d S) rz3 "Null" lexer, doesn't highlight anything. z Text onlytextz*.txtz text/plaing{Gz?ccsdt|fVdSNr)rselfr r;/tmp/pip-unpacked-wheel-6wad6tea/pygments/lexers/special.pyget_tokens_unprocessed sz TextLexer.get_tokens_unprocessedcCstjS)N)rpriority)r rrr analyse_text#szTextLexer.analyse_textN) __name__ __module__ __qualname____doc__namealiases filenames mimetypesrrrrrrrrsc@s"eZdZdZdZdgZddZdS)r zj Simple lexer that highlights everything as ``Token.Generic.Output``. .. versionadded:: 2.10 z Text outputoutputccsdtj|fVdSr )rZOutputr rrrr0sz"OutputLexer.get_tokens_unprocessedN)rrrrrrrrrrrr 'sz.*? c@s:eZdZdZdZgZgZdgZddZddZ dd Z d S) r a Recreate a token stream formatted with the `RawTokenFormatter`. Additional options accepted: `compress` If set to ``"gz"`` or ``"bz2"``, decompress the token stream with the given compression algorithm before lexing (default: ``""``). zRaw token datazapplication/x-pygments-tokenscKs*t|dddddgd|_tj|f|dS)Ncompressnonegzbz2)rrr__init__)roptionsrrrr"Hs  zRawTokenLexer.__init__ccs|jr~t|tr|d}z>|jdkr:ddl}||}n|jdkrVddl}||}Wn$tk r|t| dfVYnXt|t r| d}| dd}| |D]\}}}||fVqdS)Nlatin1r rr! ) r isinstancestrencodegzip decompressr!OSErrorrdecodebytesstripr)rr r)r!itvrrr get_tokensMs"       zRawTokenLexer.get_tokensc csd}t|D]}z|dd\}}t|}|st}|ddd}|D]&}|rh|dspt dt ||}qT|t|<t |}t |tst dWn$tt fk r|}t}YnX|||fV|t|7}qdS)Nr .zmalformed token namez expected str)line_refinditergrouprstripsplit _ttype_cachegetrisupper ValueErrorgetattrast literal_evalr&r' SyntaxErrorrlen) rr lengthmatchZttypestrvalttypeZttypesZttype_rrrrbs*       z$RawTokenLexer.get_tokens_unprocessedN) rrrrrrrrr"r2rrrrrr 9s )rr@reZpygments.lexerrZpygments.tokenrrrrZ pygments.utilr__all__rr r;compiler6r rrrrs