U [ªSh8ã@sŒdZddlmZz(ddlZddlmZddlmZdZWne k rPdZYnXdd d gZ Gd d „d eƒZ Gd d„dƒZ Gdd„dƒZ dS)z@Lexical analysis of formal languages (i.e. code) using Pygments.é)ÚApplicationErrorN)Úget_lexer_by_name)Ú_get_ttype_classTFÚtokenÚtextÚc@s eZdZdS)Ú LexerErrorN)Ú__name__Ú __module__Ú __qualname__©r r úO/root/rtd-docs/venv/lib/python3.8/site-packages/docutils/utils/code_analyzer.pyrsrc@s*eZdZdZd dd„Zdd„Zdd„Zd S) ÚLexera¡Parse `code` lines and yield "classified" tokens. Arguments code -- string of source code to parse, language -- formal language the code is written in, tokennames -- either 'long', 'short', or 'none' (see below). Merge subsequent tokens of the same token-type. Iterating over an instance yields the tokens as ``(tokentype, value)`` tuples. The value of `tokennames` configures the naming of the tokentype: 'long': downcased full token type name, 'short': short name defined by pygments.token.STANDARD_TYPES (= class argument used in pygments html output), 'none': skip lexical analysis. ÚshortcCsr||_||_||_d|_|dks(|dkr,dSts8tdƒ‚zt|jƒ|_Wn$tjj k rltd|ƒ‚YnXdS)zE Set up a lexical analyzer for `code` in `language`. N)rrÚnonez0Cannot analyze code. Pygments package not found.z6Cannot analyze code. No Pygments lexer found for "%s".) ÚcodeÚlanguageÚ tokennamesÚlexerÚ with_pygmentsrrÚpygmentsÚutilÚ ClassNotFound)Úselfrrrr r r Ú__init__/sÿzLexer.__init__ccspt|ƒ}t|ƒ\}}|D].\}}||kr2||7}q||fV||}}q| d¡r^|dd…}|rl||fVdS)zrMerge subsequent tokens of same token-type. Also strip the final newline (added by pygments). Ú Néÿÿÿÿ)ÚiterÚnextÚendswith)rÚtokensZlasttypeZlastvalÚttypeÚvaluer r r ÚmergeJs       z Lexer.mergeccs‚|jdkrg|jfVdSt |j|j¡}| |¡D]H\}}|jdkrZt|ƒ ¡ d¡}n t |ƒg}dd„|Dƒ}||fVq4dS)z7Parse self.code and yield "classified" tokens. NÚlongÚ.cSsg|]}|tkr|‘qSr )Úunstyled_tokens)Ú.0Úclsr r r Ú hsz"Lexer.__iter__..) rrrÚlexr#rÚstrÚlowerÚsplitr)rr Ú tokentyper"Úclassesr r r Ú__iter__\s    zLexer.__iter__N)r)r r r Ú__doc__rr#r0r r r r rs rc@s eZdZdZdd„Zdd„ZdS)Ú NumberLinesaqInsert linenumber-tokens at the start of every code line. Arguments tokens -- iterable of ``(classes, value)`` tuples startline -- first line number endline -- last line number Iterating over an instance yields the tokens with a ``(['ln'], '')`` token added for every code line. Multi-line tokens are split.cCs"||_||_dtt|ƒƒ|_dS)Nz%%%dd )r Ú startlineÚlenr+Úfmt_str)rr r3Úendliner r r ryszNumberLines.__init__ccs~|j}dg|j|fV|jD]Z\}}| d¡}|dd…D],}||dfV|d7}dg|j|fVq<||dfVqdS)NÚlnrré)r3r5r r-)rÚlinenor!r"ÚlinesÚliner r r r0s zNumberLines.__iter__N)r r r r1rr0r r r r r2ls r2)r1ZdocutilsrrZpygments.lexersrZpygments.formatters.htmlrrÚ ImportErrorr&rrr2r r r r Ús    þQ