%PDF- %PDF-
Mini Shell

Mini Shell

Direktori : /snap/core22/current/lib/python3/dist-packages/jinja2/__pycache__/
Upload File :
Create Path :
Current File : //snap/core22/current/lib/python3/dist-packages/jinja2/__pycache__/lexer.cpython-310.pyc

o

��g-u�@spUdZddlZddlZddlmZzddlmZWney(ddl	mZYnwddl
mZddlm
ZddlmZdd	lmZejrNddlZdd
lmZed�Zejejdfed
<e�d�Ze�d�Ze�dej�Z e�dej!ej"B�Z#e�dej!ej"B�Z$ed�Z%ed�Z&ed�Z'ed�Z(ed�Z)ed�Z*ed�Z+ed�Z,ed�Z-ed�Z.ed�Z/ed�Z0ed�Z1ed �Z2ed!�Z3ed"�Z4ed#�Z5ed$�Z6ed%�Z7ed&�Z8ed'�Z9ed(�Z:ed)�Z;ed*�Z<ed+�Z=ed,�Z>ed-�Z?ed.�Z@ed/�ZAed0�ZBed1�ZCed2�ZDed3�ZEed4�ZFed5�ZGed6�ZHed7�ZIed8�ZJed9�ZKed:�ZLed;�ZMed<�ZNed=�ZOed>�ZPed?�ZQed@�ZRedA�ZSedB�ZTedC�ZUidDe%�dEe=�dFe)�dGe,�dHe5�dIe4�dJe8�dKe>�dLe0�dMe:�dNe1�dOe;�dPe/�dQe9�dRe+�dSe6�dTe-�e.e2e3e&e*e'e7e(e<dU�	�ZVdVdW�eV�W�D�ZXeYeV�eYeX�k�s�JdX��e�dNdY�ZdZd[�e[eVd\d]�d^�D���dO��Z\e]eKeMeLe?ePeQeRg�Z^e]e?eSeMeRg�Z_d_e`d`e`fdadb�Zadcddd`e`fdedf�Zbdge`d`e`fdhdi�Zcdje`d`edfdkdl�Zedmdnd`ejfeje`e`ffdodp�ZgGdqdr�dr�ZhGdsdd�ddeji�ZjGdtdu�du�ZkGdvdw�dw�Zlddxdy�ZmGdzd{�d{en�ZoGd|d}�d}eji�ZpGd~d�d�ZqdS)�z�Implements a Jinja / Python combination lexer. The ``Lexer`` class
is used to do some preprocessing. It filters out invalid operators like
the bitshift operators we don't allow in templates. It separates
template code and python code in expressions.
�N)�literal_eval)�deque)�intern�)�pattern)�TemplateSyntaxError)�LRUCache)�Environment�2�Lexer�_lexer_cachez\s+z(\r\n|\r|\n)z7('([^'\\]*(?:\\.[^'\\]*)*)'|"([^"\\]*(?:\\.[^"\\]*)*)")z�
    (
        0b(_?[0-1])+ # binary
    |
        0o(_?[0-7])+ # octal
    |
        0x(_?[\da-f])+ # hex
    |
        [1-9](_?\d)* # decimal
    |
        0(_?0)* # decimal zero
    )
    z�
    (?<!\.)  # doesn't start with a .
    (\d+_)*\d+  # digits, possibly _ separated
    (
        (\.(\d+_)*\d+)?  # optional fractional part
        e[+\-]?(\d+_)*\d+  # exponent part
    |
        \.(\d+_)*\d+  # required fractional part
    )
    �add�assign�colon�comma�div�dot�eq�floordiv�gt�gteq�lbrace�lbracket�lparen�lt�lteq�mod�mul�ne�pipe�pow�rbrace�rbracket�rparen�	semicolon�sub�tilde�
whitespace�float�integer�name�string�operator�block_begin�	block_end�variable_begin�variable_end�	raw_begin�raw_end�
comment_begin�comment_end�comment�linestatement_begin�linestatement_end�linecomment_begin�linecomment_end�linecomment�data�initial�eof�+�-�/z//�*�%z**�~�[�]�(�)�{�}z==z!=�>)	z>=�<z<=�=�.�:�|�,�;cCsi|]\}}||�qS�rR)�.0�k�vrRrR�./usr/lib/python3/dist-packages/jinja2/lexer.py�
<dictcomp>�srWzoperators droppedrOccs�|]}t�|�VqdS�N)�re�escape�rS�xrRrRrV�	<genexpr>���r]cCs
t|�SrX)�len�r\rRrRrV�<lambda>�s
ra)�key�
token_type�returncCsL|tvrt|Stdtdtdtdtdtdtdtdt	dt
d	td
tdi�
||�S)Nzbegin of commentzend of commentr5zbegin of statement blockzend of statement blockzbegin of print statementzend of print statementzbegin of line statementzend of line statementztemplate data / textzend of template)�reverse_operators�TOKEN_COMMENT_BEGIN�TOKEN_COMMENT_END�
TOKEN_COMMENT�TOKEN_LINECOMMENT�TOKEN_BLOCK_BEGIN�TOKEN_BLOCK_END�TOKEN_VARIABLE_BEGIN�TOKEN_VARIABLE_END�TOKEN_LINESTATEMENT_BEGIN�TOKEN_LINESTATEMENT_END�
TOKEN_DATA�	TOKEN_EOF�get)rcrRrRrV�_describe_token_type�s"�
�rs�token�TokencCs|jtkr|jSt|j�S)z#Returns a description of the token.)�type�
TOKEN_NAME�valuers)rtrRrRrV�describe_token�s

ry�exprcCs8d|vr|�dd�\}}|tkr|St|�S|}t|�S)z0Like `describe_token` but for token expressions.rNr)�splitrwrs)rzrvrxrRrRrV�describe_token_expr�s�r|rxcCstt�|��S)zsCount the number of newline characters in the string.  This is
    useful for extensions that filter a stream.
    )r_�
newline_re�findall)rxrRrRrV�count_newlines��r�environmentr	cCs�tj}t|j�t||j�ft|j�t||j�ft|j�t||j�fg}|j	dur8|�
t|j	�td||j	�f�|jdurM|�
t|j�t
d||j�f�dd�t|dd�D�S)zACompiles all the rules from the environment into a list of rules.Nz	^[ \t\v]*z(?:^|(?<=\S))[^\S\r\n]*cSsg|]}|dd��qS)rNrRr[rRrRrV�
<listcomp>�sz!compile_rules.<locals>.<listcomp>T)�reverse)rYrZr_�comment_start_stringrf�block_start_stringrj�variable_start_stringrl�line_statement_prefix�appendrn�line_comment_prefix�TOKEN_LINECOMMENT_BEGIN�sorted)r��e�rulesrRrRrV�
compile_rules�s:����
��
��r�c@sFeZdZdZefdedejeddfdd�Zde	d	edd
fdd�Z
dS)
�FailurezjClass that raises a `TemplateSyntaxError` if called.
    Used by the `Lexer` to specify known errors.
    �message�clsrdNcCs||_||_dSrX)r��error_class)�selfr�r�rRrRrV�__init__s
zFailure.__init__�lineno�filenamezte.NoReturncCs|�|j||��rX)r�r�)r�r�r�rRrRrV�__call__
szFailure.__call__)�__name__�
__module__�__qualname__�__doc__r�str�t�Typer��intr�rRrRrRrVr��s���
�r�c@sXeZdZUeed<eed<eed<defdd�Zdedefdd	�Zd
edefdd�Z	d
S)rur�rvrxrdcC�t|�SrX)ry�r�rRrRrV�__str__�z
Token.__str__rzcCs2|j|krdSd|vr|�dd�|j|jgkSdS)z�Test a token against a token expression.  This can either be a
        token type or ``'token_type:token_value'``.  This can only test
        against string values and types.
        TrNrF)rvr{rx�r�rzrRrRrV�tests

z
Token.test�iterablecst�fdd�|D��S)z(Test against multiple token expressions.c3s�|]}��|�VqdSrX)r�)rSrzr�rRrVr]'r^z!Token.test_any.<locals>.<genexpr>)�any)r�r�rRr�rV�test_any%szToken.test_anyN)
r�r�r�r��__annotations__r�r��boolr�r�rRrRrRrVrus
c@s2eZdZdZddd�Zd
dd	�Zdefd
d�ZdS)�TokenStreamIteratorz`The iterator for tokenstreams.  Iterate over the stream
    until the eof token is reached.
    �stream�TokenStreamrdNcCs
||_dSrX)r�)r�r�rRrRrVr�/s
zTokenStreamIterator.__init__cCs|SrXrRr�rRrRrV�__iter__2szTokenStreamIterator.__iter__cCs.|jj}|jtur|j��t�t|j�|SrX)r��currentrvrq�close�
StopIteration�next�r�rtrRrRrV�__next__5s


zTokenStreamIterator.__next__)r�r�rdN)rdr�)r�r�r�r�r�r�rur�rRrRrRrVr�*s


r�c@s�eZdZdZdejedejedejefdd�Z	de
fdd	�Zdefd
d�Z
edefdd
��Zdeddfdd�Zdefdd�Zd#deddfdd�Zdedejefdd�Zdedefdd�Zdefdd�Zd$dd �Zdedefd!d"�ZdS)%r�z�A token stream is an iterable that yields :class:`Token`\s.  The
    parser however does not iterate over it but calls :meth:`next` to go
    one token ahead.  The current active token is stored as :attr:`current`.
    �	generatorr*r�cCs>t|�|_t�|_||_||_d|_tdtd�|_	t
|�dS)NFr�)�iter�_iterr�_pushedr*r��closedru�
TOKEN_INITIALr�r�)r�r�r*r�rRrRrVr�Fs
zTokenStream.__init__rdcCr�rX)r�r�rRrRrVr�Tr�zTokenStream.__iter__cCst|j�p
|jjtuSrX)r�r�r�rvrqr�rRrRrV�__bool__WszTokenStream.__bool__cCs|S)z Are we at the end of the stream?rRr�rRrRrV�eosZszTokenStream.eosrtNcCs|j�|�dS)z Push a token back to the stream.N)r�r�r�rRrRrV�push_szTokenStream.pushcCs"t|�}|j}|�|�||_|S)zLook at the next token.)r�r�r�)r��	old_token�resultrRrRrV�lookcs

zTokenStream.lookr�ncCst|�D]}t|�qdS)zGot n tokens ahead.N)�ranger�)r�r��_rRrRrV�skipks
�zTokenStream.skiprzcCs|j�|�r
t|�SdS)zqPerform the token test and return the token if it matched.
        Otherwise the return value is `None`.
        N)r�r�r�r�rRrRrV�next_ifpszTokenStream.next_ifcCs|�|�duS)z8Like :meth:`next_if` but only returns `True` or `False`.N)r�r�rRrRrV�skip_ifyszTokenStream.skip_ifcCs\|j}|jr|j��|_|S|jjtur,z	t|j�|_W|Sty+|��Y|Sw|S)z|Go one token ahead and return the old one.

        Use the built-in :func:`next` instead of calling this directly.
        )	r�r��popleftrvrqr�r�r�r�)r��rvrRrRrVr�}s��
�zTokenStream.__next__cCs&t|jjtd�|_td�|_d|_dS)zClose the stream.r�rRTN)rur�r�rqr�r�r�r�rRrRrVr��s

zTokenStream.closecCsn|j�|�s3t|�}|jjturtd|�d�|jj|j|j��td|�dt	|j���|jj|j|j��t
|�S)z}Expect a given token type and return it.  This accepts the same
        argument as :meth:`jinja2.lexer.Token.test`.
        z%unexpected end of template, expected rMzexpected token z, got )r�r�r|rvrqrr�r*r�ryr�r�rRrRrV�expect�s 
��zTokenStream.expect)r)rdN)r�r�r�r�r��Iterableru�Optionalr�r�r�r�r�r��propertyr�r�r�r�r�r�r�r�r�r�rRrRrRrVr�@s*��
�	
r�cCsZ|j|j|j|j|j|j|j|j|j|j	|j
|jf}t�
|�}|dur+t|�t|<}|S)z(Return a lexer which is probably cached.N)r��block_end_stringr��variable_end_stringr��comment_end_stringr�r��trim_blocks�
lstrip_blocks�newline_sequence�keep_trailing_newlinerrrr)r�rb�lexerrRrRrV�	get_lexer�s"�
r�cs$eZdZdZdZ�fdd�Z�ZS)�OptionalLStripzWA special tuple for marking a point in the state that can have
    lstrip applied.
    rRcst��||�SrX)�super�__new__)r��members�kwargs��	__class__rRrVr��szOptionalLStrip.__new__)r�r�r�r��	__slots__r��
__classcell__rRrRr�rVr��sr�c@sNeZdZUejeed<ejeejedfeje	fed<ej
eed<dS)�_Ruler.�tokens�commandN)r�r�r�r��Patternr�r��Union�Tupler�r�rRrRrRrVr��s
$r�c@s�eZdZdZddd�Zdedefd	d
�Z			ddedejed
ejedejede	f
dd�Z
		ddejeje
eefdejed
ejedejefdd�Z		ddedejed
ejedejedejeje
eeff
dd�ZdS)ra
Class that implements a lexer for a given environment. Automatically
    created by the environment class, usually you don't have to do that.

    Note that the lexer is not automatically bound to an environment.
    Multiple environments can share the same lexer.
    r�r	rdNc
Cs2tj}dtdtjtfdd�}tttd�ttt	d�tt
td�ttt
d�tttd�tttd�g}t|�}||j�}||j�}||j�}||j�}	|jrLdnd}
|jrU|d�nd|_|j|_|j|_d|�d	|�d
|�d�}d�|gd
d�|D��}dt|d|�d��ttd�d�t|d�td�gtt|d|�d|�d
|�|
�d��t t!fd�t|d�t"d�fd�gt#t|d|�d|�d
|�|
�d��t$d�g|t%t|d|	�d
|	���t&d�g|t't|d|�d|�d|�d
|�|
�d�
�ttt(�d�t|d�t"d�fd�gt)t|d�t*d�g|t+t|d�t,t-fd�gi|_.dS) Nr\rdcSst�|tjtjB�SrX)rY�compile�M�Sr`rRrRrV�c�szLexer.__init__.<locals>.cz\n?r�z[^ \t]z(?P<raw_begin>z(\-|\+|)\s*raw\s*(?:\-z\s*|z))rOcSs"g|]
\}}d|�d|�d��qS)z(?P<rJz	(\-|\+|))rR)rSr��rrRrRrVr�
s"z"Lexer.__init__.<locals>.<listcomp>�rootz(.*?)(?:rG�#bygroupz.+z(.*?)((?:\+z|\-�#popz(.)zMissing end of comment tagz(?:\+z\-z	(.*?)((?:z(\-|\+|))\s*endraw\s*(?:\+zMissing end of raw directivez	\s*(\n|$)z(.*?)()(?=\n|$))/rYrZr�r�r�r��
whitespace_re�TOKEN_WHITESPACE�float_re�TOKEN_FLOAT�
integer_re�
TOKEN_INTEGER�name_rerw�	string_re�TOKEN_STRING�operator_re�TOKEN_OPERATORr�r�r�r�r�r�r��lstrip_unless_rer�r��joinr�rprfrhrgr�rjrkrlrm�TOKEN_RAW_BEGIN�
TOKEN_RAW_ENDrnror�ri�TOKEN_LINECOMMENT_ENDr�)
r�r�r�r��	tag_rules�root_tag_rules�block_start_re�block_end_re�comment_end_re�variable_end_re�block_suffix_re�root_raw_re�
root_parts_rerRrRrVr��s�





�



����������������
����	������	�
����
�zLexer.__init__rxcCst�|j|�S)z`Replace all newlines with the configured sequence in strings
        and template data.
        )r}r%r�)r�rxrRrRrV�_normalize_newlinesYr�zLexer._normalize_newlines�sourcer*r��statecCs&|�||||�}t|�|||�||�S)z:Calls tokeniter + tokenize and wraps it in a token stream.)�	tokeniterr��wrap)r�rr*r�r	r�rRrRrV�tokenize_szLexer.tokenizer�c
csT�|D]�\}}}|tvr
q|}|tkrt}n�|tkrt}n�|ttfvr$q|tkr.|�|�}nr|dkr5|}nk|t	krG|}|�
�sFtd|||��nY|tkr}z|�|dd���
dd��d�}WnBty|}zt|��d�d��}	t|	|||�|�d	}~ww|tkr�t|�d
d�d�}n|tkr�t|�d
d��}n|tkr�t|}t|||�Vqd	S)
z�This is called with the stream as returned by `tokenize` and wraps
        every token in a :class:`Token` and converts the value.
        �keywordzInvalid character in identifierr����ascii�backslashreplacezunicode-escaperNNr�r�r)�ignored_tokensrnrjrorkr�r�rprrw�isidentifierrr��encode�decode�	Exceptionr�r{�stripr�r��replacer�rr��	operatorsru)
r�r�r*r�r�rt�	value_strrxr��msgrRrRrVrjsR�	������z
Lexer.wrapccs*�t�|�ddd�}|js|ddkr|d=d�|�}d}d}dg}|dur:|dkr:|d	vs3Jd
��|�|d�|j|d}	t|�}
g}|j}d}
d}	|	D�]�\}}}|�||�}|durbqQ|rl|t	t
tfvrlqQt|t
��r6|��}t|t�r�|d}td
d�|ddd�D��}|dkr�|��}|t|�d��d�}
|g|dd��}n/|dkr�|dur�|���t�s�|�d�d}|dks�|r�|�||�s�|d|�g|dd��}t|�D]W\}}|jtur�|||��|dk�r|����D]\}}|du�r|||fV||�d�7}nq�t|�d���q�||}|�s#|tv�r)|||fV||�d�|
7}d}
q�ni|��}|tk�r�|dk�rJ|�d�n@|dk�rU|�d�n5|dk�r`|�d�n*|dv�r�|�sst d|�d�|||��|�!�}||k�r�t d|�d|�d�|||��|�s�|tv�r�|||fV||�d�7}|��dd�dk}|�"�}|du�r�|dk�r�|�!�n*|dk�r�|����D]\}}|du�r�|�|�n	�q�t|�d���n|�|�|j|d}	n||k�r�t|�d���|}n||
k�rdSt d ||�d!|��|||��qO)"aThis method tokenizes the text and returns the tokens in a
        generator. Use this method if you just want to tokenize a template.

        .. versionchanged:: 3.0
            Only ``\n``, ``\r\n`` and ``\r`` are treated as line
            breaks.
        N�rr��
rrr�)�variable�blockz
invalid state�_beginTcss�|]	}|dur|VqdSrXrR)rS�grRrRrVr]�s�z"Lexer.tokeniter.<locals>.<genexpr>r?r>r�z= wanted to resolve the token dynamically but no group matchedrHrIrFrGrDrE)rIrGrEzunexpected '�'z
', expected 'r�zA wanted to resolve the new state dynamically but no group matchedz* yielded empty string without stack changezunexpected char z at )#r}r{r�r�r�r�r_r��matchrmrkro�
isinstance�tuple�groupsr�r��rstrip�count�	groupdictrrrl�rfind�search�	enumerater�r��items�RuntimeError�ignore_if_empty�groupr�r�pop�end)r�rr*r�r	�lines�posr��stack�statetokens�
source_length�balancing_stackr��newlines_stripped�
line_starting�regexr��	new_state�mr%�text�
strip_sign�stripped�l_pos�idxrtrbrxr;�expected_op�pos2rRrRrVr
�s��
�
�



����




�
�





���

�
���zLexer.tokeniter)r�r	rdN)NNN)NN)r�r�r�r�r�r�rr�r�r�rr�r�r��Iteratorrurr
rRrRrRrVr�sT
y	�����
�����
�:������)r�r	rdr)rr�rY�typingr��astr�collections.abcr�ImportError�collections�sysr�_identifierrr��
exceptionsr�utilsr�
TYPE_CHECKING�typing_extensions�ter�r	r�MutableMappingr�r�r�r�r}r�r��
IGNORECASE�VERBOSEr�r��	TOKEN_ADD�TOKEN_ASSIGN�TOKEN_COLON�TOKEN_COMMA�	TOKEN_DIV�	TOKEN_DOT�TOKEN_EQ�TOKEN_FLOORDIV�TOKEN_GT�
TOKEN_GTEQ�TOKEN_LBRACE�TOKEN_LBRACKET�TOKEN_LPAREN�TOKEN_LT�
TOKEN_LTEQ�	TOKEN_MOD�	TOKEN_MUL�TOKEN_NE�
TOKEN_PIPE�	TOKEN_POW�TOKEN_RBRACE�TOKEN_RBRACKET�TOKEN_RPAREN�TOKEN_SEMICOLON�	TOKEN_SUB�TOKEN_TILDEr�r�r�rwr�r�rjrkrlrmr�r�rfrgrhrnror�r�rirpr�rqrr,rer_r�r�r��	frozensetrr.r�rsryr|r�r�Listr�r��
NamedTuplerur�r�r�r$r�r�rrRrRrRrV�<module>s6�

�

�

���������	�
���
������&���
�
")
m


Zerion Mini Shell 1.0