File: //lib64/python3.6/site-packages/ldap/schema/__pycache__/tokenizer.cpython-36.pyc
3
�`a� � @ s6 d Z ddlZejd�jZejd�Zdd� Zdd� ZdS ) z
ldap.schema.tokenizer - Low-level parsing functions for schema element strings
See https://www.python-ldap.org/ for details.
� Nz@(\()|(\))|([^'$()\s]+)|('(?:[^'\\]|\\\\|\\.)*?'(?!\w))|([^\s]+?)z\\(.)c C s� g }d}x�t | �D ]�\}}}}}|r0|j|� q|rP|jtjd|dd� �� q|rh|d7 }|j|� q|r�|d8 }|j|� q|dkr�|s�td| ��qt|| ��qW |r�td| ��|S )zJ
Returns list of syntax elements with quotes and spaces stripped.
r z\1� �$z '$' outside parenthesis in %rz Unbalanced parenthesis in %r���)�TOKENS_FINDALL�append�UNESCAPE_PATTERN�sub�
ValueError)�s�partsZparensZoparZcparZunquotedZquotedZresidue� r �!/usr/lib64/python3.6/tokenizer.py� split_tokens s( r c C s | d j � dkr | d j � dks,tt| ���i }|j|� d}t| �}x�||k �r| | |k�r
| | }|d7 }||k �r| | |kr�f ||< nx| | dkr�|d7 }|}x ||k r�| | dkr�|d7 }q�W ttdd� | ||� ��||< |d7 }n| | f||< |d7 }qH|d7 }qHW |S )z8
Returns dictionary of known tokens with all values
r �(r �)c S s | dkS )Nr r )�vr r r
�<lambda>L s z extract_tokens.<locals>.<lambda>r )�strip�AssertionErrorr �update�len�tuple�filter)�lZ known_tokens�result�iZl_len�token�startr r r
�extract_tokens5 s. ,
r )�__doc__�re�compile�findallr r r r r r r r
�<module> s