File: //usr/lib64/python3.6/site-packages/ldap/schema/__pycache__/tokenizer.cpython-36.opt-1.pyc
3
�`a� � @ s6 d Z ddlZejd�jZejd�Zdd� Zdd� ZdS ) z
ldap.schema.tokenizer - Low-level parsing functions for schema element strings
See https://www.python-ldap.org/ for details.
� Nz@(\()|(\))|([^'$()\s]+)|('(?:[^'\\]|\\\\|\\.)*?'(?!\w))|([^\s]+?)z\\(.)c C s� g }d}x�t | �D ]�\}}}}}|r0|j|� q|rP|jtjd|dd� �� q|rh|d7 }|j|� q|r�|d8 }|j|� q|dkr�|s�td| ��qt|| ��qW |r�td| ��|S )zJ
Returns list of syntax elements with quotes and spaces stripped.
r z\1� �$z '$' outside parenthesis in %rz Unbalanced parenthesis in %r���)�TOKENS_FINDALL�append�UNESCAPE_PATTERN�sub�
ValueError)�s�partsZparensZoparZcparZunquotedZquotedZresidue� r �!/usr/lib64/python3.6/tokenizer.py� split_tokens s( r c C s� i }|j |� d}t| �}x�||k r�| | |kr�| | }|d7 }||k r�| | |kr^f ||< q�| | dkr�|d7 }|}x ||k r�| | dkr�|d7 }qxW ttdd� | ||� ��||< |d7 }q�| | f||< |d7 }q |d7 }q W |S )z8
Returns dictionary of known tokens with all values
r r �(�)c S s | dkS )Nr r )�vr r r
�<lambda>L s z extract_tokens.<locals>.<lambda>)�update�len�tuple�filter)�lZ known_tokens�result�iZl_len�token�startr r r
�extract_tokens5 s,
r )�__doc__�re�compile�findallr r r r r r r r
�<module> s