Your IP : 216.73.216.52
f
�h � @ s� d Z d d d d g Z d Z d Z d Z d Z d Z d
Z d Z d Z d
Z
d Z d Z d Z
d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d! Z d" Z d# Z d$ Z! d% Z" d& Z# d' Z$ d( Z% d) Z& d* Z' d+ Z( d, Z) d- Z* d. Z+ d/ Z, d0 Z- d1 Z. d2 Z/ d3 Z0 d4 Z1 d5 Z2 d6 Z3 d7 Z4 d8 Z5 d9 Z6 d: Z7 d; Z8 d< Z9 d= Z: d> Z; d? Z< d@ dA � e= � j> � D� Z? e j@ e? jA � � dB d � ZB dC d � ZC dD d � ZD dE dF � ZE eF dG k r�eE � dH S)Iz!Token constants (from "token.h").�tok_name�
ISTERMINAL�
ISNONTERMINAL�ISEOF� � � � � � � � � � �
� � �
� � � � � � � � � � � � � � � � � � � �! �" �# �$ �% �& �' �( �) �* �+ �, �- �. �/ �0 �1 �2 �3 �4 �5 �6 �7 �8 �9 � c C s> i | ]4 \ } } t | t � r | j d � r | | � q S)�_)�
isinstance�int�
startswith)�.0�name�value� rG �/usr/lib/python3.5/token.py�
<dictcomp>J s rI c C s
| t k S)N)� NT_OFFSET)�xrG rG rH r O s c C s
| t k S)N)rJ )rK rG rG rH r R s c C s
| t k S)N)� ENDMARKER)rK rG rG rH r U s c J C s d d l } d d l } | j d d � } | r; | d p> d } d } t | � d k rc | d } y t | � } WnL t k
r� } z, | j j d t | � � | j d � WYd d } ~ Xn X| � | j
� j d � } Wd QRX| j d | j
� } i } xQ | D]I }
| j |
� } | r| j d d � \ } }
t |
� }
| | |
<qWt | j � � } y t | � } WnL t k
r�} z, | j j d t | � � | j d � WYd d } ~ Xn X| � | j
� j d � } Wd QRXy& | j d � d } | j d
� } Wn/ t k
r?| j j d � | j d � Yn Xg } x) | D]! }
| j d
| |
|
f � qMW| | | | � <y t | d � } WnL t k
r�} z, | j j d t | � � | j d � WYd d } ~ Xn X| � | j d j | � � Wd QRXd S)Nr r zInclude/token.hz Lib/token.pyzI/O error: %s
�
z:#define[ ][ ]*([A-Z0-9][A-Z0-9_]*)[ ][ ]*([0-9][0-9]*)r z#--start constants--z#--end constants--z&target does not contain format markersr z%s = %d�wr )�re�sys�argv�len�open�OSError�stdout�write�str�exit�read�split�compile�
IGNORECASE�match�grouprB �sorted�keys�stderr�index�
ValueError�append�join)rO rP �args�
inFileName� outFileName�fp�err�lines�prog�tokens�liner] rE �valr` �format�start�endrG rG rH �_mainY sb
rs �__main__N)G�__doc__�__all__rL �NAME�NUMBER�STRING�NEWLINE�INDENT�DEDENT�LPAR�RPAR�LSQB�RSQB�COLON�COMMA�SEMI�PLUS�MINUS�STAR�SLASH�VBAR�AMPER�LESS�GREATER�EQUAL�DOT�PERCENT�LBRACE�RBRACE�EQEQUAL�NOTEQUAL� LESSEQUAL� GREATEREQUAL�TILDE�
CIRCUMFLEX� LEFTSHIFT�
RIGHTSHIFT�
DOUBLESTAR� PLUSEQUAL�MINEQUAL� STAREQUAL�
SLASHEQUAL� PERCENTEQUAL�
AMPEREQUAL� VBAREQUAL�CIRCUMFLEXEQUAL�LEFTSHIFTEQUAL�RIGHTSHIFTEQUAL�DOUBLESTAREQUAL� DOUBLESLASH�DOUBLESLASHEQUAL�AT�ATEQUAL�RARROW�ELLIPSIS�OP�AWAIT�ASYNC�
ERRORTOKEN�N_TOKENSrJ �globals�itemsr �extend�valuesr r r rs �__name__rG rG rG rH �<module> s�
5