Rudimentary lexer written in Python.
Given input source code, in the form of a text file, the lexer will classify each lexeme with an appropriate token. Possible tokens are identifier, keyword, separator, float, and integer.
liang108/PyLexer
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|