Lexer and Token related classes. More...
Classes | |
| class | ComplexLexer |
| Lexer capable of recognizing all standard complex mathematical expressions. More... | |
| class | Lexer |
| Generic very simple lexer, capable of matching tokens defined by regular expressions. More... | |
| class | StdMathLexer |
| Lexer capable of recognizing all standard mathematical expressions. More... | |
| class | Token |
| Token class. More... | |
| class | TokenDefinition |
| Token definitions using regular expressions to match input. More... | |
| class | TokenType |
| Token type values. More... | |
Lexer and Token related classes.
Lexical analysis or lexing is the process of converting an input string into a sequence of tokens, representing discrete parts of the input each carrying certain meaning.