Lexer and Token related classes. More...
Classes | |
class | ComplexLexer |
Lexer capable of recognizing all standard complex mathematical expressions. More... | |
class | Lexer |
Generic very simple lexer, capable of matching tokens defined by regular expressions. More... | |
class | StdMathLexer |
Lexer capable of recognizing all standard mathematical expressions. More... | |
class | Token |
Token class. More... | |
class | TokenDefinition |
Token definitions using regular expressions to match input. More... | |
class | TokenType |
Token type values. More... | |
Lexer and Token related classes.
Lexical analysis or lexing is the process of converting an input string into a sequence of tokens, representing discrete parts of the input each carrying certain meaning.