Public Attributes | |
TZTokenType | TokenType |
string | Value |
For example, a typical tokenizer would break the string "1.23 <= 12.3"
into three tokens: the number 1.23, a less-than-or-equal symbol, and the number 12.3. A token is a receptacle, and relies on a tokenizer to decide precisely how to divide a string into tokens.
Definition at line 111 of file ZTokenizer.pas.
Definition at line 116 of file ZTokenizer.pas.
string TZToken::Value |
Definition at line 114 of file ZTokenizer.pas.