TZToken Struct Reference

A token represents a logical chunk of a string. More...

List of all members.

Public Attributes

TZTokenType TokenType
string Value


Detailed Description

A token represents a logical chunk of a string.

For example, a typical tokenizer would break the string "1.23 <= 12.3" into three tokens: the number 1.23, a less-than-or-equal symbol, and the number 12.3. A token is a receptacle, and relies on a tokenizer to decide precisely how to divide a string into tokens.

Definition at line 111 of file ZTokenizer.pas.


Member Data Documentation

Definition at line 116 of file ZTokenizer.pas.

Definition at line 114 of file ZTokenizer.pas.


The documentation for this struct was generated from the following file:

Generated on Wed Dec 30 08:42:58 2009 for zeoslib by  doxygen 1.5.7.1