TZTokenizer Class Reference

Implements a default tokenizer object. More...

Inheritance diagram for TZTokenizer:

TZAbstractObject IZTokenizer TInterfacedObject IZObject TZExpressionTokenizer TZGenericSQLTokenizer TZInterbaseTokenizer TZMySQLTokenizer TZOracleTokenizer TZPostgreSQLTokenizer TZSQLiteTokenizer TZSybaseTokenizer

List of all members.

Public Member Functions

IZInterface Clone ()
 Clones an object instance.
Boolean Equals (const IZInterface Value)
TZTokenizerState GetCharacterState (Char StartChar)
TZCommentState GetCommentState ()
TZNumberState GetNumberState ()
TZQuoteState GetQuoteState ()
TZSymbolState GetSymbolState ()
TZWhitespaceState GetWhitespaceState ()
TZWordState GetWordState ()
LongInt Hash ()
 Gets a unique hash for this object.
Boolean InstanceOf (const TGUID IId)
 Checks is this object implements a specified interface.
 SetCharacterState (Char FromChar, Char ToChar, TZTokenizerState State)
TZTokenDynArray TokenizeBuffer (const string Buffer, TZTokenOptions Options)
TStrings TokenizeBufferToList (const string Buffer, TZTokenOptions Options)
TZTokenDynArray TokenizeStream (TStream Stream, TZTokenOptions Options)
TStrings TokenizeStreamToList (TStream Stream, TZTokenOptions Options)
string ToString ()
 Converts this object into the string representation.
 TZTokenizer ()
 ~TZTokenizer ()

Public Attributes

TZCommentState CommentState
TZNumberState NumberState
TZQuoteState QuoteState
TZSymbolState SymbolState
TZWhitespaceState WhitespaceState
TZWordState WordState

Private Attributes

TZTokenizerState FCharacterStates [255]
TZCommentState FCommentState
TZNumberState FNumberState
TZQuoteState FQuoteState
TZSymbolState FSymbolState
TZWhitespaceState FWhitespaceState
TZWordState FWordState


Detailed Description

Implements a default tokenizer object.

Definition at line 641 of file ZTokenizer.pas.


Constructor & Destructor Documentation

TZTokenizer::TZTokenizer (  ) 

TZTokenizer::~TZTokenizer (  ) 


Member Function Documentation

IZInterface TZAbstractObject::Clone (  )  [inherited]

Clones an object instance.

Returns:
a clonned object instance.

Reimplemented from IZObject.

Reimplemented in TZCollection, TZUnmodifiableCollection, TZHashMap, TZStack, and TZAnyValue.

Definition at line 474 of file ZClasses.pas.

Boolean TZAbstractObject::Equals ( const IZInterface  Value  )  [inherited]

Reimplemented in TZAnyValue.

TZTokenizerState TZTokenizer::GetCharacterState ( Char  StartChar  ) 

TZCommentState TZTokenizer::GetCommentState (  ) 

Reimplemented from IZTokenizer.

TZNumberState TZTokenizer::GetNumberState (  ) 

Reimplemented from IZTokenizer.

TZQuoteState TZTokenizer::GetQuoteState (  ) 

Reimplemented from IZTokenizer.

TZSymbolState TZTokenizer::GetSymbolState (  ) 

Reimplemented from IZTokenizer.

TZWhitespaceState TZTokenizer::GetWhitespaceState (  ) 

Reimplemented from IZTokenizer.

TZWordState TZTokenizer::GetWordState (  ) 

Reimplemented from IZTokenizer.

LongInt TZAbstractObject::Hash (  )  [inherited]

Gets a unique hash for this object.

Returns:
a unique hash for this object.

Reimplemented from IZObject.

Definition at line 462 of file ZClasses.pas.

Boolean TZAbstractObject::InstanceOf ( const TGUID  IId  )  [inherited]

Checks is this object implements a specified interface.

Parameters:
IId an interface id.
Returns:
True if this object support the interface.

Reimplemented from IZObject.

Definition at line 488 of file ZClasses.pas.

TZTokenizer::SetCharacterState ( Char  FromChar,
Char  ToChar,
TZTokenizerState  State 
)

TZTokenDynArray TZTokenizer::TokenizeBuffer ( const string  Buffer,
TZTokenOptions  Options 
)

Reimplemented from IZTokenizer.

TStrings TZTokenizer::TokenizeBufferToList ( const string  Buffer,
TZTokenOptions  Options 
)

Reimplemented from IZTokenizer.

TZTokenDynArray TZTokenizer::TokenizeStream ( TStream  Stream,
TZTokenOptions  Options 
)

Reimplemented from IZTokenizer.

TStrings TZTokenizer::TokenizeStreamToList ( TStream  Stream,
TZTokenOptions  Options 
)

Reimplemented from IZTokenizer.

string TZAbstractObject::ToString (  )  [inherited]

Converts this object into the string representation.

Returns:
a string representation for this object.

Reimplemented from IZObject.

Reimplemented in TZCollection, TZUnmodifiableCollection, TZStack, and TZAnyValue.

Definition at line 501 of file ZClasses.pas.


Member Data Documentation

See also:
FCommentState For reading

FCommentState For writing

Definition at line 725 of file ZTokenizer.pas.

[0..255]

Definition at line 646 of file ZTokenizer.pas.

Definition at line 648 of file ZTokenizer.pas.

Definition at line 650 of file ZTokenizer.pas.

Definition at line 652 of file ZTokenizer.pas.

Definition at line 654 of file ZTokenizer.pas.

Definition at line 656 of file ZTokenizer.pas.

Definition at line 658 of file ZTokenizer.pas.

See also:
FNumberState For reading

FNumberState For writing

Definition at line 728 of file ZTokenizer.pas.

See also:
FQuoteState For reading

FQuoteState For writing

Definition at line 731 of file ZTokenizer.pas.

See also:
FSymbolState For reading

FSymbolState For writing

Definition at line 734 of file ZTokenizer.pas.

See also:
FWhitespaceState For reading

FWhitespaceState For writing

Definition at line 738 of file ZTokenizer.pas.

See also:
FWordState For reading

FWordState For writing

Definition at line 741 of file ZTokenizer.pas.


The documentation for this class was generated from the following file:

Generated on Wed Dec 30 08:42:58 2009 for zeoslib by  doxygen 1.5.7.1