Click or drag to resize

NonTokenisedTokenQueue Fields

The NonTokenisedTokenQueue type exposes the following members.

Fields
  NameDescription
Protected field_lasttokentype
Type of Last Token dequeued.
(Inherited from BaseTokenQueue.)
Protected field_tokeniser
Tokeniser used to fill the Token Queue.
(Inherited from BaseTokenQueue.)
Protected field_tokens
Internal Queue object which this class is a wrapper around.
(Inherited from TokenQueue.)
Protected field_tracing
Variable indicating whether Tokeniser Tracing is enabled.
(Inherited from BaseTokenQueue.)
Top
See Also