Click or drag to resize

BaseTokeniser Methods

The BaseTokeniser type exposes the following members.

Methods
  NameDescription
Protected methodBacktrack
Allows you to Backtrack one character (and no more).
Protected methodConsumeCharacter
Consumes a single Character into the Output Buffer and increments the Position Counters.
Protected methodConsumeCharacter(Boolean)
Consumes a single Character into the Output Buffer and increments the Position Counters.
Protected methodConsumeNewLine(Boolean)
Consumes a New Line (which may be a single \n or \r or the two characters following each other).
Protected methodConsumeNewLine(Boolean, Boolean)
Consumes a New Line (which may be a single \n or \r or the two characters following each other).
Protected methodDiscardWhiteSpace
Helper function which discards White Space which the Tokeniser doesn't care about and increments position counters correctly.
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Protected methodError
Helper Function for generating Standardised Parser Errors.
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Public methodGetNextToken
Gets the Next available Token from the Input.
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Protected methodHandleComplexLocalNameEscapes
Handles the complex escapes that can occur in a local name.
Protected methodHandleEscapes
Handles the standard escapes supported in all the UTF-8 based RDF serializations.
Protected methodIsHexDigit
Determines whether a given Character can be valid as a Hex Digit.
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Protected methodPeek
Peeks at the next Character.
Protected methodSkipCharacter
Skips a single Character and increments the Position Counters.
Protected methodStartNewToken
Informs the Helper that you wish to start reading a new Token.
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Protected methodUnexpectedCharacter
Helper Function for generating Standardised Parser Errors about unexpected characters.
Protected methodUnexpectedEndOfInput
Helper Function for generating Standardised Parser Errors about unexpected end of input.
Protected methodUnexpectedNewLine
Helper Function for generating Standardised Parser Errors about unexpected new lines.
Protected methodUnexpectedToken
Helper Function for generating Standardised Parser Errors about unexpected tokens.
Top
See Also