Package org.pipservices3.expressions.tokenizers

Interface IWordState

All Superinterfaces:

ITokenizerState

All Known Implementing Classes:

CsvWordState, ExpressionWordState, GenericWordState

public interface IWordState
extends ITokenizerState

Defines an interface for tokenizer state that processes words, identificators or keywords

Method Summary

Modifier and Type	Method	Description
void	clearWordChars()	Clears definitions of word chars.
void	setWordChars(int fromSymbol, int toSymbol, boolean enable)	Establish characters in the given range as valid characters for part of a word after the first character.

Methods inherited from interface org.pipservices3.expressions.tokenizers.ITokenizerState

nextToken

Method Details

setWordChars

void setWordChars(int fromSymbol,
 int toSymbol,
 boolean enable)
           throws Exception

Establish characters in the given range as valid characters for part of a word after the first character. Note that the tokenizer must determine which characters are valid as the beginning character of a word.

Parameters:

fromSymbol - First character index of the interval.

toSymbol - Last character index of the interval.

enable - true if this state should use characters in the given range.

Throws:

Exception

clearWordChars

void clearWordChars()

Clears definitions of word chars.