Uses of Class
org.pipservices3.expressions.tokenizers.Token

Packages that use Token

Package	Description
org.pipservices3.expressions.calculator
org.pipservices3.expressions.calculator.parsers
org.pipservices3.expressions.calculator.tokenizers
org.pipservices3.expressions.csv
org.pipservices3.expressions.mustache
org.pipservices3.expressions.mustache.parsers
org.pipservices3.expressions.mustache.tokenizers
org.pipservices3.expressions.tokenizers
org.pipservices3.expressions.tokenizers.generic

Uses of Token in org.pipservices3.expressions.calculator

Methods in org.pipservices3.expressions.calculator that return types with arguments of type Token

Modifier and Type	Method	Description
List<Token>	ExpressionCalculator.getOriginalTokens()

Method parameters in org.pipservices3.expressions.calculator with type arguments of type Token

Modifier and Type	Method	Description
void	ExpressionCalculator.setOriginalTokens(List<Token> value)

Uses of Token in org.pipservices3.expressions.calculator.parsers

Methods in org.pipservices3.expressions.calculator.parsers that return types with arguments of type Token

Modifier and Type	Method	Description
List<Token>	ExpressionParser.getOriginalTokens()

Method parameters in org.pipservices3.expressions.calculator.parsers with type arguments of type Token

Modifier and Type	Method	Description
void	ExpressionParser.parseTokens(List<Token> tokens)
void	ExpressionParser.setOriginalTokens(List<Token> value)

Uses of Token in org.pipservices3.expressions.calculator.tokenizers

Methods in org.pipservices3.expressions.calculator.tokenizers that return Token

Modifier and Type	Method	Description
Token	ExpressionNumberState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	ExpressionQuoteState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	ExpressionWordState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.

Uses of Token in org.pipservices3.expressions.csv

Methods in org.pipservices3.expressions.csv that return Token

Modifier and Type	Method	Description
Token	CsvQuoteState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	CsvSymbolState.nextToken(IScanner scanner, ITokenizer tokenizer)

Uses of Token in org.pipservices3.expressions.mustache

Methods in org.pipservices3.expressions.mustache that return types with arguments of type Token

Modifier and Type	Method	Description
List<Token>	MustacheTemplate.getOriginalTokens()

Method parameters in org.pipservices3.expressions.mustache with type arguments of type Token

Modifier and Type	Method	Description
void	MustacheTemplate.setOriginalTokens(List<Token> value)

Uses of Token in org.pipservices3.expressions.mustache.parsers

Methods in org.pipservices3.expressions.mustache.parsers that return types with arguments of type Token

Modifier and Type	Method	Description
List<Token>	MustacheParser.getOriginalTokens()

Method parameters in org.pipservices3.expressions.mustache.parsers with type arguments of type Token

Modifier and Type	Method	Description
void	MustacheParser.parseTokens(List<Token> tokens)
void	MustacheParser.setOriginalTokens(List<Token> value)

Uses of Token in org.pipservices3.expressions.mustache.tokenizers

Methods in org.pipservices3.expressions.mustache.tokenizers that return Token

Modifier and Type	Method	Description
Token	MustacheSpecialState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
protected Token	MustacheTokenizer.readNextToken()

Uses of Token in org.pipservices3.expressions.tokenizers

Fields in org.pipservices3.expressions.tokenizers declared as Token

Modifier and Type	Field	Description
protected Token	AbstractTokenizer._nextToken

Methods in org.pipservices3.expressions.tokenizers that return Token

Modifier and Type	Method	Description
Token	AbstractTokenizer.nextToken()
Token	ITokenizer.nextToken()	Gets the next token from the scanner.
Token	ITokenizerState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
protected Token	AbstractTokenizer.readNextToken()

Methods in org.pipservices3.expressions.tokenizers that return types with arguments of type Token

Modifier and Type	Method	Description
List<Token>	AbstractTokenizer.tokenizeBuffer(String buffer)
List<Token>	ITokenizer.tokenizeBuffer(String buffer)	Tokenizes a string buffer into a list of tokens structures.
List<Token>	AbstractTokenizer.tokenizeStream(IScanner scanner)
List<Token>	ITokenizer.tokenizeStream(IScanner scanner)	Tokenizes a textual stream into a list of token structures.

Uses of Token in org.pipservices3.expressions.tokenizers.generic

Methods in org.pipservices3.expressions.tokenizers.generic that return Token

Modifier and Type	Method	Description
Token	CCommentState.nextToken(IScanner scanner, ITokenizer tokenizer)	Either delegate to a comment-handling state, or return a token with just a slash in it.
Token	CppCommentState.nextToken(IScanner scanner, ITokenizer tokenizer)	Either delegate to a comment-handling state, or return a token with just a slash in it.
Token	GenericCommentState.nextToken(IScanner scanner, ITokenizer tokenizer)	Either delegate to a comment-handling state, or return a token with just a slash in it.
Token	GenericNumberState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	GenericQuoteState.nextToken(IScanner scanner, ITokenizer tokenizer)	Return a quoted string token from a scanner.
Token	GenericSymbolState.nextToken(IScanner scanner, ITokenizer tokenizer)	Return a symbol token from a scanner.
Token	GenericWhitespaceState.nextToken(IScanner scanner, ITokenizer tokenizer)	Ignore whitespace (such as blanks and tabs), and return the tokenizer's next token.
Token	GenericWordState.nextToken(IScanner scanner, ITokenizer tokenizer)	Ignore word (such as blanks and tabs), and return the tokenizer's next token.
Token	SymbolRootNode.nextToken(IScanner scanner)	Return a symbol string from a scanner.