java.lang.Object
org.pipservices3.expressions.tokenizers.Token

public class Token extends Object
A token represents a logical chunk of a string. For example, a typical tokenizer would break the string "1.23 <= 12.3" into three tokens: the number 1.23, a less-than-or-equal symbol, and the number 12.3. A token is a receptacle, and relies on a tokenizer to decide precisely how to divide a string into tokens.
  • Constructor Details

    • Token

      public Token(TokenType type, String value, int line, int column)
  • Method Details

    • getType

      public TokenType getType()
      The token type.
    • getValue

      public String getValue()
      The token value.
    • getLine

      public int getLine()
      The line number where the token is.
    • getColumn

      public int getColumn()
      The column number where the token is.
    • equals

      public boolean equals(Object obj)
      Overrides:
      equals in class Object