Package org.pipservices3.expressions.csv

Class CsvTokenizer

java.lang.Object

org.pipservices3.expressions.tokenizers.AbstractTokenizer

org.pipservices3.expressions.csv.CsvTokenizer

All Implemented Interfaces:

ITokenizer

public class CsvTokenizer
extends AbstractTokenizer

Implements a tokenizer class for CSV files.

Field Summary

Fields inherited from class org.pipservices3.expressions.tokenizers.AbstractTokenizer

_lastTokenType, _nextToken, _scanner

Constructor Summary

Constructors

Constructor	Description
CsvTokenizer()	Constructs this object with default parameters.

Method Summary

Modifier and Type	Method	Description
String	getEndOfLine()	Separator for rows in CSV stream.
List<Integer>	getFieldSeparators()	Separator for fields in CSV stream.
List<Integer>	getQuoteSymbols()	Character to quote strings.
void	setEndOfLine(String value)	Separator for rows in CSV stream.
void	setFieldSeparators(List<Integer> value)	Separator for fields in CSV stream.
void	setQuoteSymbols(List<Integer> value)	Character to quote strings.

Methods inherited from class org.pipservices3.expressions.tokenizers.AbstractTokenizer

clearCharacterStates, getCharacterState, getCommentState, getDecodeStrings, getMergeWhitespaces, getNumberState, getQuoteState, getScanner, getSkipComments, getSkipEof, getSkipUnknown, getSkipWhitespaces, getSymbolState, getUnifyNumbers, getWhitespaceState, getWordState, hasNextToken, nextToken, readNextToken, setCharacterState, setCommentState, setDecodeStrings, setMergeWhitespaces, setNumberState, setQuoteState, setScanner, setSkipComments, setSkipEof, setSkipUnknown, setSkipWhitespaces, setSymbolState, setUnifyNumbers, setWhitespaceState, setWordState, tokenizeBuffer, tokenizeBufferToStrings, tokenizeStream, tokenizeStreamToStrings

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CsvTokenizer

public CsvTokenizer()
             throws Exception

Constructs this object with default parameters.

Throws:

Exception

Method Details

getFieldSeparators

public List<Integer> getFieldSeparators()

Separator for fields in CSV stream.

setFieldSeparators

public void setFieldSeparators(List<Integer> value)
                        throws Exception

Separator for fields in CSV stream.

Throws:

Exception

getEndOfLine

public String getEndOfLine()

Separator for rows in CSV stream.

setEndOfLine

public void setEndOfLine(String value)

Separator for rows in CSV stream.

getQuoteSymbols

public List<Integer> getQuoteSymbols()

Character to quote strings.

setQuoteSymbols

public void setQuoteSymbols(List<Integer> value)
                     throws Exception

Character to quote strings.

Throws:

Exception