provided.token.tokenizer

Interface IStringTokenizer

All Known Implementing Classes:

ABCTokenizer, StringTokenizer

public interface IStringTokenizer

Tokenizer that only returns string tokens. This is a specialization of ITokenizer for strings.

Author:

swong

Method Summary

Modifier and Type	Method and Description
java.lang.String	getNextStringToken() Return the next token.
void	putStringBack(java.lang.String t) Put the previously consumed token back into the token stream.

Method Detail

getNextStringToken

java.lang.String getNextStringToken()

Return the next token.

Returns:

The next token in the tokenizer

putStringBack

void putStringBack(java.lang.String t)

Put the previously consumed token back into the token stream. Can only put back one token.

Parameters:

t - the token to push back into the tokenizer