token.tokenizer
Class StringTokenizer

java.lang.Object
  token.tokenizer.StringTokenizer

All Implemented Interfaces:

IStringTokenizer

Direct Known Subclasses:

ABCTokenizer

public class StringTokenizer
extends java.lang.Object
implements IStringTokenizer

Field Summary

protected java.io.Reader	_fileReader Reader to use.
protected java.io.StreamTokenizer	_st StreamTokenizer to use.
private java.util.Stack<java.lang.String>	stack

Constructor Summary

StringTokenizer(java.lang.String inputFileName)
Initialize _st to read from a input Reader file with the given input file name.

Method Summary

java.lang.String	getNextStringToken() Return the next token.
private java.lang.String	makeNextStringToken() Returns the next string in the stream Returns LF ("\n") at end of line Returns null for EOF or error
void	putStringBack(java.lang.String str) Put the previously consumed token back into the token stream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

stack

private java.util.Stack<java.lang.String> stack

_st

protected java.io.StreamTokenizer _st

StreamTokenizer to use.

_fileReader

protected java.io.Reader _fileReader

Reader to use.

Constructor Detail

StringTokenizer

public StringTokenizer(java.lang.String inputFileName)
                throws java.io.FileNotFoundException

Initialize _st to read from a input Reader file with the given input file name.

Parameters:

inputFileName - the name of the input text file

Throws:

java.io.FileNotFoundException

Method Detail

getNextStringToken

public java.lang.String getNextStringToken()

Description copied from interface: IStringTokenizer

Return the next token.

Specified by:

getNextStringToken in interface IStringTokenizer

putStringBack

public void putStringBack(java.lang.String str)

Description copied from interface: IStringTokenizer

Put the previously consumed token back into the token stream. Can only put back one token.

Specified by:

putStringBack in interface IStringTokenizer

makeNextStringToken

private java.lang.String makeNextStringToken()

Returns the next string in the stream Returns LF ("\n") at end of line Returns null for EOF or error

Returns:

A string token or null if EOF