| Interface | Description |
|---|---|
| IStringTokenizer |
Tokenizer that only returns string tokens.
|
| ITokenizer |
Extract and return an appropriate Token from some given source.
|
| Class | Description |
|---|---|
| ABCTokenizer |
Tokenizer for the abc music language.
|
| StringTokenizer |
Special tokenizer that converts a stream of various types of tokens from StreamTokenizer and converts them into a stream of strings.
|