org.apache.james.ai.classic
Class Tokenizer
java.lang.Object
org.apache.james.ai.classic.Tokenizer
- Direct Known Subclasses:
- TokenCollector, TokenCounter
public abstract class Tokenizer
- extends Object
Tokenizes streaming mail input.
Method Summary |
protected void |
doTokenize(Reader stream)
Tokenizes a stream. |
protected abstract void |
next(String token)
Process next token. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Tokenizer
public Tokenizer()
doTokenize
protected void doTokenize(Reader stream)
throws IOException
- Tokenizes a stream.
- Parameters:
stream
- not null
- Throws:
IOException
next
protected abstract void next(String token)
- Process next token.
- Parameters:
token
- not null
Copyright © 2008-2012 The Apache Software Foundation. All Rights Reserved.