org.apache.james.ai.classic
Class Tokenizer

java.lang.Object
  extended by org.apache.james.ai.classic.Tokenizer
Direct Known Subclasses:
TokenCollector, TokenCounter

public abstract class Tokenizer
extends Object

Tokenizes streaming mail input.


Constructor Summary
Tokenizer()
           
 
Method Summary
protected  void doTokenize(Reader stream)
          Tokenizes a stream.
protected abstract  void next(String token)
          Process next token.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

Tokenizer

public Tokenizer()
Method Detail

doTokenize

protected void doTokenize(Reader stream)
                   throws IOException
Tokenizes a stream.

Parameters:
stream - not null
Throws:
IOException

next

protected abstract void next(String token)
Process next token.

Parameters:
token - not null


Copyright © 2008-2012 The Apache Software Foundation. All Rights Reserved.