org.apache.james.util.bayesian

Class BayesianAnalyzer

java.lang.Object

org.apache.james.util.bayesian.BayesianAnalyzer

Direct Known Subclasses:

JDBCBayesianAnalyzer

public class BayesianAnalyzer
extends Object

Determines probability that text contains Spam.

Based upon Paul Grahams' A Plan for Spam. Extended to Paul Grahams' Better Bayesian Filtering.

Sample method usage:

Use: void addHam(Reader) and void addSpam(Reader) methods to build up the Maps of ham & spam tokens/occurrences. Both addHam and addSpam assume they're reading one message at a time, if you feed more than one message per call, be sure to adjust the appropriate message counter: hamMessageCount or spamMessageCount. Then...

Use: void buildCorpus() to build the final token/probabilities Map. Use your own methods for persistent storage of either the individual ham/spam corpus & message counts, and/or the final corpus. Then you can...

Use: double computeSpamProbability(Reader) to determine the probability that a particular text contains spam. A returned result of 0.9 or above is an indicator that the text was spam.

If you use persistent storage, use: void setCorpus(Map) before calling computeSpamProbability.

Since:

2.3.0

Constructor Summary

Constructors

Constructor and Description
BayesianAnalyzer() Basic class constructor.

Method Summary

Methods

Modifier and Type	Method and Description
void	addHam(Reader stream) Adds a message to the ham list.
void	addSpam(Reader stream) Adds a message to the spam list.
void	buildCorpus() Builds the corpus from the existing ham & spam counts.
void	clear() Clears all analysis repositories and counters.
double	computeSpamProbability(Reader stream) Computes the probability that the stream contains SPAM.
Map<String,Double>	getCorpus() Public getter for corpus.
int	getHamMessageCount() Public getter for hamMessageCount.
Map<String,Integer>	getHamTokenCounts() Public getter for the hamTokenCounts Map.
int	getSpamMessageCount() Public getter for spamMessageCount.
Map<String,Integer>	getSpamTokenCounts() Public getter for the spamTokenCounts Map.
void	setCorpus(Map<String,Double> corpus) Public setter for corpus.
void	setHamMessageCount(int hamMessageCount) Public setter for hamMessageCount.
void	setHamTokenCounts(Map<String,Integer> hamTokenCounts) Public setter for the hamTokenCounts Map.
void	setSpamMessageCount(int spamMessageCount) Public setter for spamMessageCount.
void	setSpamTokenCounts(Map<String,Integer> spamTokenCounts) Public setter for the spamTokenCounts Map.
void	tokenCountsClear() Clears token counters.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BayesianAnalyzer

public BayesianAnalyzer()

Basic class constructor.

Method Detail

setHamTokenCounts

public void setHamTokenCounts(Map<String,Integer> hamTokenCounts)

Public setter for the hamTokenCounts Map.

Parameters:

hamTokenCounts - The new ham Token counts Map.

getHamTokenCounts

public Map<String,Integer> getHamTokenCounts()

Public getter for the hamTokenCounts Map.

setSpamTokenCounts

public void setSpamTokenCounts(Map<String,Integer> spamTokenCounts)

Public setter for the spamTokenCounts Map.

Parameters:

spamTokenCounts - The new spam Token counts Map.

getSpamTokenCounts

public Map<String,Integer> getSpamTokenCounts()

Public getter for the spamTokenCounts Map.

setSpamMessageCount

public void setSpamMessageCount(int spamMessageCount)

Public setter for spamMessageCount.

Parameters:

spamMessageCount - The new spam message count.

getSpamMessageCount

public int getSpamMessageCount()

Public getter for spamMessageCount.

setHamMessageCount

public void setHamMessageCount(int hamMessageCount)

Public setter for hamMessageCount.

Parameters:

hamMessageCount - The new ham message count.

getHamMessageCount

public int getHamMessageCount()

Public getter for hamMessageCount.

clear

public void clear()

Clears all analysis repositories and counters.

tokenCountsClear

public void tokenCountsClear()

Clears token counters.

setCorpus

public void setCorpus(Map<String,Double> corpus)

Public setter for corpus.

Parameters:

corpus - The new corpus.

getCorpus

public Map<String,Double> getCorpus()

Public getter for corpus.

buildCorpus

public void buildCorpus()

Builds the corpus from the existing ham & spam counts.

addHam

public void addHam(Reader stream)
            throws IOException

Adds a message to the ham list.

Parameters:

stream - A reader stream on the ham message to analyze

Throws:

IOException - If any error occurs

addSpam

public void addSpam(Reader stream)
             throws IOException

Adds a message to the spam list.

Parameters:

stream - A reader stream on the spam message to analyze

Throws:

IOException - If any error occurs

computeSpamProbability

public double computeSpamProbability(Reader stream)
                              throws IOException

Computes the probability that the stream contains SPAM.

Parameters:

stream - The text to be analyzed for Spamminess.

Returns:

A 0.0 - 1.0 probability

Throws:

IOException - If any error occurs