org.apache.james.mailbox.hbase.io

Class ChunkOutputStream

java.lang.Object

java.io.OutputStream

org.apache.james.mailbox.hbase.io.ChunkOutputStream

All Implemented Interfaces:

Closeable, Flushable, AutoCloseable

public class ChunkOutputStream
extends OutputStream

Provide an OutputStream which will write to a row. The written data will be split up by chunks of the given chunkSize. Each chunk we get written to own column which will have the chunk number (starting at 0) as column key (Long). This implementation is not thread-safe! Based on Hector implementation for Cassandra. https://github.com/rantav/hector/blob/master/core/src/main/java/me/prettyprint/cassandra/io/ChunkOutputStream.java

Constructor Summary

Constructors

Constructor and Description
ChunkOutputStream(org.apache.hadoop.conf.Configuration conf, byte[] tableName, byte[] cf, byte[] key, int chunkSize) Creates a special type of OutputStream that writes data directly to HBase.

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
void	flush() Trigger a flush.
void	write(int b)

Methods inherited from class java.io.OutputStream

write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ChunkOutputStream

public ChunkOutputStream(org.apache.hadoop.conf.Configuration conf,
                 byte[] tableName,
                 byte[] cf,
                 byte[] key,
                 int chunkSize)

Creates a special type of OutputStream that writes data directly to HBase.

Parameters:

conf - HBase cluster configuration

tableName - name of the table that writes will be made

cf - name of the column family where data is going to be written

key - the row key

chunkSize - the size of each column, in bytes. For HBase, max is 10MB

Method Detail

write

public void write(int b)
           throws IOException

Specified by:

write in class OutputStream

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class OutputStream

Throws:

IOException

flush

public void flush()
           throws IOException

Trigger a flush. This will only write the content to the column if the chunk size is reached

Specified by:

flush in interface Flushable

Overrides:

flush in class OutputStream

Throws:

IOException