Package com.illumon.iris.db.v2.parquet.transfer

Class CodecTransfer<T>

java.lang.Object

com.illumon.iris.db.v2.parquet.transfer.CodecTransfer<T>

All Implemented Interfaces:

TransferObject<org.apache.parquet.io.api.Binary[]>, SafeCloseable, AutoCloseable

public class CodecTransfer<T>
extends Object
implements TransferObject<org.apache.parquet.io.api.Binary[]>

Constructor Summary

Constructors

Constructor	Description
CodecTransfer(ColumnSource<T> columnSource, io.deephaven.util.codec.ObjectCodec<? super T> codec, int targetSize)

Method Summary

Modifier and Type	Method	Description
void	close()
void	fetchData(OrderedKeys rs)	Copy the data from the upstream ColumnSource into this object in preparation for writing
org.apache.parquet.io.api.Binary[]	getBuffer()	Get the buffer suitable for writing to a Parquet file
int	rowCount()	Get the number of rows contained within the current transfer set to be written
<T extends Comparable<T>> void	updateStatistics(org.apache.parquet.column.statistics.Statistics<T> stats)	After a sequence of calls to TransferObject.fetchData(OrderedKeys) this may be called to append statistic information into the Parquet footer for readers.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CodecTransfer

public CodecTransfer(@NotNull
 ColumnSource<T> columnSource,
 @NotNull
 io.deephaven.util.codec.ObjectCodec<? super T> codec,
 int targetSize)

Method Details

getBuffer

public org.apache.parquet.io.api.Binary[] getBuffer()

Description copied from interface: TransferObject

Get the buffer suitable for writing to a Parquet file

Specified by:

getBuffer in interface TransferObject<T>

Returns:

the buffer

rowCount

public int rowCount()

Description copied from interface: TransferObject

Get the number of rows contained within the current transfer set to be written

Specified by:

rowCount in interface TransferObject<T>

Returns:

the number of rows that are ready to write to the Parquet file

fetchData

public void fetchData(@NotNull
 OrderedKeys rs)

Description copied from interface: TransferObject

Copy the data from the upstream ColumnSource into this object in preparation for writing

Specified by:

fetchData in interface TransferObject<T>

Parameters:

rs - the OrderedKeys to copy

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface SafeCloseable

updateStatistics

public <T extends Comparable<T>> void updateStatistics(@NotNull
 org.apache.parquet.column.statistics.Statistics<T> stats)

Description copied from interface: TransferObject

After a sequence of calls to TransferObject.fetchData(OrderedKeys) this may be called to append statistic information into the Parquet footer for readers.

Specified by:

updateStatistics in interface TransferObject<T>