Package com.illumon.iris.db.v2.parquet.transfer

Interface TransferObject<B>

Type Parameters:

B -

All Superinterfaces:

AutoCloseable, SafeCloseable

All Known Implementing Classes:

BooleanTransfer, ByteTransfer, CharTransfer, CodecTransfer, DoubleTransfer, FloatTransfer, IntTransfer, LongTransfer, ShortTransfer, StringTransfer

public interface TransferObject<B>
extends SafeCloseable

Classes that implement this interface are responsible for converting data from individual DH columns into buffers to be written out to the Parquet file.

Method Summary

Modifier and Type	Method	Description
static <DATA_TYPE> TransferObject<?>	create(Map<String,Map<ParquetCacheTags,Object>> computedCache, ReadOnlyIndex tableRowSet, ColumnSource<DATA_TYPE> columnSource, com.illumon.dataobjects.ColumnDefinition<DATA_TYPE> columnDefinition, int maxValuesPerPage, Class<DATA_TYPE> columnType, ParquetInstructions instructions)	Create an appropriate TransferObject to copy data from upstream ColumnSources into appropriate buffer format for a Parquet ColumnWriter
void	fetchData(OrderedKeys rs)	Copy the data from the upstream ColumnSource into this object in preparation for writing
B	getBuffer()	Get the buffer suitable for writing to a Parquet file
int	rowCount()	Get the number of rows contained within the current transfer set to be written
<T extends Comparable<T>> void	updateStatistics(org.apache.parquet.column.statistics.Statistics<T> stats)	After a sequence of calls to fetchData(OrderedKeys) this may be called to append statistic information into the Parquet footer for readers.

Methods inherited from interface com.illumon.util.SafeCloseable

close

Method Details

create

static <DATA_TYPE> TransferObject<?> create(@NotNull
 Map<String,Map<ParquetCacheTags,Object>> computedCache,
 @NotNull
 ReadOnlyIndex tableRowSet,
 @NotNull
 ColumnSource<DATA_TYPE> columnSource,
 @NotNull
 com.illumon.dataobjects.ColumnDefinition<DATA_TYPE> columnDefinition,
 int maxValuesPerPage,
 @NotNull
 Class<DATA_TYPE> columnType,
 @NotNull
 ParquetInstructions instructions)

Create an appropriate TransferObject to copy data from upstream ColumnSources into appropriate buffer format for a Parquet ColumnWriter

Type Parameters:

DATA_TYPE -

Parameters:

computedCache -

tableRowSet -

columnSource -

columnDefinition -

maxValuesPerPage -

columnType -

instructions -

Returns:

getBuffer

B getBuffer()

Get the buffer suitable for writing to a Parquet file

Returns:

the buffer

rowCount

int rowCount()

Get the number of rows contained within the current transfer set to be written

Returns:

the number of rows that are ready to write to the Parquet file

fetchData

void fetchData(@NotNull
 OrderedKeys rs)

Copy the data from the upstream ColumnSource into this object in preparation for writing

Parameters:

rs - the OrderedKeys to copy

updateStatistics

<T extends Comparable<T>> void updateStatistics(@NotNull
 org.apache.parquet.column.statistics.Statistics<T> stats)

After a sequence of calls to fetchData(OrderedKeys) this may be called to append statistic information into the Parquet footer for readers.

Type Parameters:

T -

Parameters:

stats -