Package com.illumon.iris.importers.csv.sink

Interface AppendableSink<TYPE,TARRAY>

Type Parameters:
TYPE - The column data type
TARRAY - The stored values array data type (for example Integer DataType column would have int[] array data type) on occasion this may be different for example AppendableBooleanAsByteColumnSink
All Superinterfaces:
PartitionUpdatesObserver, RowUpdateObservable, io.deephaven.csv.sinks.Sink<TARRAY>
All Known Subinterfaces:
AppendableColumnSink<DATA_TYPE,TARRAY>, ColumnSinkHolder<DATA_TYPE,TARRAY>
All Known Implementing Classes:
AppendableColumnSinkHolder, BaseAppendableColumnSink
public interface AppendableSink<TYPE,TARRAY> extends io.deephaven.csv.sinks.Sink<TARRAY>, PartitionUpdatesObserver, RowUpdateObservable
Sink interface used in import csv.

  • Method Summary

    Modifier and Type
    Method
    Description
    TYPE
    getConstantValue()
    Returns the defined constant value in case of a constant column value.
    default Object
    getUnderlying()
    Default implementation for Sink.getUnderlying() is to return the current object instance.
    void
    nullFlagsToValues(TARRAY values, boolean[] isNull, int size)
    The method allows the appropriate null values to be populated in the chunk.
    void
    updateRowChunk(int size, long destEnd)
    Allows columns not in csv source file to apply updates to next chunk of rows.
    default void
    write(TARRAY src, boolean[] isNull, long destBegin, long destEnd, boolean appending)
    Default implementation for Sink.write(Object, boolean[], long, long, boolean)
    void
    writeToLocal(TARRAY values, int size, long destEnd)
    The method will save the values chunk to disk.

    Methods inherited from interface com.illumon.iris.importers.csv.PartitionUpdatesObserver

    onPartitionParserUpdate

    Methods inherited from interface com.illumon.iris.importers.csv.RowUpdateObservable

    registerRowUpdateObserver

  • Method Details

    • getUnderlying

      default Object getUnderlying()
      Default implementation for Sink.getUnderlying() is to return the current object instance.
      Specified by:
      getUnderlying in interface io.deephaven.csv.sinks.Sink<TYPE>

    • write

      default void write(TARRAY src, boolean[] isNull, long destBegin, long destEnd, boolean appending)
      Default implementation for Sink.write(Object, boolean[], long, long, boolean)
      Specified by:
      write in interface io.deephaven.csv.sinks.Sink<TYPE>
      Parameters:
      src - The chunk of data, a typed array (short[], double[], etc) with valid elements in the half-open interval [0..(destEnd - destBegin)).
      isNull - A boolean array, with the same range of valid elements. A "true" value at position i means that src[i] should be ignored and the element should be considered as the "null value", whose representation depends on the target data structure. A "false" value means that src[i] should be interpreted normally.
      destBegin - The inclusive start index of the destination range.
      destEnd - The exclusive end index of the destination range.
      appending - A hint to the destination which indicates whether the system is appending to the data structure (if appending is true), or overwriting previously-written values (if appending is false). The caller promises to never span these two cases: i.e. it will never pass a chunk of data which partially overwrites values and then partially appends values. This flag is convenient but technically redundant because code can also determine what case it's in by comparing destEnd to the data structure's current size.

    • nullFlagsToValues

      void nullFlagsToValues(@NotNull TARRAY values, boolean[] isNull, int size)
      The method allows the appropriate null values to be populated in the chunk.
      Parameters:
      values - The chunk to populate null values if 'isNull' param is true for the index
      isNull - Indicates if the cell should be null value
      size - The size of the values array that should be persisted

    • writeToLocal

      void writeToLocal(@NotNull TARRAY values, int size, long destEnd)
      The method will save the values chunk to disk.
      Parameters:
      values - The current chunk ready to be persisted
      size - The size of the values array that should be persisted
      destEnd - Overall size of processed rows at the end of this chunk

    • getConstantValue

      @Nullable TYPE getConstantValue()
      Returns the defined constant value in case of a constant column value. Constant value definition is present in the importColumn xml element. The value will be accessible through ImportDataTransformer

    • updateRowChunk

      void updateRowChunk(int size, long destEnd)
      Allows columns not in csv source file to apply updates to next chunk of rows. For example constant column values are not part of the csv source file, they will receive current row chunk details by registering with a row that is in csv source file.
      Parameters:
      size - The current chunk length
      destEnd - Overall size of processed rows at the end of this chunk update