Package com.illumon.iris.importers.csv

Interface PartitionUpdatesObserver

All Known Subinterfaces:
AppendableColumnSink<DATA_TYPE,TARRAY>, AppendableSink<TYPE,TARRAY>, ColumnSinkHolder<DATA_TYPE,TARRAY>
All Known Implementing Classes:
AppendableColumnSinkHolder, BaseAppendableColumnSink
public interface PartitionUpdatesObserver
This is an Observer interface.

CsvPartitionColumnParser is the source observable for this observer, It builds and publishes PartitionParserUpdates to the observer as it processes the received chunks.

AppendableTableWrapper plays two roles, 1. it is the "only" PartitionUpdatesObserver that registers with the parser. 2. The received updates are processed by applying eviction logic if necessary and then "published" to all the column sinks.

All column sink implementations BaseAppendableColumnSink implement this observer and receive the PartitionParserUpdates from AppendableTableWrapper. The processing of individual chunks of parsed data in the column sinks will be done based on these updates when there is a partition column.

  • Method Details

    • onPartitionParserUpdate

      void onPartitionParserUpdate(@NotNull PartitionParserUpdate parserUpdate)
      Updates are published by the source (CsvPartitionColumnParser or AppendableTableWrapper) by invoking this method.
      Parameters:
      parserUpdate - Partition for current chunk.