Package com.illumon.iris.importers.csv

Class PartitionParserUpdate

java.lang.Object

com.illumon.iris.importers.csv.PartitionParserUpdate

public class PartitionParserUpdate
extends Object

Holds the map of partition to its list of chunks (startIndex and size) in one parser chunk which is approximately 262K in size. The TIntArrayList holds the startIndex on even index values(starting with 0, 2, 4...) and size is on odd index values (1, 3, 5...)

Constructor Summary

Constructors

Constructor	Description
PartitionParserUpdate(long destEnd, Map<String,gnu.trove.list.array.TIntArrayList> partitionMap)	Is populated with the map of partition to start-size arraylist as processed in the current chunk in CsvPartitionColumnParser.

Method Summary

Modifier and Type	Method	Description
long	getDestEnd()
Map<String,gnu.trove.list.array.TIntArrayList>	getPartitionMap()
boolean	hasMorePartitions()	Returns true if there are more partitions to be processed in the original PartitionParserUpdate published from partition parser
void	processingComplete()	This will invoke await on the barrier reducing the number of processing threads.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PartitionParserUpdate

public PartitionParserUpdate(long destEnd, @NotNull Map<String,gnu.trove.list.array.TIntArrayList> partitionMap)

Is populated with the map of partition to start-size arraylist as processed in the current chunk in CsvPartitionColumnParser.

Parameters:

destEnd - The destEnd for the chunk processed in partition parser

partitionMap - Map of partition to start-size arraylist

Method Details

getDestEnd

public long getDestEnd()

getPartitionMap

public Map<String,gnu.trove.list.array.TIntArrayList> getPartitionMap()

processingComplete

public void processingComplete() throws BrokenBarrierException, InterruptedException, TimeoutException

This will invoke await on the barrier reducing the number of processing threads. This should be invoked when processing is complete for the current parser update in a column sink. When all column sinks invoke the method then partition parser updates for the next chunk will be published

Throws:

BrokenBarrierException

InterruptedException

TimeoutException

hasMorePartitions

public boolean hasMorePartitions()

Returns true if there are more partitions to be processed in the original PartitionParserUpdate published from partition parser