Package io.deephaven.extensions.barrage.util

Class ArrowToTableConverter

java.lang.Object

io.deephaven.extensions.barrage.util.ArrowToTableConverter

Direct Known Subclasses:

ArrowFlightUtil.DoPutObserver

public class ArrowToTableConverter
extends Object

This class allows the incremental making of a BarrageTable from Arrow IPC messages, starting with an Arrow Schema message followed by zero or more RecordBatches

Field Summary

Fields

Modifier and Type	Field	Description
protected BarrageSubscriptionOptions	options
protected BarrageTable	resultTable
protected long	totalRowsRead

Constructor Summary

Constructors

Constructor	Description
ArrowToTableConverter()

Method Summary

Modifier and Type	Method	Description
protected void	addDictionaryBatch(BarrageProtoUtil.MessageInfo mi)	Updates the per-stream DictionaryReaderRegistry from a parsed DictionaryBatch message.
void	addRecordBatch(ByteBuffer ipcMessage)
void	addRecordBatches(ByteBuffer... ipcMessages)
protected void	configureWithSchema(org.apache.arrow.flatbuf.Schema schema)
protected BarrageMessage	createBarrageMessage(BarrageProtoUtil.MessageInfo mi, int numColumns)
static PrimitiveIterator.OfLong	extractBufferInfo(@NotNull org.apache.arrow.flatbuf.RecordBatch batch)
BarrageTable	getResultTable()
void	onCompleted()
static BarrageProtoUtil.MessageInfo	parseArrowIpcMessage(ByteBuffer bb)
static org.apache.arrow.flatbuf.Schema	parseArrowSchema(BarrageProtoUtil.MessageInfo mi)
void	setSchema(ByteBuffer ipcMessage)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

totalRowsRead

protected long totalRowsRead

resultTable

protected BarrageTable resultTable

options

protected BarrageSubscriptionOptions options

Constructor Details

ArrowToTableConverter

public ArrowToTableConverter()

Method Details

parseArrowIpcMessage

public static BarrageProtoUtil.MessageInfo parseArrowIpcMessage(ByteBuffer bb)

parseArrowSchema

public static org.apache.arrow.flatbuf.Schema parseArrowSchema(BarrageProtoUtil.MessageInfo mi)

extractBufferInfo

public static PrimitiveIterator.OfLong extractBufferInfo(@NotNull
 @NotNull org.apache.arrow.flatbuf.RecordBatch batch)

setSchema

@ScriptApi
public void setSchema(ByteBuffer ipcMessage)

addRecordBatches

@ScriptApi
public void addRecordBatches(ByteBuffer... ipcMessages)

addDictionaryBatch

protected void addDictionaryBatch(@NotNull
 BarrageProtoUtil.MessageInfo mi)

Updates the per-stream DictionaryReaderRegistry from a parsed DictionaryBatch message. Callable by subclasses that receive DictionaryBatch messages through a different transport path (e.g. gRPC doPut streaming).

Throws:

IllegalStateException - if the dictionary id is not present in the schema

addRecordBatch

@ScriptApi
public void addRecordBatch(ByteBuffer ipcMessage)

getResultTable

@ScriptApi
public BarrageTable getResultTable()

onCompleted

@ScriptApi
public void onCompleted()
                 throws InterruptedException

Throws:

InterruptedException

configureWithSchema

protected void configureWithSchema(org.apache.arrow.flatbuf.Schema schema)

createBarrageMessage

protected BarrageMessage createBarrageMessage(BarrageProtoUtil.MessageInfo mi,
 int numColumns)