Package io.deephaven.parquet.base

Class PlainBinaryChunkedWriter

java.lang.Object

org.apache.parquet.column.values.ValuesWriter

io.deephaven.parquet.base.AbstractBulkValuesWriter<org.apache.parquet.io.api.Binary[]>

io.deephaven.parquet.base.PlainBinaryChunkedWriter

All Implemented Interfaces:

BulkWriter<org.apache.parquet.io.api.Binary[]>, AutoCloseable

public class PlainBinaryChunkedWriter
extends AbstractBulkValuesWriter<org.apache.parquet.io.api.Binary[]>

Plain encoding except for binary values

Nested Class Summary

Nested classes/interfaces inherited from interface io.deephaven.parquet.base.BulkWriter

BulkWriter.WriteResult

Field Summary

Fields inherited from class io.deephaven.parquet.base.AbstractBulkValuesWriter

MAX_ARRAY_SIZE

Constructor Summary

Constructors

Constructor	Description
PlainBinaryChunkedWriter(int pageSize, @NotNull org.apache.parquet.bytes.ByteBufferAllocator allocator)

Method Summary

Modifier and Type	Method	Description
void	close()
long	getAllocatedSize()
long	getBufferedSize()
ByteBuffer	getByteBufferView()	Get a view of this writer ByteBuffer.
org.apache.parquet.bytes.BytesInput	getBytes()
org.apache.parquet.column.Encoding	getEncoding()
String	memUsageString(String prefix)
void	reset()	Clear all internal state.
void	writeBulk(@NotNull org.apache.parquet.io.api.Binary[] bulkValues, int rowCount)	Write a buffer's worth of values to the underlying page.
@NotNull BulkWriter.WriteResult	writeBulkFilterNulls(@NotNull org.apache.parquet.io.api.Binary[] bulkValues, int nonNullLeafCount)	Write a buffer's worth of packed vector values to the underlying page, skipping null values.
@NotNull BulkWriter.WriteResult	writeBulkFilterNulls(@NotNull org.apache.parquet.io.api.Binary[] bulkValues, @NotNull org.apache.parquet.column.values.rle.RunLengthBitPackingHybridEncoder dlEncoder, int rowCount)	Write a buffer's worth of values to the underlying page.
final void	writeBytes(org.apache.parquet.io.api.Binary v)

Methods inherited from class io.deephaven.parquet.base.AbstractBulkValuesWriter

writeBulkVector

Methods inherited from class org.apache.parquet.column.values.ValuesWriter

resetDictionary, toDictPageAndClose, writeBoolean, writeByte, writeDouble, writeFloat, writeInteger, writeLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PlainBinaryChunkedWriter

public PlainBinaryChunkedWriter(int pageSize,
 @NotNull
 @NotNull org.apache.parquet.bytes.ByteBufferAllocator allocator)

Method Details

writeBytes

public final void writeBytes(org.apache.parquet.io.api.Binary v)

Overrides:

writeBytes in class org.apache.parquet.column.values.ValuesWriter

getBufferedSize

public long getBufferedSize()

Specified by:

getBufferedSize in class org.apache.parquet.column.values.ValuesWriter

getBytes

public org.apache.parquet.bytes.BytesInput getBytes()

Specified by:

getBytes in class org.apache.parquet.column.values.ValuesWriter

reset

public void reset()

Description copied from interface: BulkWriter

Clear all internal state.

Specified by:

reset in interface BulkWriter<org.apache.parquet.io.api.Binary[]>

Specified by:

reset in class org.apache.parquet.column.values.ValuesWriter

getByteBufferView

public ByteBuffer getByteBufferView()

Description copied from interface: BulkWriter

Get a view of this writer ByteBuffer.

Returns:

a ByteBuffer containing the written data.

close

public void close()

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.parquet.column.values.ValuesWriter

getAllocatedSize

public long getAllocatedSize()

Specified by:

getAllocatedSize in class org.apache.parquet.column.values.ValuesWriter

getEncoding

public org.apache.parquet.column.Encoding getEncoding()

Specified by:

getEncoding in class org.apache.parquet.column.values.ValuesWriter

memUsageString

public String memUsageString(String prefix)

Specified by:

memUsageString in class org.apache.parquet.column.values.ValuesWriter

writeBulk

public void writeBulk(@NotNull
 @NotNull org.apache.parquet.io.api.Binary[] bulkValues,
 int rowCount)

Description copied from interface: BulkWriter

Write a buffer's worth of values to the underlying page.

Parameters:

bulkValues - the buffer of values

rowCount - the total number of rows to write.

writeBulkFilterNulls

@NotNull
public @NotNull BulkWriter.WriteResult writeBulkFilterNulls(@NotNull
 @NotNull org.apache.parquet.io.api.Binary[] bulkValues,
 @NotNull
 @NotNull org.apache.parquet.column.values.rle.RunLengthBitPackingHybridEncoder dlEncoder,
 int rowCount)
                                                     throws IOException

Description copied from interface: BulkWriter

Write a buffer's worth of values to the underlying page. This method will find, without writing, null values and record their offsets in an IntBuffer in the result. The appropriate definition level will be set for null values.

Parameters:

bulkValues - the values to write

dlEncoder - the encoder for definition levels

rowCount - the number of rows being written

Returns:

a BulkWriter.WriteResult containing the statistics of the result.

Throws:

IOException - if there was an error during write.

writeBulkFilterNulls

@NotNull
public @NotNull BulkWriter.WriteResult writeBulkFilterNulls(@NotNull
 @NotNull org.apache.parquet.io.api.Binary[] bulkValues,
 int nonNullLeafCount)

Description copied from interface: BulkWriter

Write a buffer's worth of packed vector values to the underlying page, skipping null values. This method will find null values and record their offsets in an IntBuffer in the result.

Parameters:

bulkValues - the packed vector values to write

nonNullLeafCount - the number of rows being written.

Returns:

a BulkWriter.WriteResult containing the statistics of the result.