Package io.deephaven.parquet.base

Class PlainBinaryChunkedWriter

java.lang.Object
org.apache.parquet.column.values.ValuesWriter
io.deephaven.parquet.base.AbstractBulkValuesWriter<org.apache.parquet.io.api.Binary[]>
io.deephaven.parquet.base.PlainBinaryChunkedWriter
All Implemented Interfaces:
BulkWriter<org.apache.parquet.io.api.Binary[]>
public class PlainBinaryChunkedWriter extends AbstractBulkValuesWriter<org.apache.parquet.io.api.Binary[]>
Plain encoding except for binary values

  • Nested Class Summary

    Nested classes/interfaces inherited from interface io.deephaven.parquet.base.BulkWriter

    BulkWriter.WriteResult

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    close()
     
    long
    getAllocatedSize()
     
    long
    getBufferedSize()
     
    ByteBuffer
    getByteBufferView()
    Get a view of this writer ByteBuffer.
    org.apache.parquet.bytes.BytesInput
    getBytes()
     
    org.apache.parquet.column.Encoding
    getEncoding()
     
    String
    memUsageString(String prefix)
     
    void
    reset()
    Clear all internal state.
    void
    writeBulk(@NotNull org.apache.parquet.io.api.Binary[] bulkValues, int rowCount, @NotNull org.apache.parquet.column.statistics.Statistics<?> statistics)
    Write a buffer's worth of values to the underlying page.
    @NotNull BulkWriter.WriteResult
    writeBulkFilterNulls(@NotNull org.apache.parquet.io.api.Binary[] bulkValues, @NotNull org.apache.parquet.column.values.rle.RunLengthBitPackingHybridEncoder dlEncoder, int rowCount, @NotNull org.apache.parquet.column.statistics.Statistics<?> statistics)
    Write a buffer's worth of values to the underlying page.
    @NotNull BulkWriter.WriteResult
    writeBulkVectorFilterNulls(@NotNull org.apache.parquet.io.api.Binary[] bulkValues, int nonNullLeafCount, @NotNull org.apache.parquet.column.statistics.Statistics<?> statistics)
    Write a buffer's worth of packed vector values to the underlying page, skipping null values.
    final void
    writeBytes(org.apache.parquet.io.api.Binary v)
     

    Methods inherited from class io.deephaven.parquet.base.AbstractBulkValuesWriter

    writeBulkVector

    Methods inherited from class org.apache.parquet.column.values.ValuesWriter

    resetDictionary, toDictPageAndClose, writeBoolean, writeByte, writeDouble, writeFloat, writeInteger, writeLong

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Method Details

    • writeBytes

      public final void writeBytes(org.apache.parquet.io.api.Binary v)
      Overrides:
      writeBytes in class org.apache.parquet.column.values.ValuesWriter

    • getBufferedSize

      public long getBufferedSize()
      Specified by:
      getBufferedSize in class org.apache.parquet.column.values.ValuesWriter

    • getBytes

      public org.apache.parquet.bytes.BytesInput getBytes()
      Specified by:
      getBytes in class org.apache.parquet.column.values.ValuesWriter

    • reset

      public void reset()
      Description copied from interface: BulkWriter
      Clear all internal state.
      Specified by:
      reset in interface BulkWriter<org.apache.parquet.io.api.Binary[]>
      Specified by:
      reset in class org.apache.parquet.column.values.ValuesWriter

    • getByteBufferView

      public ByteBuffer getByteBufferView()
      Description copied from interface: BulkWriter
      Get a view of this writer ByteBuffer.
      Returns:
      a ByteBuffer containing the written data.

    • close

      public void close()
      Overrides:
      close in class org.apache.parquet.column.values.ValuesWriter

    • getAllocatedSize

      public long getAllocatedSize()
      Specified by:
      getAllocatedSize in class org.apache.parquet.column.values.ValuesWriter

    • getEncoding

      public org.apache.parquet.column.Encoding getEncoding()
      Specified by:
      getEncoding in class org.apache.parquet.column.values.ValuesWriter

    • memUsageString

      public String memUsageString(String prefix)
      Specified by:
      memUsageString in class org.apache.parquet.column.values.ValuesWriter

    • writeBulk

      public void writeBulk(@NotNull @NotNull org.apache.parquet.io.api.Binary[] bulkValues, int rowCount, @NotNull @NotNull org.apache.parquet.column.statistics.Statistics<?> statistics)
      Description copied from interface: BulkWriter
      Write a buffer's worth of values to the underlying page.
      Parameters:
      bulkValues - the buffer of values
      rowCount - the total number of rows to write.

    • writeBulkFilterNulls

      @NotNull public @NotNull BulkWriter.WriteResult writeBulkFilterNulls(@NotNull @NotNull org.apache.parquet.io.api.Binary[] bulkValues, @NotNull @NotNull org.apache.parquet.column.values.rle.RunLengthBitPackingHybridEncoder dlEncoder, int rowCount, @NotNull @NotNull org.apache.parquet.column.statistics.Statistics<?> statistics) throws IOException
      Description copied from interface: BulkWriter
      Write a buffer's worth of values to the underlying page. This method will find, without writing, null values and record their offsets in an IntBuffer in the result. The appropriate definition level will be set for null values.
      Parameters:
      bulkValues - the values to write
      dlEncoder - the encoder for definition levels
      rowCount - the number of rows being written
      statistics - the Statistics object to modify.
      Returns:
      a BulkWriter.WriteResult containing the statistics of the result.
      Throws:
      IOException - if there was an error during write.

    • writeBulkVectorFilterNulls

      @NotNull public @NotNull BulkWriter.WriteResult writeBulkVectorFilterNulls(@NotNull @NotNull org.apache.parquet.io.api.Binary[] bulkValues, int nonNullLeafCount, @NotNull @NotNull org.apache.parquet.column.statistics.Statistics<?> statistics)
      Description copied from interface: BulkWriter
      Write a buffer's worth of packed vector values to the underlying page, skipping null values. This method will find null values and record their offsets in an IntBuffer in the result.
      Parameters:
      bulkValues - the packed vector values to write
      nonNullLeafCount - the number of rows being written.
      Returns:
      a BulkWriter.WriteResult containing the statistics of the result.