Package io.deephaven.parquet.base

Interface ParquetMetadataFileWriter

All Known Implementing Classes:
NullParquetMetadataFileWriter
public interface ParquetMetadataFileWriter
Used to write "_metadata" and "_common_metadata" files for Parquet.

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    addParquetFileMetadata(String parquetFilePath, org.apache.parquet.hadoop.metadata.ParquetMetadata metadata)
    Add the parquet metadata for the provided parquet file to the list of metadata to be written to combined metadata files.
    void
    clear()
    Clear the list of metadata accumulated so far.
    void
    writeMetadataFiles(String metadataFilePath, String commonMetadataFilePath)
    Write the combined metadata files for all metadata accumulated so far and clear the list.

  • Method Details

    • addParquetFileMetadata

      void addParquetFileMetadata(String parquetFilePath, org.apache.parquet.hadoop.metadata.ParquetMetadata metadata)
      Add the parquet metadata for the provided parquet file to the list of metadata to be written to combined metadata files.
      Parameters:
      parquetFilePath - The parquet file destination path
      metadata - The parquet metadata corresponding to the parquet file

    • writeMetadataFiles

      void writeMetadataFiles(String metadataFilePath, String commonMetadataFilePath) throws IOException
      Write the combined metadata files for all metadata accumulated so far and clear the list.
      Parameters:
      metadataFilePath - The destination path for the "_metadata" file
      commonMetadataFilePath - The destination path for the "_common_metadata" file
      Throws:
      IOException

    • clear

      void clear()
      Clear the list of metadata accumulated so far.