Package io.deephaven.parquet.table.layout

Class ParquetMetadataFileLayout

java.lang.Object

io.deephaven.parquet.table.layout.ParquetMetadataFileLayout

All Implemented Interfaces:

TableLocationKeyFinder<ParquetTableLocationKey>

public class ParquetMetadataFileLayout
extends Object
implements TableLocationKeyFinder<ParquetTableLocationKey>

Location finder that will examine a parquet metadata file to discover locations.

Note that we expect to find the following files:

• "_metadata" - A file containing Parquet metadata for all row groups in all .parquet files for the entire data set, including schema information non-partitioning columns and key-value metadata
• "_common_metadata" (optional) - A file containing Parquet metadata with schema information that applies to the entire data set, including partitioning columns that are inferred from file paths rather than explicitly written in column chunks within .parquet files

Method Summary

Modifier and Type	Method	Description
static ParquetMetadataFileLayout	create(@NotNull URI source, @NotNull ParquetInstructions inputInstructions, @Nullable SeekableChannelsProvider channelsProvider)	Create a new ParquetMetadataFileLayout for the given source and inputInstructions.
void	findKeys(@NotNull Consumer<ParquetTableLocationKey> locationKeyObserver)	Find keys and deliver them to the locationKeyObserver.
ParquetInstructions	getInstructions()
TableDefinition	getTableDefinition()
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Details

create

public static ParquetMetadataFileLayout create(@NotNull
 @NotNull URI source,
 @NotNull
 @NotNull ParquetInstructions inputInstructions,
 @Nullable
 @Nullable SeekableChannelsProvider channelsProvider)

Create a new ParquetMetadataFileLayout for the given source and inputInstructions.

Parameters:

source - The source URI for the metadata file or directory containing the metadata file.

inputInstructions - The instructions for customizations while reading.

channelsProvider - The provider for seekable channels. If null, a new provider will be created and used for all location keys.

toString

public String toString()

Overrides:

toString in class Object

getTableDefinition

public TableDefinition getTableDefinition()

getInstructions

public ParquetInstructions getInstructions()

findKeys

public void findKeys(@NotNull
 @NotNull Consumer<ParquetTableLocationKey> locationKeyObserver)

Description copied from interface: TableLocationKeyFinder

Find keys and deliver them to the locationKeyObserver.

Specified by:

findKeys in interface TableLocationKeyFinder<ParquetTableLocationKey>

Parameters:

locationKeyObserver - Per-key callback