Package io.deephaven.parquet.table.layout

Class ParquetKeyValuePartitionedLayout

java.lang.Object

io.deephaven.engine.table.impl.locations.local.KeyValuePartitionLayout<TLK,URI>

io.deephaven.engine.table.impl.locations.local.URIStreamKeyValuePartitionLayout<ParquetTableLocationKey>

io.deephaven.parquet.table.layout.ParquetKeyValuePartitionedLayout

All Implemented Interfaces:

TableLocationKeyFinder<ParquetTableLocationKey>

public class ParquetKeyValuePartitionedLayout
extends URIStreamKeyValuePartitionLayout<ParquetTableLocationKey>
implements TableLocationKeyFinder<ParquetTableLocationKey>

KeyValuePartitionLayout for Parquet data.

ImplNote:

• Unless a TableDefinition is provided, type inference for partitioning column uses CsvTools.readCsv as a conversion tool, and hence follows the same rules.
• Column names will be legalized via NameValidator.legalizeColumnName.

Nested Class Summary

Nested classes/interfaces inherited from class io.deephaven.engine.table.impl.locations.local.KeyValuePartitionLayout

KeyValuePartitionLayout.LocationTableBuilder

Field Summary

Fields inherited from class io.deephaven.engine.table.impl.locations.local.URIStreamKeyValuePartitionLayout

tableRootDirectory

Method Summary

Modifier and Type	Method	Description
static ParquetKeyValuePartitionedLayout	create(@NotNull URI tableRootDirectory, int maxPartitioningLevels, @NotNull ParquetInstructions readInstructions, @Nullable SeekableChannelsProvider channelsProvider)	Create a new ParquetKeyValuePartitionedLayout for the given tableRootDirectory.
static ParquetKeyValuePartitionedLayout	create(@NotNull URI tableRootDirectory, @NotNull TableDefinition tableDefinition, @NotNull ParquetInstructions readInstructions, @Nullable SeekableChannelsProvider channelsProvider)	Create a new ParquetKeyValuePartitionedLayout for the given tableRootDirectory and tableDefinition.
final void	findKeys(@NotNull Consumer<ParquetTableLocationKey> locationKeyObserver)	Find keys and deliver them to the locationKeyObserver.

Methods inherited from class io.deephaven.engine.table.impl.locations.local.URIStreamKeyValuePartitionLayout

findKeys, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Details

create

public static ParquetKeyValuePartitionedLayout create(@NotNull
 @NotNull URI tableRootDirectory,
 @NotNull
 @NotNull TableDefinition tableDefinition,
 @NotNull
 @NotNull ParquetInstructions readInstructions,
 @Nullable
 @Nullable SeekableChannelsProvider channelsProvider)

Create a new ParquetKeyValuePartitionedLayout for the given tableRootDirectory and tableDefinition.

Parameters:

tableRootDirectory - The root directory for the table.

tableDefinition - The table definition to use for the layout.

readInstructions - The instructions for customizations while reading.

channelsProvider - The provider for seekable channels. If null, a new provider will be created and used for all location keys.

create

public static ParquetKeyValuePartitionedLayout create(@NotNull
 @NotNull URI tableRootDirectory,
 int maxPartitioningLevels,
 @NotNull
 @NotNull ParquetInstructions readInstructions,
 @Nullable
 @Nullable SeekableChannelsProvider channelsProvider)

Create a new ParquetKeyValuePartitionedLayout for the given tableRootDirectory. The table definition will be inferred from the data using CsvTools.readCsv.

Parameters:

tableRootDirectory - The root directory for the table.

maxPartitioningLevels - The maximum number of partitioning levels to use.

readInstructions - The instructions for customizations while reading.

channelsProvider - The provider for seekable channels. If null, a new provider will be created and used for all location keys.

findKeys

public final void findKeys(@NotNull
 @NotNull Consumer<ParquetTableLocationKey> locationKeyObserver)

Description copied from interface: TableLocationKeyFinder

Find keys and deliver them to the locationKeyObserver.

Specified by:

findKeys in interface TableLocationKeyFinder<ParquetTableLocationKey>

Parameters:

locationKeyObserver - Per-key callback