Package io.deephaven.engine.table.impl.locations.local

Class FileKeyValuePartitionLayout<TLK extends TableLocationKey>

java.lang.Object

io.deephaven.engine.table.impl.locations.local.KeyValuePartitionLayout<TLK,Path>

io.deephaven.engine.table.impl.locations.local.FileKeyValuePartitionLayout<TLK>

All Implemented Interfaces:

TableLocationKeyFinder<TLK>

public class FileKeyValuePartitionLayout<TLK extends TableLocationKey>
extends KeyValuePartitionLayout<TLK,Path>
implements TableLocationKeyFinder<TLK>

Location finder that will take a directory file, traverse the directory hierarchy and infer partitions from key-value pairs in the directory names, for example:

 tableRootDirectory/Country=France/City=Paris/parisData.parquet
 

Traversal is depth-first, and assumes that target files will only be found at a single depth. This class is specialized for handling of files. For handling of URIs, see URIStreamKeyValuePartitionLayout.

ImplNote:

Column names will be legalized via NameValidator.legalizeColumnName(String, Set).

Nested Class Summary

Nested classes/interfaces inherited from class io.deephaven.engine.table.impl.locations.local.KeyValuePartitionLayout

KeyValuePartitionLayout.LocationTableBuilder

Constructor Summary

Constructors

Constructor	Description
FileKeyValuePartitionLayout(@NotNull File tableRootDirectory, @NotNull Predicate<Path> pathFilter, @NotNull Supplier<KeyValuePartitionLayout.LocationTableBuilder> locationTableBuilderFactory, @NotNull BiFunction<Path,Map<String,Comparable<?>>,TLK> keyFactory, int maxPartitioningLevels)

Method Summary

Modifier and Type	Method	Description
void	findKeys(@NotNull Consumer<TLK> locationKeyObserver)	Find keys and deliver them to the locationKeyObserver.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Details

FileKeyValuePartitionLayout

public FileKeyValuePartitionLayout(@NotNull
 @NotNull File tableRootDirectory,
 @NotNull
 @NotNull Predicate<Path> pathFilter,
 @NotNull
 @NotNull Supplier<KeyValuePartitionLayout.LocationTableBuilder> locationTableBuilderFactory,
 @NotNull
 @NotNull BiFunction<Path,Map<String,Comparable<?>>,TLK> keyFactory,
 int maxPartitioningLevels)

Parameters:

tableRootDirectory - The directory to traverse from

pathFilter - Filter to determine whether a regular file should be used to create a key

locationTableBuilderFactory - Factory for builders used to organize partition information; as builders are typically stateful, a new builder is created each time this KeyValuePartitionLayout is used to find keys

keyFactory - Factory function used to generate table location keys from target files and partition values

maxPartitioningLevels - Maximum partitioning levels to traverse. Must be >= 0. 0 means only look at files in tableRootDirectory and find no partitions.

Method Details

toString

public String toString()

Overrides:

toString in class KeyValuePartitionLayout<TLK extends TableLocationKey,Path>

findKeys

public void findKeys(@NotNull
 @NotNull Consumer<TLK> locationKeyObserver)

Description copied from interface: TableLocationKeyFinder

Find keys and deliver them to the locationKeyObserver.

Specified by:

findKeys in interface TableLocationKeyFinder<TLK extends TableLocationKey>

Parameters:

locationKeyObserver - Per-key callback