Package io.deephaven.parquet.table.layout

Class DeephavenNestedPartitionLayout<TLK extends URITableLocationKey>

java.lang.Object

io.deephaven.parquet.table.layout.DeephavenNestedPartitionLayout<TLK>

All Implemented Interfaces:

TableLocationKeyFinder<TLK>

public abstract class DeephavenNestedPartitionLayout<TLK extends URITableLocationKey>
extends Object
implements TableLocationKeyFinder<TLK>

TableLocationKeyFinder that will traverse a directory hierarchy laid out in Deephaven's "nested-partitioned" format, e.g.

 tableRootDirectory/internalPartitionValue/columnPartitionValue/tableName/...
 

, producing URITableLocationKey's with two partitions, for keys "__INTERNAL_PARTITION__" and the specified columnPartitionKey.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	INTERNAL_PARTITION_KEY
static final String	PARQUET_FILE_NAME

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	DeephavenNestedPartitionLayout(@NotNull File tableRootDirectory, @NotNull String tableName, @NotNull String columnPartitionKey, @Nullable Predicate<String> internalPartitionValueFilter)

Method Summary

Modifier and Type	Method	Description
final void	findKeys(@NotNull Consumer<TLK> locationKeyObserver)	Find keys and deliver them to the locationKeyObserver.
static DeephavenNestedPartitionLayout<ParquetTableLocationKey>	forParquet(@NotNull File tableRootDirectory, @NotNull String tableName, @NotNull String columnPartitionKey, @Nullable Predicate<String> internalPartitionValueFilter, @NotNull ParquetInstructions readInstructions)
protected String	getColumnPartitionKey()
protected abstract TLK	makeKey(@NotNull Path tableLeafDirectory, @NotNull Map<String,Comparable<?>> partitions)
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

PARQUET_FILE_NAME

@VisibleForTesting
public static final String PARQUET_FILE_NAME

See Also:

• Constant Field Values

INTERNAL_PARTITION_KEY

public static final String INTERNAL_PARTITION_KEY

See Also:

• Constant Field Values

Constructor Details

DeephavenNestedPartitionLayout

protected DeephavenNestedPartitionLayout(@NotNull
 @NotNull File tableRootDirectory,
 @NotNull
 @NotNull String tableName,
 @NotNull
 @NotNull String columnPartitionKey,
 @Nullable
 @Nullable Predicate<String> internalPartitionValueFilter)

Parameters:

tableRootDirectory - The directory to traverse from

tableName - The table name

columnPartitionKey - The partitioning column name

internalPartitionValueFilter - Filter to control which internal partitions are included, null for all

Method Details

forParquet

public static DeephavenNestedPartitionLayout<ParquetTableLocationKey> forParquet(@NotNull
 @NotNull File tableRootDirectory,
 @NotNull
 @NotNull String tableName,
 @NotNull
 @NotNull String columnPartitionKey,
 @Nullable
 @Nullable Predicate<String> internalPartitionValueFilter,
 @NotNull
 @NotNull ParquetInstructions readInstructions)

toString

public String toString()

Overrides:

toString in class Object

findKeys

public final void findKeys(@NotNull
 @NotNull Consumer<TLK> locationKeyObserver)

Description copied from interface: TableLocationKeyFinder

Find keys and deliver them to the locationKeyObserver.

Specified by:

findKeys in interface TableLocationKeyFinder<TLK extends URITableLocationKey>

Parameters:

locationKeyObserver - Per-key callback

makeKey

protected abstract TLK makeKey(@NotNull
 @NotNull Path tableLeafDirectory,
 @NotNull
 @NotNull Map<String,Comparable<?>> partitions)

getColumnPartitionKey

protected String getColumnPartitionKey()