Package io.deephaven.parquet.base

Class ParquetFileReader

java.lang.Object

io.deephaven.parquet.base.ParquetFileReader

public class ParquetFileReader
extends Object

Top level accessor for a parquet file which can read both from a file path string or a CLI style file URI, ex."s3://bucket/key".

Field Summary

Fields

Modifier and Type	Field	Description
static final String	FILE_URI_SCHEME
final org.apache.parquet.format.FileMetaData	fileMetaData

Method Summary

Modifier and Type	Method	Description
static ParquetFileReader	create(@NotNull File parquetFile, @NotNull SeekableChannelsProvider channelsProvider)	Make a ParquetFileReader for the supplied File.
static ParquetFileReader	create(@NotNull URI parquetFileURI, @NotNull SeekableChannelsProvider channelsProvider)	Make a ParquetFileReader for the supplied URI.
SeekableChannelsProvider	getChannelsProvider()
Set<String>	getColumnsWithDictionaryUsedOnEveryDataPage()	Get the name of all columns that we can know for certain (a) have a dictionary, and (b) use the dictionary on all data pages.
RowGroupReader	getRowGroup(int groupNumber, String version)	Create a RowGroupReader object for provided row group number
org.apache.parquet.schema.MessageType	getSchema()
int	rowGroupCount()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

FILE_URI_SCHEME

public static final String FILE_URI_SCHEME

See Also:

• Constant Field Values

fileMetaData

public final org.apache.parquet.format.FileMetaData fileMetaData

Method Details

create

public static ParquetFileReader create(@NotNull
 @NotNull File parquetFile,
 @NotNull
 @NotNull SeekableChannelsProvider channelsProvider)

Make a ParquetFileReader for the supplied File. Wraps IOException as UncheckedIOException.

Parameters:

parquetFile - The parquet file or the parquet metadata file

channelsProvider - The SeekableChannelsProvider to use for reading the file

Returns:

The new ParquetFileReader

create

public static ParquetFileReader create(@NotNull
 @NotNull URI parquetFileURI,
 @NotNull
 @NotNull SeekableChannelsProvider channelsProvider)

Make a ParquetFileReader for the supplied URI. Wraps IOException as UncheckedIOException.

Parameters:

parquetFileURI - The URI for the parquet file or the parquet metadata file

channelsProvider - The SeekableChannelsProvider to use for reading the file

Returns:

The new ParquetFileReader

getChannelsProvider

public SeekableChannelsProvider getChannelsProvider()

Returns:

The SeekableChannelsProvider used for this reader, appropriate to use for related file access

getColumnsWithDictionaryUsedOnEveryDataPage

public Set<String> getColumnsWithDictionaryUsedOnEveryDataPage()

Get the name of all columns that we can know for certain (a) have a dictionary, and (b) use the dictionary on all data pages.

Returns:

A set of parquet column names that satisfies the required condition.

getRowGroup

public RowGroupReader getRowGroup(int groupNumber,
 String version)

Create a RowGroupReader object for provided row group number

Parameters:

version - The "version" string from deephaven specific parquet metadata, or null if it's not present.

getSchema

public org.apache.parquet.schema.MessageType getSchema()

rowGroupCount

public int rowGroupCount()