Package io.deephaven.parquet.table

Class ParquetTableWriter

java.lang.Object

io.deephaven.parquet.table.ParquetTableWriter

public class ParquetTableWriter
extends Object

API for writing DH tables in parquet format

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ParquetTableWriter.GroupingColumnWritingInfo	Helper struct used to pass information about where to write the grouping files for each grouping column

Field Summary

Fields

Modifier and Type	Field	Description
static final String	BEGIN_POS
static final String	END_POS
static final String	GROUPING_KEY
static final String	METADATA_KEY
static final String	PARQUET_FILE_EXTENSION

Constructor Summary

Constructors

Constructor	Description
ParquetTableWriter()

Method Summary

Modifier and Type	Method	Description
static void	write(@NotNull Table table, @NotNull TableDefinition definition, @NotNull ParquetInstructions writeInstructions, @NotNull String path, @NotNull Map<String,String> tableMeta, TableInfo.Builder tableInfoBuilder)	Writes a table in parquet format under a given path
static void	write(@NotNull Table t, @NotNull TableDefinition definition, @NotNull ParquetInstructions writeInstructions, @NotNull String destPathName, @NotNull Map<String,String> incomingMeta, Map<String,ParquetTableWriter.GroupingColumnWritingInfo> groupingColumnsWritingInfoMap)	Writes a table in parquet format under a given path

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

METADATA_KEY

public static final String METADATA_KEY

See Also:

• Constant Field Values

BEGIN_POS

public static final String BEGIN_POS

See Also:

• Constant Field Values

END_POS

public static final String END_POS

See Also:

• Constant Field Values

GROUPING_KEY

public static final String GROUPING_KEY

See Also:

• Constant Field Values

PARQUET_FILE_EXTENSION

public static final String PARQUET_FILE_EXTENSION

See Also:

• Constant Field Values

Constructor Details

ParquetTableWriter

public ParquetTableWriter()

Method Details

write

public static void write(@NotNull
 @NotNull Table t,
 @NotNull
 @NotNull TableDefinition definition,
 @NotNull
 @NotNull ParquetInstructions writeInstructions,
 @NotNull
 @NotNull String destPathName,
 @NotNull
 @NotNull Map<String,String> incomingMeta,
 Map<String,ParquetTableWriter.GroupingColumnWritingInfo> groupingColumnsWritingInfoMap)
                  throws SchemaMappingException,
IOException

Writes a table in parquet format under a given path

Parameters:

t - The table to write

definition - Table definition

writeInstructions - Write instructions for customizations while writing

destPathName - The destination path

incomingMeta - A map of metadata values to be stores in the file footer

Throws:

SchemaMappingException - Error creating a parquet table schema for the given table (likely due to unsupported types)

IOException - For file writing related errors

write

public static void write(@NotNull
 @NotNull Table table,
 @NotNull
 @NotNull TableDefinition definition,
 @NotNull
 @NotNull ParquetInstructions writeInstructions,
 @NotNull
 @NotNull String path,
 @NotNull
 @NotNull Map<String,String> tableMeta,
 @NotNull
 TableInfo.Builder tableInfoBuilder)
                  throws SchemaMappingException,
IOException

Writes a table in parquet format under a given path

Parameters:

table - The table to write

definition - The table definition

writeInstructions - Write instructions for customizations while writing

path - The destination path

tableMeta - A map of metadata values to be stores in the file footer

tableInfoBuilder - A partially-constructed builder for the metadata object

Throws:

SchemaMappingException - Error creating a parquet table schema for the given table (likely due to unsupported types)

IOException - For file writing related errors