Package io.deephaven.parquet.table
Class ParquetTableWriter
java.lang.Object
io.deephaven.parquet.table.ParquetTableWriter
API for writing DH tables in parquet format
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic classHelper struct used to pass information about where to write the grouping files for each grouping column -
Field Summary
Fields -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionstatic voidwrite(@NotNull Table table, @NotNull TableDefinition definition, @NotNull ParquetInstructions writeInstructions, @NotNull String path, @NotNull Map<String, String> tableMeta, TableInfo.Builder tableInfoBuilder) Writes a table in parquet format under a given pathstatic voidwrite(@NotNull Table t, @NotNull TableDefinition definition, @NotNull ParquetInstructions writeInstructions, @NotNull String destPathName, @NotNull Map<String, String> incomingMeta, Map<String, ParquetTableWriter.GroupingColumnWritingInfo> groupingColumnsWritingInfoMap) Writes a table in parquet format under a given path
-
Field Details
-
METADATA_KEY
- See Also:
-
BEGIN_POS
- See Also:
-
END_POS
- See Also:
-
GROUPING_KEY
- See Also:
-
PARQUET_FILE_EXTENSION
- See Also:
-
-
Constructor Details
-
ParquetTableWriter
public ParquetTableWriter()
-
-
Method Details
-
write
public static void write(@NotNull @NotNull Table t, @NotNull @NotNull TableDefinition definition, @NotNull @NotNull ParquetInstructions writeInstructions, @NotNull @NotNull String destPathName, @NotNull @NotNull Map<String, String> incomingMeta, Map<String, throws SchemaMappingException, IOExceptionParquetTableWriter.GroupingColumnWritingInfo> groupingColumnsWritingInfoMap) Writes a table in parquet format under a given path- Parameters:
t- The table to writedefinition- Table definitionwriteInstructions- Write instructions for customizations while writingdestPathName- The destination pathincomingMeta- A map of metadata values to be stores in the file footer- Throws:
SchemaMappingException- Error creating a parquet table schema for the given table (likely due to unsupported types)IOException- For file writing related errors
-
write
public static void write(@NotNull @NotNull Table table, @NotNull @NotNull TableDefinition definition, @NotNull @NotNull ParquetInstructions writeInstructions, @NotNull @NotNull String path, @NotNull @NotNull Map<String, String> tableMeta, @NotNull TableInfo.Builder tableInfoBuilder) throws SchemaMappingException, IOExceptionWrites a table in parquet format under a given path- Parameters:
table- The table to writedefinition- The table definitionwriteInstructions- Write instructions for customizations while writingpath- The destination pathtableMeta- A map of metadata values to be stores in the file footertableInfoBuilder- A partially-constructed builder for the metadata object- Throws:
SchemaMappingException- Error creating a parquet table schema for the given table (likely due to unsupported types)IOException- For file writing related errors
-