Package io.deephaven.enterprise.replay

Class WritableReplayDatabase

java.lang.Object
io.deephaven.enterprise.replay.ReplayDatabase
io.deephaven.enterprise.replay.WritableReplayDatabase
All Implemented Interfaces:
Database, DatabaseInternal, WritableDatabase
public class WritableReplayDatabase extends ReplayDatabase implements WritableDatabase, DatabaseInternal
A ReplayDatabase that also wraps a WritableDatabase.

No changes are made to the WritableDatabase operations, they are simply delegated to the underlying WritableDatabase.

  • Constructor Details

    • WritableReplayDatabase

      public WritableReplayDatabase(@NotNull @NotNull Clock replayClock, @NotNull @NotNull WritableDatabase wrappedWritable, @NotNull @NotNull Database wrapped, @NotNull @NotNull io.deephaven.shadow.enterprise.com.illumon.iris.db.tables.databases.ReplaySettings replaySettings, @NotNull @NotNull ReplayConfigurationImpl replayConfiguration)
      Create a new WritableReplayDatabase that wraps an underlying database.
      Parameters:
      replayClock - the clock for replaying data
      wrappedWritable - the WritableDatabase to wrap, very likely the same as wrapped
      wrapped - the Database to wrap, very likely the same as wrappedWritable
      replaySettings - the replay settings from the persistent query
      replayConfiguration - the per-table replay configuration

  • Method Details

    • addUnpartitionedTable

      public void addUnpartitionedTable(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull Table table)
      Description copied from interface: WritableDatabase

      Adds an unpartitioned user table.

      Writes an unpartitioned user table to disk. If the namespace does not exist, then it is created. The schema must not already exist.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      addUnpartitionedTable in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      table - table that the definition and data will be based on

    • deleteUnpartitionedTable

      public boolean deleteUnpartitionedTable(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName)
      Description copied from interface: WritableDatabase
      Deletes an unpartitioned user table and the schema.

      If the schema does not exist, then data is not deleted. If there is no data but the schema exists, then the schema is deleted.

      The namespace is not removed even if this is the last table in the namespace.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      deleteUnpartitionedTable in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      Returns:
      true if the data was deleted, false if there was no data or preexisting schema

    • addPartitionedTableSchema

      public boolean addPartitionedTableSchema(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull String partitionColumnName, @NotNull @NotNull TableDefinition prototype)
      Description copied from interface: WritableDatabase
      Adds a schema for a partitioned user table.

      The schema is derived from the prototype TableDefinition and the partitionColumnName parameter. The prototype definition must not include a partitioning column.

      If the namespace does not exist, then it is created.

      If the schema already exists and it is identical (this is a stricter check than compatibility; all columns must be present in the same order with the same properties), then the method returns false. If the schema already exists and is not identical, then an error is thrown.

      Specified by:
      addPartitionedTableSchema in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      partitionColumnName - name of the partitioning column
      prototype - table definition to derive schema from
      Returns:
      true if the partitioned table schema was added, false if it already existed

    • updatePartitionedTableSchema

      public boolean updatePartitionedTableSchema(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull TableDefinition prototype)
      Description copied from interface: WritableDatabase
      Updates a preexisting User table schema.

      If the schema does not exist an error is thrown. Not all schema modifications are permitted. The partitioning column may not be changed. Existing columns may not have their type changed. Columns may be added or deleted.

      Note that no data is modified by this operation. Removed columns remain on persistent storage, and added columns are treated as null on read.

      Although each modification in isolation is verified for safety, a sequence of modifications to the schema may be unsafe. For example, deleting a column and adding it back with a new type results in unreadable data.

      Specified by:
      updatePartitionedTableSchema in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      prototype - table definition to derive schema from
      Returns:
      true if the partitioned table schema was updated, false if there was already an identical definition

    • addTablePartition

      public void addTablePartition(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull String partitionColumnValue, @NotNull @NotNull Table table)
      Description copied from interface: WritableDatabase
      Adds a single column partition of data to a partitioned user table.

      The data table must have a mutually compatible definition with the current schema. The data table must not have a column with the same name as the partitioning column.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      addTablePartition in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      partitionColumnValue - value for the partitioning column, e.g. "2015-09-25" for "Date"
      table - table to write data from

    • deleteTablePartition

      public boolean deleteTablePartition(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull String partitionColumnValue)
      Description copied from interface: WritableDatabase
      Deletes a single column partition of data from a partitioned user table.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      deleteTablePartition in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      partitionColumnValue - value for the partitioning column, e.g. "2015-09-25" for "Date"
      Returns:
      true if the partition was deleted, false if there was no partition or preexisting schema

    • appendLiveTable

      public void appendLiveTable(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull String partitionColumnValue, @NotNull @NotNull Table table)
      Description copied from interface: WritableDatabase
      Appends all rows from a given table to a live user table partition.

      The data table must have a mutually compatible definition with the current schema. The data table must not have a column with the same name as the partitioning column.

      The specified column partition may already exist, or may be created by the system.

      This method is asynchronous. After returning, the data may not be immediately available. It is possible for the write to fail after this method has returned. When multiple workers append to a partition, ordering is imposed outside the worker by other system components.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      appendLiveTable in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      partitionColumnValue - value for the partitioning column, e.g. "2015-09-25" for "Date"
      table - table to append rows from

    • appendLiveTableIncremental

      public SafeCloseable appendLiveTableIncremental(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull String partitionColumnValue, @NotNull @NotNull Table table)
      Description copied from interface: WritableDatabase
      Appends all rows from a given table to a live user table partition. When rows are added to the table, they are additionally appended to the table.

      The input table updates can only have additions and shifts. No modifications or removals are permitted.

      The data table must have a mutually compatible definition with the current schema. The data table must not have a column with the same name as the partitioning column.

      The specified column partition may already exist, or may be created by the system.

      This method is asynchronous, after returning the data may not be immediately available. It is possible for the write to fail after this method has returned. When multiple workers append to a partition, ordering is imposed outside the worker by other system components.

      A reference must be maintained to the returned SafeCloseable to ensure expected functionality; calling SafeCloseable.close() will stop incremental appends, and clean up related resources.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      appendLiveTableIncremental in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      partitionColumnValue - value for the partitioning column, e.g. "2015-09-25" for "Date"
      table - table to append updates from
      Returns:
      the Closeable reference used to ensure and stop expected functionality

    • deleteLiveTablePartition

      public boolean deleteLiveTablePartition(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull String partitionColumnValue)
      Description copied from interface: WritableDatabase
      Delete a partition from a live user table.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      deleteLiveTablePartition in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      partitionColumnValue - value for the partitioning column, e.g. "2015-09-25" for "Date"
      Returns:
      true if the partition was deleted, false if there was no partition or preexisting schema

    • deletePartitionedTable

      public boolean deletePartitionedTable(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName)
      Description copied from interface: WritableDatabase
      Delete all partitions, whether direct or live, and the schema, from a partitioned user table.

      All partitions from the table are deleted sequentially. If a partition cannot be deleted, then the operation fails but some data may have already been removed. After all partitions are deleted, then the schema is deleted. If the schema does not exist, then data is not deleted. If there is no data, but the schema exists, then the schema is deleted.

      The namespace is not removed, even if this is the last table in the namespace.

      If a UserTableIOException is thrown, the state of the table is undefined.

      Specified by:
      deletePartitionedTable in interface WritableDatabase
      Parameters:
      namespace - table namespace
      tableName - table name
      Returns:
      true if data was deleted, false if there was no data or preexisting schema

    • addInputTableSchema

      public boolean addInputTableSchema(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull InputTableSpec inputTableSpec)
      Description copied from interface: WritableDatabase
      Add a new input table schema using the InputTableSpec.
      Specified by:
      addInputTableSchema in interface WritableDatabase
      Parameters:
      namespace - the namespace of the input table
      tableName - the name of the input table
      inputTableSpec - the input table specification
      Returns:
      true if the input table schema was added, false if the input table already exists with the same spec

    • addInputTableSchema

      public boolean addInputTableSchema(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, @NotNull @NotNull TableDefinition prototype, @NotNull @NotNull String... keyColNames)
      Description copied from interface: WritableDatabase
      Add a new input table schema using the TableDefinition and specified key column names.
      Specified by:
      addInputTableSchema in interface WritableDatabase
      Parameters:
      namespace - the namespace of the input table
      tableName - the name of the input table
      prototype - TableDefinition to derive the input table spec from
      keyColNames - columns that should be keyed in the input table
      Returns:
      true if the input table schema was added, false if the input table already exists with the same spec

    • updateInputTableSchema

      public boolean updateInputTableSchema(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName, InputTableSpec inputTableSpec)
      Description copied from interface: WritableDatabase
      Update an existing input table schema using the provided InputTableSpec.

      Retrieve and use a new InputTableUpdater via WritableDatabase.inputTableUpdater(String, String) after updating an input table's specification to ensure proper behavior.

      Specified by:
      updateInputTableSchema in interface WritableDatabase
      Parameters:
      namespace - the namespace of the input table
      tableName - the name of the input table
      inputTableSpec - the new specification for the input table
      Returns:
      true if the input table schema was updated, false if the input table already exists with the same spec

    • deleteInputTable

      public boolean deleteInputTable(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName)
      Description copied from interface: WritableDatabase
      Delete the input table given the namespace and table name.
      Specified by:
      deleteInputTable in interface WritableDatabase
      Parameters:
      namespace - the namespace of the input table
      tableName - the name of the input table
      Returns:
      true if the input table was deleted, false if there was no data or preexisting schema for the input table

    • inputTableUpdater

      public InputTableUpdater inputTableUpdater(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName)
      Description copied from interface: WritableDatabase
      Retrieve the specified InputTableUpdater, which can be used to programmatically add or delete rows.
      Specified by:
      inputTableUpdater in interface WritableDatabase
      Parameters:
      namespace - the namespace in which the table exists.
      tableName - the name of the table in the namespace.
      Returns:
      an InputTableUpdater for the specified input table.

    • inputTable

      public Table inputTable(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName)
      Description copied from interface: WritableDatabase
      Retrieve the specified input table view.
      Specified by:
      inputTable in interface WritableDatabase
      Parameters:
      namespace - the namespace in which the table exists.
      tableName - the name of the table in the namespace.
      Returns:
      a table view for the specified input table.

    • inputTableSpecFor

      public InputTableSpec inputTableSpecFor(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName)
      Description copied from interface: WritableDatabase
      Retrieve the current InputTableSpec for the given namespace and table.
      Specified by:
      inputTableSpecFor in interface WritableDatabase
      Parameters:
      namespace - the namespace of the input table
      tableName - the name of the input table
      Returns:
      the current input table specification for the given namespace and table

    • isInputTable

      public boolean isInputTable(@NotNull @NotNull String namespace, @NotNull @NotNull String tableName)
      Description copied from interface: WritableDatabase
      Determines whether a table is a Core+ input table.
      Specified by:
      isInputTable in interface WritableDatabase
      Parameters:
      namespace - the namespace of the input table
      tableName - the name of the input table
      Returns:
      true if the table is an input table, false if not

    • getUserContext

      public UserContext getUserContext()
      Specified by:
      getUserContext in interface DatabaseInternal