Package io.deephaven.engine.table.impl

Class PartitionAwareSourceTable

java.lang.Object

io.deephaven.util.referencecounting.ReferenceCounted

io.deephaven.engine.liveness.ReferenceCountedLivenessReferent

io.deephaven.engine.liveness.ReferenceCountedLivenessNode

io.deephaven.engine.liveness.LivenessArtifact

io.deephaven.engine.table.impl.LiveAttributeMap<IFACE_TYPE,IMPL_TYPE>

io.deephaven.engine.table.impl.BaseGridAttributes<Table,IMPL_TYPE>

io.deephaven.engine.table.impl.BaseTable<IMPL_TYPE>

io.deephaven.engine.table.impl.UncoalescedTable<IMPL_TYPE>

io.deephaven.engine.table.impl.RedefinableTable<IMPL_TYPE>

io.deephaven.engine.table.impl.SourceTable<PartitionAwareSourceTable>

io.deephaven.engine.table.impl.PartitionAwareSourceTable

All Implemented Interfaces:

TableOperations<Table,Table>, TableOperationsDefaults<Table,Table>, LogOutputAppendable, LivenessManager, LivenessNode, LivenessReferent, AttributeMap<Table>, GridAttributes<Table>, HasParentPerformanceIds, HasRefreshingSource, NotificationStepReceiver, NotificationStepSource, TableDefaults, Table, DynamicNode, NotificationQueue.Dependency, SystemicObject<Table>, LongSizedDataStructure, Serializable

Direct Known Subclasses:

IcebergTableImpl

public class PartitionAwareSourceTable
extends SourceTable<PartitionAwareSourceTable>

A source table that can filter partitions before coalescing. Refer to TableLocationKey for an explanation of partitioning.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class io.deephaven.engine.table.impl.BaseTable

BaseTable.CopyAttributeOperation, BaseTable.ListenerImpl, BaseTable.ShiftObliviousListenerImpl, BaseTable.SnapshotControlFactory<T extends ConstructSnapshot.SnapshotControl>

Field Summary

Fields inherited from class io.deephaven.engine.table.impl.BaseTable

definition, PRINT_SERIALIZED_UPDATE_OVERLAPS, updateGraph, VALIDATE_UPDATE_OVERLAPS

Fields inherited from interface io.deephaven.engine.table.GridAttributes

COLUMN_DESCRIPTIONS_ATTRIBUTE, DESCRIPTION_ATTRIBUTE, LAYOUT_HINTS_ATTRIBUTE, SORTABLE_COLUMNS_ATTRIBUTE

Fields inherited from interface io.deephaven.engine.table.impl.NotificationStepReceiver

NULL_NOTIFICATION_STEP

Fields inherited from interface io.deephaven.engine.table.Table

ADD_ONLY_TABLE_ATTRIBUTE, AGGREGATION_ROW_LOOKUP_ATTRIBUTE, APPEND_ONLY_TABLE_ATTRIBUTE, BARRAGE_PERFORMANCE_KEY_ATTRIBUTE, BARRAGE_SCHEMA_ATTRIBUTE, BLINK_TABLE_ATTRIBUTE, FILTERABLE_COLUMNS_ATTRIBUTE, INITIALLY_EMPTY_COALESCED_SOURCE_TABLE_ATTRIBUTE, INPUT_TABLE_ATTRIBUTE, KEY_COLUMNS_ATTRIBUTE, MERGED_TABLE_ATTRIBUTE, NON_DISPLAY_TABLE, PLUGIN_NAME, PREVIEW_PARENT_TABLE, SNAPSHOT_VIEWPORT_TYPE, SORT_REVERSE_LOOKUP_ATTRIBUTE, SORT_ROW_REDIRECTION_ATTRIBUTE, SORTED_COLUMNS_ATTRIBUTE, SYSTEMIC_TABLE_ATTRIBUTE, TEST_SOURCE_TABLE_ATTRIBUTE, TOTALS_TABLE_ATTRIBUTE, UNIQUE_KEYS_ATTRIBUTE

Fields inherited from interface io.deephaven.engine.table.impl.TableDefaults

ZERO_LENGTH_TABLE_ARRAY

Fields inherited from interface io.deephaven.api.TableOperations

AGG_BY_PRESERVE_EMPTY_DEFAULT

Fields inherited from interface io.deephaven.api.TableOperationsDefaults

ZERO_LENGTH_COLUMNNAME_ARRAY, ZERO_LENGTH_FILTER_ARRAY

Constructor Summary

Constructors

Constructor	Description
PartitionAwareSourceTable(@NotNull TableDefinition tableDefinition, @NotNull String description, @NotNull SourceTableComponentFactory componentFactory, @NotNull TableLocationProvider locationProvider, @Nullable UpdateSourceRegistrar updateSourceRegistrar)

Method Summary

Modifier and Type	Method	Description
protected PartitionAwareSourceTable	copy()	Create a copy of this with initially-shared LiveAttributeMap.mutableAttributes.
protected final Collection<LiveSupplier<ImmutableTableLocationKey>>	filterLocationKeys(@NotNull Collection<LiveSupplier<ImmutableTableLocationKey>> foundLocationKeys)	Hook to allow found location keys to be filtered (e.g.
protected PartitionAwareSourceTable	newInstance(@NotNull TableDefinition tableDefinition, @NotNull String description, @NotNull SourceTableComponentFactory componentFactory, @NotNull TableLocationProvider locationProvider, @Nullable UpdateSourceRegistrar updateSourceRegistrar, @NotNull Map<String,ColumnDefinition<?>> partitioningColumnDefinitions, @Nullable WhereFilter... partitioningColumnFilters)
protected final BaseTable<?>	redefine(@NotNull TableDefinition newDefinition)	Redefine this table with a subset of its current columns.
protected final Table	redefine(TableDefinition newDefinitionExternal, TableDefinition newDefinitionInternal, SelectColumn[] viewColumns)	Redefine this table with a subset of its current columns, with a potentially-differing definition to present to external interfaces and one or more select columns to apply.
final Table	selectDistinct(@NotNull Collection<? extends Selectable> columns)
Table	where(Filter filter)

Methods inherited from class io.deephaven.engine.table.impl.SourceTable

destroy, doCoalesce, getRowSet, initialize, refresh, sourceEntries, tableLocationProvider

Methods inherited from class io.deephaven.engine.table.impl.RedefinableTable

dropColumns, renameColumns, updateView, view

Methods inherited from class io.deephaven.engine.table.impl.UncoalescedTable

addUpdateListener, addUpdateListener, addUpdateListener, addUpdateListenerUncoalesced, addUpdateListenerUncoalesced, aggAllBy, aggBy, apply, asOfJoin, awaitUpdate, awaitUpdate, byteColumnIterator, characterColumnIterator, coalesce, columnIterator, doubleColumnIterator, exactJoin, flatten, floatColumnIterator, getCoalesced, getColumnSource, getColumnSourceMap, getColumnSources, getSubTable, head, headBy, headPct, integerColumnIterator, isFlat, join, lazyUpdate, longColumnIterator, moveColumns, naturalJoin, objectColumnIterator, objectColumnIterator, partitionBy, partitionedAggBy, rangeJoin, removeUpdateListener, removeUpdateListener, removeUpdateListenerUncoalesced, reverse, rollup, select, setCoalesced, shortColumnIterator, size, sizeForInstrumentation, slice, slicePct, snapshot, snapshotWhen, sort, tail, tailBy, tailPct, tree, ungroup, update, updateBy, whereIn, whereNotIn, wouldMatch

Methods inherited from class io.deephaven.engine.table.impl.BaseTable

addParentReference, append, assertAddOnly, assertAppendOnly, assertBlink, checkAvailableColumns, copyAttributes, copyAttributes, copySortableColumns, createSnapshotControlIfRefreshing, getDefinition, getDescription, getLastNotificationStep, getNotificationQueue, getUpdateGraph, hasListeners, initializeWithSnapshot, isAddOnly, isAppendOnly, isBlink, isFailed, isRefreshing, isSystemicObject, markSystemic, notifyListeners, notifyListeners, notifyListenersOnError, parentPerformanceEntryIds, removeBlink, satisfied, setLastNotificationStep, setRefreshing, setTotalsTable, shouldCopyAttribute, toString, withKeys, withUniqueKeys

Methods inherited from class io.deephaven.engine.table.impl.BaseGridAttributes

clearSortingRestrictions, getSortableColumns, restrictSortTo, setColumnDescriptions, setLayoutHints, setSortableColumns, withColumnDescription, withColumnDescriptions, withDescription

Methods inherited from class io.deephaven.engine.table.impl.LiveAttributeMap

copyAttributes, getAttribute, getAttributeKeys, getAttributes, getAttributes, hasAttribute, prepareReturnCopy, prepareReturnThis, published, retainingAttributes, setAttribute, setAttribute, withAttributes, withAttributes, withoutAttributes

Methods inherited from class io.deephaven.engine.liveness.LivenessArtifact

manageWithCurrentScope

Methods inherited from class io.deephaven.engine.liveness.ReferenceCountedLivenessNode

getWeakReference, initializeTransientFieldsForLiveness, onReferenceCountAtZero, tryManage, tryUnmanage, tryUnmanage

Methods inherited from class io.deephaven.engine.liveness.ReferenceCountedLivenessReferent

dropReference, tryRetainReference

Methods inherited from class io.deephaven.util.referencecounting.ReferenceCounted

decrementReferenceCount, forceReferenceCountToZero, getReferenceCountDebug, incrementReferenceCount, resetReferenceCount, tryDecrementReferenceCount, tryIncrementReferenceCount

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface io.deephaven.engine.table.AttributeMap

getAttribute, getAttributeKeys, getAttributes, getAttributes, hasAttribute, retainingAttributes, withAttributes, withAttributes, withoutAttributes

Methods inherited from interface io.deephaven.engine.table.GridAttributes

clearSortingRestrictions, restrictSortTo, setLayoutHints, withColumnDescription, withColumnDescriptions, withDescription

Methods inherited from interface io.deephaven.engine.liveness.LivenessManager

manage, tryManage, tryUnmanage, tryUnmanage, unmanage, unmanage

Methods inherited from interface io.deephaven.engine.liveness.LivenessReferent

dropReference, getReferentDescription, getWeakReference, retainReference, tryRetainReference

Methods inherited from interface io.deephaven.util.datastructures.LongSizedDataStructure

intSize, intSize

Methods inherited from interface io.deephaven.engine.updategraph.NotificationQueue.Dependency

getUpdateGraph

Methods inherited from interface io.deephaven.engine.table.impl.NotificationStepReceiver

initializeLastNotificationStep

Methods inherited from interface io.deephaven.engine.table.impl.TableDefaults

addUpdateListener, applyToAllBy, applyToAllBy, applyToAllBy, close, dropColumnFormats, formatColumns, formatColumnWhere, formatRowWhere, getColumnSource, getColumnSource, hasColumns, hasColumns, headBy, isEmpty, join, meta, moveColumnsDown, moveColumnsUp, numColumns, partitionBy, releaseCachedResources, renameAllColumns, renameColumns, rollup, rollup, rollup, rollup, rollup, selectDistinct, snapshotWhen, snapshotWhen, tailBy, wouldMatch

Methods inherited from interface io.deephaven.api.TableOperationsDefaults

absSumBy, absSumBy, absSumBy, absSumBy, aggAllBy, aggAllBy, aggAllBy, aggBy, aggBy, aggBy, aggBy, aggBy, aggBy, aggBy, aj, aj, avgBy, avgBy, avgBy, avgBy, countBy, countBy, countBy, countBy, dropColumns, dropColumns, exactJoin, exactJoin, firstBy, firstBy, firstBy, firstBy, groupBy, groupBy, groupBy, join, join, join, lastBy, lastBy, lastBy, lastBy, lazyUpdate, maxBy, maxBy, maxBy, maxBy, medianBy, medianBy, medianBy, medianBy, minBy, minBy, minBy, minBy, naturalJoin, naturalJoin, naturalJoin, naturalJoin, naturalJoin, raj, raj, rangeJoin, select, select, selectDistinct, sort, sortDescending, stdBy, stdBy, stdBy, stdBy, sumBy, sumBy, sumBy, sumBy, ungroup, ungroup, ungroup, ungroup, update, updateBy, updateBy, updateBy, updateBy, updateBy, updateBy, updateBy, updateBy, updateView, varBy, varBy, varBy, varBy, view, wavgBy, wavgBy, wavgBy, wavgBy, where, whereIn, whereNotIn, wsumBy, wsumBy, wsumBy, wsumBy

Constructor Details

PartitionAwareSourceTable

public PartitionAwareSourceTable(@NotNull
 @NotNull TableDefinition tableDefinition,
 @NotNull
 @NotNull String description,
 @NotNull
 @NotNull SourceTableComponentFactory componentFactory,
 @NotNull
 @NotNull TableLocationProvider locationProvider,
 @Nullable
 @Nullable UpdateSourceRegistrar updateSourceRegistrar)

Parameters:

tableDefinition - A TableDefinition

description - A human-readable description for this table

componentFactory - A component factory for creating column source managers

locationProvider - A TableLocationProvider, for use in discovering the locations that compose this table

updateSourceRegistrar - Callback for registering live tables for refreshes, null if this table is not live

Method Details

newInstance

protected PartitionAwareSourceTable newInstance(@NotNull
 @NotNull TableDefinition tableDefinition,
 @NotNull
 @NotNull String description,
 @NotNull
 @NotNull SourceTableComponentFactory componentFactory,
 @NotNull
 @NotNull TableLocationProvider locationProvider,
 @Nullable
 @Nullable UpdateSourceRegistrar updateSourceRegistrar,
 @NotNull
 @NotNull Map<String,ColumnDefinition<?>> partitioningColumnDefinitions,
 @Nullable
 @Nullable WhereFilter... partitioningColumnFilters)

copy

protected PartitionAwareSourceTable copy()

Description copied from class: LiveAttributeMap

Create a copy of this with initially-shared LiveAttributeMap.mutableAttributes.

Specified by:

copy in class LiveAttributeMap<Table,PartitionAwareSourceTable>

redefine

protected final BaseTable<?> redefine(@NotNull
 @NotNull TableDefinition newDefinition)

Description copied from class: RedefinableTable

Redefine this table with a subset of its current columns.

Specified by:

redefine in class RedefinableTable<PartitionAwareSourceTable>

Parameters:

newDefinition - A TableDefinition with a subset of this RedefinableTable's ColumnDefinitions.

Returns:

the redefined table

redefine

protected final Table redefine(TableDefinition newDefinitionExternal,
 TableDefinition newDefinitionInternal,
 SelectColumn[] viewColumns)

Description copied from class: RedefinableTable

Redefine this table with a subset of its current columns, with a potentially-differing definition to present to external interfaces and one or more select columns to apply.

Specified by:

redefine in class RedefinableTable<PartitionAwareSourceTable>

Parameters:

newDefinitionExternal - A TableDefinition that represents the results of redefine(newDefinitionInternal).view(viewColumns).

newDefinitionInternal - A TableDefinition with a subset of this RedefinableTable's ColumnDefinitions.

viewColumns - A set of SelectColumns to apply in order to transform a table with newDefinitionInternal to a table with newDefinitionExternal.

Returns:

the redefined table

filterLocationKeys

protected final Collection<LiveSupplier<ImmutableTableLocationKey>> filterLocationKeys(@NotNull
 @NotNull Collection<LiveSupplier<ImmutableTableLocationKey>> foundLocationKeys)

Description copied from class: SourceTable

Hook to allow found location keys to be filtered (e.g. according to a where-clause on the partitioning columns of a PartitionAwareSourceTable. The default implementation returns its input unmolested.

Overrides:

filterLocationKeys in class SourceTable<PartitionAwareSourceTable>

Parameters:

foundLocationKeys - A collection of ImmutableTableLocationKeys fetched from the TableLocationProvider, but not yet incorporated into the table

Returns:

A sub-collection of the input

where

public Table where(Filter filter)

Specified by:

where in interface TableOperations<Table,Table>

Overrides:

where in class UncoalescedTable<PartitionAwareSourceTable>

selectDistinct

public final Table selectDistinct(@NotNull
 @NotNull Collection<? extends Selectable> columns)

Specified by:

selectDistinct in interface TableOperations<Table,Table>

Overrides:

selectDistinct in class UncoalescedTable<PartitionAwareSourceTable>