Package io.deephaven.engine.table.impl.naturaljoin

Class IncrementalNaturalJoinStateManagerTypedBase

java.lang.Object

io.deephaven.engine.table.impl.StaticNaturalJoinStateManager

io.deephaven.engine.table.impl.naturaljoin.IncrementalNaturalJoinStateManagerTypedBase

All Implemented Interfaces:

BothIncrementalNaturalJoinStateManager, IncrementalNaturalJoinStateManager

public abstract class IncrementalNaturalJoinStateManagerTypedBase
extends StaticNaturalJoinStateManager
implements IncrementalNaturalJoinStateManager, BothIncrementalNaturalJoinStateManager

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	IncrementalNaturalJoinStateManagerTypedBase.BuildContext
static class	IncrementalNaturalJoinStateManagerTypedBase.ProbeContext

Nested classes/interfaces inherited from interface io.deephaven.engine.table.impl.BothIncrementalNaturalJoinStateManager

BothIncrementalNaturalJoinStateManager.InitialBuildContext

Field Summary

Fields

Modifier and Type	Field	Description
protected long	alternateEntries	How many entries are in the alternate table (includes tombstones)?
protected int	alternateInsertMask
protected final WritableColumnSource[]	alternateKeySources
protected ImmutableObjectArraySource<WritableRowSet>	alternateLeftRowSet
protected ImmutableLongArraySource	alternateModifiedTrackerCookieSource
protected ImmutableLongArraySource	alternateRightRowKey
protected int	alternateTableSize
protected final ChunkType[]	chunkTypes
protected it.unimi.dsi.fastutil.longs.LongArrayList	freeDuplicateValues
protected long	liveEntries	How many values do we have that are live (in both main and alternate)?
protected int	mainInsertMask
protected final WritableColumnSource[]	mainKeySources
protected ImmutableObjectArraySource<WritableRowSet>	mainLeftRowSet
protected ImmutableLongArraySource	mainModifiedTrackerCookieSource
protected ImmutableLongArraySource	mainRightRowKey	We use a RowSet.NULL_ROW_KEY for a state that exists, but has no right hand side; the column sources are initialized with NULL_LONG for something that does not exist.
protected long	nextDuplicateRightSide
protected long	numEntries	How many entries are taking up slots in the main hash table (includes tombstones)?
static final int	REHASH_SLOTS_PER_ENTRY	The alternate slots a partial rehash examines for each entry about to be built.
protected int	rehashPointer
protected ObjectArraySource<WritableRowSet>	rightSideDuplicateRowSets
protected int	tableSize

Fields inherited from class io.deephaven.engine.table.impl.StaticNaturalJoinStateManager

addOnly, DUPLICATE_RIGHT_VALUE, joinType, keySourcesForErrorMessages, NO_RIGHT_ENTRY_VALUE

Fields inherited from interface io.deephaven.engine.table.impl.IncrementalNaturalJoinStateManager

EMPTY_RIGHT_STATE, FIRST_DUPLICATE, TOMBSTONE_RIGHT_STATE

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	IncrementalNaturalJoinStateManagerTypedBase(ColumnSource<?>[] tableKeySources, ColumnSource<?>[] keySourcesForErrorMessages, int tableSize, double maximumLoadFactor, NaturalJoinType joinType, boolean addOnly)

Method Summary

Modifier and Type	Method	Description
protected abstract void	addLeftSide(RowSequence rowSequence, Chunk[] sourceKeyChunks, LongArraySource leftRedirections, long redirectionOffset, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	addLeftSide(Context bc, RowSequence leftRowSet, ColumnSource<?>[] leftSources, LongArraySource leftRedirections, @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker, boolean addedToTable)	Add left rows to their key's slots, storing each row's right redirection (by position) in leftRedirections.
protected abstract void	addRightSide(RowSequence rowSequence, Chunk[] sourceKeyChunks, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	addRightSide(Context bc, RowSequence rightRowSet, ColumnSource<?>[] rightSources, @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)
protected abstract void	adviseNewAlternate()	After creating the new alternate key states, advise the derived classes, so they can cast them to the typed versions of the column source and adjust the derived class pointers.
protected long	allocateDuplicateLocation()
protected abstract void	applyLeftShift(RowSequence rowSequence, Chunk[] sourceKeyChunks, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	applyLeftShift(Context pc, ColumnSource<?>[] leftSources, RowSet shiftedRowSet, long shiftDelta, @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)	Move the left rows of one shift range within their slots' left row sets.
protected abstract void	applyRightShift(RowSequence rowSequence, Chunk[] sourceKeyChunks, long shiftDelta, NaturalJoinModifiedSlotTracker modifiedSlotTracker, IncrementalNaturalJoinStateManagerTypedBase.ProbeContext pc)
void	applyRightShift(Context pc, ColumnSource<?>[] rightSources, RowSet shiftedRowSet, long shiftDelta, @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)
protected abstract void	buildFromLeftSide(RowSequence rowSequence, Chunk[] sourceKeyChunks)
protected abstract void	buildFromRightSide(RowSequence rowSequence, Chunk[] sourceKeyChunks)
void	buildFromRightSide(Table rightTable, ColumnSource<?>[] rightSources)
WritableRowRedirection	buildIndexedRowRedirection(QueryTable leftTable, BothIncrementalNaturalJoinStateManager.InitialBuildContext ibc, ColumnSource<RowSet> indexRowSets, JoinControl.RedirectionType redirectionType)
WritableRowRedirection	buildRowRedirectionFromRedirections(QueryTable leftTable, BothIncrementalNaturalJoinStateManager.InitialBuildContext ibc, JoinControl.RedirectionType redirectionType)
protected void	buildTable(boolean initialBuild, IncrementalNaturalJoinStateManagerTypedBase.BuildContext bc, RowSequence buildRows, ColumnSource<?>[] buildSources, TypedHasherUtil.BuildHandler buildHandler, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
protected void	clearAlternate()	Drop the alternate table once every live entry has migrated to the main table.
void	compactAll()
int	computeTableSize(int nextChunkSize, int alternateSize, boolean fullRehash)
void	decorateLeftSide(RowSet leftRows, ColumnSource<?>[] leftSources, BothIncrementalNaturalJoinStateManager.InitialBuildContext ibc)
void	decorateLeftSide(RowSet leftRowSet, ColumnSource<?>[] leftSources, LongArraySource leftRedirections)
boolean	doRehash(boolean fullRehash, MutableInt rehashCredits, int nextChunkSize, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
protected long	duplicateLocationFromRowKey(long rowKey)
protected void	freeDuplicateLocation(long duplicateLocation)
RowSet	getLeftRowSet(int slot)
long	getRightRowKey(int slot)
RowSet	getRightRowSet(int slot)
protected int	hashToTableLocation(int hash)
protected int	hashToTableLocationAlternate(int hash)
String	keyString(int slot)
IncrementalNaturalJoinStateManagerTypedBase.BuildContext	makeBuildContext(ColumnSource<?>[] buildSources, long maxSize)
BothIncrementalNaturalJoinStateManager.InitialBuildContext	makeInitialBuildContext()
IncrementalNaturalJoinStateManagerTypedBase.ProbeContext	makeProbeContext(ColumnSource<?>[] buildSources, long maxSize)
protected abstract void	migrateFront(NaturalJoinModifiedSlotTracker modifiedSlotTracker)
protected abstract void	modifyByRight(RowSequence rowSequence, Chunk[] sourceKeyChunks, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	modifyByRight(Context pc, RowSet modified, ColumnSource<?>[] rightSources, @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)
protected void	probeTable(IncrementalNaturalJoinStateManagerTypedBase.ProbeContext pc, RowSequence probeRows, boolean usePrev, ColumnSource<?>[] probeSources, TypedHasherUtil.ProbeHandler handler)
protected abstract void	rehashInternalFull(int oldSize)
protected abstract int	rehashInternalPartial(int numEntriesToRehash, NaturalJoinModifiedSlotTracker modifiedSlotTracker)	Migrate entries from the alternate table, examining REHASH_SLOTS_PER_ENTRY alternate slots, whether they hold a live entry, a tombstone or nothing, for each entry's worth of work requested.
boolean	rehashRequired(int nextChunkSize)
protected abstract void	removeLeft(RowSequence rowSequence, Chunk[] sourceKeyChunks, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	removeLeft(Context pc, RowSequence leftIndex, ColumnSource<?>[] leftSources, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	removeLeftModifications(ColumnSource<?>[] leftSources, RowSet modifiedPreShift, RowSet modifiedPostShift, RowSetBuilderSequential changedPreShift, RowSetBuilderSequential changedPostShift, NaturalJoinModifiedSlotTracker modifiedSlotTracker)	In a single pass over the modified left rows, determine which rows' key value actually changed (by comparing the current key values at the post-shift row keys with the previous key values at the pre-shift row keys), remove those changed rows from their previous-key hash slots, and report the changed keys.
protected abstract void	removeRight(RowSequence rowSequence, Chunk[] sourceKeyChunks, NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	removeRight(Context pc, RowSequence rightRowSet, ColumnSource<?>[] rightSources, @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)
void	removeRightModifications(ColumnSource<?>[] rightSources, RowSet modifiedPreShift, RowSet modifiedPostShift, RowSetBuilderSequential changedPreShift, RowSetBuilderSequential changedPostShift, @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)	The right-side counterpart of BothIncrementalNaturalJoinStateManager.removeLeftModifications(io.deephaven.engine.table.ColumnSource<?>[], io.deephaven.engine.rowset.RowSet, io.deephaven.engine.rowset.RowSet, io.deephaven.engine.rowset.RowSetBuilderSequential, io.deephaven.engine.rowset.RowSetBuilderSequential, io.deephaven.engine.table.impl.NaturalJoinModifiedSlotTracker): in a single pass over the modified right rows, determine which rows' key value actually changed, remove those rows from their previous-key hash slots, and report the changed keys.
protected long	rowKeyFromDuplicateLocation(long duplicateLocation)
protected void	tombstoneSlot(boolean main, long location, NaturalJoinModifiedSlotTracker modifiedSlotTracker)	Mark a slot dead once its last left row and last right row are gone.

Methods inherited from class io.deephaven.engine.table.impl.StaticNaturalJoinStateManager

buildRowRedirection, checkExactMatch, extractKeyStringFromSourceTable

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.deephaven.engine.table.impl.IncrementalNaturalJoinStateManager

addRightRowKeyToDuplicates, checkExactMatch, duplicateCreationChangesState, getRightRowKeyFromDuplicates, removeRightRowKeyFromDuplicates, shiftOneKey

Field Details

REHASH_SLOTS_PER_ENTRY

public static final int REHASH_SLOTS_PER_ENTRY

The alternate slots a partial rehash examines for each entry about to be built. Bounding the slots examined, rather than the live entries moved, keeps one build from scanning a long run of tombstones and empty slots; computeTableSize(int, int, boolean) sizes a new table so that the alternate still drains before the new table fills. That requires a maximum load factor greater than 1 / REHASH_SLOTS_PER_ENTRY: at or below it, a new table the size of the alternate cannot pay for examining every alternate slot once anything is live or being built, so every rehash would double the table. Just above it, the table stabilizes only once it is many times the live entries. The generated hashers refer to this constant, so changing it changes both the drain rate and the sizing.

See Also:

• Constant Field Values

tableSize

protected int tableSize

alternateTableSize

protected int alternateTableSize

rehashPointer

protected int rehashPointer

numEntries

protected long numEntries

How many entries are taking up slots in the main hash table (includes tombstones)?

liveEntries

protected long liveEntries

How many values do we have that are live (in both main and alternate)?

alternateEntries

protected long alternateEntries

How many entries are in the alternate table (includes tombstones)?

chunkTypes

protected final ChunkType[] chunkTypes

mainKeySources

protected final WritableColumnSource[] mainKeySources

alternateKeySources

protected final WritableColumnSource[] alternateKeySources

mainRightRowKey

protected ImmutableLongArraySource mainRightRowKey

We use a RowSet.NULL_ROW_KEY for a state that exists, but has no right hand side; the column sources are initialized with NULL_LONG for something that does not exist. When there are multiple right rows, we store a value less than TOMBSTONE_RIGHT_STATE, which is a position in the rightSideDuplicateRowSets (-3 maps to 0, -4 to 1, etc.). We must maintain the right side duplicates so that we do not need a rescan; but in the common (as opposed to impending error) case of a single value we do not want to allocate any objects The TOMBSTONE_RIGHT_STATE indicates that the row was deleted.

alternateRightRowKey

protected ImmutableLongArraySource alternateRightRowKey

mainLeftRowSet

protected ImmutableObjectArraySource<WritableRowSet> mainLeftRowSet

mainModifiedTrackerCookieSource

protected ImmutableLongArraySource mainModifiedTrackerCookieSource

alternateLeftRowSet

protected ImmutableObjectArraySource<WritableRowSet> alternateLeftRowSet

alternateModifiedTrackerCookieSource

protected ImmutableLongArraySource alternateModifiedTrackerCookieSource

rightSideDuplicateRowSets

protected ObjectArraySource<WritableRowSet> rightSideDuplicateRowSets

nextDuplicateRightSide

protected long nextDuplicateRightSide

freeDuplicateValues

protected it.unimi.dsi.fastutil.longs.LongArrayList freeDuplicateValues

mainInsertMask

protected int mainInsertMask

alternateInsertMask

protected int alternateInsertMask

Constructor Details

IncrementalNaturalJoinStateManagerTypedBase

protected IncrementalNaturalJoinStateManagerTypedBase(ColumnSource<?>[] tableKeySources,
 ColumnSource<?>[] keySourcesForErrorMessages,
 int tableSize,
 double maximumLoadFactor,
 NaturalJoinType joinType,
 boolean addOnly)

Method Details

makeBuildContext

public IncrementalNaturalJoinStateManagerTypedBase.BuildContext makeBuildContext(ColumnSource<?>[] buildSources,
 long maxSize)

Specified by:

makeBuildContext in interface BothIncrementalNaturalJoinStateManager

makeProbeContext

public IncrementalNaturalJoinStateManagerTypedBase.ProbeContext makeProbeContext(ColumnSource<?>[] buildSources,
 long maxSize)

Specified by:

makeProbeContext in interface BothIncrementalNaturalJoinStateManager

buildTable

protected void buildTable(boolean initialBuild,
 IncrementalNaturalJoinStateManagerTypedBase.BuildContext bc,
 RowSequence buildRows,
 ColumnSource<?>[] buildSources,
 TypedHasherUtil.BuildHandler buildHandler,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

probeTable

protected void probeTable(IncrementalNaturalJoinStateManagerTypedBase.ProbeContext pc,
 RowSequence probeRows,
 boolean usePrev,
 ColumnSource<?>[] probeSources,
 TypedHasherUtil.ProbeHandler handler)

doRehash

public boolean doRehash(boolean fullRehash,
 MutableInt rehashCredits,
 int nextChunkSize,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Parameters:

fullRehash - should we rehash the entire table (if false, we rehash incrementally)

rehashCredits - the rehash work this operation has done, in entries' worth of alternate slots examined (REHASH_SLOTS_PER_ENTRY slots each), which pays for building as many entries (input/output)

nextChunkSize - the size of the chunk we are processing

Returns:

true if a front migration is required

adviseNewAlternate

protected abstract void adviseNewAlternate()

After creating the new alternate key states, advise the derived classes, so they can cast them to the typed versions of the column source and adjust the derived class pointers.

clearAlternate

protected void clearAlternate()

Drop the alternate table once every live entry has migrated to the main table. Any tracker entry that referred to an alternate slot was moved to the slot's main location as it migrated, so nothing reads the alternate sources afterwards and their arrays are released.

rehashRequired

public boolean rehashRequired(int nextChunkSize)

computeTableSize

public int computeTableSize(int nextChunkSize,
 int alternateSize,
 boolean fullRehash)

Parameters:

nextChunkSize - the size of the chunk about to be built

alternateSize - the size of the table that becomes the alternate

fullRehash - whether the whole table is rehashed at once, leaving no alternate to drain

Returns:

the size of the new table

rehashInternalFull

protected abstract void rehashInternalFull(int oldSize)

migrateFront

protected abstract void migrateFront(NaturalJoinModifiedSlotTracker modifiedSlotTracker)

rehashInternalPartial

protected abstract int rehashInternalPartial(int numEntriesToRehash,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Migrate entries from the alternate table, examining REHASH_SLOTS_PER_ENTRY alternate slots, whether they hold a live entry, a tombstone or nothing, for each entry's worth of work requested.

Parameters:

numEntriesToRehash - the entries' worth of work to do, which pays for building as many entries

Returns:

the entries' worth of work done: the slots examined divided by REHASH_SLOTS_PER_ENTRY, or numEntriesToRehash if the alternate table was drained

hashToTableLocation

protected int hashToTableLocation(int hash)

hashToTableLocationAlternate

protected int hashToTableLocationAlternate(int hash)

duplicateLocationFromRowKey

protected long duplicateLocationFromRowKey(long rowKey)

rowKeyFromDuplicateLocation

protected long rowKeyFromDuplicateLocation(long duplicateLocation)

allocateDuplicateLocation

protected long allocateDuplicateLocation()

freeDuplicateLocation

protected void freeDuplicateLocation(long duplicateLocation)

getRightRowKey

public long getRightRowKey(int slot)

Specified by:

getRightRowKey in interface IncrementalNaturalJoinStateManager

getLeftRowSet

public RowSet getLeftRowSet(int slot)

Specified by:

getLeftRowSet in interface IncrementalNaturalJoinStateManager

getRightRowSet

public RowSet getRightRowSet(int slot)

Specified by:

getRightRowSet in interface IncrementalNaturalJoinStateManager

keyString

public String keyString(int slot)

Specified by:

keyString in interface IncrementalNaturalJoinStateManager

buildIndexedRowRedirection

public WritableRowRedirection buildIndexedRowRedirection(QueryTable leftTable,
 BothIncrementalNaturalJoinStateManager.InitialBuildContext ibc,
 ColumnSource<RowSet> indexRowSets,
 JoinControl.RedirectionType redirectionType)

Specified by:

buildIndexedRowRedirection in interface BothIncrementalNaturalJoinStateManager

buildRowRedirectionFromRedirections

public WritableRowRedirection buildRowRedirectionFromRedirections(QueryTable leftTable,
 BothIncrementalNaturalJoinStateManager.InitialBuildContext ibc,
 JoinControl.RedirectionType redirectionType)

Specified by:

buildRowRedirectionFromRedirections in interface BothIncrementalNaturalJoinStateManager

buildFromRightSide

protected abstract void buildFromRightSide(RowSequence rowSequence,
 Chunk[] sourceKeyChunks)

applyRightShift

protected abstract void applyRightShift(RowSequence rowSequence,
 Chunk[] sourceKeyChunks,
 long shiftDelta,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker,
 IncrementalNaturalJoinStateManagerTypedBase.ProbeContext pc)

modifyByRight

public void modifyByRight(Context pc,
 RowSet modified,
 ColumnSource<?>[] rightSources,
 @NotNull
 @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Specified by:

modifyByRight in interface BothIncrementalNaturalJoinStateManager

modifyByRight

protected abstract void modifyByRight(RowSequence rowSequence,
 Chunk[] sourceKeyChunks,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

removeRight

public void removeRight(Context pc,
 RowSequence rightRowSet,
 ColumnSource<?>[] rightSources,
 @NotNull
 @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Specified by:

removeRight in interface BothIncrementalNaturalJoinStateManager

removeRight

protected abstract void removeRight(RowSequence rowSequence,
 Chunk[] sourceKeyChunks,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

buildFromRightSide

public void buildFromRightSide(Table rightTable,
 ColumnSource<?>[] rightSources)

Specified by:

buildFromRightSide in interface BothIncrementalNaturalJoinStateManager

decorateLeftSide

public void decorateLeftSide(RowSet leftRows,
 ColumnSource<?>[] leftSources,
 BothIncrementalNaturalJoinStateManager.InitialBuildContext ibc)

Specified by:

decorateLeftSide in interface BothIncrementalNaturalJoinStateManager

buildFromLeftSide

protected abstract void buildFromLeftSide(RowSequence rowSequence,
 Chunk[] sourceKeyChunks)

addRightSide

public void addRightSide(Context bc,
 RowSequence rightRowSet,
 ColumnSource<?>[] rightSources,
 @NotNull
 @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Specified by:

addRightSide in interface BothIncrementalNaturalJoinStateManager

addRightSide

protected abstract void addRightSide(RowSequence rowSequence,
 Chunk[] sourceKeyChunks,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

addLeftSide

public void addLeftSide(Context bc,
 RowSequence leftRowSet,
 ColumnSource<?>[] leftSources,
 LongArraySource leftRedirections,
 @NotNull
 @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker,
 boolean addedToTable)

Description copied from interface: BothIncrementalNaturalJoinStateManager

Add left rows to their key's slots, storing each row's right redirection (by position) in leftRedirections.

Specified by:

addLeftSide in interface BothIncrementalNaturalJoinStateManager

Parameters:

bc - the build context

leftRowSet - the left rows to add

leftSources - the left key sources

leftRedirections - receives the right row key (or RowSequence.NULL_ROW_KEY) of each row, by position

modifiedSlotTracker - the tracker, whose per-slot builders accumulate the added keys of each slot

addedToTable - whether the rows were added to the left table this cycle, as opposed to rows that were present before this cycle and whose key value changed; only rows added to the table are counted by the tracker as rows whose right values need no reporting

addLeftSide

protected abstract void addLeftSide(RowSequence rowSequence,
 Chunk[] sourceKeyChunks,
 LongArraySource leftRedirections,
 long redirectionOffset,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

removeLeft

public void removeLeft(Context pc,
 RowSequence leftIndex,
 ColumnSource<?>[] leftSources,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Specified by:

removeLeft in interface BothIncrementalNaturalJoinStateManager

tombstoneSlot

protected void tombstoneSlot(boolean main,
 long location,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Mark a slot dead once its last left row and last right row are gone. Any modified slot tracker entry the slot holds this cycle describes the key that just died, so it is discarded rather than applied to the key that later reuses the slot. The slot's (now empty) left row set is released; a key that later reuses the slot builds a fresh one.

removeLeftModifications

public void removeLeftModifications(ColumnSource<?>[] leftSources,
 RowSet modifiedPreShift,
 RowSet modifiedPostShift,
 RowSetBuilderSequential changedPreShift,
 RowSetBuilderSequential changedPostShift,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Description copied from interface: BothIncrementalNaturalJoinStateManager

In a single pass over the modified left rows, determine which rows' key value actually changed (by comparing the current key values at the post-shift row keys with the previous key values at the pre-shift row keys), remove those changed rows from their previous-key hash slots, and report the changed keys. Rows whose key value is unchanged are collapsed away entirely, so the caller avoids the hash lookups and per-key row set churn of removing and re-adding them. The previous key values are read only once: the same values used for the equality test are reused to drive the removal.

Specified by:

removeLeftModifications in interface BothIncrementalNaturalJoinStateManager

Parameters:

leftSources - the left key sources

modifiedPreShift - the modified rows, in pre-shift key space, aligned positionally with modifiedPostShift

modifiedPostShift - the modified rows, in post-shift key space

changedPreShift - output, ascending, receives the pre-shift keys whose key value changed, aligned with changedPostShift (for the caller's redirection removal)

changedPostShift - output, ascending, receives the post-shift keys whose key value changed (to be re-added by the caller)

removeLeft

protected abstract void removeLeft(RowSequence rowSequence,
 Chunk[] sourceKeyChunks,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

removeRightModifications

public void removeRightModifications(ColumnSource<?>[] rightSources,
 RowSet modifiedPreShift,
 RowSet modifiedPostShift,
 RowSetBuilderSequential changedPreShift,
 RowSetBuilderSequential changedPostShift,
 @NotNull
 @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Description copied from interface: BothIncrementalNaturalJoinStateManager

The right-side counterpart of BothIncrementalNaturalJoinStateManager.removeLeftModifications(io.deephaven.engine.table.ColumnSource<?>[], io.deephaven.engine.rowset.RowSet, io.deephaven.engine.rowset.RowSet, io.deephaven.engine.rowset.RowSetBuilderSequential, io.deephaven.engine.rowset.RowSetBuilderSequential, io.deephaven.engine.table.impl.NaturalJoinModifiedSlotTracker): in a single pass over the modified right rows, determine which rows' key value actually changed, remove those rows from their previous-key hash slots, and report the changed keys. Rows whose key value is unchanged keep their slot.

Specified by:

removeRightModifications in interface BothIncrementalNaturalJoinStateManager

Parameters:

rightSources - the right key sources

modifiedPreShift - the modified rows, in pre-shift key space, aligned positionally with modifiedPostShift

modifiedPostShift - the modified rows, in post-shift key space

changedPreShift - output, ascending, receives the pre-shift keys whose key value changed (to be excluded from the caller's shift processing)

changedPostShift - output, ascending, receives the post-shift keys whose key value changed (to be re-added by the caller)

applyLeftShift

public void applyLeftShift(Context pc,
 ColumnSource<?>[] leftSources,
 RowSet shiftedRowSet,
 long shiftDelta,
 @NotNull
 @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Description copied from interface: BothIncrementalNaturalJoinStateManager

Move the left rows of one shift range within their slots' left row sets.

Specified by:

applyLeftShift in interface BothIncrementalNaturalJoinStateManager

Parameters:

pc - the probe context

leftSources - the left key sources

shiftedRowSet - the post-shift row keys of the shifted left rows

shiftDelta - the shift range's delta

modifiedSlotTracker - the tracker, whose per-slot builders accumulate the shifted keys of each slot

applyRightShift

public void applyRightShift(Context pc,
 ColumnSource<?>[] rightSources,
 RowSet shiftedRowSet,
 long shiftDelta,
 @NotNull
 @NotNull NaturalJoinModifiedSlotTracker modifiedSlotTracker)

Specified by:

applyRightShift in interface BothIncrementalNaturalJoinStateManager

applyLeftShift

protected abstract void applyLeftShift(RowSequence rowSequence,
 Chunk[] sourceKeyChunks,
 NaturalJoinModifiedSlotTracker modifiedSlotTracker)

makeInitialBuildContext

public BothIncrementalNaturalJoinStateManager.InitialBuildContext makeInitialBuildContext()

Specified by:

makeInitialBuildContext in interface BothIncrementalNaturalJoinStateManager

decorateLeftSide

public void decorateLeftSide(RowSet leftRowSet,
 ColumnSource<?>[] leftSources,
 LongArraySource leftRedirections)

Specified by:

decorateLeftSide in class StaticNaturalJoinStateManager

compactAll

public void compactAll()

Specified by:

compactAll in interface BothIncrementalNaturalJoinStateManager