Package io.deephaven.engine.table.impl.multijoin

Class IncrementalMultiJoinStateManagerTypedBase

java.lang.Object
io.deephaven.engine.table.impl.multijoin.IncrementalMultiJoinStateManagerTypedBase
All Implemented Interfaces:
MultiJoinStateManager
public abstract class IncrementalMultiJoinStateManagerTypedBase extends Object implements MultiJoinStateManager

  • Field Details

    • keySourcesForErrorMessages

      protected final ColumnSource<?>[] keySourcesForErrorMessages

    • NO_REDIRECTION

      public static final long NO_REDIRECTION
      See Also:

    • EMPTY_OUTPUT_ROW

      public static final int EMPTY_OUTPUT_ROW
      See Also:

    • tableSize

      protected int tableSize
      The number of slots in our hash table.

    • alternateTableSize

      protected int alternateTableSize
      The number of slots in our alternate table, to start with "1" is a lie, but rehashPointer is zero; so our location value is positive and can be compared against rehashPointer safely.

    • numEntries

      protected int numEntries
      The number of entries in our hash table in use.

    • chunkTypes

      protected final ChunkType[] chunkTypes
      The keys for our hash entries.

    • mainKeySources

      protected final WritableColumnSource<?>[] mainKeySources

    • alternateKeySources

      protected final WritableColumnSource<?>[] alternateKeySources

    • outputKeySources

      protected final WritableColumnSource[] outputKeySources
      The output sources representing the keys of our joined table.

    • slotToOutputRow

      protected ImmutableIntArraySource slotToOutputRow
      Store sentinel information and maps hash slots to output row keys.

    • alternateSlotToOutputRow

      protected ImmutableIntArraySource alternateSlotToOutputRow

    • mainModifiedTrackerCookieSource

      protected ImmutableLongArraySource mainModifiedTrackerCookieSource

    • alternateModifiedTrackerCookieSource

      protected ImmutableLongArraySource alternateModifiedTrackerCookieSource

    • rehashPointer

      protected int rehashPointer
      how much of the alternate sources are necessary to rehash?

  • Constructor Details

    • IncrementalMultiJoinStateManagerTypedBase

      protected IncrementalMultiJoinStateManagerTypedBase(ColumnSource<?>[] tableKeySources, ColumnSource<?>[] keySourcesForErrorMessages, int tableSize, double maximumLoadFactor)

  • Method Details

    • getTableCount

      public int getTableCount()

    • makeBuildContext

      public IncrementalMultiJoinStateManagerTypedBase.BuildContext makeBuildContext(ColumnSource<?>[] buildSources, long maxSize)

    • makeProbeContext

      public IncrementalMultiJoinStateManagerTypedBase.ProbeContext makeProbeContext(ColumnSource<?>[] probeSources, long maxSize)

    • build

      public void build(Table table, ColumnSource<?>[] keySources, int tableNumber)
      Description copied from interface: MultiJoinStateManager
      Add the given table to this multiJoin result.
      Specified by:
      build in interface MultiJoinStateManager
      Parameters:
      table - the table to add
      keySources - the column sources that contain the keys
      tableNumber - the table number for which we are adding rows

    • processRemoved

      public void processRemoved(RowSet rowSet, ColumnSource<?>[] sources, int tableNumber, @NotNull @NotNull MultiJoinModifiedSlotTracker slotTracker, byte trackerFlag)

    • processShifts

      public void processShifts(RowSet rowSet, RowSetShiftData rowSetShiftData, ColumnSource<?>[] sources, int tableNumber, @NotNull @NotNull MultiJoinModifiedSlotTracker slotTracker)

    • processModified

      public void processModified(RowSet rowSet, ColumnSource<?>[] sources, int tableNumber, @NotNull @NotNull MultiJoinModifiedSlotTracker slotTracker, byte trackerFlag)

    • processAdded

      public void processAdded(RowSet rowSet, ColumnSource<?>[] sources, int tableNumber, @NotNull @NotNull MultiJoinModifiedSlotTracker slotTracker, byte trackerFlag)

    • buildFromTable

      protected abstract void buildFromTable(RowSequence rowSequence, Chunk<Values>[] sourceKeyChunks, LongArraySource tableRedirSource, int tableNumber, MultiJoinModifiedSlotTracker modifiedSlotTracker, byte trackerFlag)

    • remove

      protected abstract void remove(RowSequence rowSequence, Chunk<Values>[] sourceKeyChunks, LongArraySource tableRedirSource, int tableNumber, MultiJoinModifiedSlotTracker modifiedSlotTracker, byte trackerFlag)

    • shift

      protected abstract void shift(RowSequence rowSequence, Chunk<Values>[] sourceKeyChunks, LongArraySource tableRedirSource, int tableNumber, MultiJoinModifiedSlotTracker modifiedSlotTracker, byte trackerFlag, long shiftDelta)

    • modify

      protected abstract void modify(RowSequence rowSequence, Chunk<Values>[] sourceKeyChunks, LongArraySource tableRedirSource, int tableNumber, MultiJoinModifiedSlotTracker modifiedSlotTracker, byte trackerFlag)

    • migrateFront

      protected abstract void migrateFront()

    • doRehash

      public boolean doRehash(boolean fullRehash, MutableInt rehashCredits, int nextChunkSize)
      Parameters:
      fullRehash - should we rehash the entire table (if false, we rehash incrementally)
      rehashCredits - the number of entries this operation has rehashed (input/output)
      nextChunkSize - the size of the chunk we are processing
      Returns:
      true if a front migration is required

    • adviseNewAlternate

      protected abstract void adviseNewAlternate()
      After creating the new alternate key states, advise the derived classes, so they can cast them to the typed versions of the column source and adjust the derived class pointers.

    • clearAlternate

      protected void clearAlternate()

    • rehashRequired

      public boolean rehashRequired(int nextChunkSize)

    • rehashInternalFull

      protected abstract void rehashInternalFull(int oldSize)

    • rehashInternalPartial

      protected abstract int rehashInternalPartial(int numEntriesToRehash)
      Parameters:
      numEntriesToRehash - number of entries to rehash into main table
      Returns:
      actual number of entries rehashed

    • hashToTableLocation

      protected int hashToTableLocation(int hash)

    • hashToTableLocationAlternate

      protected int hashToTableLocationAlternate(int hash)

    • keyString

      protected String keyString(Chunk<Values>[] sourceKeyChunks, int chunkPosition)
      produce a pretty key for error messages.

    • getCurrentRedirections

      public void getCurrentRedirections(long slot, long[] redirections)

    • startTrackingPrevRedirectionValues

      public void startTrackingPrevRedirectionValues(int tableNumber)

    • getResultSize

      public long getResultSize()
      Description copied from interface: MultiJoinStateManager
      Get the number of rows in the result table
      Specified by:
      getResultSize in interface MultiJoinStateManager
      Returns:
      the number of rows in the result table

    • getKeyHashTableSources

      public ColumnSource<?>[] getKeyHashTableSources()
      Description copied from interface: MultiJoinStateManager
      Get the hash table column sources for the result table. These are used as the key columns of our result.
      Specified by:
      getKeyHashTableSources in interface MultiJoinStateManager

    • getRowRedirectionForTable

      public RowRedirection getRowRedirectionForTable(int tableNumber)
      Description copied from interface: MultiJoinStateManager
      Get the result row redirection for a given table
      Specified by:
      getRowRedirectionForTable in interface MultiJoinStateManager
      Parameters:
      tableNumber - the table to fetch
      Returns:
      the row redirection for the table

    • ensureTableCapacity

      public void ensureTableCapacity(int tables)
      Description copied from interface: MultiJoinStateManager
      Ensure that this state manager can handle numTables tables as constituents of the multiJoin.
      Specified by:
      ensureTableCapacity in interface MultiJoinStateManager
      Parameters:
      tables - the number of tables that participate

    • setTargetLoadFactor

      public void setTargetLoadFactor(double targetLoadFactor)
      Specified by:
      setTargetLoadFactor in interface MultiJoinStateManager

    • setMaximumLoadFactor

      public void setMaximumLoadFactor(double maximumLoadFactor)
      Specified by:
      setMaximumLoadFactor in interface MultiJoinStateManager