Class IngesterUtils

java.lang.Object
io.deephaven.importers.util.IngesterUtils

public class IngesterUtils extends Object
Importer utilities required for the Illumon importers
  • Field Details

  • Constructor Details

    • IngesterUtils

      public IngesterUtils(Logger log, String partition)
      Parameters:
      log - the Logger
      partition - the partition
  • Method Details

    • getFilenameAry

      public String[] getFilenameAry(String serverName, String pattern, boolean isPrefix)
      Get the list of files to be processed.
      Parameters:
      serverName - the server name
      pattern - the pattern to match
      isPrefix - true if the pattern is a prefix, false if it is a substring
      Returns:
      an array of file names
    • getColumnNamesFromSchema

      public static List<String> getColumnNamesFromSchema(@Nullable @Nullable io.deephaven.shadow.enterprise.org.jdom2.Element sourceElement, @NotNull @NotNull io.deephaven.shadow.enterprise.com.illumon.iris.db.tables.TableDefinition tableDefinition, boolean includePartitioningColumn)
      Returns a list of column source names from a schema and ImportSource.
      Parameters:
      sourceElement - optional Schema ImportSource to use when finding alternate source names for table columns
      tableDefinition - TableDefinition object for the table
      includePartitioningColumn - whether to include the partitioning column in the resultant list
      Returns:
      a list of column names.
    • getAttributesMap

      public static Map<String,String> getAttributesMap(@NotNull @NotNull ImporterColumnDefinition importerColumnDefinition)
      Utility method to get the attributes from an ImporterColumnDefinition.
      Parameters:
      importerColumnDefinition - the ImporterColumnDefinition
      Returns:
      a Map of the attributes.