Package com.illumon.iris.utils

Class IngesterUtils

java.lang.Object

com.illumon.iris.utils.IngesterUtils

public class IngesterUtils
extends Object

Importer utilities required for the Illumon importers

Field Summary

Fields

Modifier and Type	Field	Description
static final long	DAY
static final long	HOUR
static final long	MINUTE
static final long	SECOND
static final long	WEEK
static final long	YEAR

Constructor Summary

Constructors

Constructor	Description
IngesterUtils(com.fishlib.io.logger.Logger log, String partition)

Method Summary

Modifier and Type	Method	Description
static List<String>	getColumnNamesFromSchema(org.jdom2.Element sourceElement, TableDefinition tableDefinition, boolean includePartitioningColumn)	Returns a list of column source names from a schema and ImportSource.
static String	getDateNDaysPrevious(String date, int daysprevious)
static DBDateTime	getDateTime(String dateString)
static DBDateTime	getDateTime(String namespace, String dateString)
String[]	getFilenameAry(String serverName, String pattern, boolean isPrefix)
static String	getPreviousTradingDay(String date)
static List<String>	getSourceOnlyColumnNames(org.jdom2.Element sourceElement, TableDefinition tableDefinition, boolean includePartitioningColumn)	Returns a list of column source names from a schema and ImportSource.
static Map<String,String>	processNamedOptionalArgs(String[] args, int startIndex, String... allowedArgumentKeys)
static boolean	safeGetBoolean(Object o, boolean defaultValue)
static int	safeGetInt(Object o, int defaultValue)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

SECOND

public static final long SECOND

See Also:

• Constant Field Values

MINUTE

public static final long MINUTE

See Also:

• Constant Field Values

HOUR

public static final long HOUR

See Also:

• Constant Field Values

DAY

public static final long DAY

See Also:

• Constant Field Values

WEEK

public static final long WEEK

See Also:

• Constant Field Values

YEAR

public static final long YEAR

See Also:

• Constant Field Values

Constructor Details

IngesterUtils

public IngesterUtils(com.fishlib.io.logger.Logger log,
 String partition)

Method Details

getFilenameAry

public String[] getFilenameAry(String serverName,
 String pattern,
 boolean isPrefix)

getColumnNamesFromSchema

public static List<String> getColumnNamesFromSchema(org.jdom2.Element sourceElement,
 @NotNull
 TableDefinition tableDefinition,
 boolean includePartitioningColumn)

Returns a list of column source names from a schema and ImportSource. This is useful for importing from sources that don't include column names in the source data.

Parameters:

sourceElement - Optional Schema ImportSource to use when finding alternate source names for table columns.

tableDefinition - TableDefinition object for the table.

includePartitioningColumn - Whether to include the partitioning column in the resultant list.

Returns:

A list of column names.

getSourceOnlyColumnNames

public static List<String> getSourceOnlyColumnNames(org.jdom2.Element sourceElement,
 @NotNull
 TableDefinition tableDefinition,
 boolean includePartitioningColumn)

Returns a list of column source names from a schema and ImportSource. Ignores Constant and CustomSetter columns

In addition, no duplicates are included. So if multiple columns have same source column only one source column name is included.

This is useful for importing from sources that don't include column names in the source data, and in case of XmlImports this is always the case

Parameters:

sourceElement - Optional Schema ImportSource to use when finding alternate source names for table columns.

tableDefinition - TableDefinition object for the table.

includePartitioningColumn - Whether to include the partitioning column in the resultant list.

Returns:

A list of column names.

processNamedOptionalArgs

public static Map<String,String> processNamedOptionalArgs(@NotNull
 String[] args,
 int startIndex,
 @NotNull
 String... allowedArgumentKeys)

getPreviousTradingDay

public static String getPreviousTradingDay(String date)
                                    throws IllegalArgumentException

Throws:

IllegalArgumentException

getDateNDaysPrevious

public static String getDateNDaysPrevious(String date,
 int daysprevious)

getDateTime

public static DBDateTime getDateTime(String namespace,
 String dateString)

getDateTime

public static DBDateTime getDateTime(String dateString)

safeGetBoolean

public static boolean safeGetBoolean(Object o,
 boolean defaultValue)

safeGetInt

public static int safeGetInt(Object o,
 int defaultValue)