Package com.toolsverse.etl.core.engine

Interface Summary

Interface	Description
Block	This interface is a main building block of the etl scenario.
CodeGen	CodeGen is an interface for code generators.
FileFilter	This interfaces stores history of the processed files.
OnTask	The etl building blocks, such as Source and Destination can have one or multiple tasks attached.
SupportsCodeUpdate	Moniker interface for OnTask that supports upading the code before recording start/finish event in Redis
SupportsRecording	Moniker interface for OnTask that supports start/stop recording in Redis
TaskFeatureProvider	Task that has specific features which must be reported to the engine need to implement this interface.

Class Summary

Class	Description
BaseMetrics	The base class for metrics captured during ETL.
Destination	Destination is a one of the two building blocks of the ETL scenario: etl process extracts data from the Sources and loads into the Destinations.
EtlEngine	A singleton wrapper used to initialize embedded EtlProcess
EtlFactory	Creates etl scenario by parsing xml.
EtlMetrics	The POJO which represents ETL metrics for a single DataSet.
EtlMetricsTracker	This class tracks basic ETL metrics, such as records extracted, records loaded, timestamps, exceptions, etc.
EtlProcess	This class executes one or multiple etl scenarios.
EtlRequest	This POJO used to send etl request.
EtlResponse	The data structure returned by etl process when it finished.
EtlUnit	This data structure used to separate multiple "load" instances executed in parallel.
Extractor	Extracts data from the multiple sources.
FileMetrics	The POJO which represents File ETL metrics such as file copied, file moved, file deleted, etc.
Loader	Load data into the destinations.
LoadFunctionContext	LoadFunctionContext is the class that represents execution context, used primarily by etl functions.
MetadataTracker	The collection of the utility methods to check and update metadata in the source and in the destination.
NoDupsFileFilter	Implementation of FileFilter interface used by FileManagerTask to track what files were copied from the source to destination.
OnAddDataSetChangeListener	The listener interface for receiving onAddDataSetChange events.
RunningEtlTask	The instance of this POJO is returned by REST ETL Server when /tasks endpoint is called.
Scenario	This class defines an etl (extract, transfer, load) scenario.
Source	Source is a one of the two building blocks of the ETL scenario: etl process extracts data from the Sources and loads into the Destinations.
Task	This is a class which contains all data related to the etl task.
TaskExecutor	This class executes all tasks attached to the Source or Destination.
TaskFeature	This class encapsulates features of the Task .
TaskRecorder	The singleton instance of this class records currently running tasks in Redis.
TaskResult	All "execute" methods of the class implementing OnTask interface must return this data structure.

Enum Summary

Enum	Description
Block.BlockType	Possible block types
EtlProcess.EtlMode	The EtlProcess modes INCLUDED - ETL engine included into other Toolsverse apps, such as Data Explorer STANDALONE - ETL engine is a standalone application EMBEDDED - ETL engine embedded into third-party application.
TaskResult.TaskResultCode	The result codes