public class MetadataTracker
extends Object
Constructor and Description |
---|
MetadataTracker() |
Modifier and Type | Method and Description |
---|---|
void |
createTableAndIndexesOrChangeFieldDataTypeIfNeeded(Scenario scenario,
EtlConfig config,
Destination destination,
DataSet dataSet,
Alias alias,
CodeGen codeGen)
Creates the table and indexes or change field data type if needed.
|
String |
getLoadKey(EtlConfig config,
Destination destination,
String destTableName,
List<String> fields,
DataSetFields dataSetFields,
Driver driver)
Gets the load key.
|
String |
getSourceKeys(Destination destination,
EtlConfig config,
DataSetFields dataSetFields)
Gets the source keys.
|
boolean |
needToUpdateMetadataInTarget(Destination destination,
DataSet dataSet)
Checks if ETL engine needs to update metadata for the destination based
on the existing data.
|
boolean |
recreateDestTableIfNeededWhenHWMIsEnabled(Scenario scenario,
Source source,
Destination destination,
EtlConfig config)
Recreate destination table if needed when the high watermark replication
is enabled.
|
void |
updateMetadataInTarget(EtlConfig config,
Destination destination,
DataSet dataSet,
Scenario scenario)
Update metadata in target.
|
void |
updateOrderOfFields(Destination destination,
DataSet dataSet)
Update order of fields.
|
public String getSourceKeys(Destination destination, EtlConfig config, DataSetFields dataSetFields)
destination
- the destinationconfig
- the configdataSetFields
- the data set fieldspublic String getLoadKey(EtlConfig config, Destination destination, String destTableName, List<String> fields, DataSetFields dataSetFields, Driver driver)
source
- the sourcedestination
- the destinationsourceTableName
- the source table namedestTableName
- the destination table namepublic boolean needToUpdateMetadataInTarget(Destination destination, DataSet dataSet)
destination
- the destinationdataSet
- the data setpublic void updateMetadataInTarget(EtlConfig config, Destination destination, DataSet dataSet, Scenario scenario)
config
- the configdestination
- the destinationdataSet
- the data setscenario
- the scenariopublic void updateOrderOfFields(Destination destination, DataSet dataSet)
destination
- the destinationdataSet
- the data setpublic void createTableAndIndexesOrChangeFieldDataTypeIfNeeded(Scenario scenario, EtlConfig config, Destination destination, DataSet dataSet, Alias alias, CodeGen codeGen) throws Exception
scenario
- the scenarioconfig
- the configdestination
- the destinationdataSet
- the data setalias
- the aliascodeGen
- the code genException
- the exceptionpublic boolean recreateDestTableIfNeededWhenHWMIsEnabled(Scenario scenario, Source source, Destination destination, EtlConfig config) throws Exception
scenario
- the scenariosource
- the sourcedestination
- the destinationconfig
- the etl configException
- the exceptionCopyright © 2010-2020 Toolsverse. All Rights Reserved.