com.toolsverse.etl.connector

Class SourceConnector

Object

com.toolsverse.etl.connector.SourceConnector

All Implemented Interfaces:

DataSetConnector<SourceConnectorParams,ConnectorResult>, Serializable

public class SourceConnector
extends Object
implements DataSetConnector<SourceConnectorParams,ConnectorResult>

Reads data from the excising data set. Supports data streaming.

Since:

2.0

Version:

2.0

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SourceConnector()

Method Summary

Modifier and Type	Method and Description
boolean	canRead() Checks if connector can read data.
boolean	canWrite() Checks if connector can write data.
void	cleanUp(SourceConnectorParams params, DataSet dataSet, Driver driver) Cleans up after DataSetConnector populated or persisted DataSet.
SourceConnectorParams	getDataSetConnectorParams() Gets the DataSetConnectorParams.
String	getExt() Gets the file ext.
String	getName() Gets the name.
String	initQueryLabel() The init query label.
void	inlinePersist(SourceConnectorParams params, DataSet dataSet, Driver driver, DataSetRecord record, int row, int records) Persists data set row.
boolean	isFileConnector() Checks if this is a connector to the file based data source.
boolean	isTextFormat() Checks if this is a connector for the text-based data format, such as JOSN, XML, etc.
ConnectorResult	persist(SourceConnectorParams params, DataSet dataSet, Driver driver) Persists data set.
ConnectorResult	populate(SourceConnectorParams params, DataSet dataSet, Driver driver) Populates data set.
void	postPersist(SourceConnectorParams params, DataSet dataSet, Driver driver) Called when DataSetConnector finished persisting data set.
void	prePersist(SourceConnectorParams params, DataSet dataSet, Driver driver) Called when DataSetConnector starts persisting data set.
boolean	supportsNested() Supports nested.
boolean	supportsReadStreaming() Supports read streaming.
boolean	supportsWorksheets() Checks if connector supports worksheets.
boolean	supportsWriteStreaming() Supports write streaming.
String	testConnection(ConnectionParams connectionParams) Tests the connection.
ConnectorResult	writeMetaData(SourceConnectorParams params, DataSet dataSet, Driver driver) Writes meta data.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.toolsverse.etl.connector.DataSetConnector

supportsReordering

Constructor Detail

SourceConnector

public SourceConnector()

Method Detail

supportsReadStreaming

public boolean supportsReadStreaming()

Description copied from interface: DataSetConnector

Supports read streaming.

Specified by:

supportsReadStreaming in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if successful

supportsWriteStreaming

public boolean supportsWriteStreaming()

Description copied from interface: DataSetConnector

Supports write streaming.

Specified by:

supportsWriteStreaming in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if successful

canRead

public boolean canRead()

Description copied from interface: DataSetConnector

Checks if connector can read data.

Specified by:

canRead in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if connector can read data

canWrite

public boolean canWrite()

Description copied from interface: DataSetConnector

Checks if connector can write data.

Specified by:

canWrite in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if connector can write data

cleanUp

public void cleanUp(SourceConnectorParams params,
                    DataSet dataSet,
                    Driver driver)
             throws Exception

Description copied from interface: DataSetConnector

Cleans up after DataSetConnector populated or persisted DataSet. Called regardless of exception. Usually used to free allocated resources such as streams, handlers, etc.

Specified by:

cleanUp in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

params - the DataSetConnectorParams

dataSet - the data set

driver - the driver

Throws:

Exception - in case of any error

getDataSetConnectorParams

public SourceConnectorParams getDataSetConnectorParams()

Description copied from interface: DataSetConnector

Gets the DataSetConnectorParams.

Specified by:

getDataSetConnectorParams in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

the DataSetConnectorParams

getExt

public String getExt()

Description copied from interface: DataSetConnector

Gets the file ext.

Specified by:

getExt in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

the file ext

getName

public String getName()

Description copied from interface: DataSetConnector

Gets the name.

Specified by:

getName in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

the name

inlinePersist

public void inlinePersist(SourceConnectorParams params,
                          DataSet dataSet,
                          Driver driver,
                          DataSetRecord record,
                          int row,
                          int records)
                   throws Exception

Description copied from interface: DataSetConnector

Persists data set row. For example adds line to the text file.

Specified by:

inlinePersist in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

params - the DataSetConnectorParams

dataSet - the data set

driver - the driver

record - the record

row - the row

records - the total number of records

Throws:

Exception - in case of any error

isFileConnector

public boolean isFileConnector()

Description copied from interface: DataSetConnector

Checks if this is a connector to the file based data source.

Specified by:

isFileConnector in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if this is a connector to the file based data source.

isTextFormat

public boolean isTextFormat()

Description copied from interface: DataSetConnector

Checks if this is a connector for the text-based data format, such as JOSN, XML, etc.

Specified by:

isTextFormat in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if this is a connector for the text-based data format.

persist

public ConnectorResult persist(SourceConnectorParams params,
                               DataSet dataSet,
                               Driver driver)
                        throws Exception

Description copied from interface: DataSetConnector

Persists data set.

Specified by:

persist in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

params - the DataSetConnectorParams

dataSet - the data set

driver - the driver

Returns:

the ConnectorResult

Throws:

Exception - in case of any error

populate

public ConnectorResult populate(SourceConnectorParams params,
                                DataSet dataSet,
                                Driver driver)
                         throws Exception

Description copied from interface: DataSetConnector

Populates data set.

Specified by:

populate in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

params - the DataSetConnectorParams

dataSet - the data set

driver - the driver

Returns:

the ConnectorResult

Throws:

Exception - in case of any error

postPersist

public void postPersist(SourceConnectorParams params,
                        DataSet dataSet,
                        Driver driver)
                 throws Exception

Description copied from interface: DataSetConnector

Called when DataSetConnector finished persisting data set. Never called if there was an exception.

Specified by:

postPersist in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

params - the DataSetConnectorParams

dataSet - the data set

driver - the driver

Throws:

Exception - in case of any error

prePersist

public void prePersist(SourceConnectorParams params,
                       DataSet dataSet,
                       Driver driver)
                throws Exception

Description copied from interface: DataSetConnector

Called when DataSetConnector starts persisting data set.

Specified by:

prePersist in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

params - the DataSetConnectorParams

dataSet - the data set

driver - the driver

Throws:

Exception - in case of any error

testConnection

public String testConnection(ConnectionParams connectionParams)
                      throws Exception

Description copied from interface: DataSetConnector

Tests the connection.

Specified by:

testConnection in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

connectionParams - the connection params

Returns:

the status. If null or empty connection is ok

Throws:

Exception - the exception in case of any error

writeMetaData

public ConnectorResult writeMetaData(SourceConnectorParams params,
                                     DataSet dataSet,
                                     Driver driver)
                              throws Exception

Description copied from interface: DataSetConnector

Writes meta data. For example along with delimited text file the DataSetConnector can create a xml file with the same name which contains field definitions.

Specified by:

writeMetaData in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Parameters:

params - the DataSetConnectorParams

dataSet - the data set

driver - the driver

Returns:

the ConnectorResult

Throws:

Exception - in case of any error

initQueryLabel

public String initQueryLabel()

Description copied from interface: DataSetConnector

The init query label. If not empty the init query, for example XML XQuery, will be enabled and label in editor will be set to the value of this field

Specified by:

initQueryLabel in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

the string

supportsNested

public boolean supportsNested()

Description copied from interface: DataSetConnector

Supports nested.

Specified by:

supportsNested in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if connector supports nested data sets

supportsWorksheets

public boolean supportsWorksheets()

Description copied from interface: DataSetConnector

Checks if connector supports worksheets.

Specified by:

supportsWorksheets in interface DataSetConnector<SourceConnectorParams,ConnectorResult>

Returns:

true, if connector supports worksheets