Installing and Configuring ETL Framework

From Toolsverse Knowledge Base
Revision as of 13:56, 5 August 2014 by Maxlmus (Talk | contribs)

Jump to: navigation, search

Downloading

Look for clearly marked ETL Framework downloads. On Windows and OS X ETL Framework can be downloaded as an installer. Use archive downloads for other operating systems.

Installing

There are two ways to install ETL Framework: using installer or extracting files from the archive.

When using installer just execute it and follow instructions on the screen.

OS X installer is offered in a form of self-extracting DMG file. When prompted drag and drop ETL Framework folder to the Applications.

When installing from archive you will need to manually extract files using utility provided by operating system. All files are contained in the enclosing folder named etl-version.

Installing from archive will not add any entries to the Start menu, add desktop launchers or register the software in the registry.

Configuring

ETL Framework comes pre-configured to provide highest levels of performance and compatibility.

ETL framework requires a valid not expired license. Licenses are located under ETL_FRAMEWORK_HOME\license folder (*.lic files) or under ETL_FRAMEWORK_HOME\lib (*.jar files).

Note: ETL Framework comes with a 20-days evaluation license. It will expire after 20 days since the first use. You can a buy a commercial license which will never expire. License can be delivered as a lic or jar file. Using jars for licenses decreases dependency on external folders.

You can read more about licensing here.

Changing configuration properties

ETL framework uses etl.properties file located under ETL_FRAMEWORK_HOME/config folder to load configuration properties from. If file does not exist framework uses default values.

The only two properties you can safely change are:

  • network.appupdateurl - the URL used to call uuto-update Web service
  • network.appserverurl - the URL used to call ETL Web service

Example:

network.appserverurl=http://localhost:8080/dataexplorer/ide
network.appupdateurl=http://www.toolsverse.com/api/services/CheckForUpdates
app.update.key=etl
app.name=etlprocess
app.title=ETL Framework

Changing JVM Parameters

  1. Open ETL_FRAMEWORK_HOME\etlappstart.properties in your favorite text editor
  2. Change line containing app.vm.options
  3. Save

Changing Logging Parameters

  1. Open ETL_FRAMEWORK_HOME\config\log4j.properties in your favorite text editor
  2. Make a change
  3. Save

Adding JDBC drivers

Each copy of the ETL Framework comes with the following JDBC drivers:

  • DB2
  • Informix
  • Microsoft SQL Server
  • Sybase Advanced Server
  • MySQL
  • Oracle
  • PostgreSQL
  • Java DB (Derby)

They are located in the ETL_FRAMEWORK_HOME\jdbc folder. ETL Framework automatically recognizes (on start-up) and dynamically loads (when needed) jdbc drivers under this folder.

To install new jdbc driver just add a sub folder under ETL_FRAMEWORK_HOME\jdbc and put all required files there. Restart Data Explorer.

Alternatively, since JDBC drivers are just jar files you can simply put them in the ETL_FRAMEWORK_HOME\lib folder and they will be automatically loaded and added to the classpath.

Redistribution and dependencies

Configure ETL framework just the way you like it and exclude all unneeded components. You can find redistribution list and dependencies here.

Most jars under lib are required unless you don't need a particular functionality, for example reading and writing Excel files. All jars under lib folder are automatically added to the classpath on the start-up. Jars under plugin folder are optional and loaded based on rules and available licenses.

If you want to reduce number of folders framework depends on you can:

  • Copy all files from the plugin folder to lib.
  • Package existing licenses (*.lic files) in the license folder into jar file and copy jar into lib folder. Name of the jar file doesn't matter but

lic files must be located in the com/toolsverse/license folder inside jar

Checking for updates

ETL Framework can check for new version and update itself if new version exists.

To check for new new version run ETL framework executable with -v parameter.

Example:

C:\projects\toolsverse\java\dist\etl>etl.exe -v
Toolsverse Etl Framework 4.0-19862. Use -? for help.

Checking for updates...
Update status: new version available

To auto update ETL framework run executable with -u parameter.

Example:

C:\projects\toolsverse\java\dist\etl>etl.exe -u
Toolsverse Etl Framework 4.0-19862. Use -? for help.

Manually updating

You can update framework to the new version manually:

  1. Download update
  2. Replace exiting files on files from the update