Difference between revisions of "Writing data integration and data migration scenarios"
From Toolsverse Knowledge Base
m (Maxlmus moved page Writing ETL scenarios to Writing data integration and data migration scenarios) |
m |
||
| Line 1: | Line 1: | ||
| − | |||
| − | |||
== Basic stuff == | == Basic stuff == | ||
| − | Any data integration or data migration process can be described as an extract-transform-load (ETL) or extract-load-transform (ELT). | + | Any data integration or data migration process can be described as an extract-transform-load (ETL) or extract-load-transform (ELT). With that is mind writing scenario becomes a |
| + | process of splitting task on extracts, loads and transformations. Scenario glues them all together and adds purpose and logic. | ||
| + | [[http://www.toolsverse.com/products/etl-framework/ ETL engine]] which powers Toolsverse products uses XML-based language to create scenarios. Before reading this page please take a look at [[ETL scenario language]]. XML was a natural choice because it enforces a structure: loads follow extracts and transformations follow extracts and loads. That said you can chose to stream data so extract and load combine in one logical operation and run things in parallel. | ||
| + | |||
== Simple data migration scenario == | == Simple data migration scenario == | ||
Revision as of 20:34, 27 July 2014
Basic stuff
Any data integration or data migration process can be described as an extract-transform-load (ETL) or extract-load-transform (ELT). With that is mind writing scenario becomes a process of splitting task on extracts, loads and transformations. Scenario glues them all together and adds purpose and logic.
[ETL engine] which powers Toolsverse products uses XML-based language to create scenarios. Before reading this page please take a look at ETL scenario language. XML was a natural choice because it enforces a structure: loads follow extracts and transformations follow extracts and loads. That said you can chose to stream data so extract and load combine in one logical operation and run things in parallel.
