com.toolsverse.etl.connector.json

Class JsonSplitProcessor

Object

com.toolsverse.etl.connector.BaseSplitProcessor

com.toolsverse.etl.connector.json.JsonSplitProcessor

All Implemented Interfaces:

SplitProcessor

public class JsonSplitProcessor
extends BaseSplitProcessor

This class implements SplitProcessor for JSON files. This class is not thread safe.

Since:

5.8

Version:

1.0

Constructor Summary

Constructors

Constructor and Description
JsonSplitProcessor()

Method Summary

Modifier and Type	Method and Description
void	configureSplit(Properties properties, String toFilename) Configure split.
com.toolsverse.etl.connector.json.JsonSplitProcessor.KeyValue<Long,Long>	split(IoProcessor destination, File file, Map<String,String> paths, String destinationDir, int max, boolean includeHeader) Split the JSON file to files on specified repeating elements
com.toolsverse.etl.connector.json.JsonSplitProcessor.KeyValue<Long,Long>	split(IoProcessor destination, InputStream stream, String fileName, Map<String,String> paths, String destinationDir, int max, boolean includeHeader) Split the JSON input stream to files on specified repeating elements
IoStatus	split(IoProcessor source, IoProcessor destination, String fromFolder, String toFolder, String filename) Split the input stream into multiple files.
com.toolsverse.etl.connector.json.JsonSplitProcessor.KeyValue<Long,Long>	split(IoProcessor destination, String file, Map<String,String> paths, String destinationDir, int max, boolean includeHeader) Split the JSON file to files on specified repeating elements

Methods inherited from class com.toolsverse.etl.connector.BaseSplitProcessor

close, getAction, getMaxNumberOfRows, supportsParallel

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JsonSplitProcessor

public JsonSplitProcessor()

Method Detail

configureSplit

public void configureSplit(Properties properties,
                           String toFilename)
                    throws IllegalArgumentException

Description copied from interface: SplitProcessor

Configure split.

Specified by:

configureSplit in interface SplitProcessor

Overrides:

configureSplit in class BaseSplitProcessor

Parameters:

properties - the properties

toFilename - the to filename

Throws:

IllegalArgumentException - the illegal argument exception

split

public IoStatus split(IoProcessor source,
                      IoProcessor destination,
                      String fromFolder,
                      String toFolder,
                      String filename)
               throws Exception

Description copied from interface: SplitProcessor

Split the input stream into multiple files.

Parameters:

source - IoProcessor, the source IoProcessor

destination - IoProcessor, the destination IoProcessor

fromFolder - the from folder

toFolder - the to folder

filename - the filename

Returns:

IoStatus, the status

Throws:

Exception - in case of any error

split

public com.toolsverse.etl.connector.json.JsonSplitProcessor.KeyValue<Long,Long> split(IoProcessor destination,
                                                                                      String file,
                                                                                      Map<String,String> paths,
                                                                                      String destinationDir,
                                                                                      int max,
                                                                                      boolean includeHeader)
                                                                               throws Exception

Split the JSON file to files on specified repeating elements

Parameters:

file - the JSON file path

paths - the map of paths to repeating elements, where key is an XPath like path to repeating element and value is a suffix that should be used for this element files

destinationDir - the output files directory path

max - the maximum number of repeating elements to be included into each file

includeHeader - if true, collect everything until repeating element and include to each split file as a header

Throws:

Exception - in case of any error

split

public com.toolsverse.etl.connector.json.JsonSplitProcessor.KeyValue<Long,Long> split(IoProcessor destination,
                                                                                      File file,
                                                                                      Map<String,String> paths,
                                                                                      String destinationDir,
                                                                                      int max,
                                                                                      boolean includeHeader)
                                                                               throws Exception

Split the JSON file to files on specified repeating elements

Parameters:

file - the JSON file

paths - the map of paths to repeating elements, where key is an XPath like path to repeating element and value is a suffix that should be used for this element files

destinationDir - the output files directory path

max - the maximum number of repeating elements to be included into each file

includeHeader - if true, collect everything until repeating element and include to each split file as a header

Throws:

Exception - in case of any error

split

public com.toolsverse.etl.connector.json.JsonSplitProcessor.KeyValue<Long,Long> split(IoProcessor destination,
                                                                                      InputStream stream,
                                                                                      String fileName,
                                                                                      Map<String,String> paths,
                                                                                      String destinationDir,
                                                                                      int max,
                                                                                      boolean includeHeader)
                                                                               throws Exception

Split the JSON input stream to files on specified repeating elements

Parameters:

stream - the input stream with JSON data

fileName - the name of the output file (no extension)

paths - the map of paths to repeating elements, where key is an XPath like path to repeating element and value is a suffix that should be used for this element files

destinationDir - the output files directory path

max - the maximum number of repeating elements to be included into each file

includeHeader - if true, collect everything until repeating element and include to each split file as a header

Throws:

Exception - in case of any error