Parquet Connector

The parquet connector allows exporting data in parquet format to the local filesystem. In the current implementation, the parquet connector is write-only.

Connector Specific Connection Properties

name

description 

path

a path to the local filesystem

Parquet connector data source creation
call SYSADMIN.createConnection(name => <parquetalias>, jbossCLITemplateName => 'parquet', connectionOrResourceAdapterProperties => 'path="path/to/folder"') ;;
call SYSADMIN.createDataSource(name => <parquetalias>, translator => 'parquet', modelProperties => null, translatorProperties => null) ;;

Usage

Data is exported by using the SELECT INTO command:

Usage
SELECT *
INTO <parquet data source name>.<file name>
FROM ...

The data will be exported into the folder that is specified via connection property path. The filename is generated using the pattern <parquet data source name>_<name provided in select into command>.parquet. An already existing file with the same name will be overridden.

Example

Example usage
call SYSADMIN.createConnection(name => 'parquet_1', jbossCLITemplateName => 'parquet', connectionOrResourceAdapterProperties => 'path="/home/exportuser/examples"') ;;
call SYSADMIN.createDataSource(name => 'parquet_1', translator => 'parquet', modelProperties => null, translatorProperties => null) ;;
 
SELECT *
INTO parquet_1.example_salesorderdetail
FROM adventurework.salesorderdetail ;;
 
-- content of table salesorderdetail in schema adventureworks will be exported into a file parquet_1.example_salesorderdetail.parquet in folder /home/exportuser/examples