Parquet Connector
The parquet connector allows exporting data in parquet format to the local filesystem. In the current implementation, the parquet connector is write-only.
Connector Specific Connection Properties
name |
description |
path |
a path to the local filesystem |
Parquet connector data source creation
call SYSADMIN.createConnection(
name
=> <parquetalias>, jbossCLITemplateName =>
'parquet'
, connectionOrResourceAdapterProperties =>
'path="path/to/folder"'
) ;;
call SYSADMIN.createDataSource(
name
=> <parquetalias>, translator =>
'parquet'
, modelProperties =>
null
, translatorProperties =>
null
) ;;
Usage
Data is exported by using the SELECT INTO command:
Usage
SELECT
*
INTO
<parquet data source
name
>.<file
name
>
FROM
...
The data will be exported into the folder that is specified via connection property path. The filename is generated using the pattern <parquet data source name>_<name provided in select into command>.parquet. An already existing file with the same name will be overridden.
Example
Example usage
call SYSADMIN.createConnection(
name
=>
'parquet_1'
, jbossCLITemplateName =>
'parquet'
, connectionOrResourceAdapterProperties =>
'path="/home/exportuser/examples"'
) ;;
call SYSADMIN.createDataSource(
name
=>
'parquet_1'
, translator =>
'parquet'
, modelProperties =>
null
, translatorProperties =>
null
) ;;
SELECT
*
INTO
parquet_1.example_salesorderdetail
FROM
adventurework.salesorderdetail ;;
-- content of table salesorderdetail in schema adventureworks will be exported into a file parquet_1.example_salesorderdetail.parquet in folder /home/exportuser/examples