SAP Vora Loader
The SAP Vora Loader operator works as a client for the SAP Vora transaction coordinator and allows you to load data into SAP Vora.
For now, loading data is supported through HDFS, WEBHDFS, S3 and ADLS.
Configuration Parameters
Parameter |
Type |
Description |
---|---|---|
connection |
object |
Holds information abount connection information for the services. |
configurationType |
string |
connection parameter: Which type of connection information will be used: Manual (user input) or retrieved by the Connection Management Service. Default: "" |
connectionID |
string |
connection parameter: The ID of the connection information to retrieve from the Connection Management Service. Default: "" |
connectionProperties |
object |
connection parameter: All the connection properties for the selected service for manual input. |
storage |
string |
The file service to operate. Additional parameters may depend on the selected service. Default: "local" |
host |
string |
Hostname of SAP Vora instance. Default: "localhost" |
port |
string |
Port of SAP Vora instance. Default: "9090" |
tenant |
string |
Tenant of SAP Vora instance. Default: "" |
user |
string |
SAP Vora username. Default: "" |
password |
string |
SAP Vora password. Default: "" |
clientId |
string |
Mandatory. ADL parameter: The client ID from ADLS. Default: "" |
tenantId |
string |
Mandatory. ADL parameter: The tenant ID from ADLS. Default: "" |
clientKey |
string |
Mandatory. ADL parameter: The client key from ADLS. Default: "" |
accountName |
string |
Mandatory. ADL parameter:The account name from ADLS. Default: "" |
rootPath |
string |
ADL parameter: The optional root path name for browsing. Starts with a slash (e.g. /MyFolder/MySubfolder). Default: "/MyFolder/MySubfolder" |
host |
string |
Mandatory. HDFS parameter: The IP address to the Hadoop name node. Default: "127.0.0.1" |
port |
string |
Mandatory. HDFS parameter: The port to the Hadoop name node. Default: "9000" |
user |
string |
Mandatory. HDFS parameter: The Hadoop user name. Default: "hdfs" |
rootPath |
string |
HDFS parameter: The optional root path name for browsing. Starts with a slash (e.g. /MyFolder/MySubfolder). Default: "/MyFolder/MySubfolder" |
accessKey |
string |
Mandatory. S3 parameter: The AWS access key ID. Default: "AWSAccessKeyId" |
secretKey |
string |
Mandatory. S3 parameter: The AWS secret access key. Default: "AWSSecretAccessKey" |
endpoint |
string |
S3 parameter: allows a custom endpoint http://awsEndpointURL Default: "" |
awsBucket |
string |
S3 parameter: AWS bucket name. Default: "" |
region |
string |
Mandatory. S3 parameter: The AWS region to create the bucket in. Default: "eu-central-1" |
rootPath |
string |
Mandatory. S3 parameter: The optional root path name for browsing. Starts with a slash and the bucket name (e.g. /MyBucket/MyFolder). Default: "/MyBucket/MyFolder" |
rootPath |
string |
WebHDFS parameter: The optional root path name for browsing. Starts with a slash (e.g. /MyFolder/MySubfolder). Default: "/MyFolder/MySubfolder" |
protocol |
string |
Mandatory. WebHDFS parameter: The scheme used on WebHDFS connection (webhdfs/http or swebhdfs/https). Default: "webhdfs" |
host |
string |
Mandatory. WebHDFS parameter: The IP address to the WebHDFS node. Default: "localhost" |
port |
string |
Mandatory. WebHDFS parameter: The port to the WebHDFS node. Default: "9000" |
user |
string |
Mandatory. WebHDFS parameter: The WebHDFS user name. Default: "hdfs" |
protocol |
string |
Mandatory. S3 parameter: The protocol schema to be used (HTTP or HTTPS). Default: "HTTP" |
initStatements |
string |
SQL code to be executed when the operator is initialized. Default: "CREATE SCHEMA TEST;CREATE TABLE TEST.T1(V VARCHAR(\*));" |
tableName |
string |
Mandatory. The name of the table where the loaded file is inserted. Default: "TEST.T1" |
delimiter |
string |
Mandatory. The character used to separate column values. Default: "," |
tableName |
string |
The name of the table where the loaded file is inserted. Default: "TEST.T1" |
delimiter |
string |
The character used to separate column values. Default: "," |
fileFormat |
string |
The format of the file to be loaded. Default: "csv" |
numRetryAttempts |
int |
The number of retry attempts. Default: 0 |
retryPeriodInMs |
int |
The waiting time in milliseconds between consecutive retry attempts. Default: 0 |
hadoopNamenode |
string |
The Hadoop name node address to receive data from. Default: "localhost:9000" |
Input
Input |
Type |
Description |
---|---|---|
inFilename |
string |
The storage path of the file to be loaded to the transaction coordinator. |
Output
Output |
Type |
Description |
---|---|---|
outResult |
string |
Either "Successfully executed sql!" or the appropriate error message. |