Configure the Data Target Node
Data Target nodes provide connections to the output data.
- You have modeled the Data Transform operator with the Data Target node and connected the previous node to the Data Target node.
- You have created connections in the SAP Data Hub Connection management application.
- The connection type used in the connection definition has the STRUCTURED_TRANSFORM capability.
- Double-click the Data Target node.
Select the target data set.
If you have connected the input of the Data Target node to other nodes, then in the Columns section, the tool displays all columns from the connected node.
In Connection ID text field, enter the required connection
You can also browse and select the required connection.
- In Connection ID text field, enter the required connection ID.
(Optional) Import target data set from Metadata Catalog.
You can browse the folders in the Metadata Catalog and select the required data set.
- In the editor, choose Import from Catalog.
- Browse and select the required data set.
The tool automatically populates the connection details based on the selected data set. For more information on Metadata Catalog, see topic Managing the Catalog in the Data Governance User Guide.
Define output columns.
Select a target data set depending on the selected connection ID. After selecting the target data set, in the Columns section, define the data set.
HDFS, Amazon S3, ADL, Google Cloud Storage (GCS), and WASB1. In the Target field, browse to the required file in HDFS, Amazon S3, ADLS, Google Cloud Storage, or WASB.
2. In the Format dropdown list, select the file format type.
The tool supports Parquet, CSV, and ORC file formats. For CSV files, you can define additional CSV-specific properties such as the character set, column delimiter, and the text delimiter. The tool parses the CSV files based on the values that you provide.
3. For CSV files, select a value for Includes Header.
This value helps the tool identify whether the selected file contains a header row. If the file already has a header row, enable the Includes Header toggle button.
1. In the Schema Name field, browse to the required SAP Vora table.
The tool automatically populates the Table Name field.
- (Optional) Choose + (Add Column) to define additional columns.
Select a data type for each column.
Depending on the selected data type, you can define the length, scale, precision, or format.
Under the Primary Key column, select a column
that serves as the primary key.
Typically the data in this column is unique.
- Under the Nullable column, choose whether the column value can be empty (nullable).
- (Optional) To reorder the columns, click the up and down arrow icon. Select the column that you want to move and click the up or down arrows.
- (Optional) If you want to use the structure definition that the tool proposes for the selected file or table, in the Columns section, choose Auto Propose.
If you want to overwrite the changes in the target data set, in the
Columns section toolbar, choose
You can also append the changes in the target data set without overwriting them. In the toolbar, choose Append instead of Overwrite.
Map input columns and output columns.
- In the Columns section, under Mapping Column, select an appropriate column to map the input column names to the output columns.
- If you want to automap the columns based on column names, in the Columns pane, choose (Auto Map by Name).
If you want to configure the Data Transform operator with another node,
- In the menu bar, use the breadcrumb navigation to navigate back to the operator configuration editor.
- Add new nodes.
- To connect the nodes, select the output port of a node and drag the cursor to an input port of another node.