Performing Data Transformation
Infoworks supports various transformations that can be performed on a source. |
Following are the steps to perform transformation on data:
- Drag and drop the node from the Transformation section to the pipeline editor page.
- Connect the source node to the transformation node.
- Double-click the transformation node. The properties of the node will be displayed. For details on the node settings, see the Node Settings section.
- Configure the properties and save the settings. The properties for each node are explained in the following sections.
The following transformation nodes are not supported for pipelines in Snowflake environment:
- Lookup
- Fuzzy Match
- Custom Transformation
- Logistic Regression
- Decision Tree
- K Means Clustering
- Random Forest Classification
- Analytics Model Import
The following transformation nodes are not supported for pipelines in BigQuery environment:
- Lookup
- Fuzzy Match
- Custom Transformation
- Logistic Regression
- Decision Tree
- K Means Clustering
- Random Forest Classification
- Analytics Model Import
If the imported pipeline contains a node which is not supported in data warehouse pipeline, that node is shown to be in the error state to the user every time the editor page of that pipeline is opened. This error is visible in Warnings and Errors model of the pipeline editor page as well.
After you configure the node properties, the Preview Data page might not fetch the required data, or fetching data might take an unusually longer time. This is mainly due to network issues. To resolve such issues, see the Configuring Data Validation in Node Properties section.