Onboarding Data from Teradata TPT

Prerequisite

Ensure to install TPT on the master node of the interactive cluster, along with the cloud specific access module using the TPT installer.

Perform the following steps to install TPT on the edge node, interactive cluster, and persistent cluster as applicable.

$inline[badge,NOTE,primary] The TPT installation procedure is OS specific.

1. Download the Teradata Tools and Utilities (TTU) installer package for the required OS.
2. Extract the installer package to a directory.
3. Navigate to the extracted directory.
4. Execute the following command: sudo ./setup.bat a

For more information on TPT installation steps, refer to Teradata Tools and Utilities Installation.

Creating a Teradata TPT Source

For creating a Teradata TPT source, see $link[page,198065,auto$]. Ensure that the Source Type selected is Teradata.

Teradata Configurations

Windows Azure Storage Blob (WASB), also known as Blob Storage, is a file system for storing large amounts of unstructured object data, such as text or binary data. For more details, see Azure Blob Storage Documentation.

For Azure Blob Storage (WASB), enter the following:

Amazon Simple Storage Service (S3) is storage for the Internet. Amazon S3 has a simple web services interface that you can use to store and retrieve any amount of data, at any time, from anywhere on the web. For more details, see Amazon S3 Documentation.

For Amazon S3, enter the following:

Google Cloud Storage (GCS) is an online file storage web service for storing and accessing data on Google Cloud Platform infrastructure. In GCS, buckets are the basic containers that hold the data. For more details, see GCS documentation.

For GCS, enter the following:

Enabling TD Wallet

Once the settings are saved, you can test the connection.

Configuring a Teradata Table

$inline[badge,NOTE,primary] While using TPT with Query as a Table, it is advised to use double quotes to enclose column names, schema name, and table name.

Target Configuration

Configure the following fields:

Optimization Configuration

Configure the following fields:

Advanced Configurations

Following are the steps to set advanced configuration for a table:

1. Click the Data Catalog menu and click Ingest for the required source.

$inline[badge,NOTE,primary] For already ingested table, click View Source, click the Tables tab, click Configure for the required table and click the Advanced Configuration tab.

2. Click the Configure Tables tab, click the Advanced Configuration tab and click Add Configuration.
3. Enter Key, Value, and Description. You can also select the configuration from the list displayed.

Configure Multiple TPT Data Writers and Readers

To configure multiple data writers and readers for TPT:

1. Click Advanced Configuration -> Add Configuration.
2. Set the following configuration parameters to any desired integer value in the Add Configuration screen:

• tpt_reader_instances
• tpt_writer_instances

3. Click Save to save the configuration changes.

Configure the Default Data Fetch Mechanism

To configure default data fetch mechanism, you must configure the following parameters at the source level or global level.

1. Click Advanced Configuration -> Add Configuration.

2. In the Add Configuration screen, enter data_fetch_ type under the Key field.

3. Add one of the following values in the Value field.

   1. jdbc
   2. tpt
   3. skip_iw_processing

4. Click Save to save the configuration changes.

Sync Data to Target

Using this option, you can configure the Target connections and sync data as described in the section $link[page,198264,auto$]

The following are the steps to sync data to target.

1. From the Data Sources menu, select one of the tables and click View Source/Ingest button.
2. Select the source table to be synchronized to Target.
3. Click the Sync Data to Target button.
4. Enter the mandatory fields as listed in the table below:

Click $link[page,198065,auto$] to navigate back to complete the onboarding process.