Onboarding Data from PostgreSQL

Creating a PostgreSQL Source

For onboarding data from a PostgreSQL source, see $link[page,198065,auto$]. Ensure that the Source Type selected is PostgreSQL.

PostgreSQL Configurations

Once the settings are saved, you can test the connection.

Configuring a PostgreSQL Table

$inline[badge,NOTE,primary] Columns with array and struct datatypes are not supported.

With the source metadata in the catalog, you can now configure the table for CDC and incremental synchronization.

1. Click the Configuration link, for the desired table.
2. Provide the ingestion configuration details.

Target Configuration

Configure the following fields:

Optimization Configuration

Configure the following fields:

Advanced Configurations

Following are the steps to set advanced configuration for a table:

1. Click the Data Catalog menu and click Ingest for the required source.

$inline[badge,NOTE,primary] For already ingested table, click View Source, click the Tables tab, click Configure for the required table and click the Advanced Configuration tab.

2. Click the Configure Tables tab, click the Advanced Configuration tab and click Add Configuration.
3. Enter key, value, and description. You can also select the configuration from the list displayed.

Sync Data to Target

Using this option, you can configure the Target connections and sync data as described in the section $link[page,198264,auto$]

The following are the steps to sync data to target.

1. From the Data Sources menu, select one of the tables and click View Source/Ingest button.
2. Select the source table to be synchronized to Target.
3. Click the Sync Data to Target button.
4. Enter the mandatory fields as listed in the table below:

Click $link[page,198065,auto$] to navigate back to complete the onboarding process.