Ingesting Tables in Segments

$inline[badge,IMPORTANT,warning] Segmentation is applicable for the following sources:

• Native RDBMS (except log-based tables)
• Salesforce
• Generic JDBC
• CDATA

$inline[badge,NOTE,primary] Segmented load can only be performed if at least one table in the specific source has been submitted for ingestion.

Following are the steps to perform segmented load on a table:

1. Navigate to the required source.
2. Click the Tables tab.
3. Click the $inline[icon,fas fa-ellipsis-v] icon near the Details option for the required table and click the Start Segmentation option. This option will be available only for the tables with Not Loaded status.

4. In the Start Segmentation window, click the Add Column button.

5. Select the following details:

6. You can click the Add Column button to add more columns for segmentation. For example, in this use case, you can select the required records of the firstname and last_modified columns and ingest them.

7. Click Start. The segmentation details will be displayed.

8. Select the required records and click Ingest.
9. In the Ingest Data page, provide the ingestion details and click Ingest. For details, see $link[page,179689,auto$]. The status of segmentation will be displayed in the Status column.

• You can click End Segmentation to stop the segmentation in progress or click Refresh Segmentation Value to refresh the page with the latest segmentation configurations.
• When all the segments have been crawled, the message, all the table segments have been loaded. You can proceed with End Segmentation, will be displayed.
• If the table includes segments that have not been ingested, you can continue the segmentation by clicking $inline[icon,fas fa-ellipsis-v] icon near the Details option and clicking Continue Segmentation.

Advanced Configurations

• sfdcSegDateFormat: The date format for SFDC segment load. The default value is E MMM dd HH:mm:ss z uuuu. This is a source-level configuration.
• max_number_of_chunks_default: The maximum number of unique segments for segmentation. The default value is 2000. This is a table-level configuration.

$inline[badge,Limitations,warning]

• For Salesforce sources, the segments selected must not have carriage return values.
• In Teradata source, for TPT tables, segment load is supported only if all segments are run as a single job.