Incremental ingestion is failing with unable to find the column of the target table error

Incremental ingestion is failing with "unable to find the column of the target table" error

Description:

Incremental ingestion is failing with unable to find the column of the target table. Error message in the databricks log looks something like below.

Copy

Root Cause:

This happens when CDC brings the column which is not there in the already created target table.

Solution:

To resolve this one needs to truncate, recrawl, and reingest the data for that particular table.

Applicable versions:

All versions of Datafoundry.

VariableType to search · ESC to discard
GlossaryType to search · ESC to discard
InsertType to search · ESC to discard
No matches