Source Table Watermark Configuration

For $link[page,358635,Additional Connectors] and $link[page,358632,Generic JDBC Sources], if the source watermark column is of Timestamp datatype, and in ISO format/not compatible with Spark, perform the following:

  • Navigate to the pipeline Advanced Configurations page.
  • Set the dt_convert_source_watermark_to_timestamp configuration to true.

This configuration, when set to true, converts the source watermark timestamp value to Spark compatible timestamp value.

VariableType to search · ESC to discard
GlossaryType to search · ESC to discard
InsertType to search · ESC to discard
No matches
On This Page