Infoworks 6.1.3
Prepare Data

Source Table Watermark Configuration

For Additional Connectors and Generic JDBC Sources, if the source watermark column is of Timestamp datatype, and in ISO format/not compatible with Spark, perform the following:

  • Navigate to the pipeline Advanced Configurations page.
  • Set the dt_convert_source_watermark_to_timestamp configuration to true.

This configuration, when set to true, converts the source watermark timestamp value to Spark compatible timestamp value.