Pipeline Job failing with Dates older than '1582-10-15' or Timestamp older than ‘1900-01-01 00 00 00.0'

Pipeline Job failing with Dates older than '1582-10-15' or Timestamp older than ‘1900-01-01 00:00:00.0'

This is due to Spark 2.X's legacy calendar.


Please add the below Spark configuration to your pipeline job and retry the job

Key:iw_spark_app_conf
Value: spark.sql.legacy.parquet.int96RebaseModeInWrite=LEGACY;spark.sql.legacy.parquet.datetimeRebaseModeInWrite=LEGACY


Next to read:
Pipeline build fails with Too many open files error

For more details, refer to our Knowledge Base and Best Practices!

For help, contact our support team!

© UNIPHORE TECHNOLOGIES 2025 | Confidential

On This Page
Pipeline Job failing with Dates older than '1582-10-15' or Timestamp older than ‘1900-01-01 00 00 00.0'Pipeline Job failing with Dates older than '1582-10-15' or Timestamp older than ‘1900-01-01 00:00:00.0'