Structured file ingestion is failing with java.lang.IllegalArgumentException Delimiter cannot be more than one character

Structured file ingestion is failing with java.lang.IllegalArgumentException: Delimiter cannot be more than one character

Problem Description:

Structured file ingestion failing with java.lang.IllegalArgumentException: Delimiter cannot be more than one character error, sample stack trace looks like below,

Copy

Root cause:

Spark 2 doesn't support multi-character delimiter during CSV read. The databricks runtime version(5.5) we use for the submission of the job has spark version 2.X. So by default files with multi-character delimiter will fail with the below-mentioned error.

Solution:

Spark 3 can handle multi-character delimiter so if we submit the with databricks runtime 7.2X we can avoid above mentioned error while crawling the data. Below is the advanced configuration one needs to set at the table or the source level to run an ingestion job on different runtime than the default one.

Copy

Applicable IWX versions:

IWX 4.2

VariableType to search · ESC to discard
GlossaryType to search · ESC to discard
InsertType to search · ESC to discard
No matches
Next to read:
Sync to Target (Teradata failing)

For more details, refer to our Knowledge Base and Best Practices!

For help, contact our support team!

© UNIPHORE TECHNOLOGIES 2025 | Confidential

On This Page
Structured file ingestion is failing with java.lang.IllegalArgumentException Delimiter cannot be more than one characterStructured file ingestion is failing with java.lang.IllegalArgumentException: Delimiter cannot be more than one character