Ingestion job fails with java.util.concurrent.ExecutionException java.io.FileNotFoundException in DataFoundry 4.2

Ingestion job fails with java.util.concurrent.ExecutionException: java.io.FileNotFoundException in DataFoundry 4.2

Problem Description:

Ingestion job fails with the below error in Infoworks DataFoundry 4.2

{"life_cycle_state":"INTERNAL_ERROR","result_state":"FAILED","state_message":"Library installation failed for library jar: \"dbfs:/infoworks/lib/ingestion-dist/commons.jar\"\n. Error messages:\njava.lang.RuntimeException: ManagedLibraryInstallFailed: java.util.concurrent.ExecutionException: java.io.FileNotFoundException: dbfs:/infoworks/lib/ingestion-dist/commons.jar for library:JavaJarId(dbfs:/infoworks/lib/ingestion-dist/commons.jar,,NONE),isSharedLibrary=false"}

Root Cause: This issue happens is some of the ingestion related jars are not copied properly into the Databricks file system(dbfs) during the DataFoundry Installation process.

**Solution:**Perform the below steps to copy the jars manually into dbfs and then trigger the ingestion job again.

a) Login to Infoworks Edge node.

b) sudo su infoworks

c) source /opt/infoworks/bin/env.sh;

dbfs cp --overwrite /lib/ingestion-dist/commons.jar dbfs:/lib/ingestion-dist/commons.jar; dbfs cp --overwrite /lib/ingestion-dist/pojo.jar dbfs:/lib/ingestion-dist/pojo.jar; dbfs cp --overwrite /lib/ingestion-dist/dao.jar dbfs:/lib/ingestion-dist/dao.jar; dbfs cp --overwrite /lib/ingestion-dist/core.jar dbfs:/lib/ingestion-dist/core.jar; dbfs cp --overwrite /lib/ingestion-dist/json-simple-1.1.1.jar dbfs:/lib/ingestion-dist/json-simple-1.1.1.jar; dbfs cp --overwrite /lib/ingestion-dist/mongo-java-driver-3.9.1.jar dbfs:/lib/ingestion-dist/mongo-java-driver-3.9.1.jar; dbfs cp --overwrite /lib/platform/scala-utils/sparkMetrics-assembly.jar dbfs:/lib/platform/scala-utils/sparkMetrics-assembly.jar

Sample command:

dbfs cp --overwrite /opt/infoworks/lib/ingestion-dist/lib/commons.jar dbfs:/infoworks/lib/ingestion-dist/commons.jar;

where is /opt/infoworks/lib/ingestion-dist and is /infoworks. Provide these paths according to your installation.

d) Run the ingestion job again.

Applicable Infoworks DataFoundry Versions:

v4.2

Next to read:
Is it possible to change domain of existing pipeline in IWX

For more details, refer to our Knowledge Base and Best Practices!

For help, contact our support team!

© UNIPHORE TECHNOLOGIES 2025 | Confidential

On This Page
Ingestion job fails with java.util.concurrent.ExecutionException java.io.FileNotFoundException in DataFoundry 4.2Ingestion job fails with java.util.concurrent.ExecutionException: java.io.FileNotFoundException in DataFoundry 4.2