How to add custom tags to Infoworks Job clusters

How to add custom tags to Infoworks Job clusters?

Description

By default the Infoworks Job clusters spun up for ingestion or pipelines jobs will have a few default tags

If customers wish to add a few custom tags to the Job clusters please follow this document.

Solution

We can add custom tags by editing the file {$IW_HOME}/conf/databricks_defaults_aws.json (for AWS Databricks) on the Infoworks Server. For

Example:

From


"standard": { "custom_tags": {}, "spark_env_vars": { "PYSPARK_PYTHON": "/databricks/python3/bin/python3" },

to


"standard": { "custom_tags": {"environment":"demo", "product":"4.2iwx"}, "spark_env_vars": { "PYSPARK_PYTHON": "/databricks/python3/bin/python3" },

Note: Databricks allows at most 45 custom tags

Application versions

Infoworks  AWS Databricks 4.x, 5.x