Purge the archived files

Purge After Days

The Purge After Days field allows you to define how long archived files should be retained.

• Enter a valid number of days to enable purge tracking.
• If the field is left empty or set to 0, purge functionality is disabled.

Metadata File Creation

When a valid value is provided in Purge After Days, a metadata file is created for each archived file at the archival location.

Metadata File Name

{file_name}.metadata.json

Example Metadata File

xxxxxxxxxx

{

"sourceFilePath": "csv-files/testing_file_archive/dir5/d1/SYNC_DF_TBL2.csv",

"sourceFileName": "SYNC_DF_TBL2.csv",

"archivedFilePath": "file_archive/csv/append1/d1",

"archivedAt": "2025-11-26T10:19:27.598520526Z",

"purgeAfterDays": 3,

"purgeAfter": "2025-11-29T10:19:27.598520526Z"

}

Purge Mechanism

• The system calculates the purgeAfter timestamp using the archivedAt time and purgeAfterDays.

• Any purge script can use this timestamp to delete archived files once the retention period has expired.

• If Purge After Days is not configured (empty or 0), metadata files are not created, and no purge tracking occurs.