Purge the archived files

Purge After Days

The Purge After Days field allows you to define how long archived files should be retained.

  • Enter a valid number of days to enable purge tracking.

  • If the field is left empty or set to 0, purge functionality is disabled.


Metadata File Creation

When a valid value is provided in Purge After Days, a metadata file is created for each archived file at the archival location.

Metadata File Name

{file_name}.metadata.json

Example Metadata File

{ "sourceFilePath": "csv-files/testing_file_archive/dir5/d1/SYNC_DF_TBL2.csv", "sourceFileName": "SYNC_DF_TBL2.csv", "archivedFilePath": "file_archive/csv/append1/d1", "archivedAt": "2025-11-26T10:19:27.598520526Z", "purgeAfterDays": 3, "purgeAfter": "2025-11-29T10:19:27.598520526Z" }

Purge Mechanism

  • The system calculates the purgeAfter timestamp using the archivedAt time and purgeAfterDays.

  • Any purge script can use this timestamp to delete archived files once the retention period has expired.

  • If Purge After Days is not configured (empty or 0), metadata files are not created, and no purge tracking occurs.


On This Page