For regular dataflow operation, Borealis writes files with .rawacf suffix. rsync_to_nas zips them up so the suffix is now .rawacf.bz2 and then transfers them to the NAS. When this transfer to the NAS fails, the .rawacf.bz2 files remain on the Borealis computer until the next time rsync_to_nas runs.
This situation occurred at Clyde River recently, and the following issues arose:
- The
.rawacf.bz2 suffix was handled incorrectly, so the file was treated as an unknown type and moved to the conversion failure
- The file wasn't backed up before moving to conversion failure
This issue is likely a syntax problem within the file suffix checking logic.
For regular dataflow operation, Borealis writes files with
.rawacfsuffix. rsync_to_nas zips them up so the suffix is now.rawacf.bz2and then transfers them to the NAS. When this transfer to the NAS fails, the.rawacf.bz2files remain on the Borealis computer until the next time rsync_to_nas runs.This situation occurred at Clyde River recently, and the following issues arose:
.rawacf.bz2suffix was handled incorrectly, so the file was treated as an unknown type and moved to the conversion failureThis issue is likely a syntax problem within the file suffix checking logic.