Skipping checksum when grafting files on Object store

Publisher / Stratum 0
1

Hello. We’d like to publish a large amount of files on S3(compatible) storage using cvmfs via the grafting process. However, we are finding that it is slow to graft since the entire file has to be read in order to produce the checksum. Is there a way to use the md5sum info provided by the S3 storage instead of having to recalculate it?

Thanks in advance!

Myung

2

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.

3

Hi Myung,

this is currently not supported, but could be possible with moderate effort. We’re not sure if md5 is a suitable hash though, I’ll discuss this per mail for the details.
Cheers,
Valentin