As part of an initial repository publish, I’m running into a libcurl error (65). It’s the initial stratum0, uses an S3 backend (HTTPS, Vast). I’m curious if I could get some help debugging this. From some searching, it seems cvmfs might not have https seek retry via libcurl implemented?
Apr 29 22:53:44 cmvfs-local cvmfs_swissknife[10571]: unexpected curl error (65) while trying to upload [server]/data/02/83d5c1359026aa8511cb9687c93b6685caf37a-shake128P: necessary data rewind wasn’t possible
Apr 29 22:53:44 cmvfs-local cvmfs_swissknife[10571]: unexpected curl error (65) while trying to upload [server]/data/9e/1c2cfd362d8e552ce6cc43c5ec91acdab33ef3-shake128P: necessary data rewind wasn’t possible
Apr 29 22:53:45 cmvfs-local cvmfs_swissknife[10571]: unexpected curl error (65) while trying to upload [server]/data/7b/a67b3fe24732a8cb30bc2a0a928d9e0d61c1f8-shake128P: necessary data rewind wasn’t possible
my s3.conf doesn’t have a ton of tunables:
CVMFS_S3_MAX_NUMBER_OF_PARALLEL_CONNECTIONS=500
CVMFS_S3_DNS_BUCKETS=false
CVMFS_S3_USE_HTTPS=true
server.conf:
CVMFS_CREATOR_VERSION=143
CVMFS_REPOSITORY_NAME=[server]
CVMFS_REPOSITORY_TYPE=stratum0
CVMFS_USER=root
CVMFS_UNION_DIR=/cvmfs/[server]
CVMFS_SPOOL_DIR=/var/spool/cvmfs/[server]
CVMFS_STRATUM0=https://[server]/path
CVMFS_UPSTREAM_STORAGE=S3,/var/spool/cvmfs/[server]/tmp,[server]@/etc/cvmfs/s3.conf
CVMFS_USE_FILE_CHUNKING=true
CVMFS_MIN_CHUNK_SIZE=4194304
CVMFS_AVG_CHUNK_SIZE=8388608
CVMFS_MAX_CHUNK_SIZE=16777216
CVMFS_UNION_FS_TYPE=overlayfs
CVMFS_HASH_ALGORITHM=shake128
CVMFS_COMPRESSION_ALGORITHM=none
CVMFS_FILE_MBYTE_LIMIT=10240
CVMFS_EXTERNAL_DATA=false
CVMFS_AUTO_TAG=true
CVMFS_AUTO_TAG_TIMESPAN=“8 weeks ago”
CVMFS_GARBAGE_COLLECTION=false
CVMFS_AUTO_REPAIR_MOUNTPOINT=true
CVMFS_AUTOCATALOGS=true
CVMFS_ASYNC_SCRATCH_CLEANUP=true
CVMFS_PRINT_STATISTICS=false
CVMFS_UPLOAD_STATS_DB=false
CVMFS_UPLOAD_STATS_PLOTS=false
CVMFS_IGNORE_XDIR_HARDLINKS=true