Different content of a repo depending on the host


Two different clients (with the same package versions and same configuration files) have different versions of the same repo:

[root@host_1 ~]# attr -g revision /cvmfs/cms.cern.ch/
Attribute "revision" had a 6 byte value for /cvmfs/cms.cern.ch/:
[root@host_1 ~]# grep ^PY_PATH /cvmfs/cms.cern.ch/rucio/setup.sh
PY_PATH=$(ls -d --color=never ${THISDIR}/${SELECTED_VERSION}/lib/python*/site-packages)

[root@host_2 ~]# attr -g revision /cvmfs/cms.cern.ch/
Attribute "revision" had a 5 byte value for /cvmfs/cms.cern.ch/:
[root@host_2 ~]# grep ^PY_PATH /cvmfs/cms.cern.ch/rucio/setup.sh
PY_PATH=$(ls -d ${THISDIR}/${SELECTED_VERSION}/lib/python*/site-packages)

host_2 seems to have a quite old version of the content. How can I force an update?
I tried to umount and mount it again, but it didn’t help.

I also have this in the logs:

2021-06-22T13:23:38.673617+01:00 lcgui05 cvmfs2: (cms.cern.ch) geographic order of servers retrieved from cvmfs-stratum-one.cern.ch
2021-06-22T13:23:38.677071+01:00 lcgui05 cvmfs2: (cms.cern.ch) whitelist verification failed (6): invalid whitelist signature
2021-06-22T13:23:38.677326+01:00 lcgui05 cvmfs2: (cms.cern.ch) failed to fetch manifest (8 - bad whitelist), trying another stratum 1
2021-06-22T13:23:38.677534+01:00 lcgui05 cvmfs2: (cms.cern.ch) switching host from http://cvmfs-wlcg.gridpp.rl.ac.uk:8000/cvmfs/cms.cern.ch to http://cvmfs-stratum-one.cern.ch:8000/opt/cms (manually triggered)
2021-06-22T13:23:38.738104+01:00 lcgui05 cvmfs2: (cms.cern.ch) whitelist verification failed (6): invalid whitelist signature
2021-06-22T13:23:38.800969+01:00 lcgui05 cvmfs2: (cms.cern.ch) CernVM-FS: linking /cvmfs/cms.cern.ch to repository cms.cern.ch
2021-06-22T13:23:38.808463+01:00 lcgui05 cvmfs2: (cms.cern.ch) warning, could not apply updated catalog revision, entering offline mode

Any suggestion on how to fix it?

Thanks a lot in advance.

Anything that’s referring to “/opt/” has an ancient configuration that needs to be updated. There must be a .local file setting CVMFS_SERVER_URL somewhere that shouldn’t be there. There must also be a problem with the cern .pub key causing the invalid whitelist. I recommend updating the configuration to the current modern configuration.


For other reasons, I ended up reinstalling the host, and after that it is working fine.