The problem was that with addition of galera3 paths to libgalera_smm.so have changed in PXC 5.5, but not in PXB 5.6 (yet).
Fixed by checking the location of libgalera_smm.so on startup in run.sh, and using the $LIBGALERA_PATH variable set in run.sh instead of hard-coded paths in tests.