Move the extra sse libs to /usr/lib/sse2. That is a bit more elitist than we need to be, but the linker already looks there without adding yet another path permutation, and in practice most people who really care about how long this is going to take won't find that sets the bar too high for them at all.
Actually, it's apparently ldconfig rather than the linker that is missing this path, but this will still do for now while people figure out if or when that should be fixed too.