I can't reproduce this problem on my systems, but it's quite plausible - the sane backend was split out into a separate binary due to the difficulties in using sane from a long-running process.
I've just uploaded colord 0.1.21. Although I'm not aware of any specific colord-sane bugfixes in there, can you please check whether this is fixed in the new version? If not, could you please gather some information about what's spinning - this could be as simple as installing linux-tools, colord debugging symbols, and running ‘perf top’ when your system is in this state.
signature.asc
Description: This is a digitally signed message part