As suggested, I rebuilt the debian package (version 3.61.1+dfsg1-4) with and without adding --enable-generic to configure using a PC with AVX support. I tested the resulting packages using 2 PCs without AVX support. The package built with --enable-generic doesn't crash while the other one always does.
Applying this fix to the freefem++ package for buster would be really nice.