There is another, perhaps obsolete, consideration.Some CPUs do not have floating point units. C, for example, is carefully set up so that when you don't need floating point, it isn't required to have an FPU. This made C usable on cheap processors.
It's sorta like "why is the GC linked in even though I never used it?"