I would assume that, like "traditional" photography with a lens, as exposure time increases sharpness decreases, all factors being equal. So using a smaller hole than the optimal may lead to decreased sharpness, but on the other hand, the decrease in sharpness may not be visible anyway.
Great discussion! R.J. R.J.