If I remember correctly, just to delete a file and have it moved to
the trash is command-backspace. To delete the file right away, and
not move to the trash is command-shift-backspace. It could be
another modifier key, like option, but I'm fairly certain it's a
shift. That should do the trick for you.