By the gods yes please fix this... only warn me if something is not saved... otherwise don't ask confirmation of what I told you to do.
If "prompting only when unsaved" is too difficult to add... AT LEAST give us a preference to turn this off.
This has got to be the most annoying "feature"