As long as you drive it daily, I don't see any problem.
Why don't you clip the key to the steering wheel with some sort of chain, plastic ring or whatever?
What do they do with cars with keyless go for example? There must be a solution to your "problem".