Stash it, or whatever the button is. I don't remember, but you can just drop the weapon. It's not permanent anyway, so when you do it's gone.