Does he have enough toys of his own to play with? Do you spend enough time interacting and playing with him? You can redirect him to the appropriate toy and give him treats afterward. Tire him out with a wand or fishing rod type of toy, or a laser toy (just be careful of his eyes). Teach him to fetch. Train him to a harness and take him for walks. It sounds to me like he's just being a kitten and has lots of energy to burn.
How about keeping lids on everything so that he can't have access to the stuff you don't want him to?
Please don't spray him, it doesn't teach him anything except to avoid doing this around you, which he's already apparently learned. If you don't want him getting into the garbage or whatever, make it so that he can't.
"To close your eyes will not ease another's pain." ~ Chinese Proverb
“We must not refuse to see with our eyes what they must endure with their bodies.” ~ Gretchen Wyler