Definitely vet. While a cat cold isn't fatal, the danger is that cats lose their sense of smell and taste and won't eat or drink. As the others said, several days without food and water is not good for kitty. Their liver and kidneys can't handle that.
You may have to syringe feed him and keep him hydrated as he's working through the cold.