We have two cats and we are always thinking about getting more.. but space is tight! I'd say it really depends on where you are. In a big city, in an apartment I might suggest that 5+ cats might be pushing it....In a house, that many seems fine if there's lots of space and everyone gets along.
I wonder if there guidelines about this? I know my wife would want as many cats as possible - lol.