I agree with Shay and doubly agree with Rustycat.
I admit years ago, I bought over the counter stuff as far as flea shampoos, area sprays, flea collars..the whole nine yards. I spent more money and time trying to battle flea problems until we switched to Revolution for our cats and Advantage II for our dogs.
Your picture does look like flea infestation and do yourself and kitty a huge favour. Spend a little extra money, take kitty to the vet and purchase quality topical products.
Good luck and please keep us posted.