Our usual procedure for potty training puppies is to make a trip outside for potty immediately upon getting up in the morning or from a nap, before and after play (and watch them for signs they have to pee while playing because at very young ages they may get the 'call' when they're active
), and at least every two hours to start.
Another rule of thumb is that the pup can hold it's potty for one hour per month of age--so 2 hours at 2 mos of age, 3 at 3 mos, etc--but every pup is different and you may have to adjust that schedule to accommodate your little one.
If you catch them in the act of eliminating indoors, interrupt them with a vocal signal (we just use a guttural "uh-uh") and take them outdoors. Don't make a fuss--just take them out and then praise them when they finish up outside.
If you find a mess but didn't catch pup in the act, just clean it up and don't correct the dog at all--after the fact, pup won't make the connection between the correction and having eliminated in the house.
And above all, patience, patience, patience.
It may take some time, but it'll happen.