Teething. Regardless of a puppy's world of discovery missions, teething is the most common cause of bad breath in puppies.
Teething smells are sometimes "fishy" or "rotten." The entire process lasts for about 4 weeks, so if you can keep your nose pointed away from your pup's mouth, you'lll be fine.