Do not feed a puppy cow's milk, goat's milk, or human infant formula although puppy formulas may contain some similar ingredients. ... Feed your puppies while they're lying on their stomachs, to mimic the way they nurse in real life. Just as with human babies, puppies need to be burped after feeding.