When dogs clean themselves after going to the bathroom, there may be a foul-smelling excretion from the tail area that's transmitting into their mouth, and many pet parents describe it as fishy smelling. On either side of your dog's anus is a pair of anal glands or anal sacs.