If he's older than 6 months, talk to your veterinarian.
A dog's permanent teeth are usually in place by 7 months of age.
Removing retained baby teeth is important.
If they're not removed, food can collect in the gap between the adult and baby teeth, leading to decay and gum disease.