Yes, it is normal for puppies to lose their baby teeth, just like children lose theirs.
Pups have 28 sharp little puppy (deciduous) teeth that begin to erupt at about a month old and are all present by two months.
By 4 months, the roots of the deciduous teeth begin to resorb (dissolve).