Yes, it is normal for puppies to lose their baby teeth, just like children lose theirs.
Pups have 28 sharp little puppy (deciduous) teeth that begin to erupt at about a month old and are all present by two months.
All of the 42 permanent teeth should be in place by the time a puppy is about 6 months old.