Yes, it is normal for puppies to lose their baby teeth, just like children lose theirs.
Pups have 28 sharp little puppy (deciduous) teeth that begin to erupt at about a month old and are all present by two months.
Next, the long fang-like canine teeth should fall out as the permanent canines erupt.