Taking a puppy away from its mother in the transitional stage (2-4 weeks) can create a number of problems for later life.
Any time before 8 weeks even, can cause problems so that a puppy is pre-disposed to become fearful of other dogs.
Ideally the whole litter should be kept together until at least 8 weeks.