You can start mixing powdered goat's milk with baby food to start getting them off mom's milk.
By 6 weeks, a puppy can handle solid foods, so yes.
You might want to stick with soft treats for a while, though, just in case the hard ones are too tough for him.