Yes, if you back off the dog will know that growling works to get him out of an uncomfortable situation.
The kids need to learn to avoid the behavior that causes growling until the dog is trained (and possibly afterward as well).
The adults need to teach the dog to enjoy whatever situations cause him to growl.