In most cases, no, they will not harm your dog. Yes, graham crackers can negatively impact your dog if fed to them in excess. When dogs eat sugary treats, it can cause them to gain weight. It can also potentially cause them to have other long-lasting health problems, including diabetes.