Graphically Structured Diffusion Models Beat