Graphically Structured Diffusion Model