Diffusion Model Inverse Matrix