Regularized Conditional Diffusion Model