Does Simple Diffusion Go Against The Gradient