Diffusion Based Representation Matters