Point Diffusion Implicit Memory System