Learning Physics From Scratch