How Can We Know What Language Models Know