Finding Structure In Language Models