What Determines Which Things Go Together