Towards Concept Aware Large Language Models