Can Large Language Models Explore In Context