When Llms Step Into The Past