Can Llms Generate Probabilities