Learning To Prompt Segment Anything Models