One Click Direct Policy Optimization