Offline Equilibrium Finding