Inverse Graph Physics