The Forward Pass Determines The Sum