Rethinking Deep Marginal Extension