How Much Correlation Is Too Much