Spark Drop Duplicates Vs Distinct