spark git commit: [SPARK-11303][SQL] filter should not be pushed down into sample

2015-10-28 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.5 86ee81e5c -> 3bd596de4 [SPARK-11303][SQL] filter should not be pushed down into sample When sampling and then filtering DataFrame, the SQL Optimizer will push down filter into sample and produce wrong result. This is due to the sampler

spark git commit: [SPARK-11303][SQL] filter should not be pushed down into sample

2015-10-27 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 958a0ec8f -> 360ed832f [SPARK-11303][SQL] filter should not be pushed down into sample When sampling and then filtering DataFrame, the SQL Optimizer will push down filter into sample and produce wrong result. This is due to the sampler is