spark git commit: [SPARK-23853][PYSPARK][TEST] Run Hive-related PySpark tests only for `-Phive`

2018-04-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 007ae6878 -> b857fb549 [SPARK-23853][PYSPARK][TEST] Run Hive-related PySpark tests only for `-Phive` ## What changes were proposed in this pull request? When `PyArrow` or `Pandas` are not available, the corresponding PySpark tests are

spark git commit: [SPARK-24003][CORE] Add support to provide spark.executor.extraJavaOptions in terms of App Id and/or Executor Id's

2018-04-30 Thread vanzin
Repository: spark Updated Branches: refs/heads/master b42ad165b -> 007ae6878 [SPARK-24003][CORE] Add support to provide spark.executor.extraJavaOptions in terms of App Id and/or Executor Id's ## What changes were proposed in this pull request? Added support to specify the

spark git commit: [SPARK-24072][SQL] clearly define pushed filters

2018-04-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 3121b411f -> b42ad165b [SPARK-24072][SQL] clearly define pushed filters ## What changes were proposed in this pull request? filters like parquet row group filter, which is actually pushed to the data source but still to be evaluated by