svn commit: r29982 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_09_16_02-faf73dc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-09 Thread pwendell
Author: pwendell Date: Tue Oct 9 23:17:14 2018 New Revision: 29982 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_09_16_02-faf73dc docs [This commit notification would consist of 1482 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25559][FOLLOW-UP] Add comments for partial pushdown of conjuncts in Parquet

2018-10-09 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 3eee9e024 -> faf73dcd3 [SPARK-25559][FOLLOW-UP] Add comments for partial pushdown of conjuncts in Parquet ## What changes were proposed in this pull request? This is a follow up of https://github.com/apache/spark/pull/22574. Renamed the

svn commit: r29973 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_09_08_03-3eee9e0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-09 Thread pwendell
Author: pwendell Date: Tue Oct 9 15:17:22 2018 New Revision: 29973 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_09_08_03-3eee9e0 docs [This commit notification would consist of 1482 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25535][CORE] Work around bad error handling in commons-crypto.

2018-10-09 Thread irashid
Repository: spark Updated Branches: refs/heads/master deb9588b2 -> 3eee9e024 [SPARK-25535][CORE] Work around bad error handling in commons-crypto. The commons-crypto library does some questionable error handling internally, which can lead to JVM crashes if some call into native code fails and

spark git commit: [SPARK-24851][UI] Map a Stage ID to it's Associated Job ID

2018-10-09 Thread tgraves
Repository: spark Updated Branches: refs/heads/master e3133f4ab -> deb9588b2 [SPARK-24851][UI] Map a Stage ID to it's Associated Job ID It would be nice to have a field in Stage Page UI which would show mapping of the current stage id to the job id's to which that stage belongs to. ## What

svn commit: r29965 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_09_04_02-e3133f4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-09 Thread pwendell
Author: pwendell Date: Tue Oct 9 11:16:46 2018 New Revision: 29965 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_09_04_02-e3133f4 docs [This commit notification would consist of 1481 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29963 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_09_02_02-404c840-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-09 Thread pwendell
Author: pwendell Date: Tue Oct 9 09:16:59 2018 New Revision: 29963 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_09_02_02-404c840 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25497][SQL] Limit operation within whole stage codegen should not consume all the inputs

2018-10-09 Thread kiszk
Repository: spark Updated Branches: refs/heads/master 46fe40838 -> e3133f4ab [SPARK-25497][SQL] Limit operation within whole stage codegen should not consume all the inputs ## What changes were proposed in this pull request? This PR is inspired by https://github.com/apache/spark/pull/22524,

svn commit: r29962 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_09_00_02-46fe408-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-09 Thread pwendell
Author: pwendell Date: Tue Oct 9 07:16:42 2018 New Revision: 29962 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_09_00_02-46fe408 docs [This commit notification would consist of 1481 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25669][SQL] Check CSV header only when it exists

2018-10-09 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.4 4baa4d42a -> 404c84039 [SPARK-25669][SQL] Check CSV header only when it exists ## What changes were proposed in this pull request? Currently the first row of dataset of CSV strings is compared to field names of user specified or

spark git commit: [SPARK-25669][SQL] Check CSV header only when it exists

2018-10-09 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master a4b14a9cf -> 46fe40838 [SPARK-25669][SQL] Check CSV header only when it exists ## What changes were proposed in this pull request? Currently the first row of dataset of CSV strings is compared to field names of user specified or inferred