spark git commit: [SPARK-22495] Fix setup of SPARK_HOME variable on Windows

2017-11-22 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 1edb3175d -> b4edafa99 [SPARK-22495] Fix setup of SPARK_HOME variable on Windows ## What changes were proposed in this pull request? Fixing the way how `SPARK_HOME` is resolved on Windows. While the previous version was working with the

spark git commit: [SPARK-21866][ML][PYSPARK] Adding spark image reader

2017-11-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 0605ad761 -> 1edb3175d [SPARK-21866][ML][PYSPARK] Adding spark image reader ## What changes were proposed in this pull request? Adding spark image reader, an implementation of schema for representing images in spark DataFrames The code

spark git commit: [SPARK-22543][SQL] fix java 64kb compile error for deeply nested expressions

2017-11-22 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 327d25fe1 -> 0605ad761 [SPARK-22543][SQL] fix java 64kb compile error for deeply nested expressions ## What changes were proposed in this pull request? A frequently reported issue of Spark is the Java 64kb compile error. This is because

spark git commit: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Backport PR 19779 to branch-2.2 - Support writing to Hive table which uses Avro schema url 'avro.schema.url'

2017-11-22 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 df9228b49 -> b17f4063c [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Backport PR 19779 to branch-2.2 - Support writing to Hive table which uses Avro schema url 'avro.schema.url' ## What changes were proposed in this pull request? >

spark git commit: [SPARK-22572][SPARK SHELL] spark-shell does not re-initialize on :replay

2017-11-22 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 572af5027 -> 327d25fe1 [SPARK-22572][SPARK SHELL] spark-shell does not re-initialize on :replay ## What changes were proposed in this pull request? Ticket: [SPARK-22572](https://issues.apache.org/jira/browse/SPARK-22572) ## How was this

spark git commit: [SPARK-20101][SQL][FOLLOW-UP] use correct config name "spark.sql.columnVector.offheap.enabled"

2017-11-22 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 2c0fe818a -> 572af5027 [SPARK-20101][SQL][FOLLOW-UP] use correct config name "spark.sql.columnVector.offheap.enabled" ## What changes were proposed in this pull request? This PR addresses [the spelling

spark git commit: [SPARK-22445][SQL][FOLLOW-UP] Respect stream-side child's needCopyResult in BroadcastHashJoin

2017-11-22 Thread wenchen
Repository: spark Updated Branches: refs/heads/master e0d7665ce -> 2c0fe818a [SPARK-22445][SQL][FOLLOW-UP] Respect stream-side child's needCopyResult in BroadcastHashJoin ## What changes were proposed in this pull request? I found #19656 causes some bugs, for example, it changed the result