spark git commit: [SPARK-15957][ML] RFormula supports forcing to index label

2016-10-10 Thread yliang
Repository: spark Updated Branches: refs/heads/master b515768f2 -> 19401a203 [SPARK-15957][ML] RFormula supports forcing to index label ## What changes were proposed in this pull request? ```RFormula``` will index label only when it is string type currently. If the label is numeric type and

spark git commit: [SPARK-17844] Simplify DataFrame API for defining frame boundaries in window functions

2016-10-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 0c0ad436a -> b515768f2 [SPARK-17844] Simplify DataFrame API for defining frame boundaries in window functions ## What changes were proposed in this pull request? When I was creating the example code for SPARK-10496, I realized it was

spark git commit: [SPARK-17719][SPARK-17776][SQL] Unify and tie up options in a single place in JDBC datasource package

2016-10-10 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 19a5bae47 -> 0c0ad436a [SPARK-17719][SPARK-17776][SQL] Unify and tie up options in a single place in JDBC datasource package ## What changes were proposed in this pull request? This PR proposes to fix arbitrary usages among `Map[String,

spark git commit: [SPARK-17816][CORE] Fix ConcurrentModificationException issue in BlockStatusesAccumulator

2016-10-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 90217f9de -> 19a5bae47 [SPARK-17816][CORE] Fix ConcurrentModificationException issue in BlockStatusesAccumulator ## What changes were proposed in this pull request? Change the BlockStatusesAccumulator to return immutable object when value

spark git commit: [SPARK-16896][SQL] Handle duplicated field names in header consistently with null or empty strings in CSV

2016-10-10 Thread wenchen
Repository: spark Updated Branches: refs/heads/master d5ec4a3e0 -> 90217f9de [SPARK-16896][SQL] Handle duplicated field names in header consistently with null or empty strings in CSV ## What changes were proposed in this pull request? Currently, CSV datasource allows to load duplicated

spark git commit: [SPARK-17738][TEST] Fix flaky test in ColumnTypeSuite

2016-10-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 d719e9a08 -> ff9f5bbf1 [SPARK-17738][TEST] Fix flaky test in ColumnTypeSuite ## What changes were proposed in this pull request? The default buffer size is not big enough for randomly generated MapType. ## How was this patch tested?

spark git commit: [SPARK-17738][TEST] Fix flaky test in ColumnTypeSuite

2016-10-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 03c40202f -> d5ec4a3e0 [SPARK-17738][TEST] Fix flaky test in ColumnTypeSuite ## What changes were proposed in this pull request? The default buffer size is not big enough for randomly generated MapType. ## How was this patch tested? Ran

spark git commit: [SPARK-14610][ML] Remove superfluous split for continuous features in decision tree training

2016-10-10 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 29f186bfd -> 03c40202f [SPARK-14610][ML] Remove superfluous split for continuous features in decision tree training ## What changes were proposed in this pull request? A nonsensical split is produced from method

spark git commit: [SPARK-14082][MESOS] Enable GPU support with Mesos

2016-10-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3f8a0222e -> 29f186bfd [SPARK-14082][MESOS] Enable GPU support with Mesos ## What changes were proposed in this pull request? Enable GPU resources to be used when running coarse grain mode with Mesos. ## How was this patch tested?

spark git commit: [SPARK-17828][DOCS] Remove unused generate-changelist.py

2016-10-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 689de9200 -> 3f8a0222e [SPARK-17828][DOCS] Remove unused generate-changelist.py ## What changes were proposed in this pull request? We can remove this file based on discussion at https://issues.apache.org/jira/browse/SPARK-17828 it's

spark git commit: [SPARK-17830] Annotate spark.sql package with InterfaceStability

2016-10-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 4bafacaa5 -> 689de9200 [SPARK-17830] Annotate spark.sql package with InterfaceStability ## What changes were proposed in this pull request? This patch annotates the InterfaceStability level for top level classes in o.a.spark.sql and

spark git commit: [SPARK-17417][CORE] Fix # of partitions for Reliable RDD checkpointing

2016-10-10 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 7e16c94f1 -> 4bafacaa5 [SPARK-17417][CORE] Fix # of partitions for Reliable RDD checkpointing ## What changes were proposed in this pull request? Currently the no. of partition files are limited to 1 files (%05d format). If there are

spark git commit: [SPARK-17417][CORE] Fix # of partitions for Reliable RDD checkpointing

2016-10-10 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.0 d27df3579 -> d719e9a08 [SPARK-17417][CORE] Fix # of partitions for Reliable RDD checkpointing ## What changes were proposed in this pull request? Currently the no. of partition files are limited to 1 files (%05d format). If there

spark git commit: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSqlParserSuite`

2016-10-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 23ddff4b2 -> 7e16c94f1 [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSqlParserSuite` ## What changes were proposed in this pull request? The function `SparkSqlParserSuite.createTempViewUsing` is not used for now and causes build

[2/2] spark git commit: [SPARK-17338][SQL] add global temp view

2016-10-10 Thread wenchen
[SPARK-17338][SQL] add global temp view ## What changes were proposed in this pull request? Global temporary view is a cross-session temporary view, which means it's shared among all sessions. Its lifetime is the lifetime of the Spark application, i.e. it will be automatically dropped when the

[1/2] spark git commit: [SPARK-17338][SQL] add global temp view

2016-10-10 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 16590030c -> 23ddff4b2 http://git-wip-us.apache.org/repos/asf/spark/blob/23ddff4b/sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala -- diff