spark git commit: Provide same info as in spark-submit --help

2016-01-28 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4a0912321 -> c2204436a Provide same info as in spark-submit --help this is stated for --packages and --repositories. Without stating it for --jars, people expect a standard java classpath to work, with expansion and using a different deli

spark git commit: [SPARK-12818][SQL] Specialized integral and string types for Count-min Sketch

2016-01-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master c2204436a -> 415d0a859 [SPARK-12818][SQL] Specialized integral and string types for Count-min Sketch This PR is a follow-up of #10911. It adds specialized update methods for `CountMinSketch` so that we can avoid doing internal/external row

spark git commit: [SPARK-12926][SQL] SQLContext to display warning message when non-sql configs are being set

2016-01-28 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 415d0a859 -> 676803963 [SPARK-12926][SQL] SQLContext to display warning message when non-sql configs are being set Users unknowingly try to set core Spark configs in SQLContext but later realise that it didn't work. eg. sqlContext.sql("SE

spark git commit: [SPARK-13031] [SQL] cleanup codegen and improve test coverage

2016-01-28 Thread davies
Repository: spark Updated Branches: refs/heads/master 676803963 -> cc18a7199 [SPARK-13031] [SQL] cleanup codegen and improve test coverage 1. enable whole stage codegen during tests even there is only one operator supports that. 2. split doProduce() into two APIs: upstream() and doProduce() 3

spark git commit: [SPARK-9835][ML] Implement IterativelyReweightedLeastSquares solver

2016-01-28 Thread meng
Repository: spark Updated Branches: refs/heads/master cc18a7199 -> df78a934a [SPARK-9835][ML] Implement IterativelyReweightedLeastSquares solver Implement ```IterativelyReweightedLeastSquares``` solver for GLM. I consider it as a solver rather than estimator, it only used internal so I keep i

spark git commit: [SPARK-12401][SQL] Add integration tests for postgres enum types

2016-01-28 Thread lian
Repository: spark Updated Branches: refs/heads/master df78a934a -> abae889f0 [SPARK-12401][SQL] Add integration tests for postgres enum types We can handle posgresql-specific enum types as strings in jdbc. So, we should just add tests and close the corresponding JIRA ticket. Author: Takeshi Y

spark git commit: [SPARK-12749][SQL] add json option to parse floating-point types as DecimalType

2016-01-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master abae889f0 -> 3a40c0e57 [SPARK-12749][SQL] add json option to parse floating-point types as DecimalType I tried to add this via `USE_BIG_DECIMAL_FOR_FLOATS` option from Jackson with no success. Added test for non-complex types. Should I ad

spark git commit: [SPARK-11955][SQL] Mark optional fields in merging schema for safely pushdowning filters in Parquet

2016-01-28 Thread lian
Repository: spark Updated Branches: refs/heads/master 3a40c0e57 -> 4637fc08a [SPARK-11955][SQL] Mark optional fields in merging schema for safely pushdowning filters in Parquet JIRA: https://issues.apache.org/jira/browse/SPARK-11955 Currently we simply skip pushdowning filters in parquet if

spark git commit: Revert "[SPARK-13031] [SQL] cleanup codegen and improve test coverage"

2016-01-28 Thread davies
Repository: spark Updated Branches: refs/heads/master 4637fc08a -> b9dfdcc63 Revert "[SPARK-13031] [SQL] cleanup codegen and improve test coverage" This reverts commit cc18a7199240bf3b03410c1ba6704fe7ce6ae38e. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-

spark git commit: [SPARK-12968][SQL] Implement command to set current database

2016-01-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master b9dfdcc63 -> 66449b8dc [SPARK-12968][SQL] Implement command to set current database JIRA: https://issues.apache.org/jira/browse/SPARK-12968 Implement command to set current database. Author: Liang-Chi Hsieh Author: Liang-Chi Hsieh Clos

spark git commit: [SPARK-13067] [SQL] workaround for a weird scala reflection problem

2016-01-28 Thread davies
Repository: spark Updated Branches: refs/heads/master 66449b8dc -> 721ced28b [SPARK-13067] [SQL] workaround for a weird scala reflection problem A simple workaround to avoid getting parameter types when convert a logical plan to json. Author: Wenchen Fan Closes #10970 from cloud-fan/reflect

spark git commit: [SPARK-13050][BUILD] Scalatest tags fail build with the addition of the sketch module

2016-01-28 Thread lian
Repository: spark Updated Branches: refs/heads/master 721ced28b -> 8d3cc3de7 [SPARK-13050][BUILD] Scalatest tags fail build with the addition of the sketch module A dependency on the spark test tags was left out of the sketch module pom file causing builds to fail when test tags were used. T