spark git commit: [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly

Repository: spark Updated Branches: refs/heads/master 6f81eae24 -> 859dff56e [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly This adds a failing test checking that `awaitTerminationOrTimeout` returns the expected value, and then fixes that failing

spark git commit: [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly

Repository: spark Updated Branches: refs/heads/branch-1.5 d31b312fc -> 9522dd23d [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly This adds a failing test checking that `awaitTerminationOrTimeout` returns the expected value, and then fixes that

spark git commit: [SPARK-11449][CORE] PortableDataStream should be a factory

Repository: spark Updated Branches: refs/heads/master 859dff56e -> 7bdc92197 [SPARK-11449][CORE] PortableDataStream should be a factory ```PortableDataStream``` maintains some internal state. This makes it tricky to reuse a stream (one needs to call ```close``` on both the

spark git commit: [SPARK-11506][MLLIB] Removed redundant operation in Online LDA implementation

Repository: spark Updated Branches: refs/heads/master 7bdc92197 -> a94671a02 [SPARK-11506][MLLIB] Removed redundant operation in Online LDA implementation In file LDAOptimizer.scala: line 441: since "idx" was never used, replaced unrequired zipWithIndex.foreach with foreach. -

spark git commit: [SPARK-11474][SQL] change fetchSize to fetchsize

Repository: spark Updated Branches: refs/heads/branch-1.5 9522dd23d -> 8e1bd6089 [SPARK-11474][SQL] change fetchSize to fetchsize In DefaultDataSource.scala, it has override def createRelation( sqlContext: SQLContext, parameters: Map[String, String]): BaseRelation The parameters is

spark git commit: [MINOR][ML][DOC] Rename weights to coefficients in user guide

Repository: spark Updated Branches: refs/heads/master 77488fb8e -> 72634f27e [MINOR][ML][DOC] Rename weights to coefficients in user guide We should use ```coefficients``` rather than ```weights``` in user guide that freshman can get the right conventional name at the outset. mengxr

spark git commit: [SPARK-11527][ML][PYSPARK] PySpark AFTSurvivalRegressionModel should expose coefficients/intercept/scale

Repository: spark Updated Branches: refs/heads/master 72634f27e -> 2e86cf1b0 [SPARK-11527][ML][PYSPARK] PySpark AFTSurvivalRegressionModel should expose coefficients/intercept/scale PySpark ```AFTSurvivalRegressionModel``` should expose coefficients/intercept/scale. mengxr vectorijk

spark git commit: [SPARK-11501][CORE][YARN] Propagate spark.rpc config to executors

Repository: spark Updated Branches: refs/heads/master 2e86cf1b0 -> a4b5cefcf [SPARK-11501][CORE][YARN] Propagate spark.rpc config to executors spark.rpc is supposed to be configurable but is not currently (doesn't get propagated to executors because RpcEnv.create is done before driver

spark git commit: [SPARK-11484][WEBUI] Using proxyBase set by spark AM

Repository: spark Updated Branches: refs/heads/master 9da7ceed8 -> c76865c62 [SPARK-11484][WEBUI] Using proxyBase set by spark AM Use the proxyBase set by the AM, if not found then use env. This is to fix the issue if somebody accidentally set APPLICATION_WEB_PROXY_BASE to wrong proxyBase

spark git commit: [SPARK-10648][SQL][BRANCH-1.4] Oracle dialect to handle nonspecific numeric types

Repository: spark Updated Branches: refs/heads/branch-1.5 8e1bd6089 -> 0eb233507 [SPARK-10648][SQL][BRANCH-1.4] Oracle dialect to handle nonspecific numeric types This backports https://github.com/apache/spark/pull/9495 to branch-1.4 (in case anyone needs this). Author: Yin Huai

spark git commit: [SPARK-10265][DOCUMENTATION, ML] Fixed @Since annotation to ml.regression

Repository: spark Updated Branches: refs/heads/master 6b87acd66 -> f80f7b69a [SPARK-10265][DOCUMENTATION, ML] Fixed @Since annotation to ml.regression Here is my first commit. Author: Ehsan M.Kermani Closes #8728 from ehsanmok/SinceAnn. Project:

Git Push Summary

Repository: spark Updated Branches: refs/heads/branch-1.6 [created] f80f7b69a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-11542] [SPARKR] fix glm with long fomular

Repository: spark Updated Branches: refs/heads/branch-1.6 40eadae16 -> 37c59f0ba [SPARK-11542] [SPARKR] fix glm with long fomular Because deparse() will break the long string into multiple lines, the deserialization will fail Author: Davies Liu Closes #9510 from

spark git commit: [SPARK-11260][SPARKR] with() function support

Repository: spark Updated Branches: refs/heads/master 8a5314efd -> b9455d1f1 [SPARK-11260][SPARKR] with() function support Author: adrian555 Author: Adrian Zhuang Closes #9443 from adrian555/with. Project:

[2/2] spark git commit: [SPARK-11536][SQL] Remove the internal implicit conversion from Expression to Column in functions.scala

[SPARK-11536][SQL] Remove the internal implicit conversion from Expression to Column in functions.scala Author: Reynold Xin Closes #9505 from rxin/SPARK-11536. (cherry picked from commit b6974f8fed1726a381636e996834111a8e7ced8d) Signed-off-by: Reynold Xin

spark git commit: [SPARK-11542] [SPARKR] fix glm with long fomular

Repository: spark Updated Branches: refs/heads/master b6974f8fe -> 244010624 [SPARK-11542] [SPARKR] fix glm with long fomular Because deparse() will break the long string into multiple lines, the deserialization will fail Author: Davies Liu Closes #9510 from

spark git commit: [SPARK-10656][SQL] completely support special chars in DataFrame

Repository: spark Updated Branches: refs/heads/branch-1.6 975ae4e6f -> be2c18650 [SPARK-10656][SQL] completely support special chars in DataFrame the main problem is: we interpret column name with special handling of `.` for DataFrame. This enables us to write something like `df("a.b")` to

spark git commit: [SPARK-11542] [SPARKR] fix glm with long fomular

Repository: spark Updated Branches: refs/heads/branch-1.5 0eb233507 -> dac83094f [SPARK-11542] [SPARKR] fix glm with long fomular Because deparse() will break the long string into multiple lines, the deserialization will fail Author: Davies Liu Closes #9510 from

spark git commit: [SPARK-10648] Oracle dialect to handle nonspecific numeric types

Repository: spark Updated Branches: refs/heads/branch-1.6 f80f7b69a -> 3e1e03d03 [SPARK-10648] Oracle dialect to handle nonspecific numeric types This is the alternative/agreed upon solution to PR #8780. Creating an OracleDialect to handle the nonspecific numeric types that can be defined

spark git commit: [SPARK-10648] Oracle dialect to handle nonspecific numeric types

Repository: spark Updated Branches: refs/heads/master f80f7b69a -> 14ee0f572 [SPARK-10648] Oracle dialect to handle nonspecific numeric types This is the alternative/agreed upon solution to PR #8780. Creating an OracleDialect to handle the nonspecific numeric types that can be defined in

spark git commit: [SPARK-11532][SQL] Remove implicit conversion from Expression to Column

Repository: spark Updated Branches: refs/heads/master 14ee0f572 -> 8a5314efd [SPARK-11532][SQL] Remove implicit conversion from Expression to Column Author: Reynold Xin Closes #9500 from rxin/SPARK-11532. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-11188] [SQL] Elide stacktraces in bin/spark-sql for AnalysisExceptions

Repository: spark Updated Branches: refs/heads/branch-1.4 6c5e9a3a0 -> 4f98014b9 [SPARK-11188] [SQL] Elide stacktraces in bin/spark-sql for AnalysisExceptions Only print the error message to the console for Analysis Exceptions in sql-shell Author: Dilip Biswal Closes

spark git commit: [SPARK-11538][BUILD] Force guava 14 in sbt build.

Repository: spark Updated Branches: refs/heads/master 468ad0ae8 -> 5e31db70b [SPARK-11538][BUILD] Force guava 14 in sbt build. sbt's version resolution code always picks the most recent version, and we don't want that for guava. Author: Marcelo Vanzin Closes #9508 from

spark git commit: [SPARK-11514][ML] Pass random seed to spark.ml DecisionTree*

Repository: spark Updated Branches: refs/heads/branch-1.6 83b957a35 -> de03021ac [SPARK-11514][ML] Pass random seed to spark.ml DecisionTree* cc jkbradley Author: Yu ISHIKAWA Closes #9486 from yu-iskw/SPARK-11514. (cherry picked from commit

spark git commit: [SPARK-11514][ML] Pass random seed to spark.ml DecisionTree*

Repository: spark Updated Branches: refs/heads/master 6091e91fc -> 8fa8c8375 [SPARK-11514][ML] Pass random seed to spark.ml DecisionTree* cc jkbradley Author: Yu ISHIKAWA Closes #9486 from yu-iskw/SPARK-11514. Project:

spark git commit: [SPARK-11540][SQL] API audit for QueryExecutionListener.

Repository: spark Updated Branches: refs/heads/master 5e31db70b -> 3cc2c053b [SPARK-11540][SQL] API audit for QueryExecutionListener. Author: Reynold Xin Closes #9509 from rxin/SPARK-11540. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-7542][SQL] Support off-heap index/sort buffer

Repository: spark Updated Branches: refs/heads/branch-1.6 b655117d0 -> 1b43dd391 [SPARK-7542][SQL] Support off-heap index/sort buffer This brings the support of off-heap memory for array inside BytesToBytesMap and InMemorySorter, then we could allocate all the memory from off-heap for

spark git commit: [SPARK-11537] [SQL] fix negative hours/minutes/seconds

Repository: spark Updated Branches: refs/heads/branch-1.5 dac83094f -> b8b1fbfc8 [SPARK-11537] [SQL] fix negative hours/minutes/seconds Currently, if the Timestamp is before epoch (1970/01/01), the hours, minutes and seconds will be negative (also rounding up). Author: Davies Liu

spark git commit: [SPARK-11537] [SQL] fix negative hours/minutes/seconds

Repository: spark Updated Branches: refs/heads/branch-1.6 37c59f0ba -> 83b957a35 [SPARK-11537] [SQL] fix negative hours/minutes/seconds Currently, if the Timestamp is before epoch (1970/01/01), the hours, minutes and seconds will be negative (also rounding up). Author: Davies Liu

spark git commit: [SPARK-11537] [SQL] fix negative hours/minutes/seconds

Repository: spark Updated Branches: refs/heads/master 244010624 -> 07414afac [SPARK-11537] [SQL] fix negative hours/minutes/seconds Currently, if the Timestamp is before epoch (1970/01/01), the hours, minutes and seconds will be negative (also rounding up). Author: Davies Liu

spark git commit: Revert "[SPARK-11469][SQL] Allow users to define nondeterministic udfs."

Repository: spark Updated Branches: refs/heads/master 07414afac -> 6091e91fc Revert "[SPARK-11469][SQL] Allow users to define nondeterministic udfs." This reverts commit 9cf56c96b7d02a14175d40b336da14c2e1c88339. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: Revert "[SPARK-11469][SQL] Allow users to define nondeterministic udfs."

Repository: spark Updated Branches: refs/heads/branch-1.6 de03021ac -> b655117d0 Revert "[SPARK-11469][SQL] Allow users to define nondeterministic udfs." This reverts commit 9cf56c96b7d02a14175d40b336da14c2e1c88339. Conflicts: project/MimaExcludes.scala Project:

spark git commit: [MINOR][SQL] A minor log line fix

Repository: spark Updated Branches: refs/heads/master a94671a02 -> 77488fb8e [MINOR][SQL] A minor log line fix `jars` in the log line is an array, so `$jars` doesn't print its content. Author: Cheng Lian Closes #9494 from liancheng/minor.log-fix. Project: