[GitHub] spark pull request #18323: [SPARK-21117][SQL] Built-in SQL Function Support ...

2017-06-21 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/18323#discussion_r123409299 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/MathExpressionsSuite.scala --- @@ -644,4 +645,36 @@ class

[GitHub] spark pull request #18323: [SPARK-21117][SQL] Built-in SQL Function Support ...

2017-06-21 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/18323#discussion_r123401878 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -631,3 +631,109 @@ abstract class TernaryExpression

[GitHub] spark pull request #18300: [SPARK-21043][SQL] Add unionByName in Dataset

2017-06-21 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18300#discussion_r123411528 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1764,6 +1765,70 @@ class Dataset[T] private[sql]( } /**

[GitHub] spark issue #18382: [SPARK-21149][R] Add job description API for R

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18382 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18382: [SPARK-21149][R] Add job description API for R

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18382 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78419/ Test PASSed. ---

[GitHub] spark issue #18382: [SPARK-21149][R] Add job description API for R

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18382 **[Test build #78419 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78419/testReport)** for PR 18382 at commit

[GitHub] spark issue #17139: [SPARK-19486][CORE](try 3) Investigate using multiple th...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/17139 Please bring this PR up to date, then maybe some guy can review this. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18381: [SPARK-21167][SS]Decode the path generated by File sink ...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18381 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18381: [SPARK-21167][SS]Decode the path generated by File sink ...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18381 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78414/ Test PASSed. ---

[GitHub] spark issue #18381: [SPARK-21167][SS]Decode the path generated by File sink ...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18381 **[Test build #78414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78414/testReport)** for PR 18381 at commit

[GitHub] spark issue #18382: [SPARK-21149][R] Add job description API for R

2017-06-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18382 cc @felixcheung, could you take a look and see if it is as you intended in the JIRA? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #18382: [SPARK-21149][R] Add job description API for R

2017-06-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18382#discussion_r123406735 --- Diff: R/pkg/R/context.R --- @@ -295,6 +295,23 @@ setCheckpointDirSC <- function(sc, dirName) { invisible(callJMethod(sc, "setCheckpointDir",

[GitHub] spark issue #18382: [SPARK-21149][R] Add job description API for R

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18382 **[Test build #78419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78419/testReport)** for PR 18382 at commit

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18118 **[Test build #78420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78420/testReport)** for PR 18118 at commit

[GitHub] spark pull request #18382: [SPARK-21149][R] Add job description API for R

2017-06-21 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18382 [SPARK-21149][R] Add job description API for R ## What changes were proposed in this pull request? Extend `setJobDescription` to SparkR API. ## How was this patch tested?

[GitHub] spark issue #18362: [SPARK-20832][Core] Standalone master should explicitly ...

2017-06-21 Thread naliazheli
Github user naliazheli commented on the issue: https://github.com/apache/spark/pull/18362 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #18371: [SPARK-20889][SparkR] Grouped documentation for M...

2017-06-21 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18371#discussion_r123404351 --- Diff: R/pkg/R/functions.R --- @@ -1405,18 +1309,12 @@ setMethod("sha1", column(jc) }) -#' signum -#'

[GitHub] spark pull request #18371: [SPARK-20889][SparkR] Grouped documentation for M...

2017-06-21 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18371#discussion_r123404096 --- Diff: R/pkg/R/functions.R --- @@ -34,6 +34,30 @@ NULL #' df <- createDataFrame(cbind(model = rownames(mtcars), mtcars))} NULL

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18118 **[Test build #78417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78417/testReport)** for PR 18118 at commit

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18118 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78417/ Test FAILed. ---

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18118 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17713 **[Test build #78418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78418/testReport)** for PR 17713 at commit

[GitHub] spark issue #18327: [SPARK-21047] Add test suites for complicated cases in C...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18327 **[Test build #78416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78416/testReport)** for PR 18327 at commit

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18118 **[Test build #78417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78417/testReport)** for PR 18118 at commit

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-06-21 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/17713 @gatorsmile Just rebased. Thanks !! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18371: [SPARK-20889][SparkR] Grouped documentation for M...

2017-06-21 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18371#discussion_r123403295 --- Diff: R/pkg/R/functions.R --- @@ -1405,18 +1309,12 @@ setMethod("sha1", column(jc) }) -#' signum -#'

[GitHub] spark issue #18114: [SPARK-20889][SparkR] Grouped documentation for DATETIME...

2017-06-21 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18114 I think it's just the new public class detection thing that - doesn't handle R code at all - is confused by a code line starting with the word `class` some where --- If your project is

[GitHub] spark issue #17139: [SPARK-19486][CORE](try 3) Investigate using multiple th...

2017-06-21 Thread witgo
Github user witgo commented on the issue: https://github.com/apache/spark/pull/17139 @jiangxb1987 ,Yes do you have any questions? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18114: [SPARK-20889][SparkR] Grouped documentation for D...

2017-06-21 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18114#discussion_r123402476 --- Diff: R/pkg/R/functions.R --- @@ -2458,111 +2441,78 @@ setMethod("instr", signature(y = "Column", x = "character"), column(jc)

[GitHub] spark pull request #18378: [SPARK-21163][SQL] DataFrame.toPandas should resp...

2017-06-21 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18378#discussion_r123399287 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1721,7 +1721,8 @@ def toPandas(self): 15Bob """ import

[GitHub] spark issue #9518: [SPARK-11574][Core] Add metrics StatsD sink

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/9518 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #9518: [SPARK-11574][Core] Add metrics StatsD sink

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/9518 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #9518: [SPARK-11574][Core] Add metrics StatsD sink

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/9518 @jerryshao Could you find some time to look at this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-06-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17713 @dilipbiswal Could you resolve the conflict? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18253: [SPARK-18838][CORE] Introduce multiple queues in LiveLis...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78412/ Test PASSed. ---

[GitHub] spark issue #18253: [SPARK-18838][CORE] Introduce multiple queues in LiveLis...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18253 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18253: [SPARK-18838][CORE] Introduce multiple queues in LiveLis...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18253 **[Test build #78412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78412/testReport)** for PR 18253 at commit

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-06-21 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/18281 Catching up here, it sounds like the current recommendations (which I'm on board with) are to: * Switch to Futures, including using sameThreadExecutor for the case of parallelism=1 * Try

[GitHub] spark issue #18362: [SPARK-20832][Core] Standalone master should explicitly ...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18362 **[Test build #78415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78415/testReport)** for PR 18362 at commit

[GitHub] spark issue #18362: [SPARK-20832][Core] Standalone master should explicitly ...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18362 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18381: [SPARK-21167][SS]Decode the path generated by File sink ...

2017-06-21 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/18381 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18381: [SPARK-21167][SS]Decode the path generated by File sink ...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18381 **[Test build #78414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78414/testReport)** for PR 18381 at commit

[GitHub] spark pull request #18381: [SPARK-21167][SS]Decode the path generated by Fil...

2017-06-21 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/18381 [SPARK-21167][SS]Decode the path generated by File sink to handle special characters ## What changes were proposed in this pull request? Decode the path generated by File sink to handle

[GitHub] spark issue #18366: [SPARK-20889][SparkR] Grouped documentation for STRING c...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18366 **[Test build #78413 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78413/testReport)** for PR 18366 at commit

[GitHub] spark issue #18366: [SPARK-20889][SparkR] Grouped documentation for STRING c...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18366 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78413/ Test FAILed. ---

[GitHub] spark issue #18366: [SPARK-20889][SparkR] Grouped documentation for STRING c...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18366 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18366: [SPARK-20889][SparkR] Grouped documentation for STRING c...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18366 **[Test build #78413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78413/testReport)** for PR 18366 at commit

[GitHub] spark issue #18366: [SPARK-20889][SparkR] Grouped documentation for STRING c...

2017-06-21 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18366 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #9162: [SPARK-10655][SQL] Adding additional data type mappings t...

2017-06-21 Thread sureshthalamati
Github user sureshthalamati commented on the issue: https://github.com/apache/spark/pull/9162 Thank you @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15821 I will actually take it back. This could be checked and done in a followup (inclusing doc update). I see this PR is already quite big. --- If your project is set up for it, you can reply to

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15821 BTW should we need to update `setup.py` too? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17471 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17471 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78405/ Test PASSed. ---

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17471 **[Test build #78405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78405/testReport)** for PR 17471 at commit

[GitHub] spark pull request #18378: [SPARK-21163][SQL] DataFrame.toPandas should resp...

2017-06-21 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/18378#discussion_r123384341 --- Diff: python/pyspark/sql/tests.py --- @@ -2274,6 +2274,21 @@ def count_bucketed_cols(names, table="pyspark_bucket"):

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-21 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/17471 also, see my message to the dev@ list. jenkins is up, but not reachable via the amplab link. On Wed, Jun 21, 2017 at 3:23 PM, shane knapp ☠ wrote:

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-21 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/17471 it was actually a cut power line due to street construction. apparently power is back online, and we're waiting for machines and switches to finish booting back up. i'm WFH

[GitHub] spark pull request #18378: [SPARK-21163][SQL] DataFrame.toPandas should resp...

2017-06-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18378#discussion_r123380675 --- Diff: python/pyspark/sql/tests.py --- @@ -2274,6 +2274,21 @@ def count_bucketed_cols(names, table="pyspark_bucket"):

[GitHub] spark pull request #18004: [SPARK-18838][CORE] Introduce blocking strategy f...

2017-06-21 Thread bOOm-X
Github user bOOm-X closed the pull request at: https://github.com/apache/spark/pull/18004 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18004: [SPARK-18838][CORE] Introduce blocking strategy for Live...

2017-06-21 Thread bOOm-X
Github user bOOm-X commented on the issue: https://github.com/apache/spark/pull/18004 yes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18253: [SPARK-18838][CORE] Introduce multiple queues in LiveLis...

2017-06-21 Thread bOOm-X
Github user bOOm-X commented on the issue: https://github.com/apache/spark/pull/18253 > Well, you could use an ArrayBlockingQueue. Then no extra object is allocated either. Yes I agree. But you get the synchronization too. I am still agree that it should not have a big

[GitHub] spark issue #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and posexplod...

2017-06-21 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/18049 Thanks @ueshin! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Worker should handle and shutdown w...

2017-06-21 Thread devaraj-kavali
Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/18357 can we change SparkUncaughtExceptionHandler to class and create instance in each daemons main() with the constructor flag whether to kill the process for Exceptions or not? Something like

[GitHub] spark pull request #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and po...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18049 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and posexplod...

2017-06-21 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18049 Thanks! merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and po...

2017-06-21 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/18049#discussion_r123376328 --- Diff: python/pyspark/sql/tests.py --- @@ -272,6 +276,11 @@ def test_explode(self): self.assertEqual(result[0][0], "a")

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Worker should handle and shutdown w...

2017-06-21 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/18357 @devaraj-kavali SparkUncaughtExceptionHandler is a singleton so you cannot get the configuration from SparkConf. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #18253: [SPARK-18838][CORE] Introduce multiple queues in LiveLis...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18253 **[Test build #78412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78412/testReport)** for PR 18253 at commit

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-21 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/17471 I think the power is still out in the CS building at Berkeley because of the earthquake, so I'm guessing Jenkins is down as a result (note that even the vanilla AMP website doesn't work:

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Worker should handle and shutdown w...

2017-06-21 Thread devaraj-kavali
Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/18357 @zsxwing Thanks for looking into this, I see SparkUncaughtExceptionHandler exits the process for all the exceptions/errors. Can we modify SparkUncaughtExceptionHandler in such a way

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-21 Thread sitalkedia
Github user sitalkedia commented on the issue: https://github.com/apache/spark/pull/17471 @shaneknapp, @sameeragarwal - Not able to access the jenkins build link- https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78405/testReport, something wrong with the jenkins

[GitHub] spark issue #18366: [SPARK-20889][SparkR] Grouped documentation for STRING c...

2017-06-21 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18366 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18114: [SPARK-20889][SparkR] Grouped documentation for DATETIME...

2017-06-21 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18114 @felixcheung Any idea what this message means? `This patch adds the following public classes (experimental): #' @Param x For class` --- If your project is set up for it, you can reply

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Worker should handle and shutdown w...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18357 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Worker should handle and shutdown w...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18357 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78404/ Test PASSed. ---

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Worker should handle and shutdown w...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18357 **[Test build #78404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78404/testReport)** for PR 18357 at commit

[GitHub] spark issue #18371: [SPARK-20889][SparkR] Grouped documentation for MATH col...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18371 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18371: [SPARK-20889][SparkR] Grouped documentation for MATH col...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18371 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78409/ Test PASSed. ---

[GitHub] spark issue #18371: [SPARK-20889][SparkR] Grouped documentation for MATH col...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18371 **[Test build #78409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78409/testReport)** for PR 18371 at commit

[GitHub] spark issue #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and posexplod...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18049 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and posexplod...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18049 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78411/ Test PASSed. ---

[GitHub] spark issue #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and posexplod...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18049 **[Test build #78411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78411/testReport)** for PR 18049 at commit

[GitHub] spark pull request #13287: [SPARK-15491][SQL]fix assertion failure for JDBC ...

2017-06-21 Thread huaxingao
Github user huaxingao commented on a diff in the pull request: https://github.com/apache/spark/pull/13287#discussion_r123368171 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -594,7 +596,9 @@ abstract class TreeNode[BaseType <:

[GitHub] spark issue #18114: [SPARK-20889][SparkR] Grouped documentation for DATETIME...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18114 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18114: [SPARK-20889][SparkR] Grouped documentation for DATETIME...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18114 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78407/ Test PASSed. ---

[GitHub] spark issue #18114: [SPARK-20889][SparkR] Grouped documentation for DATETIME...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18114 **[Test build #78407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78407/testReport)** for PR 18114 at commit

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18355 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78410/ Test FAILed. ---

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18355 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18355 **[Test build #78410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78410/testReport)** for PR 18355 at commit

[GitHub] spark issue #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and posexplod...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18049 **[Test build #78411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78411/testReport)** for PR 18049 at commit

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18355 **[Test build #78410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78410/testReport)** for PR 18355 at commit

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/18355 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #18049: [SPARK-20830][PYSPARK][SQL] Add posexplode and po...

2017-06-21 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/18049#discussion_r123362792 --- Diff: python/pyspark/sql/tests.py --- @@ -272,6 +276,11 @@ def test_explode(self): self.assertEqual(result[0][0], "a")

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18355 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78408/ Test FAILed. ---

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18355 **[Test build #78408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78408/testReport)** for PR 18355 at commit

[GitHub] spark issue #18355: [SPARK-21145][SS] Added StateStoreProviderId with queryR...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18355 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18371: [SPARK-20889][SparkR] Grouped documentation for MATH col...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18371 **[Test build #78409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78409/testReport)** for PR 18371 at commit

[GitHub] spark issue #18371: [SPARK-20889][SparkR] Grouped documentation for MATH col...

2017-06-21 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18371 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18379: [SPARK-21164] [SQL] Remove isTableSample from Sample

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18379 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78402/ Test PASSed. ---

[GitHub] spark issue #18354: [SPARK-18016][SQL][CATALYST][BRANCH-2.1] Code Generation...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18354 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

<    1   2   3   4   5   6   >