[GitHub] spark issue #17265: [SPARK-19924] [SQL] Handle InvocationTargetException for...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17265 **[Test build #74455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74455/testReport)** for PR 17265 at commit [`91bdb39`](https://github.com/apache/spark/commit/91

[GitHub] spark issue #17194: [SPARK-19851] Add new aggregates EVERY and ANY (SOME).

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17194 **[Test build #74450 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74450/testReport)** for PR 17194 at commit [`40b1267`](https://github.com/apache/spark/commit/40

[GitHub] spark issue #17277: [SPARK-19887][SQL] null is a valid partition value

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17277 **[Test build #74452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74452/testReport)** for PR 17277 at commit [`7b85c51`](https://github.com/apache/spark/commit/7b

[GitHub] spark issue #17130: [SPARK-19791] [ML] Add doc and example for fpgrowth

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17130 **[Test build #3599 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3599/testReport)** for PR 17130 at commit [`9ce0093`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74448/testReport)** for PR 17276 at commit [`430ec95`](https://github.com/apache/spark/commit/43

[GitHub] spark issue #17274: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fai...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17274 **[Test build #7 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/7/testReport)** for PR 17274 at commit [`6cb40eb`](https://github.com/apache/spark/commit/6c

[GitHub] spark issue #17278: [SPARK-19933][SQL] Do not change output of a subquery

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17278 **[Test build #74453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74453/testReport)** for PR 17278 at commit [`54cbad1`](https://github.com/apache/spark/commit/54

[GitHub] spark pull request #16954: [SPARK-18874][SQL] First phase: Deferring the cor...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16954#discussion_r105715265 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -365,17 +368,73 @@ object TypeCoercion { }

[GitHub] spark pull request #16954: [SPARK-18874][SQL] First phase: Deferring the cor...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16954#discussion_r105714984 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -365,17 +385,66 @@ object TypeCoercion { }

[GitHub] spark pull request #16954: [SPARK-18874][SQL] First phase: Deferring the cor...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16954#discussion_r105716052 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -365,17 +368,73 @@ object TypeCoercion { }

[GitHub] spark issue #17265: [SPARK-19924] [SQL] Handle InvocationTargetException for...

2017-03-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17265 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #16954: [SPARK-18874][SQL] First phase: Deferring the cor...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16954#discussion_r105714546 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -365,17 +368,73 @@ object TypeCoercion { }

[GitHub] spark issue #17233: [SPARK-11569][ML] Fix StringIndexer to handle null value...

2017-03-13 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/17233 I'll take a look --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #16954: [SPARK-18874][SQL] First phase: Deferring the cor...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16954#discussion_r105712270 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -109,6 +109,26 @@ object TypeCoercion { }

[GitHub] spark pull request #16954: [SPARK-18874][SQL] First phase: Deferring the cor...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16954#discussion_r105711886 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -109,6 +109,26 @@ object TypeCoercion { }

[GitHub] spark issue #15604: [SPARK-18066] [CORE] [TESTS] Add Pool usage policies tes...

2017-03-13 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15604 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #15604: [SPARK-18066] [CORE] [TESTS] Add Pool usage policies tes...

2017-03-13 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15604 The following unit tests look failed due to timeout and _irrelevant_ so triggered again. **1-** org.apache.spark.storage.BlockManagerProactiveReplicationSuite.proactive block rep

[GitHub] spark pull request #17241: [SPARK-19877][SQL] Restrict the nested level of a...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17241#discussion_r105709959 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -555,6 +555,17 @@ object SQLConf { .booleanConf

[GitHub] spark pull request #17241: [SPARK-19877][SQL] Restrict the nested level of a...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17241#discussion_r105709767 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -555,6 +555,17 @@ object SQLConf { .booleanConf

[GitHub] spark pull request #17241: [SPARK-19877][SQL] Restrict the nested level of a...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17241#discussion_r105709364 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -595,6 +594,11 @@ class Analyzer( case vie

[GitHub] spark pull request #17241: [SPARK-19877][SQL] Restrict the nested level of a...

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17241#discussion_r105709239 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -595,6 +594,11 @@ class Analyzer( case vie

[GitHub] spark issue #17218: [SPARK-19281][WIP][PYTHON][ML] spark.ml Python API for F...

2017-03-13 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17218 @jkbradley Thanks for the comment. I thought about `PrefixSpan` in the future so I wanted to avoid embedding this in `FPGrowth`. I'll put it in the `fpm`. --- If your project is set up for it, yo

[GitHub] spark issue #17238: getRackForHost returns None if host is unknown by driver

2017-03-13 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/17238 @mridulm you know the yarn bits involved better than I do. It sounds like you are saying this is the wrong change, and instead its just a misconfiguration in yarn -- I'll buy that argument. Essenti

[GitHub] spark issue #17278: [SPARK-19933][SQL] Do not change output of a subquery

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17278 cc @wzhfy --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17271: [SPARK-19912][SQL][NOT FOR MERGE] String literals should...

2017-03-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17271 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17278: [SPARK-19933][SQL] Do not change output of a subq...

2017-03-13 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/17278 [SPARK-19933][SQL] Do not change output of a subquery ## What changes were proposed in this pull request? The `RemoveRedundantAlias` rule can change the output attributes (the expression id'

[GitHub] spark issue #17278: [SPARK-19933][SQL] Do not change output of a subquery

2017-03-13 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17278 cc @cloud-fan @ueshin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #17130: [SPARK-19791] [ML] Add doc and example for fpgrowth

2017-03-13 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/17130 The updated transform looks good; thanks for pinging! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #17130: [SPARK-19791] [ML] Add doc and example for fpgrow...

2017-03-13 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/17130#discussion_r105702725 --- Diff: mllib/src/main/scala/org/apache/spark/ml/fpm/FPGrowth.scala --- @@ -56,8 +56,8 @@ private[fpm] trait FPGrowthParams extends Params with HasFeatu

[GitHub] spark issue #17218: [SPARK-19281][WIP][PYTHON][ML] spark.ml Python API for F...

2017-03-13 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/17218 Thanks for the PR! I'll wait until this isn't "WIP" to review it thoroughly, but I'll make two comments now: * The params should not be added to shared.py since they are not shared by any oth

[GitHub] spark issue #17277: [SPARK-19887][SQL] null is a valid partition value

2017-03-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17277 cc @eric @mallman @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17277: [SPARK-19887][SQL] null is a valid partition valu...

2017-03-13 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/17277 [SPARK-19887][SQL] null is a valid partition value ## What changes were proposed in this pull request? When partition value is null, we will write the data to a directory like `a=__HIVE_

[GitHub] spark pull request #17126: [SPARK-19789][SS]Add the shortcut of .format("par...

2017-03-13 Thread CodingCat
Github user CodingCat closed the pull request at: https://github.com/apache/spark/pull/17126 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17126: [SPARK-19789][SS]Add the shortcut of .format("parquet")....

2017-03-13 Thread CodingCat
Github user CodingCat commented on the issue: https://github.com/apache/spark/pull/17126 thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark issue #17126: [SPARK-19789][SS]Add the shortcut of .format("parquet")....

2017-03-13 Thread CodingCat
Github user CodingCat commented on the issue: https://github.com/apache/spark/pull/17126 OK, close this one --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16373: [SPARK-18961][SQL] Support `SHOW TABLE EXTENDED ... PART...

2017-03-13 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/16373 @gatorsmile Added the positive test cases. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16373: [SPARK-18961][SQL] Support `SHOW TABLE EXTENDED ....

2017-03-13 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16373#discussion_r105687000 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -642,18 +644,34 @@ case class ShowTablesCommand( /

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

2017-03-13 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/17191 @maropu: I have made a few comments in the code and test cases. IMO, we should go back to define what we want to fix before jumping into the code. I am sorry if my previous statement gave you

[GitHub] spark pull request #17191: [SPARK-14471][SQL] Aliases in SELECT could be use...

2017-03-13 Thread nsyca
Github user nsyca commented on a diff in the pull request: https://github.com/apache/spark/pull/17191#discussion_r105659975 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2586,4 +2586,15 @@ class SQLQuerySuite extends QueryTest with SharedSQLCon

[GitHub] spark pull request #17191: [SPARK-14471][SQL] Aliases in SELECT could be use...

2017-03-13 Thread nsyca
Github user nsyca commented on a diff in the pull request: https://github.com/apache/spark/pull/17191#discussion_r105679116 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -775,11 +775,21 @@ class Analyzer( case q

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2017-03-13 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15009 @kishorvpatil please resolve the conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark issue #16735: [SPARK-19228][SQL] Introduce tryParseDate method to proc...

2017-03-13 Thread sergey-rubtsov
Github user sergey-rubtsov commented on the issue: https://github.com/apache/spark/pull/16735 Couldn't run tests in CSVSuite locally on my Windows OS, apologize for the possible test fails --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16735: [SPARK-19228][SQL] Introduce tryParseDate method to proc...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16735 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16735: [SPARK-19228][SQL] Introduce tryParseDate method ...

2017-03-13 Thread sergey-rubtsov
GitHub user sergey-rubtsov reopened a pull request: https://github.com/apache/spark/pull/16735 [SPARK-19228][SQL] Introduce tryParseDate method to process csv date … …column with custom format as date ## What changes were proposed in this pull request? This patc

[GitHub] spark pull request #16735: [SPARK-19228][SQL] Introduce tryParseDate method ...

2017-03-13 Thread sergey-rubtsov
Github user sergey-rubtsov closed the pull request at: https://github.com/apache/spark/pull/16735 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105664922 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105663697 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace def

[GitHub] spark pull request #17276: [WIP][SPARK-19937] Collect metrics of block sizes...

2017-03-13 Thread jinxing64
GitHub user jinxing64 opened a pull request: https://github.com/apache/spark/pull/17276 [WIP][SPARK-19937] Collect metrics of block sizes when shuffle. ## What changes were proposed in this pull request? Metrics of blocks sizes(when shuffle) should be collected for later an

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105659050 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105657313 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace def

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105657204 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace def

[GitHub] spark issue #17275: SPARK-19767 Add note about missing API doc for Kafka 0.1...

2017-03-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17275 Sure you can update this branch too. Force push if you need to. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark issue #17275: SPARK-19767 Add note about missing API doc for Kafka 0.1...

2017-03-13 Thread nafshartous
Github user nafshartous commented on the issue: https://github.com/apache/spark/pull/17275 Should I submit a new PR or is it acceptable to resolve by adding more commits on this one ? --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105654542 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105654236 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace

[GitHub] spark pull request #17267: [SPARK-19926][PYSPARK] Make pyspark exception mor...

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17267#discussion_r105653661 --- Diff: python/pyspark/sql/utils.py --- @@ -24,7 +24,7 @@ def __init__(self, desc, stackTrace): self.stackTrace = stackTrace

[GitHub] spark issue #17275: SPARK-19767 Add note about missing API doc for Kafka 0.1...

2017-03-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17275 It looks like the change got mangled, maybe due to line-ending differences? the diff shows the entire file as a change. Check the CRLF settings in git and try again? --- If your project is set up f

[GitHub] spark issue #17275: SPARK-19767 Add not about missing API doc for Kafka 0.10...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17275 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #17275: SPARK-19767 Add not about missing API doc for Kaf...

2017-03-13 Thread nafshartous
GitHub user nafshartous opened a pull request: https://github.com/apache/spark/pull/17275 SPARK-19767 Add not about missing API doc for Kafka 0.10 integration. ## What changes were proposed in this pull request? Adding not about missing API docs for Kafka 0.10 ## H

[GitHub] spark issue #17274: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fai...

2017-03-13 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/17274 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #17272: [SPARK-19724][SQL]create a managed table with an existed...

2017-03-13 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17272 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #17274: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFi...

2017-03-13 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/17274 [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fails when it was called on executors. ## What changes were proposed in this pull request? SparkR ```spark.getSparkFiles``` fails when it

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 How about `as.struct`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74442/ Test FAILed. ---

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74442 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74442/testReport)** for PR 17087 at commit [`530f84f`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 > array might be a bit vague - does that require the column value to be a JSON array, or just multiple JSON object spanning multiple line? Yup, it requires that input is a JSON array (mu

[GitHub] spark pull request #17178: [SPARK-19828][R] Support array type in from_json ...

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17178#discussion_r105626282 --- Diff: R/pkg/R/functions.R --- @@ -2452,11 +2453,18 @@ setMethod("date_format", signature(y = "Column", x = "character"), #'} #' @note from

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74439/ Test PASSed. ---

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17192 **[Test build #74439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74439/testReport)** for PR 17192 at commit [`e8cd20a`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17273: [MINOR][CORE] No need to call `prunePartitions` in case ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17273 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74440/ Test PASSed. ---

[GitHub] spark issue #17273: [MINOR][CORE] No need to call `prunePartitions` in case ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17273 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17273: [MINOR][CORE] No need to call `prunePartitions` in case ...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17273 **[Test build #74440 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74440/testReport)** for PR 17273 at commit [`97a426d`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #17175: [SPARK-19931][SQL] InMemoryTableScanExec should rewrite ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17175 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17175: [SPARK-19931][SQL] InMemoryTableScanExec should rewrite ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17175 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74438/ Test PASSed. ---

[GitHub] spark issue #17175: [SPARK-19931][SQL] InMemoryTableScanExec should rewrite ...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17175 **[Test build #74438 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74438/testReport)** for PR 17175 at commit [`454515d`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #17273: [MINOR][CORE] No need to call `prunePartitions` in case ...

2017-03-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17273 Thank you for review, @srowen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #17268: [SPARK-19932][SS] Also save event time into StateStore f...

2017-03-13 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/17268 @marmbrus @zsxwing would you take a look at this, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #17272: [SPARK-19724][SQL]create a managed table with an existed...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17272 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74441/ Test FAILed. ---

[GitHub] spark issue #17272: [SPARK-19724][SQL]create a managed table with an existed...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17272 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17272: [SPARK-19724][SQL]create a managed table with an existed...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17272 **[Test build #74441 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74441/testReport)** for PR 17272 at commit [`0e753cc`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74433/ Test PASSed. ---

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17256: [SPARK-19919][SQL] Defer throwing the exception for empt...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17256 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17256: [SPARK-19919][SQL] Defer throwing the exception for empt...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17256 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74432/ Test PASSed. ---

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17251 **[Test build #74433 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74433/testReport)** for PR 17251 at commit [`3bfa978`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #17256: [SPARK-19919][SQL] Defer throwing the exception for empt...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17256 **[Test build #74432 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74432/testReport)** for PR 17256 at commit [`87d3fc8`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17273: [MINOR][CORE] No need to call `prunePartitions` in case ...

2017-03-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17273 Maybe @tdas or @ericl can comment on whether that's a valid shortcut, but otherwise it does seem safer to just fix the logInfo --- If your project is set up for it, you can reply to this email and h

[GitHub] spark issue #17255: [SPARK-19918][SQL] Use TextFileFormat in implementation ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17255 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17255: [SPARK-19918][SQL] Use TextFileFormat in implementation ...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17255 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74434/ Test PASSed. ---

[GitHub] spark issue #17255: [SPARK-19918][SQL] Use TextFileFormat in implementation ...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17255 **[Test build #74434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74434/testReport)** for PR 17255 at commit [`76dceb2`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17267: [SPARK-19926][PYSPARK] Make pyspark exception more reada...

2017-03-13 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/17267 IMHO, yes. And @viirya is the original author. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74435/ Test FAILed. ---

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74442 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74442/testReport)** for PR 17087 at commit [`530f84f`](https://github.com/apache/spark/commit/53

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74435 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74435/testReport)** for PR 17087 at commit [`11f56d1`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #17087: [SPARK-19372][SQL] Fix throwing a Java exception ...

2017-03-13 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17087#discussion_r105612049 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -20,20 +20,22 @@ package org.apache.spark.sql.catalys

[GitHub] spark issue #17272: [SPARK-19724][SQL]create a managed table with an existed...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17272 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17272: [SPARK-19724][SQL]create a managed table with an existed...

2017-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17272 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74437/ Test FAILed. ---

<    1   2   3   4   5   6   >