[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20005 **[Test build #85045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85045/testReport)** for PR 20005 at commit

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20005 Oh, Thanks for cran sysadmin team's quick reply, they fixed that broken page. --- - To unsubscribe, e-mail:

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20005 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157417517 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -163,11 +204,51 @@ class CodegenContext

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157417320 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -163,11 +204,51 @@ class CodegenContext

[GitHub] spark issue #19989: [SPARK-22793][SQL]Memory leak in Spark Thrift Server

2017-12-17 Thread zuotingbing
Github user zuotingbing commented on the issue: https://github.com/apache/spark/pull/19989 we can find the cache size of FileSystem `deleteOnExit` will keep increasing. [

[GitHub] spark pull request #19892: [SPARK-20542][FollowUp][PySpark] Bucketizer suppo...

2017-12-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19892#discussion_r157416631 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -134,6 +134,20 @@ def toListFloat(value): return [float(v) for v in value]

[GitHub] spark issue #19989: [SPARK-22793][SQL]Memory leak in Spark Thrift Server

2017-12-17 Thread zuotingbing
Github user zuotingbing commented on the issue: https://github.com/apache/spark/pull/19989 as i debug, every time when i connect to thrift server through beeline, the `SessionState.start(state)` will be called two times. one is in `HiveSessionImpl:open` , **another is in

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157415970 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala --- @@ -112,15 +112,14 @@ case class Like(left:

[GitHub] spark issue #20006: [SPARK-22821][TEST] Basic tests for WidenSetOperationTyp...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20006 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85039/ Test FAILed. ---

[GitHub] spark issue #20006: [SPARK-22821][TEST] Basic tests for WidenSetOperationTyp...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20006 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20006: [SPARK-22821][TEST] Basic tests for WidenSetOperationTyp...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20006 **[Test build #85039 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85039/testReport)** for PR 20006 at commit

[GitHub] spark issue #19884: [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19884 **[Test build #85044 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85044/testReport)** for PR 19884 at commit

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20005 cc @shivaram, @felixcheung and @falaki too FYI. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #19993: [SPARK-22799][ML] Bucketizer should throw excepti...

2017-12-17 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/19993#discussion_r157414340 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/Bucketizer.scala --- @@ -140,10 +140,10 @@ final class Bucketizer @Since("1.4.0")

[GitHub] spark issue #19993: [SPARK-22799][ML] Bucketizer should throw exception if s...

2017-12-17 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/19993 @hhbyyh thanks for the review. I see that for some classes there are ongoing PRs. Thus I cannot change them now in order to have a common place and a common test. Should I wait for those PRs to be

[GitHub] spark pull request #19892: [SPARK-20542][FollowUp][PySpark] Bucketizer suppo...

2017-12-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19892#discussion_r157414231 --- Diff: python/pyspark/ml/feature.py --- @@ -315,13 +315,14 @@ class BucketedRandomProjectionLSHModel(LSHModel, JavaMLReadable, JavaMLWritable)

[GitHub] spark issue #19933: [SPARK-22744][CORE] Add a configuration to show the appl...

2017-12-17 Thread LantaoJin
Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/19933 And **spark.driver.host** can be set to sparkConf, why spark.submit.host can not be. `def makeDriverRef(name: String, conf: SparkConf, rpcEnv: RpcEnv): RpcEndpointRef = {` ` val

[GitHub] spark issue #19193: [WIP][SPARK-21896][SQL] Fix Stack Overflow when window f...

2017-12-17 Thread aokolnychyi
Github user aokolnychyi commented on the issue: https://github.com/apache/spark/pull/19193 @hvanhovell here is a summary of tried scenarios: ``` val df = Seq((1, 2), (1, 3), (2, 4), (5, 5)).toDF("a", "b") val window1 = Window.orderBy('a) val window2 =

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20005 I use R version 3.2.3 and I can reproduce this too. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20005 I see. Nice to get some helps. BTW, this also seems related with specific R version as well. I wasn't able to reproduce this with R 3.4.0 but I am able to reproduce this with R 3.1.1 (same as

[GitHub] spark issue #19811: [SPARK-18016][SQL] Code Generation: Constant Pool Limit ...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19811 LGTM except some minor comments, great job! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157410773 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala --- @@ -112,15 +112,14 @@ case class Like(left:

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20005 Note: I've emailed to cran sysadmin team and asked them for help to fix the broken page. --- - To unsubscribe, e-mail:

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157410521 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicPhysicalOperators.scala --- @@ -440,9 +435,9 @@ case class RangeExec(range:

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157410349 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SortExec.scala --- @@ -133,20 +133,17 @@ case class SortExec( override def

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157410191 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SortExec.scala --- @@ -133,20 +133,17 @@ case class SortExec( override def

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157410164 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala --- @@ -112,15 +112,14 @@ case class Like(left:

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157410133 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SortExec.scala --- @@ -133,20 +133,17 @@ case class SortExec( override def

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157409537 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -217,7 +217,7 @@ case class Stack(children:

[GitHub] spark issue #19884: [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19884 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19884: [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19884 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85043/ Test FAILed. ---

[GitHub] spark issue #19884: [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19884 **[Test build #85043 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85043/testReport)** for PR 19884 at commit

[GitHub] spark issue #19884: [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19884 **[Test build #85043 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85043/testReport)** for PR 19884 at commit

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157408804 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala --- @@ -385,20 +385,43 @@ class

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20005 I've tried to investigate this and I think it is due to a wrongly formatted document at https://cran.r-project.org/src/contrib/PACKAGES.in: ``` Package: alR X-CRAN-Comment: Archived

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157408425 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala --- @@ -112,15 +112,14 @@ case class Like(left:

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157408061 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -217,7 +217,7 @@ case class Stack(children:

[GitHub] spark pull request #19811: [SPARK-18016][SQL] Code Generation: Constant Pool...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19811#discussion_r157407681 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -163,11 +204,51 @@ class

[GitHub] spark issue #19933: [SPARK-22744][CORE] Add a configuration to show the appl...

2017-12-17 Thread LantaoJin
Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/19933 > driver host is actually probably already in the logs. What I were care about is submit host not driver host and I have built the spark under trunk and tested in yarn-cluster mode, there is

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19981 **[Test build #85042 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85042/testReport)** for PR 19981 at commit

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19981 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19981 **[Test build #85041 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85041/testReport)** for PR 19981 at commit

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19981 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85041/ Test FAILed. ---

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19981 **[Test build #85041 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85041/testReport)** for PR 19981 at commit

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19981 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85040/ Test FAILed. ---

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19981 **[Test build #85040 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85040/testReport)** for PR 19981 at commit

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19981 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19981 **[Test build #85040 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85040/testReport)** for PR 19981 at commit

[GitHub] spark issue #19981: [SPARK-22786][SQL] only use AppStatusPlugin in history s...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19981 @vanzin We can add `AppStatusPlugin` back if you can convince other people that the SQL listener and UI tag should be set up during `SparkContext` initialization(I'm kind of convinced after some

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85038/ Test FAILed. ---

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20004 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20004 **[Test build #85038 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85038/testReport)** for PR 20004 at commit

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20004 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85037/ Test FAILed. ---

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20004 **[Test build #85037 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85037/testReport)** for PR 20004 at commit

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85036/ Test FAILed. ---

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20004 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20004 **[Test build #85036 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85036/testReport)** for PR 20004 at commit

[GitHub] spark issue #19811: [SPARK-18016][SQL] Code Generation: Constant Pool Limit ...

2017-12-17 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19811 ping @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20006: [SPARK-22821][TEST] Basic tests for WidenSetOperationTyp...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20006 **[Test build #85039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85039/testReport)** for PR 20006 at commit

[GitHub] spark pull request #20006: [SPARK-22821][TEST] Basic tests for WidenSetOpera...

2017-12-17 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/20006 [SPARK-22821][TEST] Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and Division ## What changes were proposed in this pull request? Test Coverage for

[GitHub] spark issue #19884: [WIP][SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0

2017-12-17 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/19884 @wesm I was able to install pyarrow 0.8.0 to my local environment via conda. Thanks! --- - To unsubscribe, e-mail:

[GitHub] spark pull request #19981: [SPARK-22786][SQL] only use AppStatusPlugin in hi...

2017-12-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19981#discussion_r157397655 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/ui/SQLAppStatusListenerSuite.scala --- @@ -489,16 +501,17 @@ private case class

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19864 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85035/ Test FAILed. ---

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19864 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19864 **[Test build #85035 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85035/testReport)** for PR 19864 at commit

[GitHub] spark pull request #19988: [Spark-22795] [ML] Raise error when line search i...

2017-12-17 Thread mrkm4ntr
Github user mrkm4ntr commented on a diff in the pull request: https://github.com/apache/spark/pull/19988#discussion_r157396794 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -244,9 +244,9 @@ class LinearSVC @Since("2.2.0") ( }

[GitHub] spark issue #19977: [SPARK-22771][SQL] Concatenate binary inputs into a bina...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19977 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19977: [SPARK-22771][SQL] Concatenate binary inputs into a bina...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19977 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85031/ Test FAILed. ---

[GitHub] spark issue #19977: [SPARK-22771][SQL] Concatenate binary inputs into a bina...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19977 **[Test build #85031 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85031/testReport)** for PR 19977 at commit

[GitHub] spark issue #19813: [SPARK-22600][SQL] Fix 64kb limit for deeply nested expr...

2017-12-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19813 > Another solution is to not make this contract. By a quick look this seems hard to do, because at the time of doing this, the code(method body) is already generated and we don't know how to replace

[GitHub] spark pull request #19993: [SPARK-22799][ML] Bucketizer should throw excepti...

2017-12-17 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/19993#discussion_r157393913 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/Bucketizer.scala --- @@ -140,10 +140,10 @@ final class Bucketizer @Since("1.4.0")

[GitHub] spark pull request #19988: [Spark-22795] [ML] Raise error when line search i...

2017-12-17 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/19988#discussion_r157393049 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -244,9 +244,9 @@ class LinearSVC @Since("2.2.0") (

[GitHub] spark pull request #19994: [SPARK-22810][ML][PySpark] Expose Python API for ...

2017-12-17 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/19994#discussion_r157391859 --- Diff: python/pyspark/ml/regression.py --- @@ -155,6 +183,14 @@ def intercept(self): """ return

[GitHub] spark pull request #19994: [SPARK-22810][ML][PySpark] Expose Python API for ...

2017-12-17 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/19994#discussion_r157391801 --- Diff: python/pyspark/ml/tests.py --- @@ -1725,6 +1725,27 @@ def test_offset(self): self.assertTrue(np.isclose(model.intercept,

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20004 **[Test build #85038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85038/testReport)** for PR 20004 at commit

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20004 **[Test build #85037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85037/testReport)** for PR 20004 at commit

[GitHub] spark pull request #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread ep1804
Github user ep1804 commented on a diff in the pull request: https://github.com/apache/spark/pull/20004#discussion_r157391252 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -482,6 +482,36 @@ class CSVSuite extends QueryTest

[GitHub] spark pull request #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread ep1804
Github user ep1804 commented on a diff in the pull request: https://github.com/apache/spark/pull/20004#discussion_r157391233 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -482,6 +482,36 @@ class CSVSuite extends QueryTest

[GitHub] spark pull request #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread ep1804
Github user ep1804 commented on a diff in the pull request: https://github.com/apache/spark/pull/20004#discussion_r157391102 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala --- @@ -249,6 +249,8 @@ final class DataStreamReader

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18576 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18576 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85032/ Test FAILed. ---

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18576 **[Test build #85032 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85032/testReport)** for PR 18576 at commit

[GitHub] spark issue #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20004 **[Test build #85036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85036/testReport)** for PR 20004 at commit

[GitHub] spark pull request #20004: [Spark-22818][SQL] csv escape of quote escape

2017-12-17 Thread ep1804
Github user ep1804 commented on a diff in the pull request: https://github.com/apache/spark/pull/20004#discussion_r157389005 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala --- @@ -249,6 +249,8 @@ final class DataStreamReader

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19864 **[Test build #85035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85035/testReport)** for PR 19864 at commit

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19864 Let's hold it on. Seems globally failing. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #17400: [SPARK-19981][SQL] Update output partitioning info. when...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17400 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85034/ Test FAILed. ---

[GitHub] spark issue #17400: [SPARK-19981][SQL] Update output partitioning info. when...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17400 **[Test build #85034 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85034/testReport)** for PR 17400 at commit

[GitHub] spark issue #17400: [SPARK-19981][SQL] Update output partitioning info. when...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17400 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20005 **[Test build #85033 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85033/testReport)** for PR 20005 at commit

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20005 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20005 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85033/ Test FAILed. ---

[GitHub] spark issue #17400: [SPARK-19981][SQL] Update output partitioning info. when...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17400 **[Test build #85034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85034/testReport)** for PR 17400 at commit

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread CodingCat
Github user CodingCat commented on the issue: https://github.com/apache/spark/pull/19864 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19864 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19864 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85030/ Test FAILed. ---

[GitHub] spark issue #19864: [SPARK-22673][SQL] InMemoryRelation should utilize exist...

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19864 **[Test build #85030 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85030/testReport)** for PR 19864 at commit

[GitHub] spark issue #20005: [DO-NOT-MERGE] Investigating SparkR test failure

2017-12-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20005 **[Test build #85033 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85033/testReport)** for PR 20005 at commit

  1   2   3   >