[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124984978 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -1088,6 +1088,12 @@ public UTF8String clone() { retur

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124995623 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -1088,6 +1088,12 @@ public UTF8String clone() { retur

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124988718 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/GeneratedProjectionSuite.scala --- @@ -172,4 +172,40 @@ class Ge

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124985506 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Retur

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-06-30 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r124995034 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java --- @@ -126,4 +150,38 @@ private void failRema

[GitHub] spark issue #18484: [SPARK-21264][PYTHON] Call cross join path in PySpark jo...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18484 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18484: [SPARK-21264][PYTHON] Call cross join path in PySpark jo...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78971/ Test PASSed. ---

[GitHub] spark issue #18484: [SPARK-21264][PYTHON] Call cross join path in PySpark jo...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18484 **[Test build #78971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78971/testReport)** for PR 18484 at commit [`6ec509b`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #78966 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78966/testReport)** for PR 16028 at commit [`6bb1daf`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78966/ Test PASSed. ---

[GitHub] spark pull request #18452: [SPARK-21239][STREAMING] Support WAL recover in w...

2017-06-30 Thread Myasuka
Github user Myasuka commented on a diff in the pull request: https://github.com/apache/spark/pull/18452#discussion_r124988257 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -135,8 +135,11 @@ class WriteAheadLogBackedBlock

[GitHub] spark pull request #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'R...

2017-06-30 Thread guoxiaolongzte
Github user guoxiaolongzte commented on a diff in the pull request: https://github.com/apache/spark/pull/18464#discussion_r124987865 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/ui/WorkerPage.scala --- @@ -24,7 +24,7 @@ import scala.xml.Node import org.json4s.J

[GitHub] spark issue #18484: [SPARK-21224][PYTHON] Call cross join path in PySpark jo...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18484 **[Test build #78971 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78971/testReport)** for PR 18484 at commit [`6ec509b`](https://github.com/apache/spark/commit/6e

[GitHub] spark issue #18484: [SPARK-21224][PYTHON] Call cross join path in PySpark jo...

2017-06-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18484 cc @ueshin, could you take a look please when you have some time? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #18484: [SPARK-21224][PYTHON] Call cross join path in PyS...

2017-06-30 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18484 [SPARK-21224][PYTHON] Call cross join path in PySpark join with 'how' speicified rather than throwing NPE ## What changes were proposed in this pull request? Currently, it throws a NPE

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18481 **[Test build #78965 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78965/testReport)** for PR 18481 at commit [`e7d19a3`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18481 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78965/ Test FAILed. ---

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18481 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-30 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/18334 @rxin Currently we are re-calculating the stats. If we want to support incremental stats update, we may need to maintain some specific data structures. e.g. for ndv in column stats, store data structu

[GitHub] spark pull request #18159: [SPARK-20703][SQL] Associate metrics with data wr...

2017-06-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18159#discussion_r124982973 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/commands.scala --- @@ -19,25 +19,70 @@ package org.apache.spark.sql.execution.comma

[GitHub] spark pull request #18430: [SPARK-21223]:Thread-safety issue in FsHistoryPro...

2017-06-30 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18430#discussion_r124982910 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -19,7 +19,7 @@ package org.apache.spark.deploy.history

[GitHub] spark issue #18430: [SPARK-21223]:Thread-safety issue in FsHistoryProvider

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18430 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18430: [SPARK-21223]:Thread-safety issue in FsHistoryProvider

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18430 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78970/ Test FAILed. ---

[GitHub] spark issue #18430: [SPARK-21223]:Thread-safety issue in FsHistoryProvider

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18430 **[Test build #78970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78970/testReport)** for PR 18430 at commit [`fde0d34`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #18430: [SPARK-21223]:Thread-safety issue in FsHistoryProvider

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18430 **[Test build #78970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78970/testReport)** for PR 18430 at commit [`fde0d34`](https://github.com/apache/spark/commit/fd

[GitHub] spark issue #17758: [SPARK-20460][SPARK-21144][SQL] Make it more consistent ...

2017-06-30 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 ok, I'll recheck the policy and put the summary here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark issue #18430: [SPARK-21223]:Thread-safety issue in FsHistoryProvider

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18430 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #78969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78969/testReport)** for PR 18159 at commit [`32f4abf`](https://github.com/apache/spark/commit/32

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #78968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78968/testReport)** for PR 18159 at commit [`1defb3a`](https://github.com/apache/spark/commit/1d

[GitHub] spark issue #18174: [SPARK-20950][CORE]add a new config to diskWriteBufferSi...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18174 **[Test build #78967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78967/testReport)** for PR 18174 at commit [`62ccd4e`](https://github.com/apache/spark/commit/62

[GitHub] spark pull request #18159: [SPARK-20703][SQL] Associate metrics with data wr...

2017-06-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18159#discussion_r124979471 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2659,6 +2668,21 @@ private[spark] object Utils extends Logging { redact(redac

[GitHub] spark issue #18475: [SPARK][Tests] assert messager not right

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18475 This is just a typo and is so minor... maybe you can just include it in other related PRs of yours --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18174: [SPARK-20950][CORE]add a new config to diskWriteBufferSi...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18174 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18481 **[Test build #78965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78965/testReport)** for PR 18481 at commit [`e7d19a3`](https://github.com/apache/spark/commit/e7

[GitHub] spark issue #18430: [SPARK-21223]:Thread-safety issue in FsHistoryProvider

2017-06-30 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18430 Also Please change the title as mentioned above. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #78966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78966/testReport)** for PR 16028 at commit [`6bb1daf`](https://github.com/apache/spark/commit/6b

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/16028 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18483 **[Test build #78964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78964/testReport)** for PR 18483 at commit [`f630cbd`](https://github.com/apache/spark/commit/f6

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124978721 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/window/AggregateProcessor.scala --- @@ -145,13 +145,10 @@ private[window] final class Ag

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18483 cc @hvanhovell @gatorsmile @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18481 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124978673 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/SortBasedAggregationIterator.scala --- @@ -86,17 +86,6 @@ class SortBasedAggre

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124978492 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateSafeProjection.scala --- @@ -131,8 +131,6 @@ object Gener

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124978458 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -1047,7 +1047,7 @@ case class Cast(child: Expression, d

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/18483 [SPARK-17528][SQL] data should be copied properly before saving into InternalRow ## What changes were proposed in this pull request? For performance reasons, `UnsafeRow.getString`, `getS

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18436 **[Test build #78963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78963/testReport)** for PR 18436 at commit [`12347e6`](https://github.com/apache/spark/commit/12

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18436 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #18334: [SPARK-21127] [SQL] Update statistics after data ...

2017-06-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18334#discussion_r124977705 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -437,7 +437,20 @@ case class AlterTableAddPartitionCommand(

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/18334 Can the stats be updated incrementally? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18479 **[Test build #3821 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3821/testReport)** for PR 18479 at commit [`9c32d25`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18301 Let me rephrase my question. Why users care the `average number of probe`, if they already know `average number of collision`? --- If your project is set up for it, you can reply to this email a

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18301 `average number of probes` will be 1 if no collision, right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request #18334: [SPARK-21127] [SQL] Update statistics after data ...

2017-06-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/18334#discussion_r124977390 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -774,6 +774,12 @@ object SQLConf { .doubleConf

[GitHub] spark pull request #18334: [SPARK-21127] [SQL] Update statistics after data ...

2017-06-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/18334#discussion_r124977456 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -437,7 +437,20 @@ case class AlterTableAddPartitionCommand(

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18480 Also `timeSpentResizingNs` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #15405: [SPARK-15917][CORE] Added support for number of executor...

2017-06-30 Thread JonathanTaws
Github user JonathanTaws commented on the issue: https://github.com/apache/spark/pull/15405 @jiang Quite busy at the moment, will take care of it as soon as possible. I'll ping you once it's done Le 25 juin 2017 16:33, "Jiang Xingbo" a écrit : ping @JonathanTaws

[GitHub] spark issue #18469: [SPARK-21256] [SQL] Add withSQLConf to Catalyst Test

2017-06-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18469 Sure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #18482: [SPARK-21262][WIP] Stop sending 'stream request' when sh...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18482 **[Test build #78961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78961/testReport)** for PR 18482 at commit [`9802b85`](https://github.com/apache/spark/commit/98

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18480 **[Test build #78962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78962/testReport)** for PR 18480 at commit [`d8df5e0`](https://github.com/apache/spark/commit/d8

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18480 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #18437: [SPARK-21176] [Web UI] Limit number of selector threads ...

2017-06-30 Thread IngoSchuster
Github user IngoSchuster commented on the issue: https://github.com/apache/spark/pull/18437 Thank you all for your support! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18471 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78948/ Test FAILed. ---

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18471 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18436 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18471 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18436 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78950/ Test FAILed. ---

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18471 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78951/ Test FAILed. ---

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18436 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78952/ Test FAILed. ---

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18436 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18481 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78957/ Test FAILed. ---

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18481 **[Test build #78957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78957/testReport)** for PR 18481 at commit [`e7d19a3`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18479 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78959/ Test FAILed. ---

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18479 **[Test build #78959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78959/testReport)** for PR 18479 at commit [`9c32d25`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18471 **[Test build #78948 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78948/testReport)** for PR 18471 at commit [`05084a9`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78960/ Test FAILed. ---

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18023 **[Test build #78955 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78955/testReport)** for PR 18023 at commit [`4e36ed9`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18436 **[Test build #78950 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78950/testReport)** for PR 18436 at commit [`be56898`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #18481: [SPARK-20889][SparkR] Grouped documentation for WINDOW c...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18481 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18480 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78958/ Test FAILed. ---

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18023 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18480 **[Test build #78958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78958/testReport)** for PR 18480 at commit [`d8df5e0`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18436 **[Test build #78952 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78952/testReport)** for PR 18436 at commit [`12347e6`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18471 **[Test build #78951 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78951/testReport)** for PR 18471 at commit [`fd5bde5`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18479 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18479 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78954/ Test FAILed. ---

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18479 **[Test build #78954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78954/testReport)** for PR 18479 at commit [`94fb669`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18480 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #78960 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78960/testReport)** for PR 16028 at commit [`6bb1daf`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18023 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78955/ Test FAILed. ---

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18479 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #18479: WIP - logical plan stat propagation using mixin a...

2017-06-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18479#discussion_r124976032 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -438,7 +438,7 @@ case class CatalogRelation(

[GitHub] spark pull request #18482: [SPARK-21262][WIP] Stop sending 'stream request' ...

2017-06-30 Thread jinxing64
GitHub user jinxing64 reopened a pull request: https://github.com/apache/spark/pull/18482 [SPARK-21262][WIP] Stop sending 'stream request' when shuffle blocks. ## What changes were proposed in this pull request? In current code, client will fetch the remote huge blocks to di

[GitHub] spark pull request #18482: [SPARK-21262][WIP] Stop sending 'stream request' ...

2017-06-30 Thread jinxing64
Github user jinxing64 closed the pull request at: https://github.com/apache/spark/pull/18482 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #18482: Stop sending 'stream request' when shuffle blocks...

2017-06-30 Thread jinxing64
GitHub user jinxing64 opened a pull request: https://github.com/apache/spark/pull/18482 Stop sending 'stream request' when shuffle blocks. ## What changes were proposed in this pull request? In current code, client will fetch the remote huge blocks to disk. It is implemente

<    1   2   3   4   5