[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-16 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r116914922 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -461,68 +462,249 @@ case class

[GitHub] spark issue #18013: [SPARK-20781] the location of Dockerfile in docker.prope...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18013 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18013: [SPARK-20781] the location of Dockerfile in docke...

2017-05-16 Thread liu-zhaokun
GitHub user liu-zhaokun opened a pull request: https://github.com/apache/spark/pull/18013 [SPARK-20781] the location of Dockerfile in docker.properties.templat is wrong [https://issues.apache.org/jira/browse/SPARK-20781](https://issues.apache.org/jira/browse/SPARK-20781) the

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77003/ Test FAILed. ---

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77003 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77003/testReport)** for PR 17770 at commit

[GitHub] spark issue #17997: [SPARK-20763][SQL]The function of `month` and `day` retu...

2017-05-16 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/17997 @ueshin Yes, I will do it ,thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17997: [SPARK-20763][SQL]The function of `month` and `day` retu...

2017-05-16 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/17997 I guess this would also affect date-related functions such as `dayofyear`, `year`, `quater` and `weekofyear`, etc. Could you add tests for them? --- If your project is set up for it, you can

[GitHub] spark pull request #17953: [SPARK-20680][SQL] Spark-sql do not support for v...

2017-05-16 Thread LantaoJin
Github user LantaoJin commented on a diff in the pull request: https://github.com/apache/spark/pull/17953#discussion_r116912802 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1928,4 +1928,17 @@ class HiveDDLSuite }

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77010 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77010/testReport)** for PR 17770 at commit

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116911964 --- Diff: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala --- @@ -401,4 +429,146 @@ class

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116911752 --- Diff: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala --- @@ -401,4 +429,146 @@ class

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116911537 --- Diff: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala --- @@ -51,7 +59,10 @@ private[spark] class

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77002/ Test FAILed. ---

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77002/testReport)** for PR 17953 at commit

[GitHub] spark pull request #18008: [SPARK-20776] Fix perf. problems in JobProgressLi...

2017-05-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18008 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18008 thanks, merging to master/2.2! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77005/ Test FAILed. ---

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #77005 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77005/testReport)** for PR 17995 at commit

[GitHub] spark issue #17955: [SPARK-20715] Store MapStatuses only in MapOutputTracker...

2017-05-16 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/17955 I've been running some local tests of scheduler throughput to make sure that this doesn't adversely affect performance in the processing of task completion events (I discovered the perf. hotspot

[GitHub] spark pull request #17935: [SPARK-20690][SQL] Subqueries in FROM should have...

2017-05-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17935 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17935 Thanks @cloud-fan @hvanhovell @gatorsmile @wzhfy --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17935 @cloud-fan Yeah, I change the aliased name in one test. I tested it locally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17935 oops, you pushed a new commit... But it should be fine as the change is very small. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17935 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #77009 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77009/testReport)** for PR 17995 at commit

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77004/ Test FAILed. ---

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #77004 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77004/testReport)** for PR 17995 at commit

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #77008 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77008/testReport)** for PR 16989 at commit

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17935 **[Test build #77007 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77007/testReport)** for PR 17935 at commit

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #77006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77006/testReport)** for PR 16989 at commit

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #77005 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77005/testReport)** for PR 17995 at commit

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17935 Sure. On May 17, 2017 12:10 PM, "Wenchen Fan" wrote: > *@cloud-fan* commented on this pull request. > -- > > In

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77000 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77000/testReport)** for PR 17953 at commit

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77000/ Test FAILed. ---

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17739 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76998/ Test PASSed. ---

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17739 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #77004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77004/testReport)** for PR 17995 at commit

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116907421 --- Diff: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala --- @@ -401,4 +429,139 @@ class

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17739 **[Test build #76998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76998/testReport)** for PR 17739 at commit

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116907437 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -278,4 +278,10 @@ package object config {

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116907401 --- Diff: docs/configuration.md --- @@ -954,16 +970,16 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116907199 --- Diff: core/src/test/scala/org/apache/spark/scheduler/MapStatusSuite.scala --- @@ -128,4 +138,27 @@ class MapStatusSuite extends SparkFunSuite {

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76997/ Test PASSed. ---

[GitHub] spark pull request #17935: [SPARK-20690][SQL] Subqueries in FROM should have...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17935#discussion_r116906916 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala --- @@ -631,13 +631,13 @@ class CachedTableSuite extends QueryTest with

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #76997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76997/testReport)** for PR 16989 at commit

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116906572 --- Diff: docs/configuration.md --- @@ -954,16 +970,16 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76996/ Test PASSed. ---

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #76996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76996/testReport)** for PR 16989 at commit

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77003/testReport)** for PR 17770 at commit

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116906367 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -278,4 +278,10 @@ package object config {

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116906282 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -278,4 +278,10 @@ package object config {

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-16 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17770 ping @gatorsmile Can you help review this? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116905551 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -278,4 +278,10 @@ package object config {

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116905473 --- Diff: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala --- @@ -401,4 +429,139 @@ class

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116905315 --- Diff: docs/configuration.md --- @@ -954,16 +970,16 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #76995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76995/testReport)** for PR 16989 at commit

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76995/ Test FAILed. ---

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77002/testReport)** for PR 17953 at commit

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76999/ Test FAILed. ---

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #76999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76999/testReport)** for PR 17995 at commit

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116904487 --- Diff: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala --- @@ -51,7 +59,10 @@ private[spark] class

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116904336 --- Diff: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala --- @@ -51,7 +59,10 @@ private[spark] class

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116904146 --- Diff: core/src/test/scala/org/apache/spark/scheduler/MapStatusSuite.scala --- @@ -128,4 +138,27 @@ class MapStatusSuite extends SparkFunSuite {

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r116904170 --- Diff: core/src/test/scala/org/apache/spark/scheduler/MapStatusSuite.scala --- @@ -128,4 +138,27 @@ class MapStatusSuite extends SparkFunSuite {

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77001/testReport)** for PR 17953 at commit

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77001/ Test FAILed. ---

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread LantaoJin
Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/17953 Thanks, I add a row to the table `t` and now we can do nonEmpty check on table `tabNullType`. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77001/testReport)** for PR 17953 at commit

[GitHub] spark issue #18012: [SPARK-20779][Examples]The ASF header placed in an incor...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18012 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18012: [SPARK-20779][Examples]The ASF header placed in a...

2017-05-16 Thread zuotingbing
GitHub user zuotingbing opened a pull request: https://github.com/apache/spark/pull/18012 [SPARK-20779][Examples]The ASF header placed in an incorrect location in some files. ## What changes were proposed in this pull request? The license is not at the top in some files.

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-16 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r116903142 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -461,68 +462,249 @@ case class

[GitHub] spark issue #17919: [SPARK-20677][MLLIB][ML] Follow-up to ALS recommend-all ...

2017-05-16 Thread auskalia
Github user auskalia commented on the issue: https://github.com/apache/spark/pull/17919 Hi @mpjlu , your are right. But I consider that sometimes we have to use several spark mission to finish our work, especially the resource is insufficient in hadoop cluster. Due to save and reload

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17935 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17935 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76994/ Test PASSed. ---

[GitHub] spark issue #17935: [SPARK-20690][SQL] Subqueries in FROM should have alias ...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17935 **[Test build #76994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76994/testReport)** for PR 17935 at commit

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #76999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76999/testReport)** for PR 17995 at commit

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77000/testReport)** for PR 17953 at commit

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18008 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76991/ Test PASSed. ---

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18008 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18008 **[Test build #76991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76991/testReport)** for PR 18008 at commit

[GitHub] spark issue #17919: [SPARK-20677][MLLIB][ML] Follow-up to ALS recommend-all ...

2017-05-16 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/17919 Hi @auskalia , you are right. repartition can improve the performance of recommendForAll. In my experiment for PR 17742, I have 120 cores, I use 20 partition for userFeatures, and itemFeatures.

[GitHub] spark issue #17402: [SPARK-7200] Check that memory is not leaked in TaskMemo...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17402 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17894: [WIP][SPARK-17134][ML] Use level 2 BLAS operations in Lo...

2017-05-16 Thread VinceShieh
Github user VinceShieh commented on the issue: https://github.com/apache/spark/pull/17894 @sethah Sorry for the late response. Setting as WIP. We have performance data for dense features, data for the sparse feature will be ready soon. thanks. --- If your project is set up for it,

[GitHub] spark issue #17402: [SPARK-7200] Check that memory is not leaked in TaskMemo...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17402 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76992/ Test PASSed. ---

[GitHub] spark issue #17402: [SPARK-7200] Check that memory is not leaked in TaskMemo...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17402 **[Test build #76992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76992/testReport)** for PR 17402 at commit

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18008 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18008 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76990/ Test PASSed. ---

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18008 **[Test build #76990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76990/testReport)** for PR 18008 at commit

[GitHub] spark issue #17919: [SPARK-20677][MLLIB][ML] Follow-up to ALS recommend-all ...

2017-05-16 Thread auskalia
Github user auskalia commented on the issue: https://github.com/apache/spark/pull/17919 Hi, @MLnick, We find that just do repartition for userFeatures and productFeatures can improve the efficiency significantly on the ALS recommendForAll(). Here is our procedure: 1.

[GitHub] spark issue #18008: [SPARK-20776] Fix perf. problems in JobProgressListener ...

2017-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18008 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   4   5   >