[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-10 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13563 @rxin what do you think about adding an encoding parameter to `PipedRDD`? I'm inclined to it since it will resolve this issue essentially. --- If your project is set up for it, you can reply to

[GitHub] spark issue #13496: [SPARK-15753][SQL] Move Analyzer stuff to Analyzer from ...

2016-06-10 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13496 LGTM, merging to master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13604: [SPARK-15856][SQL] Revert API breaking changes made in D...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13604 **[Test build #60303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60303/consoleFull)** for PR 13604 at commit

[GitHub] spark pull request #13604: [SPARK-15856][SQL] Revert API breaking changes ma...

2016-06-10 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/13604 [SPARK-15856][SQL] Revert API breaking changes made in DataFrameReader.text and SQLContext.range ## What changes were proposed in this pull request? In Spark 2.0, after unifying

[GitHub] spark issue #13597: [SPARK-15871][SQL] Add `assertNotPartitioned` check in `...

2016-06-10 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13597 LGTM. @marmbrus what do you think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-10 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/12836 @NarineK @shivaram Sorry for the late reply. Overriding `stringArgs` is the correct solution for this issue. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-10 Thread sadikovi
Github user sadikovi commented on the issue: https://github.com/apache/spark/pull/13563 Can you give an example where it would not work? I was actually thinking about adding codec for stderr with malformed rule of CodingErrorAction.REPLACE to make it safer. --- If your project is

[GitHub] spark pull request #13549: [SPARK-15812][SQ][Streaming] Added support for so...

2016-06-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66653864 --- Diff: core/src/test/scala/org/apache/spark/util/collection/unsafe/sort/RadixSortSuite.scala --- @@ -152,7 +152,7 @@ class RadixSortSuite extends

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66653788 --- Diff: core/src/test/scala/org/apache/spark/util/collection/unsafe/sort/RadixSortSuite.scala --- @@ -152,7 +152,7 @@ class RadixSortSuite extends

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66653192 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SortOrder.scala --- @@ -64,49 +64,57 @@ case class SortOrder(child:

[GitHub] spark pull request #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF...

2016-06-10 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/13563#discussion_r66653094 --- Diff: core/src/main/scala/org/apache/spark/rdd/PipedRDD.scala --- @@ -129,7 +130,7 @@ private[spark] class PipedRDD[T: ClassTag]( override def

[GitHub] spark issue #13589: [SPARK-15825][SQL] Fix SMJ invalid results

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13589 **[Test build #60302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60302/consoleFull)** for PR 13589 at commit

[GitHub] spark issue #13601: [SPARK-15875] Try to use Seq.isEmpty and Seq.nonEmpty in...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13601 **[Test build #60301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60301/consoleFull)** for PR 13601 at commit

[GitHub] spark issue #13602: [SPARK-15878][CORE][TEST] fix cleanup in EventLoggingLis...

2016-06-10 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13602 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66650922 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeInMemorySorter.java --- @@ -301,6 +323,19 @@ public SortedIterator

[GitHub] spark issue #13601: [SPARK-15875] Try to use Seq.isEmpty and Seq.nonEmpty in...

2016-06-10 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13601 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66650450 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeInMemorySorter.java --- @@ -206,14 +216,27 @@ public void

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66649155 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeInMemorySorter.java --- @@ -93,6 +94,14 @@ public int

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66648811 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/RadixSort.java --- @@ -205,13 +210,14 @@ public static int

[GitHub] spark pull request #13161: [SPARK-14851] [Core] Support radix sort with null...

2016-06-10 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/13161#discussion_r66648782 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/RadixSort.java --- @@ -205,13 +210,14 @@ public static int

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-10 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/13481 I was trying to merge this, but looks like the merge script is not happy. Please feel free to merge this. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-10 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/13481 @yanboliang do you want to go ahead and merge this one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-10 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r66647379 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistIntegrationSuite.scala --- @@ -93,6 +94,30 @@ class BlacklistIntegrationSuite extends

[GitHub] spark pull request #13543: [SPARK-15806] [Documentation] update doc for SPAR...

2016-06-10 Thread bomeng
Github user bomeng commented on a diff in the pull request: https://github.com/apache/spark/pull/13543#discussion_r66647339 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/MasterArguments.scala --- @@ -20,18 +20,24 @@ package org.apache.spark.deploy.master import

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-10 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r66646791 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -404,6 +404,25 @@ private[spark] class TaskSetManager( }

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #60300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60300/consoleFull)** for PR 13603 at commit

[GitHub] spark issue #13481: [SPARK-15738][PYSPARK][ML] Adding Pyspark ml RFormula __...

2016-06-10 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/13481 LGTM2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-10 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/13603 [SPARK-15865][CORE] Blacklist should not result in job hanging with less than 4 executors ## What changes were proposed in this pull request? Before this change, when you turn on

[GitHub] spark issue #13155: [SPARK-15370] [SQL] Update RewriteCorrelatedScalarSubque...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13155 **[Test build #3074 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3074/consoleFull)** for PR 13155 at commit

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13562 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60298/ Test PASSed. ---

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13562 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13562 **[Test build #60298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60298/consoleFull)** for PR 13562 at commit

[GitHub] spark issue #13594: [SPARK-15866] Rename listAccumulator collectionAccumulat...

2016-06-10 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13594 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #13594: [SPARK-15866] Rename listAccumulator collectionAc...

2016-06-10 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13594#discussion_r66644139 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -415,15 +415,20 @@ class DoubleAccumulator extends AccumulatorV2[jl.Double,

[GitHub] spark issue #13602: [SPARK-15878][CORE][TEST] fix cleanup in EventLoggingLis...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13602 **[Test build #60299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60299/consoleFull)** for PR 13602 at commit

[GitHub] spark pull request #13597: [SPARK-15871][SQL] Add `assertNotPartitioned` che...

2016-06-10 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13597#discussion_r66643644 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -572,8 +573,13 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] spark pull request #13602: [SPARK-15878][CORE][TEST] fix cleanup in EventLog...

2016-06-10 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/13602 [SPARK-15878][CORE][TEST] fix cleanup in EventLoggingListenerSuite and ReplayListenerSuite ## What changes were proposed in this pull request? These tests weren't properly using

[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13563 Why would stderr be different from stdout? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-10 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/13563 @sadikovi : That will not work in all cases. See : https://github.com/apache/spark/pull/13563#discussion_r66318006 --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13562#discussion_r66641656 --- Diff: dev/make-distribution.sh --- @@ -150,7 +156,13 @@ export MAVEN_OPTS="${MAVEN_OPTS:--Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCac # Store the

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13562 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60297/ Test PASSed. ---

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13562 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13562 **[Test build #60297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60297/consoleFull)** for PR 13562 at commit

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60296/ Test PASSed. ---

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #60296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60296/consoleFull)** for PR 9571 at commit

[GitHub] spark issue #13486: [SPARK-15743][SQL] Prevent saving with all-column partit...

2016-06-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13486 Hi, @marmbrus . Could you review this PR again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #13436: [SPARK-15696][SQL] Improve `crosstab` to have a consiste...

2016-06-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13436 Thank you, @rxin . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13155: [SPARK-15370] [SQL] Update RewriteCorrelatedScalarSubque...

2016-06-10 Thread frreiss
Github user frreiss commented on the issue: https://github.com/apache/spark/pull/13155 Tests ran successfully on my machine. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13601: [SPARK-15875] Try to use Seq.isEmpty and Seq.nonE...

2016-06-10 Thread yangw1234
Github user yangw1234 commented on a diff in the pull request: https://github.com/apache/spark/pull/13601#discussion_r66630258 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1656,7 +1656,7 @@ class Analyzer(

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13562 **[Test build #60298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60298/consoleFull)** for PR 13562 at commit

[GitHub] spark pull request #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13562#discussion_r66625100 --- Diff: dev/make-distribution.sh --- @@ -42,6 +42,8 @@ function exit_with_usage { echo "usage:" cl_options="[--name] [--tgz] [--mvn ]"

[GitHub] spark pull request #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread a-roberts
Github user a-roberts commented on a diff in the pull request: https://github.com/apache/spark/pull/13562#discussion_r66624671 --- Diff: dev/make-distribution.sh --- @@ -42,6 +42,8 @@ function exit_with_usage { echo "usage:" cl_options="[--name] [--tgz] [--mvn ]"

[GitHub] spark pull request #13601: [SPARK-15875] Try to use Seq.isEmpty and Seq.nonE...

2016-06-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13601#discussion_r66624159 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1656,7 +1656,7 @@ class Analyzer( //

[GitHub] spark issue #13601: [SPARK-15875] Try to use Seq.isEmpty and Seq.nonEmpty in...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13601 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13601: [SPARK-15875] Try to use Seq.isEmpty and Seq.nonE...

2016-06-10 Thread yangw1234
GitHub user yangw1234 opened a pull request: https://github.com/apache/spark/pull/13601 [SPARK-15875] Try to use Seq.isEmpty and Seq.nonEmpty instead of Seq.length == 0 and Seq.length > 0 ## What changes were proposed in this pull request? In scala, immutable.List.length

[GitHub] spark issue #13524: [SPARK-15776][SQL] Type coercion incorrect

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13524 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60295/ Test PASSed. ---

[GitHub] spark issue #13524: [SPARK-15776][SQL] Type coercion incorrect

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13524 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13524: [SPARK-15776][SQL] Type coercion incorrect

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13524 **[Test build #60295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60295/consoleFull)** for PR 13524 at commit

[GitHub] spark pull request #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13562#discussion_r66621977 --- Diff: dev/make-distribution.sh --- @@ -42,6 +42,8 @@ function exit_with_usage { echo "usage:" cl_options="[--name] [--tgz] [--mvn ]"

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13562 **[Test build #60297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60297/consoleFull)** for PR 13562 at commit

[GitHub] spark issue #13593: [SPARK-15864] [SQL] Fix Inconsistent Behaviors when Unca...

2016-06-10 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13593 cc @rxin @hvanhovell @liancheng This is another issue related to `Cache` and `Uncache`. Actually, I am not sure if we should provide a SQL interface `UNCACHE TABLE IF EXISTS`. Thanks!

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-06-10 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/9571 Updated patch. Addresses indentation, found and eliminated one more call to {{initialize()}} outside of constructor. Adds a whole new counter, `event.replay.count`, which counts the

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #60296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60296/consoleFull)** for PR 9571 at commit

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13599 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13599 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13599 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60294/ Test PASSed. ---

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13599 **[Test build #60294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60294/consoleFull)** for PR 13599 at commit

[GitHub] spark pull request #13589: [SPARK-15822][SPARK-15825][SQL] Fix SMJ Segfault/...

2016-06-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13589#discussion_r66615434 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -490,6 +490,7 @@ class CodegenContext

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13599 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60293/ Test PASSed. ---

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13599 **[Test build #60293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60293/consoleFull)** for PR 13599 at commit

[GitHub] spark pull request #9571: [SPARK-11373] [CORE] Add metrics to the History Se...

2016-06-10 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9571#discussion_r66614402 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -667,6 +700,90 @@ private[history] class

[GitHub] spark pull request #9571: [SPARK-11373] [CORE] Add metrics to the History Se...

2016-06-10 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9571#discussion_r66613829 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -278,6 +303,9 @@ private[history] class

[GitHub] spark pull request #9571: [SPARK-11373] [CORE] Add metrics to the History Se...

2016-06-10 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9571#discussion_r66612954 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -114,28 +123,45 @@ class HistoryServer( * this UI with

[GitHub] spark pull request #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread a-roberts
Github user a-roberts commented on a diff in the pull request: https://github.com/apache/spark/pull/13562#discussion_r66610434 --- Diff: dev/make-distribution.sh --- @@ -42,6 +42,7 @@ function exit_with_usage { echo "usage:" cl_options="[--name] [--tgz] [--mvn ]"

[GitHub] spark issue #13597: [SPARK-15871][SQL] Add `assertNotPartitioned` check in `...

2016-06-10 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13597 @marmbrus @cloud-fan @zsxwing , would you mind taking a look? Thanks! :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13600: [SPARK-15873][Spark Core] JdbcRDD to support more bound ...

2016-06-10 Thread weicheng113
Github user weicheng113 commented on the issue: https://github.com/apache/spark/pull/13600 In the original JdbcRDD, it only supports Long bound type and does not leave room for extension. In the pull request, the implementation support the original Long type plus String type, which

[GitHub] spark issue #13597: [SPARK-15871][SQL] Add `assertNotPartitioned` check in `...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13597 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60292/ Test PASSed. ---

[GitHub] spark issue #13597: [SPARK-15871][SQL] Add `assertNotPartitioned` check in `...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13597 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13597: [SPARK-15871][SQL] Add `assertNotPartitioned` check in `...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13597 **[Test build #60292 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60292/consoleFull)** for PR 13597 at commit

[GitHub] spark pull request #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/13562#discussion_r66606804 --- Diff: dev/make-distribution.sh --- @@ -42,6 +42,7 @@ function exit_with_usage { echo "usage:" cl_options="[--name] [--tgz] [--mvn ]"

[GitHub] spark pull request #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/13562#discussion_r66606535 --- Diff: dev/make-distribution.sh --- @@ -42,6 +42,7 @@ function exit_with_usage { echo "usage:" cl_options="[--name] [--tgz] [--mvn ]"

[GitHub] spark issue #13524: [SPARK-15776][SQL] Type coercion incorrect

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13524 **[Test build #60295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60295/consoleFull)** for PR 13524 at commit

[GitHub] spark issue #13596: [SPARK-15870][SQL] DataFrame can't execute after uncache...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13596 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60291/ Test PASSed. ---

[GitHub] spark issue #13596: [SPARK-15870][SQL] DataFrame can't execute after uncache...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13596 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13596: [SPARK-15870][SQL] DataFrame can't execute after uncache...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13596 **[Test build #60291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60291/consoleFull)** for PR 13596 at commit

[GitHub] spark issue #13600: JdbcRDD - generalize lower bound type support, not...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13600 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13595: [MINOR][SQL] Standardize 'continuous queries' to 'stream...

2016-06-10 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13595 @tdas @zsxwing , would you mind taking a look? Thanks! :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #13600: JdbcRDD - generalize lower bound type suppo...

2016-06-10 Thread weicheng113
GitHub user weicheng113 opened a pull request: https://github.com/apache/spark/pull/13600 JdbcRDD - generalize lower bound type support, not just long type. ## What changes were proposed in this pull request? JdbcRDD - generalize lower bound type support, not just long

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13599 **[Test build #60294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60294/consoleFull)** for PR 13599 at commit

[GitHub] spark issue #13595: [MINOR][SQL] Standardize 'continuous queries' to 'stream...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13595 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13595: [MINOR][SQL] Standardize 'continuous queries' to 'stream...

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13595 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60290/ Test PASSed. ---

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13599 **[Test build #60293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60293/consoleFull)** for PR 13599 at commit

[GitHub] spark issue #13595: [MINOR][SQL] Standardize 'continuous queries' to 'stream...

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13595 **[Test build #60290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60290/consoleFull)** for PR 13595 at commit

[GitHub] spark pull request #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pys...

2016-06-10 Thread zjffdu
GitHub user zjffdu opened a pull request: https://github.com/apache/spark/pull/13599 [SPARK-13587] [PYSPARK] Support virtualenv in pyspark ## What changes were proposed in this pull request? Support virtualenv in pyspark as described in SPARK-13587 ## How was this patch

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13562 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60288/ Test PASSed. ---

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13562 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13562 **[Test build #60288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60288/consoleFull)** for PR 13562 at commit

[GitHub] spark pull request #13598: [SPARK-13587] [PYSPARK] Support virtualenv in pys...

2016-06-10 Thread zjffdu
Github user zjffdu closed the pull request at: https://github.com/apache/spark/pull/13598 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

<    1   2   3   4   5   6   7   >