[GitHub] spark issue #15649: [SPARK-18121][SQL] Unable to query global temp views whe...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15649 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15649: [SPARK-18121][SQL] Unable to query global temp views whe...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15649 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67621/ Test FAILed. ---

[GitHub] spark issue #15649: [SPARK-18121][SQL] Unable to query global temp views whe...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15649 **[Test build #67621 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67621/consoleFull)** for PR 15649 at commit

[GitHub] spark issue #15636: [SPARK-18109][ML] Add instrumentation to GMM

2016-10-26 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/15636 @jkbradley @yanboliang Could you please make a review in your spare time? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2016-10-26 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/15435 It seems that many metrics in `MultinomialLogisticRegressionSummary` are generic to other classification algos. So what about create a new class `MultiClassificationSummary` and put it in a

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67626/consoleFull)** for PR 15647 at commit

[GitHub] spark pull request #15656: [SPARK-18132] Fix checkstyle

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15656 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67625 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67625/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15515 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15656: [SPARK-18132] Fix checkstyle

2016-10-26 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15656 merging to master and branch 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15642: [SPARK-18009][SQL] Fix ClassCastException while calling ...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15642 LGTM, merging to master and 2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15642: [SPARK-18009][SQL] Fix ClassCastException while calling ...

2016-10-26 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/15642 Thank you so much @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15642: [SPARK-18009][SQL] Fix ClassCastException while c...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15642 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15656: [SPARK-18132] Fix checkstyle

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15656 **[Test build #67624 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67624/consoleFull)** for PR 15656 at commit

[GitHub] spark pull request #15656: [SPARK-18132] Fix checkstyle

2016-10-26 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/15656 [SPARK-18132] Fix checkstyle This PR fixes checkstyle. You can merge this pull request into a Git repository by running: $ git pull https://github.com/yhuai/spark fix-format

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15515 ``` [info] - SPARK-10562: partition by column with mixed case name *** FAILED *** (605 milliseconds) [info] java.lang.reflect.InvocationTargetException: [info] at

[GitHub] spark pull request #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to tr...

2016-10-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15651#discussion_r85266229 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -130,17 +130,23 @@ case class ExternalRDDScanExec[T]( /**

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #67623 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67623/consoleFull)** for PR 14079 at commit

[GitHub] spark pull request #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to tr...

2016-10-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15651#discussion_r85265891 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -482,6 +483,33 @@ class Dataset[T] private[sql](

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67615/ Test FAILed. ---

[GitHub] spark pull request #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigge...

2016-10-26 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15527#discussion_r85265049 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -121,16 +124,61 @@ private[kafka010] case class

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigge...

2016-10-26 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15527#discussion_r85265053 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -121,16 +124,61 @@ private[kafka010] case class

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15354 **[Test build #67622 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67622/consoleFull)** for PR 15354 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67615 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67615/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15354 @marmbrus Thank you so much. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15653: [SPARK-18130][SQL] Don't add inferred redundant isnotnul...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15653 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15653: [SPARK-18130][SQL] Don't add inferred redundant isnotnul...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15653 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67613/ Test PASSed. ---

[GitHub] spark issue #15653: [SPARK-18130][SQL] Don't add inferred redundant isnotnul...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15653 **[Test build #67613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67613/consoleFull)** for PR 15653 at commit

[GitHub] spark issue #15649: [SPARK-18121][SQL] Unable to query global temp views whe...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15649 **[Test build #67621 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67621/consoleFull)** for PR 15649 at commit

[GitHub] spark issue #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to truncate ...

2016-10-26 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15651 @yhuai We have `RDD.localCheckpoint` which provides alternative approach to truncate periodically long lineages while skipping the expensive step of replicating the materialized data in a reliable

[GitHub] spark issue #15649: [SPARK-18121][SQL] Unable to query global temp views whe...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15649 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #67620 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67620/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #15649: [SPARK-18121][SQL] Unable to query global temp views whe...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15649 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to truncate ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15651 **[Test build #67619 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67619/consoleFull)** for PR 15651 at commit

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove shuffle codes in CollectLimitE...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15596 **[Test build #67618 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67618/consoleFull)** for PR 15596 at commit

[GitHub] spark pull request #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to tr...

2016-10-26 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/15651#discussion_r85264291 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -919,6 +922,44 @@ class DatasetSuite extends QueryTest with

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15596 **[Test build #67617 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67617/consoleFull)** for PR 15596 at commit

[GitHub] spark pull request #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15596#discussion_r85264043 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/limit.scala --- @@ -27,32 +27,14 @@ import

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15596 @JoshRosen After few tries, I think to replace `CollectLimitExec` with `GlobalLimitExec` is not a good idea. The main reason is whole stage codegen. Since `GlobalLimitExec` supports whole

[GitHub] spark issue #15655: [SPARK-18010][CORE] Reduce work performed for building u...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15655 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15556: [SPARK-18010][Core] Reduce work performed for building u...

2016-10-26 Thread vijoshi
Github user vijoshi commented on the issue: https://github.com/apache/spark/pull/15556 @vanzin @srowen - thanks, i've opened pull request #15655 on branch-2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #15655: [SPARK-18010][CORE] Reduce work performed for bui...

2016-10-26 Thread vijoshi
GitHub user vijoshi opened a pull request: https://github.com/apache/spark/pull/15655 [SPARK-18010][CORE] Reduce work performed for building up the application list for the History Server app list UI page ## What changes were proposed in this pull request? backport of

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15527 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15527 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67616/ Test PASSed. ---

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15527 **[Test build #67616 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67616/consoleFull)** for PR 15527 at commit

[GitHub] spark issue #15654: [SPARK-16881][MESOS] Migrate Mesos configs to use Config...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15654 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67614/ Test PASSed. ---

[GitHub] spark issue #15654: [SPARK-16881][MESOS] Migrate Mesos configs to use Config...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15654 **[Test build #67614 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67614/consoleFull)** for PR 15654 at commit

[GitHub] spark issue #15654: [SPARK-16881][MESOS] Migrate Mesos configs to use Config...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15654 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67612/ Test FAILed. ---

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67612 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67612/consoleFull)** for PR 15513 at commit

[GitHub] spark pull request #15195: [SPARK-17632][SQL]make console sink and other sin...

2016-10-26 Thread chuanlei
Github user chuanlei closed the pull request at: https://github.com/apache/spark/pull/15195 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15195: [SPARK-17632][SQL]make console sink and other sinks work...

2016-10-26 Thread chuanlei
Github user chuanlei commented on the issue: https://github.com/apache/spark/pull/15195 ok, I will close this pr. Thanks for the reply. @jerryshao @lw-lin @marmbrus @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15527 **[Test build #67616 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67616/consoleFull)** for PR 15527 at commit

[GitHub] spark issue #15654: [SPARK-16881][MESOS] Migrate Mesos configs to use Config...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15654 **[Test build #67614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67614/consoleFull)** for PR 15654 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67615/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15649: [SPARK-18121][SQL] Unable to query global temp views whe...

2016-10-26 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15649 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67610/ Test PASSed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67610/consoleFull)** for PR 15515 at commit

[GitHub] spark pull request #15654: [SPARK-16881][MESOS] Migrate Mesos configs to use...

2016-10-26 Thread techaddict
GitHub user techaddict opened a pull request: https://github.com/apache/spark/pull/15654 [SPARK-16881][MESOS] Migrate Mesos configs to use ConfigEntry ## What changes were proposed in this pull request? Migrate Mesos configs to use ConfigEntry ## How was this patch

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67611/ Test PASSed. ---

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67611/consoleFull)** for PR 15428 at commit

[GitHub] spark pull request #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to tr...

2016-10-26 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15651#discussion_r85259326 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -919,6 +922,44 @@ class DatasetSuite extends QueryTest with SharedSQLContext

[GitHub] spark pull request #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigge...

2016-10-26 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15527#discussion_r85258005 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -153,11 +201,7 @@ private[kafka010] case class

[GitHub] spark issue #15653: [SQL] Don't add inferred redundant isnotnull condition f...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15653 **[Test build #67613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67613/consoleFull)** for PR 15653 at commit

[GitHub] spark issue #15653: [SQL] Don't add inferred redundant isnotnull condition f...

2016-10-26 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15653 This is not a serious issue. And it doesn't affect correctness. I would left this to @cloud-fan or @hvanhovell decide if we want to fix it or not. --- If your project is set up for it, you can

[GitHub] spark pull request #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigge...

2016-10-26 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15527#discussion_r85258039 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSourceSuite.scala --- @@ -133,6 +132,41 @@ class KafkaSourceSuite

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2016-10-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15435 @sethah @jkbradley Now I am considering elemating the `probabilityToPredictionUDF`, There are some fussy problems about the `predictionCol` and the summary class hierarchy

[GitHub] spark pull request #15653: [SQL] Don't add inferred redundant isnotnull cond...

2016-10-26 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/15653 [SQL] Don't add inferred redundant isnotnull condition from constraints ## What changes were proposed in this pull request? In `Optimizer`, we will infer additional conditions from

[GitHub] spark issue #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to truncate ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15651 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67608/ Test PASSed. ---

[GitHub] spark issue #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to truncate ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15651 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to truncate ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15651 **[Test build #67608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67608/consoleFull)** for PR 15651 at commit

[GitHub] spark pull request #15513: [WIP][SPARK-17963][SQL][Documentation] Add exampl...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85254582 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -107,9 +145,19 @@ case class XPathLong(xml:

[GitHub] spark pull request #15513: [WIP][SPARK-17963][SQL][Documentation] Add exampl...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85254596 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -120,9 +168,19 @@ case class XPathFloat(xml:

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67612/consoleFull)** for PR 15513 at commit

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15513 I will take another look closely as suggested and then will let you all know. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigge...

2016-10-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15527#discussion_r85253453 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -153,11 +201,7 @@ private[kafka010] case class

[GitHub] spark issue #15629: [SQL][DOC] updating doc for JSON source to link to jsonl...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15629 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67607/ Test PASSed. ---

[GitHub] spark issue #15629: [SQL][DOC] updating doc for JSON source to link to jsonl...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15629 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67609/ Test PASSed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15629: [SQL][DOC] updating doc for JSON source to link to jsonl...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15629 **[Test build #67607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67607/consoleFull)** for PR 15629 at commit

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #67609 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67609/consoleFull)** for PR 15148 at commit

[GitHub] spark pull request #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocat...

2016-10-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15612#discussion_r85251773 --- Diff: core/src/main/scala/org/apache/spark/rdd/ZippedPartitionsRDD.scala --- @@ -45,7 +45,8 @@ private[spark] class ZippedPartitionsPartition(

[GitHub] spark pull request #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocat...

2016-10-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15612#discussion_r85251725 --- Diff: core/src/main/scala/org/apache/spark/util/ZipPartitionsRDDUtils.scala --- @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15453: [SPARK-17770] [CATALYST] making ObjectType public

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15453 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15453: [SPARK-17770] [CATALYST] making ObjectType public

2016-10-26 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15453 Thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15626: SPARK-17829 [SQL] Stable format for offset log

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15626 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67605/ Test PASSed. ---

[GitHub] spark issue #15626: SPARK-17829 [SQL] Stable format for offset log

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15626 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67611/consoleFull)** for PR 15428 at commit

[GitHub] spark issue #15626: SPARK-17829 [SQL] Stable format for offset log

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15626 **[Test build #67605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67605/consoleFull)** for PR 15626 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67610/consoleFull)** for PR 15515 at commit

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r85192795 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -66,6 +77,29 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r85187855 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -17,11 +17,17 @@ package

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r85248527 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,114 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r85248542 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,114 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r85248691 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,114 @@ class TaskSchedulerImplSuite extends

  1   2   3   4   5   6   >