[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22641195 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerUIEventListener.scala --- @@ -0,0 +1,182 @@ +/*

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22641167 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerUIEventListener.scala --- @@ -0,0 +1,182 @@ +/*

[GitHub] spark pull request: some trivial fixes

2015-01-08 Thread prabeesh
GitHub user prabeesh opened a pull request: https://github.com/apache/spark/pull/3947 some trivial fixes You can merge this pull request into a Git repository by running: $ git pull https://github.com/prabeesh/spark master Alternatively you can review and apply these changes

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22640852 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala --- @@ -17,6 +17,8 @@ package org.apache

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-69152244 [Test build #25208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25208/consoleFull) for PR 3607 at commit [`ddcd592`](https://gith

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-69152255 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22640797 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala --- @@ -93,6 +94,13 @@ private[hive] class Hi

[GitHub] spark pull request: [SPARK-4970] Do not read spark.executor.memory...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3805#issuecomment-69152046 [Test build #25213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25213/consoleFull) for PR 3805 at commit [`6339ca7`](https://githu

[GitHub] spark pull request: [SPARK-5009][SQL] [WIP] Long keyword support i...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3926#issuecomment-69152068 [Test build #25212 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25212/consoleFull) for PR 3926 at commit [`dd0e60a`](https://githu

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3946#issuecomment-69152003 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/3946#issuecomment-69151945 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-01-08 Thread adrian-wang
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-69151953 The [NanoTime in Hive-0.14](https://github.com/apache/hive/blob/f64d707e4d59aafbcf7e9b82ed199f6781d97946/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/Nan

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread tianyi
GitHub user tianyi opened a pull request: https://github.com/apache/spark/pull/3946 [SPARK-5100][SQL] add thriftserver-ui support In the latest Spark release, there is a Spark Streaming tab on the driver web UI, which shows information about running streaming application. It should

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/3935#discussion_r22640643 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -326,4 +327,17 @@ private[sql] abstract class SparkStrate

[GitHub] spark pull request: [SPARK-2429] [MLlib] Hierarchical Implementati...

2015-01-08 Thread freeman-lab
Github user freeman-lab commented on a diff in the pull request: https://github.com/apache/spark/pull/2906#discussion_r22640591 --- Diff: data/mllib/sample_hierarchical_data.csv --- @@ -0,0 +1,150 @@ +5.1,3.5,1.4,0.2 --- End diff -- Good point =) Leave as is then. M

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-01-08 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/3820#discussion_r22640517 --- Diff: sql/core/pom.xml --- @@ -69,6 +69,11 @@ 2.3.0 + org.jodd + jodd-core + ${jodd.version}

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on a diff in the pull request: https://github.com/apache/spark/pull/3935#discussion_r22640526 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala --- @@ -181,3 +183,25 @@ case class DescribeCommand( child.

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/3935#discussion_r22640443 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -328,18 +328,19 @@ class SQLContext(@transient val sparkContext: SparkCo

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/3945#issuecomment-69150883 ping @jkbradley . I think I have fixed the issue. Can you have a look? --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-69150651 [Test build #25211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25211/consoleFull) for PR 3820 at commit [`8526a33`](https://githu

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3945#issuecomment-69150611 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread MechCoder
GitHub user MechCoder opened a pull request: https://github.com/apache/spark/pull/3945 [SPARK-4406] [MLib] FIX: Validate k in SVD Raise exception when k is non-positive in SVD You can merge this pull request into a Git repository by running: $ git pull https://github.com/MechCo

[GitHub] spark pull request: [SPARK-2429] [MLlib] Hierarchical Implementati...

2015-01-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2906#discussion_r22640249 --- Diff: data/mllib/sample_hierarchical_data.csv --- @@ -0,0 +1,150 @@ +5.1,3.5,1.4,0.2 --- End diff -- Minor point - this wouldn't really be

[GitHub] spark pull request: [SPARK-5009][SQL] [WIP] Long keyword support i...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3926#issuecomment-69150443 [Test build #25210 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25210/consoleFull) for PR 3926 at commit [`c620afa`](https://gith

[GitHub] spark pull request: [SPARK-5009][SQL] [WIP] Long keyword support i...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3926#issuecomment-69150449 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2015-01-08 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on a diff in the pull request: https://github.com/apache/spark/pull/3607#discussion_r22640201 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala --- @@ -38,24 +38,30 @@ private[spark] class ClientArguments(args: A

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2015-01-08 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on a diff in the pull request: https://github.com/apache/spark/pull/3607#discussion_r22640199 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala --- @@ -38,24 +38,30 @@ private[spark] class ClientArguments(args: A

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/3935#discussion_r22640124 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala --- @@ -181,3 +183,25 @@ case class DescribeCommand( child.o

[GitHub] spark pull request: [SPARK-5009][SQL] [WIP] Long keyword support i...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3926#issuecomment-69149822 [Test build #25210 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25210/consoleFull) for PR 3926 at commit [`c620afa`](https://githu

[GitHub] spark pull request: [SPARK-3541][MLLIB] New ALS implementation wit...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3720#issuecomment-69149584 [Test build #25207 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25207/consoleFull) for PR 3720 at commit [`a76da7b`](https://gith

[GitHub] spark pull request: [SPARK-3541][MLLIB] New ALS implementation wit...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3720#issuecomment-69149589 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25

[GitHub] spark pull request: [SPARK-4286] Integrate external shuffle servic...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3861#issuecomment-69149435 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25

[GitHub] spark pull request: [SPARK-4286] Integrate external shuffle servic...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3861#issuecomment-69149427 [Test build #25206 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25206/consoleFull) for PR 3861 at commit [`c18760f`](https://gith

[GitHub] spark pull request: SPARK-4660: Use correct default classloader in...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3840#issuecomment-69149011 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25

[GitHub] spark pull request: [SPARK-4286] Integrate external shuffle servic...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3861#issuecomment-69149014 [Test build #25209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25209/consoleFull) for PR 3861 at commit [`f39cdd2`](https://githu

[GitHub] spark pull request: SPARK-4660: Use correct default classloader in...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3840#issuecomment-69149009 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25205/consoleFull) for PR 3840 at commit [`86bc5eb`](https://github.com/a

[GitHub] spark pull request: [SPARK-5141][SQL]CaseInsensitiveMap throws jav...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3944#issuecomment-69148993 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2015-01-08 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-69148864 @tgravescs @andrewor14 Sorry to produce so much issues in last rebase. I've fixed them and tested again on my cluster. Here is the configuration(

[GitHub] spark pull request: [SPARK-5141][SQL]CaseInsensitiveMap throws jav...

2015-01-08 Thread luogankun
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/3944 [SPARK-5141][SQL]CaseInsensitiveMap throws java.io.NotSerializableException CaseInsensitiveMap throws java.io.NotSerializableException. You can merge this pull request into a Git repository by run

[GitHub] spark pull request: [SPARK-3910] Remove pyspark/mllib/ from sys.pa...

2015-01-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3940#issuecomment-69147708 Would the hack we used in branch-1.2 and master work? https://github.com/apache/spark/blob/master/python/pyspark/mllib/__init__.py --- If your project is set up f

<    3   4   5   6   7   8