[GitHub] spark pull request: [SPARK-8694][WebUI]Defer executing drawTaskAss...

2015-06-28 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7071#issuecomment-116484869 For more information, I've tested using Chrome 39.0.2171.71. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark pull request: [SPARK-8694][WebUI]Defer executing drawTaskAss...

2015-06-28 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7071#issuecomment-116484699 @zsxwing Did you profile after patching? I spent some times to profile before-patching and after-patching 2 times for each, with 1 tasks. I couldn't recognized signi

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6976#discussion_r33437986 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/math.scala --- @@ -287,6 +286,85 @@ case class Pow(left: Expression, right: Ex

[GitHub] spark pull request: [SPARK-8233][SQL] misc function: hash

2015-06-28 Thread qiansl127
Github user qiansl127 commented on a diff in the pull request: https://github.com/apache/spark/pull/6971#discussion_r33437963 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala --- @@ -47,4 +48,44 @@ case class Md5(child: Expression)

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-116484564 [Test build #35970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35970/consoleFull) for PR 6394 at commit [`fcb14a2`](https://gith

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116484507 lgtm. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: [SPARK-8018][MLlib]KMeans should accept initia...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6737#issuecomment-116484455 [Test build #35964 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35964/console) for PR 6737 at commit [`242ead1`](https://github.

[GitHub] spark pull request: [SPARK-8018][MLlib]KMeans should accept initia...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6737#issuecomment-116484467 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-116484251 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-116484205 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6976#issuecomment-116483736 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6976#issuecomment-116483626 [Test build #35957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35957/console) for PR 6976 at commit [`cf9c936`](https://github.

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread piaozhexiu
Github user piaozhexiu commented on a diff in the pull request: https://github.com/apache/spark/pull/7078#discussion_r33437761 --- Diff: python/pyspark/sql/readwriter.py --- @@ -236,6 +243,13 @@ def format(self, source): return self @since(1.4) --- En

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread piaozhexiu
Github user piaozhexiu commented on a diff in the pull request: https://github.com/apache/spark/pull/7078#discussion_r33437756 --- Diff: python/pyspark/sql/readwriter.py --- @@ -74,6 +74,13 @@ def schema(self, schema): return self @since(1.4) --- End

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116482831 [Test build #35968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35968/consoleFull) for PR 7078 at commit [`c63d419`](https://gith

[GitHub] spark pull request: [SPARK-8698] partitionBy in Python DataFrame r...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7079#issuecomment-116482812 [Test build #35967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35967/consoleFull) for PR 7079 at commit [`8513e1c`](https://gith

[GitHub] spark pull request: [SPARK-8698] partitionBy in Python DataFrame r...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7079#issuecomment-116482539 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-116482538 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116482537 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-116482487 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8698] partitionBy in Python DataFrame r...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7079#issuecomment-116482474 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116482477 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8698] partitionBy in Python DataFrame r...

2015-06-28 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/7079#issuecomment-116481638 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: [SPARK-8698] partitionBy in Python DataFrame r...

2015-06-28 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/7079 [SPARK-8698] partitionBy in Python DataFrame reader/writer interface should not default to empty tuple. You can merge this pull request into a Git repository by running: $ git pull https://githu

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116478824 [Test build #35966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35966/consoleFull) for PR 7078 at commit [`524e0aa`](https://gith

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116478360 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116478296 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7078#discussion_r33437338 --- Diff: python/pyspark/sql/readwriter.py --- @@ -236,6 +243,13 @@ def format(self, source): return self @since(1.4) --- End diff

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116478137 Jenkins, ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7078#discussion_r33437334 --- Diff: python/pyspark/sql/readwriter.py --- @@ -74,6 +74,13 @@ def schema(self, schema): return self @since(1.4) --- End diff -

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116478122 Jenkins, add to whitelist. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-8235][SPARK-8236][SQL] misc functions: ...

2015-06-28 Thread qiansl127
Github user qiansl127 commented on the pull request: https://github.com/apache/spark/pull/6970#issuecomment-116476867 @davies Rebase done! Please help to check it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-7871][SQL][WIP] Improve the outputParti...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116475668 [Test build #35965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35965/consoleFull) for PR 6413 at commit [`e59b4d4`](https://gith

[GitHub] spark pull request: [SPARK-8070] [SQL] [PYSPARK] avoid spark jobs ...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6606#issuecomment-116475769 [Test build #974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/974/console) for PR 6606 at commit [`a5928bf`](https://github.c

[GitHub] spark pull request: [SPARK-7871][SQL][WIP] Improve the outputParti...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116475372 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7871][SQL][WIP] Improve the outputParti...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116475434 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7078#issuecomment-116472795 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-8355] [SQL] Python DataFrameReader/Writ...

2015-06-28 Thread piaozhexiu
GitHub user piaozhexiu opened a pull request: https://github.com/apache/spark/pull/7078 [SPARK-8355] [SQL] Python DataFrameReader/Writer should mirror Scala I compared PySpark DataFrameReader/Writer against Scala ones. `Option` function is missing in both reader and writer, but the

[GitHub] spark pull request: [SPARK-8018][MLlib]KMeans should accept initia...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6737#issuecomment-116467424 [Test build #35964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35964/consoleFull) for PR 6737 at commit [`242ead1`](https://gith

[GitHub] spark pull request: [SPARK-8018][MLlib]KMeans should accept initia...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6737#issuecomment-116465306 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8018][MLlib]KMeans should accept initia...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6737#issuecomment-116465396 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8235][SQL] misc function sha / sha1

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6963#issuecomment-116464083 [Test build #35963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35963/consoleFull) for PR 6963 at commit [`f064563`](https://gith

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116463130 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116463015 [Test build #35959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35959/console) for PR 6982 at commit [`afff0b1`](https://github.

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6982#discussion_r33436295 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ExtractValue.scala --- @@ -195,6 +205,11 @@ case class GetArrayItem(child: Exp

[GitHub] spark pull request: [SPARK-8235][SQL] misc function sha / sha1

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6963#issuecomment-116461466 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116461351 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-8235][SQL] misc function sha / sha1

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6963#issuecomment-116461371 [Test build #975 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/975/consoleFull) for PR 6963 at commit [`f064563`](https://githu

[GitHub] spark pull request: [SPARK-8235][SQL] misc function sha / sha1

2015-06-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/6963#issuecomment-116461218 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request: [SPARK-8235][SQL] misc function sha / sha1

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6963#issuecomment-116461392 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116460296 [Test build #35956 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35956/console) for PR 6981 at commit [`5fe74e1`](https://github.

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7029#issuecomment-116460293 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7029#issuecomment-116460268 [Test build #35960 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35960/console) for PR 7029 at commit [`efea1f8`](https://github.

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116460350 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7065#issuecomment-116460292 [Test build #35962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35962/consoleFull) for PR 7065 at commit [`4afae45`](https://gith

[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...

2015-06-28 Thread xuchenCN
GitHub user xuchenCN opened a pull request: https://github.com/apache/spark/pull/7077 [SPARK-8592] [CORE] CoarseGrainedExecutorBackend: Cannot register with driver => NPE Look detail of this issue at [SPARK-8592](https://issues.apache.org/jira/browse/SPARK-8592) **CoarseGr

[GitHub] spark pull request: [SPARK-8235][SQL] misc function sha / sha1

2015-06-28 Thread tarekauel
Github user tarekauel commented on the pull request: https://github.com/apache/spark/pull/6963#issuecomment-116458925 @davies okay I changed it. Can you trigger Jenkins? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7065#issuecomment-116458114 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7065#issuecomment-116458262 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8070] [SQL] [PYSPARK] avoid spark jobs ...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6606#issuecomment-116457495 [Test build #974 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/974/consoleFull) for PR 6606 at commit [`a5928bf`](https://githu

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/6982#discussion_r33435932 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ExtractValue.scala --- @@ -195,6 +205,11 @@ case class GetArrayItem(child:

[GitHub] spark pull request: [SPARK-7871][SQL][WIP] Improve the outputParti...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116453896 [Test build #35961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35961/consoleFull) for PR 6413 at commit [`32d8af0`](https://gith

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7029#issuecomment-116453278 [Test build #35960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35960/consoleFull) for PR 7029 at commit [`efea1f8`](https://gith

[GitHub] spark pull request: [SPARK-7871][SQL][WIP] Improve the outputParti...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116452833 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/6982#discussion_r33435789 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ExtractValue.scala --- @@ -195,6 +205,11 @@ case class GetArrayItem(child:

[GitHub] spark pull request: [SPARK-7871][SQL][WIP] Improve the outputParti...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116452907 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7029#issuecomment-116452822 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7029#issuecomment-116452866 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116452096 [Test build #35959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35959/consoleFull) for PR 6982 at commit [`afff0b1`](https://gith

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7029#issuecomment-116451917 LGTM except minor style issues. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7029#discussion_r33435597 --- Diff: docs/mllib-feature-extraction.md --- @@ -419,10 +419,11 @@ import org.apache.spark.mllib.feature.ChiSqSelector // Load some data in libsvm format

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7029#discussion_r33435601 --- Diff: docs/mllib-feature-extraction.md --- @@ -451,19 +452,20 @@ JavaRDD points = MLUtils.loadLibSVMFile(sc.sc(), "data/mllib/sample_libsvm_data.t

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7029#issuecomment-116451953 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7029#discussion_r33435594 --- Diff: docs/mllib-feature-extraction.md --- @@ -405,7 +405,7 @@ Note that the user can also construct a `ChiSqSelectorModel` by hand by providin

[GitHub] spark pull request: [SPARK-7739][MLlib] Improve ChiSqSelector exam...

2015-06-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7029#discussion_r33435600 --- Diff: docs/mllib-feature-extraction.md --- @@ -451,19 +452,20 @@ JavaRDD points = MLUtils.loadLibSVMFile(sc.sc(), "data/mllib/sample_libsvm_data.t

[GitHub] spark pull request: [SPARK-8625] [Core] Propagate user exceptions ...

2015-06-28 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/7014#discussion_r33435542 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -97,11 +101,17 @@ case class ExceptionFailure( description: String,

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116451177 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8691][WebUI]Enable GZip by default for ...

2015-06-28 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/7072#issuecomment-116451309 > @zsxwing have you noticed any improvement in user-facing response time for the loading of the page? I tested in my local machine, the time of downloading the p

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116451242 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8575][SQL] Deprecate callUDF in favor o...

2015-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6993 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8070] [SQL] [PYSPARK] avoid spark jobs ...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6606#issuecomment-116449764 [Test build #973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/973/console) for PR 6606 at commit [`a5928bf`](https://github.c

[GitHub] spark pull request: [SPARK-8575][SQL] Deprecate callUDF in favor o...

2015-06-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/6993#issuecomment-116449887 @BenFradet I don't think it is easy to replace that one because of `outputDataType`. The changes LGTM. Merged into master. Thanks! --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-5962] [MLlib] Python support for Power ...

2015-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6992 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5962] [MLlib] Python support for Power ...

2015-06-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/6992#issuecomment-116447610 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5962] [MLlib] Python support for Power ...

2015-06-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/6992#discussion_r33435286 --- Diff: python/pyspark/mllib/clustering.py --- @@ -466,7 +557,8 @@ def predictOnValues(self, dstream): def _test(): import doctest -

[GitHub] spark pull request: [SPARK-8692][SQL] re-order the case statements...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7073#issuecomment-116444925 [Test build #35958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35958/consoleFull) for PR 7073 at commit [`463044d`](https://gith

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7065#issuecomment-116443860 LGTM except a minor inline comment. Please create JIRAs and submit PRs for the following: 1. Java unit test 1. Python API 1. set ML attributes in the PCA

[GitHub] spark pull request: [SPARK-8070] [SQL] [PYSPARK] avoid spark jobs ...

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6606#issuecomment-116443813 [Test build #973 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/973/consoleFull) for PR 6606 at commit [`a5928bf`](https://githu

[GitHub] spark pull request: [SPARK-8692][SQL] re-order the case statements...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7073#issuecomment-116443248 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8664] [ML] Add PCA transformer

2015-06-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7065#discussion_r33435077 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/PCA.scala --- @@ -0,0 +1,130 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: [SPARK-8692][SQL] re-order the case statements...

2015-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7073#issuecomment-116443173 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8691][WebUI]Enable GZip by default for ...

2015-06-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/7072#issuecomment-116442602 @zsxwing have you noticed any improvement in user-facing response time for the loading of the page? --- If your project is set up for it, you can reply to this email a

[GitHub] spark pull request: [SPARK-7212][MLlib]Add sequence learning flag

2015-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6997 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7212][MLlib]Add sequence learning flag

2015-06-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/6997#issuecomment-116440089 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6982#discussion_r33434908 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ExtractValue.scala --- @@ -195,6 +205,10 @@ case class GetArrayItem(child: Exp

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6982#discussion_r33434873 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala --- @@ -40,51 +40,36 @@ class ComplexTypeSuite extends

[GitHub] spark pull request: [SPARK-8235][SQL] misc function sha / sha1

2015-06-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/6963#issuecomment-116437964 @tarekauel Maybe because other library depends on older version of common-codec, we should use `shaHex` instead (until fix the dependency hell). ``` davies@localho

[GitHub] spark pull request: [SPARK-8694][WebUI]Defer executing drawTaskAss...

2015-06-28 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/7071#issuecomment-116437163 Updated it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-8443][SQL] Split GenerateMutableProject...

2015-06-28 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7076#issuecomment-116436418 ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6976#issuecomment-116435662 [Test build #35957 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35957/consoleFull) for PR 6976 at commit [`cf9c936`](https://gith

  1   2   3   4   5   >