[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66453 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66453/consoleFull)** for PR 15044 at commit [`68d34de`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15370: [SPARK-17417][Core] Fix # of partitions for Relia...

2016-10-06 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/15370#discussion_r82253107 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -71,6 +72,12 @@ private[spark] object CallSite { private[spark] object Utils ext

[GitHub] spark pull request #13868: [SPARK-15899] [SQL] Fix the construction of the f...

2016-10-06 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13868#discussion_r82252372 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -55,7 +56,7 @@ object SQLConf { val WAREHOUSE_PATH = SQLConfigBuil

[GitHub] spark pull request #15370: [SPARK-17417][Core] Fix # of partitions for Relia...

2016-10-06 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15370#discussion_r82252000 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -83,8 +84,9 @@ private[spark] class ReliableCheckpointRDD[T: ClassTag](

[GitHub] spark issue #15365: [SPARK-17157][SPARKR]: Add multiclass logistic regressio...

2016-10-06 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15365 From Jekins, I saw the error: WARNING: There was 1 warning. NOTE: There were 3 notes. See '/home/jenkins/workspace/SparkPullRequestBuilder/R/SparkR.Rcheck/00check.log' for

[GitHub] spark issue #15370: [SPARK-17417][Core] Fix # of partitions for Reliable RDD...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15370 **[Test build #66454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66454/consoleFull)** for PR 15370 at commit [`580a50b`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/15249 Sorry something weird seems to have happened yesterday where github published half of my review! Anyway the rest is above. --- If your project is set up for it, you can reply to this email an

[GitHub] spark pull request #15374: [SPARK-17800] Introduce InterfaceStability annota...

2016-10-06 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/15374#discussion_r82249178 --- Diff: common/tags/src/main/java/org/apache/spark/annotation/InterfaceStability.java --- @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82105712 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetBlacklist.scala --- @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82105546 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetBlacklist.scala --- @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82104084 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -22,13 +22,13 @@ import java.util.{Timer, TimerTask} impor

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82105149 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82105053 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetBlacklist.scala --- @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82105250 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetBlacklist.scala --- @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82103864 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ExecutorFailuresInTaskSet.scala --- @@ -0,0 +1,53 @@ +/* + * Licensed to the Apache S

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82105321 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetBlacklist.scala --- @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark issue #15365: [SPARK-17157][SPARKR]: Add multiclass logistic regressio...

2016-10-06 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15365 @felixcheung When run check-cran, there are errors: Error : requireNamespace("e1071", quietly = TRUE) is not TRUE Error : requireNamespace("e1071", quietly = TRUE) is not TRUE Error

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-06 Thread olarayej
Github user olarayej commented on the issue: https://github.com/apache/spark/pull/11336 @falaki Absolutely. Let me do that. Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-06 Thread falaki
Github user falaki commented on the issue: https://github.com/apache/spark/pull/11336 @olarayej are you interested in rebasing this PR and limiting its user impact to just `head` for now? We can continue the discussion on support for distributed vector (a.k.a. `Column`) in JIRA and wh

[GitHub] spark issue #15374: [SPARK-17800] Introduce InterfaceStability annotation

2016-10-06 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15374 +1. I also agree that audience is not as useful as these; the three annotations here should cover the vast majority of use cases without the need to differentiate who's using the API. --- If your p

[GitHub] spark issue #15371: [SPARK-17463] [Core] Fix ConcurrentModificationException...

2016-10-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15371 One comment: once you figured out the proper fix, please add some comments inline so they don't get accidentally removed in the future. --- If your project is set up for it, you can reply to this ema

[GitHub] spark pull request #15044: [SQL][SPARK-17490] Optimize SerializeFromObject()...

2016-10-06 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15044#discussion_r82244393 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -441,6 +441,28 @@ object ScalaReflection extends ScalaRe

[GitHub] spark pull request #15374: [SPARK-17800] Introduce InterfaceStability annota...

2016-10-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15374#discussion_r82243978 --- Diff: common/tags/src/main/java/org/apache/spark/annotation/InterfaceStability.java --- @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark pull request #15373: [SPARK-17798][SQL] Remove redundant Experimental ...

2016-10-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15373 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15346: [SPARK-17741][SQL] Grammar to parse top level and nested...

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15346 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66451/ Test FAILed. ---

[GitHub] spark issue #15346: [SPARK-17741][SQL] Grammar to parse top level and nested...

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15346 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15373: [SPARK-17798][SQL] Remove redundant Experimental annotat...

2016-10-06 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15373 Thanks! Merging to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15346: [SPARK-17741][SQL] Grammar to parse top level and nested...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15346 **[Test build #66451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66451/consoleFull)** for PR 15346 at commit [`605aeb6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15318 Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66453/consoleFull)** for PR 15044 at commit [`68d34de`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15376 **[Test build #66452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66452/consoleFull)** for PR 15376 at commit [`dfdfc46`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-10-06 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15249 Actually my comment about locality wait makes me wonder if that should be taking blacklisting into account as well here, something I hadn't looked at closely before. There is no reason to wait for

[GitHub] spark issue #15367: [SPARK-17346][SQL][test-maven]Add Kafka source for Struc...

2016-10-06 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15367 This is rather a lot of functionality to backport, our backport guide doesn't seem to quite line up with this (based on https://www.mail-archive.com/dev@spark.apache.org/msg10284.html / https://cw

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15376 The only test failure is irrelevant. Locally, it passed. ``` [info] - MAP append/extract *** FAILED *** (2 milliseconds) [info] java.lang.IllegalArgumentException: ``` --- If

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15376 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15318 Sure. I'll make abackport for this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15378: [SPARK-17803][TESTS] Upgrade docker-client dependency

2016-10-06 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15378 Yay easier testing for developers :) +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15318 Merging to master. Thanks! I think we also need to merge it to 2.0 branch, right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15318 Thank you, @rxin and @gatorsmile . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-10-06 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/11105 ping @rxin & @squito - I'd really like to try and get this in for 2.1 if its possible. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-10-06 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15249 Sorry I haven't followed this PR since it was split off the main one. Response might be a bit split as its talking about various responses if something doesn't make sense let me know. >

[GitHub] spark pull request #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL ...

2016-10-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #9766: [SPARK-11775][PYSPARK][SQL] Allow PySpark to register Jav...

2016-10-06 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/9766 re-ping @davies :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15354: [SPARK-17764][SQL] Add `to_json` supporting to co...

2016-10-06 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15354#discussion_r82230165 --- Diff: python/pyspark/sql/functions.py --- @@ -1729,6 +1729,29 @@ def from_json(col, schema, options={}): return Column(jc) +@igno

[GitHub] spark pull request #15354: [SPARK-17764][SQL] Add `to_json` supporting to co...

2016-10-06 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15354#discussion_r82229892 --- Diff: python/pyspark/sql/functions.py --- @@ -1729,6 +1729,29 @@ def from_json(col, schema, options={}): return Column(jc) +@igno

[GitHub] spark pull request #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-10-06 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/9#discussion_r82230001 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -303,6 +312,10 @@ class KMeans @Since("1.5.0") ( @Since("1.5.0")

[GitHub] spark pull request #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-10-06 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/9#discussion_r82229991 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -303,6 +312,10 @@ class KMeans @Since("1.5.0") ( @Since("1.5.0")

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-10-06 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r82229032 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -243,8 +243,8 @@ private[spark] class TaskSchedulerImpl( }

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-10-06 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/13493 @zjffdu Enjoy vacation and no worries - I don't think this is blocking anything and we can circle back in a week :) --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark pull request #15370: [SPARK-17417][Core] Fix # of partitions for Relia...

2016-10-06 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15370#discussion_r82228045 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -83,8 +84,9 @@ private[spark] class ReliableCheckpointRDD[T: ClassTag](

[GitHub] spark issue #15370: [SPARK-17417][Core] Fix # of partitions for Reliable RDD...

2016-10-06 Thread dhruve
Github user dhruve commented on the issue: https://github.com/apache/spark/pull/15370 Using the NumberFormat will simplify the case and address both types. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread lins05
Github user lins05 commented on a diff in the pull request: https://github.com/apache/spark/pull/15377#discussion_r82224216 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2474,25 +2474,36 @@ private[spark] class CallerContext( val context = "SPARK_"

[GitHub] spark issue #15346: [SPARK-17741][SQL] Grammar to parse top level and nested...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15346 **[Test build #66451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66451/consoleFull)** for PR 15346 at commit [`605aeb6`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #13868: [SPARK-15899] [SQL] Fix the construction of the f...

2016-10-06 Thread koertkuipers
Github user koertkuipers commented on a diff in the pull request: https://github.com/apache/spark/pull/13868#discussion_r82216818 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -55,7 +56,7 @@ object SQLConf { val WAREHOUSE_PATH = SQLConf

[GitHub] spark pull request #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-10-06 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/9#discussion_r82215606 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -303,6 +312,10 @@ class KMeans @Since("1.5.0") ( @Since("1.5.0")

[GitHub] spark issue #15364: [SPARK-17792][ML] L-BFGS solver for linear regression do...

2016-10-06 Thread BenFradet
Github user BenFradet commented on the issue: https://github.com/apache/spark/pull/15364 Lgtm :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark issue #15361: [SPARK-17765][SQL] Support for writing out user-defined ...

2016-10-06 Thread kxepal
Github user kxepal commented on the issue: https://github.com/apache/spark/pull/15361 @HyukjinKwon Thank you a lot! Staying tuned. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15361: [SPARK-17765][SQL] Support for writing out user-defined ...

2016-10-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15361 I will test this and fix it here together as well if there are some more cases to handle. Thanks for verifying this PR. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark issue #15361: [SPARK-17765][SQL] Support for writing out user-defined ...

2016-10-06 Thread kxepal
Github user kxepal commented on the issue: https://github.com/apache/spark/pull/15361 @HyukjinKwon Ok, try something like this: ``` scala> val sv = org.apache.spark.mllib.linalg.Vectors.sparse(7, Array(0, 42), Array(-127, 128)) sv: org.apache.spark.mllib.linalg.Vector

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66449/consoleFull)** for PR 15377 at commit [`bc2fb25`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66449/ Test PASSed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15370: [SPARK-17417][Core] Fix # of partitions for Reliable RDD...

2016-10-06 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15370 How about instead of harding this to 5 or 10 digits we use java.text.NumberFormat, set the minimum to 5 digits but it allows going over. This way its automatically handles backwards compatible and

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-10-06 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/13493 Sorry, I am in vacation. Will update it next week. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13521: [SPARK-15770][CORE][SQL][ML] Annotation audit for...

2016-10-06 Thread zhengruifeng
Github user zhengruifeng closed the pull request at: https://github.com/apache/spark/pull/13521 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #12983: [SPARK-15213][PySpark] Unify 'range' usages

2016-10-06 Thread zhengruifeng
Github user zhengruifeng closed the pull request at: https://github.com/apache/spark/pull/12983 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #12135: [SPARK-14352][SQL] approxQuantile should support multi c...

2016-10-06 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/12135 @MLnick I have remove the unused api on the Scala side, and only the multicol version is used. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #15370: [SPARK-17417][Core] Fix # of partitions for Relia...

2016-10-06 Thread dhruve
Github user dhruve commented on a diff in the pull request: https://github.com/apache/spark/pull/15370#discussion_r82181763 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -93,19 +95,39 @@ private[spark] class ReliableCheckpointRDD[T: ClassTag]

[GitHub] spark pull request #15370: [SPARK-17417][Core] Fix # of partitions for Relia...

2016-10-06 Thread dhruve
Github user dhruve commented on a diff in the pull request: https://github.com/apache/spark/pull/15370#discussion_r82181554 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -83,8 +84,9 @@ private[spark] class ReliableCheckpointRDD[T: ClassTag](

[GitHub] spark issue #15374: [SPARK-17800] Introduce InterfaceStability annotation

2016-10-06 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15374 sorry Reynold, looks like I somehow missed your response on email about this. Comment question, otherwise looks good. --- If your project is set up for it, you can reply to this email a

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15377#discussion_r82181784 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2474,25 +2474,36 @@ private[spark] class CallerContext( val context = "SPARK_"

[GitHub] spark pull request #15370: [SPARK-17417][Core] Fix # of partitions for Relia...

2016-10-06 Thread dhruve
Github user dhruve commented on a diff in the pull request: https://github.com/apache/spark/pull/15370#discussion_r82180981 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -72,7 +72,8 @@ private[spark] class ReliableCheckpointRDD[T: ClassTag](

[GitHub] spark issue #15361: [SPARK-17765][SQL] Support for writing out user-defined ...

2016-10-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15361 @kxepal, Sure, I will definitely try to reproduce as soon as you do. Meanwhile, let me double check this. Thanks. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15239: [SPARK-17665][SPARKR] Support options/mode all for read/...

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15239 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15239: [SPARK-17665][SPARKR] Support options/mode all for read/...

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15239 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66450/ Test PASSed. ---

[GitHub] spark issue #15239: [SPARK-17665][SPARKR] Support options/mode all for read/...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15239 **[Test build #66450 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66450/consoleFull)** for PR 15239 at commit [`eeb7db5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15361: [SPARK-17765][SQL] Support for writing out user-defined ...

2016-10-06 Thread kxepal
Github user kxepal commented on the issue: https://github.com/apache/spark/pull/15361 @HyukjinKwon Thanks for the patch, but suddenly it doesn't solves the issue. Tested with 2.0.0 Spark: ``` Caused by: java.lang.ClassCastException: org.apache.spark.mllib.linalg.VectorUDT

[GitHub] spark issue #15239: [SPARK-17665][SPARKR] Support options/mode all for read/...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15239 **[Test build #66450 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66450/consoleFull)** for PR 15239 at commit [`eeb7db5`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #13690: [SPARK-15767][R][ML] Decision Tree Regression wrapper in...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13690 **[Test build #66448 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66448/consoleFull)** for PR 13690 at commit [`d034735`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13690: [SPARK-15767][R][ML] Decision Tree Regression wrapper in...

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13690 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66448/ Test FAILed. ---

[GitHub] spark issue #13690: [SPARK-15767][R][ML] Decision Tree Regression wrapper in...

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13690 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66447/ Test PASSed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66447/consoleFull)** for PR 15377 at commit [`112ddcb`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12761: [SPARK-14464] [MLLIB] Better support for logistic regres...

2016-10-06 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/12761 @daniel-siegmann-aol will you have time to work on this? I think it will be important to have this in Spark 2.1. If not, I think between @dbtsai, @sethah and myself we can help take it forward. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66449/consoleFull)** for PR 15377 at commit [`bc2fb25`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #15378: [SPARK-17803][TESTS] Upgrade docker-client dependency

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15378 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15378: [SPARK-17803][TESTS] Upgrade docker-client dependency

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15378 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66445/ Test PASSed. ---

[GitHub] spark issue #15378: [SPARK-17803][TESTS] Upgrade docker-client dependency

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15378 **[Test build #66445 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66445/consoleFull)** for PR 15378 at commit [`25e106b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15378: [SPARK-17803][TESTS] Upgrade docker-client dependency

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15378 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66444/ Test PASSed. ---

[GitHub] spark issue #15378: [SPARK-17803][TESTS] Upgrade docker-client dependency

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15378 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15378: [SPARK-17803][TESTS] Upgrade docker-client dependency

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15378 **[Test build #66444 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66444/consoleFull)** for PR 15378 at commit [`25e106b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66443/ Test PASSed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13690: [SPARK-15767][R][ML] Decision Tree Regression wrapper in...

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13690 **[Test build #66448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66448/consoleFull)** for PR 13690 at commit [`d034735`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66443/consoleFull)** for PR 15377 at commit [`3b5f9e4`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15377#discussion_r82159342 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2474,25 +2474,34 @@ private[spark] class CallerContext( val context = "SPARK_"

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66440/ Test PASSed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66440 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66440/consoleFull)** for PR 15377 at commit [`b8621ab`](https://github.com/apache/spark/commit/

<    1   2   3   4   5   >