[GitHub] spark pull request: [SPARK-15094][SPARK-14803][SQL] Add ObjectProj...

2016-05-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/12926#issuecomment-217363557 I think a simpler and better approach is just removing this alias only project in next batch. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-05 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12889#discussion_r62294700 --- Diff: python/pyspark/ml/classification.py --- @@ -1118,7 +1142,8 @@ def getBlockSize(self): return self.getOrDefault(self.blockSize)

[GitHub] spark pull request: [SPARK-15136][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12918#discussion_r62294736 --- Diff: python/pyspark/ml/classification.py --- @@ -454,7 +454,8 @@ class TreeClassifierParams(object): impurity = Param(Params._dummy(), "impurity"

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-05 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12889#discussion_r62294714 --- Diff: python/pyspark/ml/regression.py --- @@ -708,7 +710,7 @@ def _create_model(self, java_model): @inherit_doc -class DecisionTre

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-05 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12889#discussion_r62294597 --- Diff: python/pyspark/ml/classification.py --- @@ -581,8 +602,11 @@ def _create_model(self, java_model): @inherit_doc -class Decisi

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217361848 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217361850 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217361802 **[Test build #57968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57968/consoleFull)** for PR 12927 at commit [`2270148`](https://g

[GitHub] spark pull request: [SPARK-15092][PySpark][ML] Add toDebugString t...

2016-05-05 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/12937#issuecomment-217361023 cc @yanboliang --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217360439 **[Test build #57968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57968/consoleFull)** for PR 12927 at commit [`2270148`](https://gi

[GitHub] spark pull request: [SPARK-14525][SQL] Make DataFrameWrite.save wo...

2016-05-05 Thread JustinPihony
Github user JustinPihony commented on the pull request: https://github.com/apache/spark/pull/12601#issuecomment-217359217 I can finish this next Monday(fix the conflicts that now exist), and will actually do that given the above comments. I'd still like to get an opinion on whether I

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217358886 **[Test build #57967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57967/consoleFull)** for PR 12871 at commit [`e975047`](https://gi

[GitHub] spark pull request: [SPARK-15074][Shuffle] Cache shuffle index fil...

2016-05-05 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/12944#issuecomment-217358557 So a very minor style thing; it seems like the rest of the configuration values are exposed through accessor methods on TransportConf rather than directly exposing getI

[GitHub] spark pull request: [SPARK-15173][SQL] DataFrameWriter.insertInto ...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12949#issuecomment-217358270 **[Test build #57966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57966/consoleFull)** for PR 12949 at commit [`d831109`](https://gi

[GitHub] spark pull request: [SPARK-15094][SPARK-14803][SQL] Add ObjectProj...

2016-05-05 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12926#issuecomment-217357870 cc @cloud-fan @yhuai @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15094][SQL] Avoid extra Project when De...

2016-05-05 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12898#issuecomment-217357829 cc @cloud-fan @yhuai @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15173][SQL] DataFrameWriter.insertInto ...

2016-05-05 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/12949#issuecomment-217357762 cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-15173][SQL] DataFrameWriter.insertInto ...

2016-05-05 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/12949 [SPARK-15173][SQL] DataFrameWriter.insertInto should work with datasource table stored in hive ## What changes were proposed in this pull request? When we read a datasource table stored

[GitHub] spark pull request: [SPARK-14603] [SQL] [WIP] Verification of Meta...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12385#issuecomment-217357392 **[Test build #57965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57965/consoleFull)** for PR 12385 at commit [`4031b02`](https://gi

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improves the output of...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217357135 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improves the output of...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217357132 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improves the output of...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217357024 **[Test build #57962 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57962/consoleFull)** for PR 12947 at commit [`b1d01c8`](https://g

[GitHub] spark pull request: [SPARK-14603] [SQL] [WIP] Verification of Meta...

2016-05-05 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/12385#discussion_r62292867 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/AlreadyExistException.scala --- @@ -0,0 +1,46 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-15172][ML] Improve LogisticRegression w...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12948#issuecomment-217356782 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-15085][Streaming][Kafka] Rename streami...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12946#issuecomment-217356644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15172][ML] Improve LogisticRegression w...

2016-05-05 Thread dding3
GitHub user dding3 opened a pull request: https://github.com/apache/spark/pull/12948 [SPARK-15172][ML] Improve LogisticRegression warning message ## What changes were proposed in this pull request? Explicitly tell user initial coefficients is ignored if its size doesn't match ex

[GitHub] spark pull request: [SPARK-15085][Streaming][Kafka] Rename streami...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12946#issuecomment-217356648 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-05 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/11863#discussion_r62292704 --- Diff: external/kafka-beta/src/main/scala/org/apache/spark/streaming/kafka/DirectKafkaInputDStream.scala --- @@ -0,0 +1,344 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-15085][Streaming][Kafka] Rename streami...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12946#issuecomment-217356541 **[Test build #57960 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57960/consoleFull)** for PR 12946 at commit [`bc837b4`](https://g

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improves the output of...

2016-05-05 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217355660 @clockfly Can we show table name instead of `HadoopFiles` or together? If there is no table name, we could use the rightest part of path. --- If your project is set up

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217353911 **[Test build #57964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57964/consoleFull)** for PR 12945 at commit [`e17bd6d`](https://gi

[GitHub] spark pull request: [SPARK-14684] [SPARK-15026] [SQL] Disallow Dro...

2016-05-05 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/12801#issuecomment-217353785 @yhuai Agree! Actually, I initially tried to do it in a batch mode. That is the following API we need to use ``` public List dropPartitions(String dbName, Str

[GitHub] spark pull request: [SPARK-12837][CORE] reduce network IO for accu...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12899#issuecomment-217352598 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12837][CORE] reduce network IO for accu...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12899#issuecomment-217352599 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12837][CORE] reduce network IO for accu...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12899#issuecomment-217352525 **[Test build #57959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57959/consoleFull)** for PR 12899 at commit [`cb21034`](https://g

[GitHub] spark pull request: [SPARK-15137][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217351727 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15137][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217351726 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15137][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217351688 **[Test build #57963 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57963/consoleFull)** for PR 12918 at commit [`bb18b9a`](https://g

[GitHub] spark pull request: [SPARK-15137][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217349774 **[Test build #57963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57963/consoleFull)** for PR 12918 at commit [`bb18b9a`](https://gi

[GitHub] spark pull request: [SPARK-13222][Streaming][WIP]make sure latest ...

2016-05-05 Thread mwws
Github user mwws closed the pull request at: https://github.com/apache/spark/pull/11101 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [Spark-13374][Streaming] make it possible to c...

2016-05-05 Thread mwws
Github user mwws closed the pull request at: https://github.com/apache/spark/pull/11249 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-05-05 Thread mwws
Github user mwws commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-217349115 @srowen @zsxwing could you help merge it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improves the output of...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217348849 **[Test build #57962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57962/consoleFull)** for PR 12947 at commit [`b1d01c8`](https://gi

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217348813 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217348812 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217348761 **[Test build #57961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57961/consoleFull)** for PR 12914 at commit [`602c5ca`](https://g

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217348613 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217348611 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217348567 **[Test build #57957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57957/consoleFull)** for PR 12871 at commit [`8ff5d9c`](https://g

[GitHub] spark pull request: [SPARK-14476][SQL] Improves the output of data...

2016-05-05 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/12947 [SPARK-14476][SQL] Improves the output of dataset.explain by adding source table names and file paths. ## What changes were proposed in this pull request? Improve the physical plan visualizati

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217348014 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217348026 **[Test build #57961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57961/consoleFull)** for PR 12914 at commit [`602c5ca`](https://gi

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217348013 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217347997 **[Test build #57956 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57956/consoleFull)** for PR 12945 at commit [`029ce73`](https://g

[GitHub] spark pull request: [SPARK-15094][SPARK-14803][SQL] Add ObjectProj...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12926#issuecomment-217347901 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15094][SPARK-14803][SQL] Add ObjectProj...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12926#issuecomment-217347900 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15094][SPARK-14803][SQL] Add ObjectProj...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12926#issuecomment-217347818 **[Test build #57955 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57955/consoleFull)** for PR 12926 at commit [`3d0554d`](https://g

[GitHub] spark pull request: [SPARK-15094][SQL] Avoid extra Project when De...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12898#issuecomment-217347602 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15094][SQL] Avoid extra Project when De...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12898#issuecomment-217347601 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15094][SQL] Avoid extra Project when De...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12898#issuecomment-217347534 **[Test build #57954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57954/consoleFull)** for PR 12898 at commit [`08c614a`](https://g

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Add python example...

2016-05-05 Thread zhengruifeng
Github user zhengruifeng commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217347142 @MLnick Args-Parsing was removed in those examples --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-15137][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12918#discussion_r62287954 --- Diff: python/pyspark/ml/classification.py --- @@ -353,7 +353,7 @@ def roc(self): Returns the receiver operating characteristic (ROC) curve

[GitHub] spark pull request: [SPARK-15137][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217346608 Happy to, I was going to leave those files for the people working in them during QA but I can update them as well. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-15137][PySpark][DOC] Fix links to sphin...

2016-05-05 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217346237 I like it! @holdenk Could you make change for all links in spark.ml docs? I found there are links in ```regression.py```, ```recommendation.py``` and ```feature.py``

[GitHub] spark pull request: [SPARK-15085][Streaming][Kafka] Rename streami...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12946#issuecomment-217345558 **[Test build #57960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57960/consoleFull)** for PR 12946 at commit [`bc837b4`](https://gi

[GitHub] spark pull request: [SPARK-15085][Streaming][Kafka] Rename streami...

2016-05-05 Thread koeninger
GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/12946 [SPARK-15085][Streaming][Kafka] Rename streaming-kafka artifact to in… ## What changes were proposed in this pull request? Renaming the streaming-kafka artifact to include kafka version, in

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217344576 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217344567 **[Test build #57958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57958/consoleFull)** for PR 12914 at commit [`4fffa65`](https://g

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217344578 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12837][CORE] reduce network IO for accu...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12899#issuecomment-217344297 **[Test build #57959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57959/consoleFull)** for PR 12899 at commit [`cb21034`](https://gi

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12914#issuecomment-217343853 **[Test build #57958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57958/consoleFull)** for PR 12914 at commit [`4fffa65`](https://gi

[GitHub] spark pull request: [Spark-15155][Mesos] Optionally ignore default...

2016-05-05 Thread hellertime
Github user hellertime commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217343655 I'm updating the title of the PR to reflect the change in approach. I think the boolean property will be sufficient. --- If your project is set up for it, you can r

[GitHub] spark pull request: [SPARK-14997][SQL] Fixed FileCatalog to return...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12856#issuecomment-217343071 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14997][SQL] Fixed FileCatalog to return...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12856#issuecomment-217343068 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217343030 **[Test build #57957 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57957/consoleFull)** for PR 12871 at commit [`8ff5d9c`](https://gi

[GitHub] spark pull request: [SPARK-14997][SQL] Fixed FileCatalog to return...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12856#issuecomment-217342999 **[Test build #57951 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57951/consoleFull)** for PR 12856 at commit [`8c06d4e`](https://g

[GitHub] spark pull request: [SPARK-15168][PySpark][ML] Add missing params ...

2016-05-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/12943#discussion_r62286319 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/MultilayerPerceptronClassifier.scala --- @@ -88,7 +88,7 @@ private[ml] trait MultilayerPer

[GitHub] spark pull request: [SPARK-15168][PySpark][ML] Add missing params ...

2016-05-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/12943#discussion_r62286255 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/MultilayerPerceptronClassifier.scala --- @@ -88,7 +88,7 @@ private[ml] trait MultilayerPer

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217341678 **[Test build #57956 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57956/consoleFull)** for PR 12945 at commit [`029ce73`](https://gi

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/12914#discussion_r62286043 --- Diff: python/pyspark/ml/param/_shared_params_code_gen.py --- @@ -58,6 +61,9 @@ def __init__(self): if defaultValueStr is not None: t

[GitHub] spark pull request: [Spark-15155][Mesos] Selectively accept Mesos ...

2016-05-05 Thread hellertime
Github user hellertime commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217341428 True. So really the desired behavior is always just to ignore `*` resources. A boolean property would suffice here. What about `spark.mesos.ignoreDefaultResourceRole

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12914#discussion_r62285930 --- Diff: python/pyspark/ml/param/_shared_params_code_gen.py --- @@ -58,6 +61,9 @@ def __init__(self): if defaultValueStr is not None:

[GitHub] spark pull request: [Spark-15155][Mesos] Selectively accept Mesos ...

2016-05-05 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217341006 Yes I am aware of multi roles, but not sure in what situation you would want to register with multiple roles but only use one role's resources? --- If your project is

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/12914#discussion_r62285684 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -280,7 +281,9 @@ def explainParam(self, param): else: values.append("undefi

[GitHub] spark pull request: [SPARK-12837][CORE] reduce network IO for accu...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12899#issuecomment-217340511 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12837][CORE] reduce network IO for accu...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12899#issuecomment-217340512 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12914#discussion_r62285526 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -280,7 +281,9 @@ def explainParam(self, param): else: values.append("und

[GitHub] spark pull request: [SPARK-12837][CORE] reduce network IO for accu...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12899#issuecomment-217340426 **[Test build #57946 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57946/consoleFull)** for PR 12899 at commit [`b48dda8`](https://g

[GitHub] spark pull request: [SPARK-15094][SPARK-14803][SQL] Add ObjectProj...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12926#issuecomment-217339830 **[Test build #57955 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57955/consoleFull)** for PR 12926 at commit [`3d0554d`](https://gi

[GitHub] spark pull request: [SPARK-15130][PySpark][ML][DOCS] pyspark expos...

2016-05-05 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12914#discussion_r62285048 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -280,7 +281,9 @@ def explainParam(self, param): else: values.append("und

[GitHub] spark pull request: [SPARK-15094][SQL] Avoid extra Project when De...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12898#issuecomment-217339397 **[Test build #57954 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57954/consoleFull)** for PR 12898 at commit [`08c614a`](https://gi

[GitHub] spark pull request: [Spark-15155][Mesos] Selectively accept Mesos ...

2016-05-05 Thread hellertime
Github user hellertime commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217339163 I see that as a potential solution, however at some future point mesos will support frameworks which can hold multiple roles (MESOS-1763 😉) so perhaps leaving it

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-05 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/11863#discussion_r62284776 --- Diff: external/kafka-beta/src/main/scala/org/apache/spark/streaming/kafka/KafkaRDD.scala --- @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12922][SparkR][WIP] Implement gapply() ...

2016-05-05 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/12836#issuecomment-217338855 Lets create a wrapper - I think its better for R users. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-14897] [SQL] [WIP] upgrade to jetty 9.2...

2016-05-05 Thread bomeng
Github user bomeng commented on the pull request: https://github.com/apache/spark/pull/12916#issuecomment-217338702 The test failure was caused by timeout for HiveThriftHttpServerSuite and SingleSessionSuite... have not figure out the cause, any suggestion will be welcome. --- If y

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217338674 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217338672 **[Test build #57953 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57953/consoleFull)** for PR 12945 at commit [`0bcbe8c`](https://g

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217338675 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217338558 **[Test build #57953 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57953/consoleFull)** for PR 12945 at commit [`0bcbe8c`](https://gi

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Add python example...

2016-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217338464 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

  1   2   3   4   5   6   7   8   9   >