[GitHub] spark pull request: [SPARK-11677][SQL] ORC filter tests all pass i...

2015-12-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/9687#issuecomment-163104687 Can I add the function `stripSparkFilter` to `SQLTestUtils` for `ParquetFilterSuite` and `OrcQuerySuite` (and possibly `OrcFilterSuite` I will make)? --- If your

[GitHub] spark pull request: [SPARK-11676][SQL] Parquet filter tests all pa...

2015-12-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/9659#issuecomment-163102930 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12203][STREAMING] Add KafkaDirectInputD...

2015-12-08 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/10197#issuecomment-163102160 Hmm, I think its exactly-once semantics should be as same as what DirectKafkaInputDStream does. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request: [SPARK-12164] [SQL] Decode the encoded values ...

2015-12-08 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/10215 [SPARK-12164] [SQL] Decode the encoded values and then display Based on the suggestions from @marmbrus @cloud-fan in https://github.com/apache/spark/pull/10165 , this PR is to print the decoded

[GitHub] spark pull request: [SPARK-12198] [SparkR] SparkR support read.par...

2015-12-08 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/10191#issuecomment-163100750 +1 @sun-rui Only ```jdbc``` can not fit in ```read.df```. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request: [SPARK-12203][STREAMING] Add KafkaDirectInputD...

2015-12-08 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/10197#issuecomment-163096778 I'm really doubt changing to low-level API could guarantee exact-once semantics without any other changes. CC\ @koeninger --- If your project is set up for

[GitHub] spark pull request: [SPARK-12198] [SparkR] SparkR support read.par...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10191#issuecomment-163096064 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163096061 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12198] [SparkR] SparkR support read.par...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10191#issuecomment-163096063 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163096060 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-11602] [MLlib] Refine visibility for 1....

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9939#issuecomment-163096126 **[Test build #2188 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2188/consoleFull)** for PR 9939 at commit [`319e61d`](https://gi

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163096022 **[Test build #47403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47403/consoleFull)** for PR 10210 at commit [`849647c`](https://g

[GitHub] spark pull request: [SPARK-12198] [SparkR] SparkR support read.par...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10191#issuecomment-163095986 **[Test build #47401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47401/consoleFull)** for PR 10191 at commit [`9e0fd63`](https://g

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163095758 **[Test build #47383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47383/consoleFull)** for PR 10170 at commit [`a43ed34`](https://g

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163095805 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163095804 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-11796] [test-maven] [WIP] Fixing httpcl...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9876#issuecomment-163095557 **[Test build #47399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47399/consoleFull)** for PR 9876 at commit [`73a3182`](https://git

[GitHub] spark pull request: [SPARK-11796] [test-maven] [WIP] Fixing httpcl...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9876#issuecomment-163095566 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11796] [test-maven] [WIP] Fixing httpcl...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9876#issuecomment-163095565 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12228] [SQL] Try to run execution hive'...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10204#issuecomment-163095546 **[Test build #47404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47404/consoleFull)** for PR 10204 at commit [`8546b8b`](https://gi

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163094614 **[Test build #47403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47403/consoleFull)** for PR 10210 at commit [`849647c`](https://gi

[GitHub] spark pull request: [SPARK-12198] [SparkR] SparkR support read.par...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10191#issuecomment-163094060 **[Test build #47401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47401/consoleFull)** for PR 10191 at commit [`9e0fd63`](https://gi

[GitHub] spark pull request: [SPARK-12150] [SQL] [Minor] Add range API with...

2015-12-08 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10149#issuecomment-163093870 @marmbrus @cloud-fan This PR changes the external API. Not sure if this will be merged or we should revisit it after the release of 1.6? Thank you! --- If your pr

[GitHub] spark pull request: [SPARK-12164] [SQL] Display the binary/encoded...

2015-12-08 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10165#issuecomment-163093753 Thank you! @cloud-fan Will this PR be merged to 1.6? Or waiting for another PR for showing decoded values? @marmbrus Thank you! --- If your project is set

[GitHub] spark pull request: [SPARK-12188] [SQL] [FOLLOW-UP] Code refactori...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10214#issuecomment-163093055 **[Test build #47400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47400/consoleFull)** for PR 10214 at commit [`145cd5b`](https://gi

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163092800 **[Test build #47402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47402/consoleFull)** for PR 10181 at commit [`16db32f`](https://gi

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163092566 **[Test build #47382 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47382/consoleFull)** for PR 10170 at commit [`e2090d1`](https://g

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163092608 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163092604 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12188] [SQL] [FOLLOW-UP] Code refactori...

2015-12-08 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/10214 [SPARK-12188] [SQL] [FOLLOW-UP] Code refactoring and comment correction in Dataset APIs @marmbrus This PR is to address your comment. Thanks for your review! You can merge this pull request in

[GitHub] spark pull request: [SPARK-12199][DOC] Follow-up: Refine example c...

2015-12-08 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/10193#issuecomment-163092396 @mengxr The conflict is caused by the revert of https://github.com/apache/spark/pull/10002, for unchecking of Python style. I think we need to wait for that PR being m

[GitHub] spark pull request: [SPARK-12203][STREAMING] Add KafkaDirectInputD...

2015-12-08 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/10197#issuecomment-163092418 We need the exactly once feature of DirectKafkaInputDStream. But we observed that it introduces the latency compared with KafkaInputDStream due to its implementation.

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163092090 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163092088 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163092076 **[Test build #47397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47397/consoleFull)** for PR 10210 at commit [`0ab220c`](https://g

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163091758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163091753 **[Test build #47398 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47398/consoleFull)** for PR 10181 at commit [`e2262ac`](https://g

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163091754 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163091558 **[Test build #47397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47397/consoleFull)** for PR 10210 at commit [`0ab220c`](https://gi

[GitHub] spark pull request: [SPARK-12188] [SQL] Code refactoring and comme...

2015-12-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10184#discussion_r47046739 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -67,15 +67,21 @@ class Dataset[T] private[sql]( tEncoder: Encoder[T])

[GitHub] spark pull request: [SPARK-11602] [MLlib] Refine visibility for 1....

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9939#issuecomment-163091443 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11602] [MLlib] Refine visibility for 1....

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9939#issuecomment-163091440 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12188] [SQL] Code refactoring and comme...

2015-12-08 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/10184#discussion_r47046675 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -67,15 +67,21 @@ class Dataset[T] private[sql]( tEncoder: Encoder[T]) ex

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163091318 **[Test build #47398 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47398/consoleFull)** for PR 10181 at commit [`e2262ac`](https://gi

[GitHub] spark pull request: [SPARK-11796] [test-maven] [WIP] Fixing httpcl...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9876#issuecomment-163091265 **[Test build #47399 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47399/consoleFull)** for PR 9876 at commit [`73a3182`](https://gith

[GitHub] spark pull request: [SPARK-11796] [test-maven] [WIP] Fixing httpcl...

2015-12-08 Thread markgrover
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/9876#issuecomment-163091048 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11796] [test-maven] [WIP] Fixing httpcl...

2015-12-08 Thread markgrover
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/9876#issuecomment-163091025 Thanks @JoshRosen For now, I have added the mysql and postgresql drivers as dependencies and the tests pass now. We just have to make sure that the CI environment has

[GitHub] spark pull request: [SPARK-12188] [SQL] Code refactoring and comme...

2015-12-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10184#discussion_r47046431 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -67,15 +67,21 @@ class Dataset[T] private[sql]( tEncoder: Encoder[T])

[GitHub] spark pull request: [SPARK-11602] [MLlib] Refine visibility for 1....

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9939#issuecomment-163090721 **[Test build #2188 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2188/consoleFull)** for PR 9939 at commit [`319e61d`](https://git

[GitHub] spark pull request: [SPARK-12188] [SQL] Code refactoring and comme...

2015-12-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10184#discussion_r47046420 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -429,18 +432,18 @@ class Dataset[T] private[sql]( /** * (J

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-163090674 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-163090672 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-163090647 **[Test build #47392 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47392/consoleFull)** for PR 8880 at commit [`b62eb7d`](https://git

[GitHub] spark pull request: [SPARK-12222] [Core] Deserialize RoaringBitmap...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10213#issuecomment-163090489 **[Test build #47396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47396/consoleFull)** for PR 10213 at commit [`01d37b0`](https://gi

[GitHub] spark pull request: [SPARK-11602] [MLlib] Refine visibility for 1....

2015-12-08 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9939#discussion_r47046310 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala --- @@ -33,7 +33,7 @@ import org.apache.spark.rdd.RDD @Sin

[GitHub] spark pull request: [SPARK-12198] [SparkR] SparkR support read.par...

2015-12-08 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10191#issuecomment-163090230 @felixcheung, could you detail more about "read.df doesn't match DataFrameReader"? The only exception is JDBC source? --- If your project is set up for it, you can re

[GitHub] spark pull request: [SPARK-11343] [ML] Documentation of float and ...

2015-12-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9598 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11677][SQL] ORC filter tests all pass i...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9687#issuecomment-163089919 **[Test build #47395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47395/consoleFull)** for PR 9687 at commit [`18c0326`](https://gith

[GitHub] spark pull request: [SPARK-12203][STREAMING] Add KafkaDirectInputD...

2015-12-08 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/10197#issuecomment-163089826 So what is the advantage compared to use high-level API? From the point of pulling messages from Kafka, I think there's no difference between high-level API and `Simp

[GitHub] spark pull request: [SPARK-11677][SQL] ORC filter tests all pass i...

2015-12-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/9687#issuecomment-163089723 In this commit, I renamed the function extractSourceRDDToDataFrame to stripSparkFilter. --- If your project is set up for it, you can reply to this email and have y

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163089750 **[Test build #47393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47393/consoleFull)** for PR 10181 at commit [`bed5d8a`](https://g

[GitHub] spark pull request: [SPARK-11343] [ML] Documentation of float and ...

2015-12-08 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9598#issuecomment-163089742 merging with master and branch-1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-12145][SQL] Command 'Set Role [ADMIN|NO...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10144#issuecomment-163089714 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12222] [Core] Deserialize RoaringBitmap...

2015-12-08 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/10213#issuecomment-163089761 /cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163089753 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163089752 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-163089640 **[Test build #47392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47392/consoleFull)** for PR 8880 at commit [`b62eb7d`](https://gith

[GitHub] spark pull request: [SPARK-12145][SQL] Command 'Set Role [ADMIN|NO...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10144#issuecomment-163089711 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12222] [Core] Deserialize RoaringBitmap...

2015-12-08 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/10213 [SPARK-1] [Core] Deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception Deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception: ``` com

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163089365 **[Test build #47393 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47393/consoleFull)** for PR 10181 at commit [`bed5d8a`](https://gi

[GitHub] spark pull request: [SPARK-11602] [MLlib] Refine visibility for 1....

2015-12-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9939#discussion_r47045951 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -529,7 +529,7 @@ class LinearRegressionSummary private[regressi

[GitHub] spark pull request: [SPARK-11602] [MLlib] Refine visibility for 1....

2015-12-08 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/9939#discussion_r47045847 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/StringIndexer.scala --- @@ -52,6 +52,10 @@ private[feature] trait StringIndexerBase extends Params

[GitHub] spark pull request: [SPARK-11676][SQL] Parquet filter tests all pa...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9659#issuecomment-163089093 **[Test build #47391 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47391/consoleFull)** for PR 9659 at commit [`9861d96`](https://gith

[GitHub] spark pull request: [SPARK-11676][SQL] Parquet filter tests all pa...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9659#issuecomment-163089103 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11676][SQL] Parquet filter tests all pa...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9659#issuecomment-163089101 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12203][STREAMING] Add KafkaDirectInputD...

2015-12-08 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/10197#issuecomment-163088878 @jerryshao Yes. We would like to directly pull messages from Kafka like DirectKafkaInputDStream, but also use receivers like KafkaInputDStream. --- If your project is s

[GitHub] spark pull request: [SPARK-8517][ML][DOC] Reorganizes the spark.ml...

2015-12-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10207 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-8517][ML][DOC] Reorganizes the spark.ml...

2015-12-08 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/10207#issuecomment-163088112 Merging with master and branch-1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-11676][SQL] Parquet filter tests all pa...

2015-12-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/9659#issuecomment-163088089 In this commit, I resolved conflicts, renamed the function extractSourceRDDToDataFrame to stripSparkFilter and set false to `spark.sql.parquet.enableUnsafeRowRecordR

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163087766 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163087767 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163087760 **[Test build #47387 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47387/consoleFull)** for PR 10210 at commit [`0443f68`](https://g

[GitHub] spark pull request: [SPARK-12145][SQL] Command 'Set Role [ADMIN|NO...

2015-12-08 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/10144#issuecomment-163087431 This is not really my area, but I'm sure SQL guys will pick this up. ok to test --- If your project is set up for it, you can reply to this email and have your reply ap

[GitHub] spark pull request: [SPARK-8517][ML][DOC] Reorganizes the spark.ml...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10207#issuecomment-163087454 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-8517][ML][DOC] Reorganizes the spark.ml...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10207#issuecomment-163087452 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-8517][ML][DOC] Reorganizes the spark.ml...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10207#issuecomment-163087384 **[Test build #47384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47384/consoleFull)** for PR 10207 at commit [`dc584b2`](https://g

[GitHub] spark pull request: [RFC] Add type-safe config keys to SparkConf.

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10205#issuecomment-163087383 **[Test build #47388 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47388/consoleFull)** for PR 10205 at commit [`bda7e2b`](https://gi

[GitHub] spark pull request: [SPARK-12145][SQL] Command 'Set Role [ADMIN|NO...

2015-12-08 Thread winningsix
Github user winningsix commented on the pull request: https://github.com/apache/spark/pull/10144#issuecomment-163087290 Hi @vanzin This PR includes two parts: 1. Add user information to SessionState which is required to initialize the authorizer. 2. Add parser rules to fal

[GitHub] spark pull request: [SPARK-8517][ML][DOC] Reorganizes the spark.ml...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10207#issuecomment-163087316 **[Test build #2187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2187/consoleFull)** for PR 10207 at commit [`dc584b2`](https://

[GitHub] spark pull request: [SPARK-9843] Make catalyst optimizer pass plug...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10210#issuecomment-163087272 **[Test build #47387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47387/consoleFull)** for PR 10210 at commit [`0443f68`](https://gi

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163087103 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163087096 **[Test build #47386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47386/consoleFull)** for PR 10181 at commit [`9d85277`](https://g

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163087102 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163086853 Note to self RE: unroll fraction (just to be precise): At a high-level, the StaticMemoryManager a request for unroll memory will be able to obtain more memory

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163086714 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163086711 **[Test build #47386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47386/consoleFull)** for PR 10181 at commit [`9d85277`](https://gi

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10181#issuecomment-163086712 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163086560 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163086561 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12165][SPARK-12189] Fix bugs in evictio...

2015-12-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10170#issuecomment-163086522 **[Test build #47380 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47380/consoleFull)** for PR 10170 at commit [`f6fb406`](https://g

<    1   2   3   4   5   6   7   8   >