[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13912 Hm, that's a bug isn't it? any time is ambiguous without a timezone. These things can make sense for local display but not for output of data. --- If your project is set up for it, you can reply to

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13912 Thank you for your comment @srowen ! I did this for two reasons. Firstly, it can't write and read back the dates or timestamps but it might have to be converted manually by users if it writes

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13680 @cloud-fan and @hvanhovell thank you for your comments. Based on your comments, I implemented ```UnsafeArrayData``` by using one implementation with explicit clearing ```null bits``` by ```Arrays.fill

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61257/ Test PASSed. ---

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13624 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13624 **[Test build #61257 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61257/consoleFull)** for PR 13624 at commit [`5d047dd`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13624: [SPARK-15858][ML]: Fix calculating error by tree ...

2016-06-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13624#discussion_r68498491 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/model/treeEnsembleModels.scala --- @@ -151,31 +151,23 @@ class GradientBoostedTreesModel @Since("1

[GitHub] spark pull request #13624: [SPARK-15858][ML]: Fix calculating error by tree ...

2016-06-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13624#discussion_r68498490 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -205,31 +205,27 @@ private[spark] object GradientBoostedTrees

[GitHub] spark issue #13910: make SparkPi iteration time correct

2016-06-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13910 @yanghaogn since you already made a JIRA, connect it in the title please. It is not resolved --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13910: make SparkPi iteration time correct

2016-06-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13910 Nah @HyukjinKwon I think this is a simple fix that's self-contained here. Either the iterations or the estimate formula is wrong here and that's all there is to it. `(0 until n)` would be fine too.

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13912 This has a big problem though -- the times are now wrong, because there is no timezone. Why would we write formatted dates in a data file though? it's for human consumption. Timestamp is an appro

[GitHub] spark pull request #13783: [HOTFIX][SPARK-15613][SQL]Set test runtime timezo...

2016-06-25 Thread adrian-wang
Github user adrian-wang closed the pull request at: https://github.com/apache/spark/pull/13783 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #13783: [HOTFIX][SPARK-15613][SQL]Set test runtime timezone for ...

2016-06-25 Thread adrian-wang
Github user adrian-wang commented on the issue: https://github.com/apache/spark/pull/13783 Closing, thx! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #9246: [SPARK-5210] Support group event log when app is long-run...

2016-06-25 Thread eladamitpxi
Github user eladamitpxi commented on the issue: https://github.com/apache/spark/pull/9246 +1 large / infinitely growing event log files are quite a problem for long running streaming jobs --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61259/ Test FAILed. ---

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61259 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61259/consoleFull)** for PR 11863 at commit [`0610e9b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61259 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61259/consoleFull)** for PR 11863 at commit [`0610e9b`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source does not write date a...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13912 **[Test build #61258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61258/consoleFull)** for PR 13912 at commit [`79a290a`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #13912: [SPARK-16216][SQL] CSV data source does not write...

2016-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13912#discussion_r68498245 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -195,18 +202,50 @@ private[sql] class CsvOutpu

[GitHub] spark pull request #13912: [SPARK-16216][SQL] CSV data source does not write...

2016-06-25 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/13912 [SPARK-16216][SQL] CSV data source does not write date and timestamp correctly ## What changes were proposed in this pull request? This PR corrects CSV data sources in order to write `

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13907 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61253/ Test PASSed. ---

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13907 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13907 **[Test build #61253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61253/consoleFull)** for PR 13907 at commit [`a9ce0d8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13624 **[Test build #61257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61257/consoleFull)** for PR 13624 at commit [`5d047dd`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #13910: make SparkPi iteration time correct

2016-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13910 Get ready to receive a comment suggesting following https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark.. --- If your project is set up for it, you can reply to this email a

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13911 **[Test build #61256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61256/consoleFull)** for PR 13911 at commit [`b1f6289`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #13911: [SPARK-16215][SQL] Reduce runtime overhead of a p...

2016-06-25 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/13911 [SPARK-16215][SQL] Reduce runtime overhead of a program that writes an primitive array in Dataframe/Dataset ## What changes were proposed in this pull request? This PR optimize generate code

[GitHub] spark issue #13765: [SPARK-16052][SQL] Add `CollapseRepartitionBy` optimizer

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13765 **[Test build #61255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61255/consoleFull)** for PR 13765 at commit [`c3016f3`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13730 **[Test build #61254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61254/consoleFull)** for PR 13730 at commit [`ba9a529`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #13624: [SPARK-15858][ML]: Fix calculating error by tree ...

2016-06-25 Thread mhmoudr
Github user mhmoudr commented on a diff in the pull request: https://github.com/apache/spark/pull/13624#discussion_r68497920 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -205,31 +205,29 @@ private[spark] object GradientBoostedTrees

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-06-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13886 @cloud-fan Submitted a PR for converting CTAS in parquet to data source tables without hive support. Could you also review that PR? Thanks! --- If your project is set up for it, you can reply t

[GitHub] spark issue #13386: [SPARK-15646] [SQL] When spark.sql.hive.convertCTAS is t...

2016-06-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13386 Just realized this PR introduced the original changes. Could you also review my PR: https://github.com/apache/spark/pull/13907? When users create table as query with `STORED AS` or `ROW F

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61247/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61247 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61247/consoleFull)** for PR 13758 at commit [`65317e1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61251/ Test PASSed. ---

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61251/consoleFull)** for PR 13908 at commit [`d8a1ba0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61250/consoleFull)** for PR 13909 at commit [`37e4ce2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11863 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61252/ Test FAILed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61252/consoleFull)** for PR 11863 at commit [`0f15bd1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61250/ Test FAILed. ---

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13907 **[Test build #61253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61253/consoleFull)** for PR 13907 at commit [`a9ce0d8`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61252/consoleFull)** for PR 11863 at commit [`0f15bd1`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61249/ Test PASSed. ---

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61249 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61249/consoleFull)** for PR 13908 at commit [`647c2af`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61248/ Test PASSed. ---

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61248/consoleFull)** for PR 13908 at commit [`576a0e4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13910: make rdd count be n

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13910 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #13910: make rdd count be n

2016-06-25 Thread yanghaogn
Github user yanghaogn commented on the issue: https://github.com/apache/spark/pull/13910 As the denominator is n, the iteration time should also be n --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request #13910: make rdd count be n

2016-06-25 Thread yanghaogn
GitHub user yanghaogn opened a pull request: https://github.com/apache/spark/pull/13910 make rdd count be n ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #61250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61250/consoleFull)** for PR 13909 at commit [`37e4ce2`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61251/consoleFull)** for PR 13908 at commit [`d8a1ba0`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-06-25 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/13909 [SPARK-16213][SQL] Reduce runtime overhead of a program that creates an primitive array in DataFrame ## What changes were proposed in this pull request? This PR reduces runtime overhead of a

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61249/consoleFull)** for PR 13908 at commit [`647c2af`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from review...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13908 **[Test build #61248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61248/consoleFull)** for PR 13908 at commit [`576a0e4`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #13908: [SPARK-16212][STREAMING][KAFKA] code cleanup from...

2016-06-25 Thread koeninger
GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/13908 [SPARK-16212][STREAMING][KAFKA] code cleanup from review feedback ## What changes were proposed in this pull request? code cleanup in kafka-0-8 to match suggested changes for kafka-0-10 branch

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61247/consoleFull)** for PR 13758 at commit [`65317e1`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13885 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61245/ Test PASSed. ---

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13885 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13885 **[Test build #61245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61245/consoleFull)** for PR 13885 at commit [`385645b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13904 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61246/ Test PASSed. ---

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13904 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13904 **[Test build #61246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61246/consoleFull)** for PR 13904 at commit [`296c2d4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61244/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61244/consoleFull)** for PR 13758 at commit [`8ac0840`](https://github.com/apache/spark/commit/

[GitHub] spark issue #9936: [SPARK-11938][ML] Expose numFeatures in all ML Prediction...

2016-06-25 Thread Lewuathe
Github user Lewuathe commented on the issue: https://github.com/apache/spark/pull/9936 @vectorijk It seems difficult to handle this JIRA for me. Could you help me with this? Thanks so much for taking care! --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13904 **[Test build #61246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61246/consoleFull)** for PR 13904 at commit [`296c2d4`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13885 **[Test build #61245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61245/consoleFull)** for PR 13885 at commit [`385645b`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #13885: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13885#discussion_r68496462 --- Diff: R/pkg/R/SQLContext.R --- @@ -110,11 +110,46 @@ infer_type <- function(x) { } } -getDefaultSqlSource <- function() { +#

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61244/consoleFull)** for PR 13758 at commit [`8ac0840`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #13888: [SPARK-16187] [ML] Implement util method for ML M...

2016-06-25 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/13888#discussion_r68496003 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala --- @@ -309,8 +309,8 @@ object MLUtils extends Logging { } /**

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13907 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61243/ Test FAILed. ---

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13907 **[Test build #61243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61243/consoleFull)** for PR 13907 at commit [`c4bde02`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13907 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve OptimizeIn optimizer to remov...

2016-06-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13876 Hi, @rxin . For this `OptimizeIn` PR, please let me know if we need further optimization. Thank you always. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13906#discussion_r68495438 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1053,6 +1055,34 @@ object PruneFilters extends R

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13906#discussion_r68495422 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1053,6 +1055,34 @@ object PruneFilters extends R

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data Source T...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13907 **[Test build #61243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61243/consoleFull)** for PR 13907 at commit [`c4bde02`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #13907: [SPARK-16209] [SQL] Convert Hive Tables to Data S...

2016-06-25 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/13907 [SPARK-16209] [SQL] Convert Hive Tables to Data Source Tables for CREATE TABLE AS SELECT What changes were proposed in this pull request? Currently, the following created table is Hive

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13906#discussion_r68495048 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1053,6 +1055,34 @@ object PruneFilters extends Rule[Logic

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13906 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13906 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61242/ Test PASSed. ---

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13906 **[Test build #61242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61242/consoleFull)** for PR 13906 at commit [`7ddf449`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13906 **[Test build #61242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61242/consoleFull)** for PR 13906 at commit [`7ddf449`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimi...

2016-06-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/13906 [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer ## What changes were proposed in this pull request? This PR adds a new logical optimizer, `CollapseEmptyPlan`, to collapse a logi

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61241/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #61241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61241/consoleFull)** for PR 13758 at commit [`9379865`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13860 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61240/ Test PASSed. ---

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13860 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13860 **[Test build #61240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61240/consoleFull)** for PR 13860 at commit [`b8e0511`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61239/ Test PASSed. ---

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

  1   2   >