[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17865 **[Test build #78031 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78031/testReport)** for PR 17865 at commit

[GitHub] spark issue #18231: [SPARK-20994] Remove reduant characters in OpenBlocks to...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18231 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78022/ Test PASSed. ---

[GitHub] spark issue #18231: [SPARK-20994] Remove reduant characters in OpenBlocks to...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18231 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18231: [SPARK-20994] Remove reduant characters in OpenBlocks to...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18231 **[Test build #78022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78022/testReport)** for PR 18231 at commit

[GitHub] spark pull request #17865: [SPARK-20456][Docs] Add examples for functions co...

2017-06-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17865#discussion_r121859623 --- Diff: python/pyspark/sql/functions.py --- @@ -189,15 +210,15 @@ def _(): } for _name, _doc in _functions.items(): -

[GitHub] spark issue #18296: [SPARK-21090][core]Optimize the unified memory manager c...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18296 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78030/ Test FAILed. ---

[GitHub] spark issue #18296: [SPARK-21090][core]Optimize the unified memory manager c...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18296 **[Test build #78030 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78030/testReport)** for PR 18296 at commit

[GitHub] spark issue #18296: [SPARK-21090][core]Optimize the unified memory manager c...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18296 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18296: [SPARK-21090][core]Optimize the unified memory manager c...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18296 **[Test build #78030 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78030/testReport)** for PR 18296 at commit

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17865 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78029/ Test FAILed. ---

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17865 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17865 **[Test build #78029 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78029/testReport)** for PR 17865 at commit

[GitHub] spark pull request #18296: [SPARK-21090][core]Optimize the unified memory ma...

2017-06-13 Thread 10110346
GitHub user 10110346 opened a pull request: https://github.com/apache/spark/pull/18296 [SPARK-21090][core]Optimize the unified memory manager code ## What changes were proposed in this pull request? 1.In `acquireStorageMemory`, when the MemoryMode is OFF_HEAP ,the `maxMemory`

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17865 **[Test build #78029 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78029/testReport)** for PR 17865 at commit

[GitHub] spark pull request #17865: [SPARK-20456][Docs] Add examples for functions co...

2017-06-13 Thread map222
Github user map222 commented on a diff in the pull request: https://github.com/apache/spark/pull/17865#discussion_r121857727 --- Diff: python/pyspark/sql/functions.py --- @@ -92,14 +98,16 @@ def _(): _functions_1_4 = { # unary math functions 'acos': 'Computes

[GitHub] spark pull request #17865: [SPARK-20456][Docs] Add examples for functions co...

2017-06-13 Thread map222
Github user map222 commented on a diff in the pull request: https://github.com/apache/spark/pull/17865#discussion_r121857687 --- Diff: python/pyspark/sql/functions.py --- @@ -189,15 +210,15 @@ def _(): } for _name, _doc in _functions.items(): -

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS optimizer and Squared_hin...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17862 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78024/ Test PASSed. ---

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS optimizer and Squared_hin...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17862 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS optimizer and Squared_hin...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17862 **[Test build #78024 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78024/testReport)** for PR 17862 at commit

[GitHub] spark issue #18295: [SPARK-21085] [SQL] Failed to read the partitioned table...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18295 **[Test build #78028 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78028/testReport)** for PR 18295 at commit

[GitHub] spark issue #18295: [SPARK-21085] [SQL] Failed to read the partitioned table...

2017-06-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18295 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18295: [SPARK-21085] [SQL] Failed to read the partitione...

2017-06-13 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/18295 [SPARK-21085] [SQL] Failed to read the partitioned table created by Spark 2.1 ### What changes were proposed in this pull request? Before the PR, Spark is unable to read the partitioned

[GitHub] spark issue #18294: [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED to Show ...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18294 **[Test build #78027 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78027/testReport)** for PR 18294 at commit

[GitHub] spark issue #18294: [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED to Show ...

2017-06-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18294 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18294: [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED t...

2017-06-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18294#discussion_r121855663 --- Diff: sql/core/src/test/resources/sql-tests/results/describe.sql.out --- @@ -127,8 +127,9 @@ Providerparquet Num Buckets

[GitHub] spark pull request #18294: [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED t...

2017-06-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18294#discussion_r121855587 --- Diff: sql/core/src/test/resources/sql-tests/results/describe.sql.out --- @@ -127,8 +127,9 @@ Providerparquet Num Buckets

[GitHub] spark pull request #18294: [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED t...

2017-06-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18294#discussion_r121855563 --- Diff: sql/core/src/test/resources/sql-tests/results/describe.sql.out --- @@ -127,8 +127,9 @@ Providerparquet Num Buckets

[GitHub] spark issue #18292: [SPARK-21083][SQL] Consider staleness when collecting co...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18292 **[Test build #78026 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78026/testReport)** for PR 18292 at commit

[GitHub] spark issue #18294: [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED to Show ...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18294 **[Test build #78025 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78025/testReport)** for PR 18294 at commit

[GitHub] spark pull request #18294: [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED t...

2017-06-13 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/18294 [SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED to Show Table Properties ### What changes were proposed in this pull request? Since both table properties and storage properties share

[GitHub] spark pull request #18292: [SPARK-21083][SQL] Consider staleness when collec...

2017-06-13 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/18292#discussion_r121855001 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -218,6 +224,49 @@ class StatisticsSuite extends

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS optimizer and Squared_hin...

2017-06-13 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/17862 @hhbyyh Thanks for doing the extra work to use the new aggregator here. I do think it's better to separate those changes from this one, though. There is actually more that needs to be done for the

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS optimizer and Squared_hin...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17862 **[Test build #78024 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78024/testReport)** for PR 17862 at commit

[GitHub] spark issue #18084: [SPARK-19900][core]Remove driver when relaunching.

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18084 **[Test build #78023 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78023/testReport)** for PR 18084 at commit

[GitHub] spark issue #18271: [MINOR][DOCS] Improve Running R Tests docs

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18271 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18271: [MINOR][DOCS] Improve Running R Tests docs

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18271 **[Test build #78021 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78021/testReport)** for PR 18271 at commit

[GitHub] spark issue #18271: [MINOR][DOCS] Improve Running R Tests docs

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18271 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78021/ Test PASSed. ---

[GitHub] spark pull request #18150: [SPARK-19753][CORE] Un-register all shuffle outpu...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18150 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18150: [SPARK-19753][CORE] Un-register all shuffle output on a ...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18150 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #18150: [SPARK-19753][CORE] Un-register all shuffle outpu...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18150#discussion_r121846539 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1370,22 +1393,42 @@ class DAGScheduler( */

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS as optimizer for LinearSV...

2017-06-13 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/17862 Merge the change from https://github.com/apache/spark/pull/17645 into a single change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #18271: [MINOR][DOCS] Improve Running R Tests docs

2017-06-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18271 For me, it looks good. I assume we consider https://github.com/apache/spark/pull/18271#discussion_r121768881 but it looks fine as is too. --- If your project is set up for it, you can reply

[GitHub] spark issue #18291: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18291 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78020/ Test PASSed. ---

[GitHub] spark issue #18291: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18291 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18291: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18291 **[Test build #78020 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78020/testReport)** for PR 18291 at commit

[GitHub] spark issue #18231: [SPARK-20994] Remove reduant characters in OpenBlocks to...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18231 **[Test build #78022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78022/testReport)** for PR 18231 at commit

[GitHub] spark issue #18150: [SPARK-19753][CORE] Un-register all shuffle output on a ...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18150 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18150: [SPARK-19753][CORE] Un-register all shuffle output on a ...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18150 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78016/ Test PASSed. ---

[GitHub] spark issue #18150: [SPARK-19753][CORE] Un-register all shuffle output on a ...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18150 **[Test build #78016 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78016/testReport)** for PR 18150 at commit

[GitHub] spark issue #18271: [MINOR][DOCS] Improve Running R Tests docs

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18271 **[Test build #78021 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78021/testReport)** for PR 18271 at commit

[GitHub] spark pull request #18150: [SPARK-19753][CORE] Un-register all shuffle outpu...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18150#discussion_r121844707 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1370,22 +1393,42 @@ class DAGScheduler( */

[GitHub] spark issue #18150: [SPARK-19753][CORE] Un-register all shuffle output on a ...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18150 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18150: [SPARK-19753][CORE] Un-register all shuffle output on a ...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18150 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78015/ Test PASSed. ---

[GitHub] spark issue #18150: [SPARK-19753][CORE] Un-register all shuffle output on a ...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18150 **[Test build #78015 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78015/testReport)** for PR 18150 at commit

[GitHub] spark issue #17267: [SPARK-19926][PYSPARK] Make pyspark exception more user-...

2017-06-13 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17267 +1 We should add a test for this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #16417: [SPARK-19014][SQL] support complex aggregate buff...

2017-06-13 Thread cloud-fan
Github user cloud-fan closed the pull request at: https://github.com/apache/spark/pull/16417 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15082: [SPARK-17528][SQL] MutableProjection should not c...

2017-06-13 Thread cloud-fan
Github user cloud-fan closed the pull request at: https://github.com/apache/spark/pull/15082 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #18269: [SPARK-21056][SQL] Use at most one spark job to l...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18269#discussion_r121843329 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala --- @@ -248,60 +245,92 @@ object InMemoryFileIndex

[GitHub] spark pull request #18269: [SPARK-21056][SQL] Use at most one spark job to l...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18269#discussion_r121843352 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala --- @@ -248,60 +245,92 @@ object InMemoryFileIndex

[GitHub] spark pull request #18269: [SPARK-21056][SQL] Use at most one spark job to l...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18269#discussion_r121843175 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala --- @@ -248,60 +245,92 @@ object InMemoryFileIndex

[GitHub] spark pull request #18269: [SPARK-21056][SQL] Use at most one spark job to l...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18269#discussion_r121843022 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala --- @@ -248,60 +245,92 @@ object InMemoryFileIndex

[GitHub] spark issue #18291: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18291 **[Test build #78020 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78020/testReport)** for PR 18291 at commit

[GitHub] spark issue #18291: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-06-13 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18291 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18231: [SPARK-20994] Remove reduant characters in OpenBlocks to...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18231 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78017/ Test FAILed. ---

[GitHub] spark issue #18231: [SPARK-20994] Remove reduant characters in OpenBlocks to...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18231 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18231: [SPARK-20994] Remove reduant characters in OpenBlocks to...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18231 **[Test build #78017 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78017/testReport)** for PR 18231 at commit

[GitHub] spark issue #18288: [SPARK-21066][ML] LibSVM load just one input file

2017-06-13 Thread darionyaphet
Github user darionyaphet commented on the issue: https://github.com/apache/spark/pull/18288 @srowen It seems OK. `FileInputFormat` will use a comma-separated paths to be set as the list of inputs for the job. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #11420: [SPARK-13493][SQL] Enable case sensitiveness in json sch...

2017-06-13 Thread zuowang
Github user zuowang commented on the issue: https://github.com/apache/spark/pull/11420 I'm not, could you work to resolve it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18206: [SPARK-20754][SQL][FOLLOWUP] Add Function Alias For MOD/...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18206 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78014/ Test PASSed. ---

[GitHub] spark issue #18206: [SPARK-20754][SQL][FOLLOWUP] Add Function Alias For MOD/...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18206 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18206: [SPARK-20754][SQL][FOLLOWUP] Add Function Alias For MOD/...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18206 **[Test build #78014 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78014/testReport)** for PR 18206 at commit

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78012/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78012 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78012/testReport)** for PR 17758 at commit

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78011/ Test PASSed. ---

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #78011 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78011/testReport)** for PR 15178 at commit

[GitHub] spark issue #18293: [SPARK-20379][core] Allow SSL config to reference env va...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18293 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18293: [SPARK-20379][core] Allow SSL config to reference env va...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18293 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78007/ Test PASSed. ---

[GitHub] spark issue #18293: [SPARK-20379][core] Allow SSL config to reference env va...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18293 **[Test build #78007 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78007/testReport)** for PR 18293 at commit

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS as optimizer for LinearSV...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17862 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78019/ Test PASSed. ---

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS as optimizer for LinearSV...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17862 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17862: [SPARK-20602] [ML]Adding LBFGS as optimizer for LinearSV...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17862 **[Test build #78019 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78019/testReport)** for PR 17862 at commit

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-06-13 Thread yssharma
Github user yssharma commented on the issue: https://github.com/apache/spark/pull/18029 Thoughts - @budde @brkyvz ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18292: [SPARK-21083][SQL] Consider staleness when collecting co...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18292 LGTM except one comment --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #18292: [SPARK-21083][SQL] Consider staleness when collec...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18292#discussion_r121839586 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -218,6 +224,49 @@ class StatisticsSuite extends

[GitHub] spark pull request #18205: [SPARK-20986] [SQL] Reset table's statistics afte...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18205 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18205: [SPARK-20986] [SQL] Reset table's statistics after Prune...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18205 thanks, merging to master/2.2! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #18205: [SPARK-20986] [SQL] Reset table's statistics afte...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18205#discussion_r121838668 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PruneFileSourcePartitions.scala --- @@ -59,8 +60,11 @@ private[sql] object

[GitHub] spark issue #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18075 LGTM except some style comments --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Con...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18075#discussion_r121838120 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -233,10 +222,124 @@ class

[GitHub] spark pull request #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Con...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18075#discussion_r121837792 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ColumnarBatchScan.scala --- @@ -93,7 +93,7 @@ private[sql] trait ColumnarBatchScan

[GitHub] spark pull request #16576: [SPARK-19215] Add necessary check for `RDD.checkp...

2017-06-13 Thread WeichenXu123
Github user WeichenXu123 closed the pull request at: https://github.com/apache/spark/pull/16576 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Con...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18075#discussion_r121837609 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ColumnarBatchScan.scala --- @@ -93,7 +93,7 @@ private[sql] trait ColumnarBatchScan

[GitHub] spark issue #18292: [SPARK-21083][SQL] Consider staleness when collecting co...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18292 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Con...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18075#discussion_r121837371 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/GeneratedProjectionSuite.scala --- @@ -83,6 +83,58 @@ class

[GitHub] spark issue #18292: [SPARK-21083][SQL] Consider staleness when collecting co...

2017-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18292 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78008/ Test PASSed. ---

[GitHub] spark issue #18292: [SPARK-21083][SQL] Consider staleness when collecting co...

2017-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18292 **[Test build #78008 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78008/testReport)** for PR 18292 at commit

[GitHub] spark pull request #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Con...

2017-06-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18075#discussion_r121837140 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/GeneratedProjectionSuite.scala --- @@ -83,6 +83,58 @@ class

[GitHub] spark pull request #18281: [SPARK-21027][ML][PYTHON] Added tunable paralleli...

2017-06-13 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/18281#discussion_r121836808 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/OneVsRest.scala --- @@ -325,8 +343,13 @@ final class OneVsRest @Since("1.4.0") (

  1   2   3   4   5   6   >