[GitHub] spark pull request #13687: [SPARK-15970][SQL]: avoid warning message for hiv...

2017-06-12 Thread xwu0226
Github user xwu0226 closed the pull request at: https://github.com/apache/spark/pull/13687 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #13687: [SPARK-15970][SQL]: avoid warning message for hive metas...

2017-06-12 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/13687 Closed since the hive refactoring code has resolve this issue by the way. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark issue #16735: [SPARK-19228][SQL] Introduce tryParseDate method to proc...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16735 **[Test build #77975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77975/testReport)** for PR 16735 at commit [`3e250f5`](https://github.com/apache/spark/commit/3e

[GitHub] spark pull request #18205: [SPARK-20986] [SQL] Reset table's statistics afte...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18205#discussion_r121595388 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruneFileSourcePartitionsSuite.scala --- @@ -66,4 +68,45 @@ class PruneFileSourcePa

[GitHub] spark pull request #18205: [SPARK-20986] [SQL] Reset table's statistics afte...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18205#discussion_r121594886 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruneFileSourcePartitionsSuite.scala --- @@ -66,4 +68,42 @@ class PruneFileSourcePa

[GitHub] spark pull request #18205: [SPARK-20986] [SQL] Reset table's statistics afte...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18205#discussion_r121594928 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruneFileSourcePartitionsSuite.scala --- @@ -66,4 +68,45 @@ class PruneFileSourcePa

[GitHub] spark pull request #18205: [SPARK-20986] [SQL] Reset table's statistics afte...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18205#discussion_r121594821 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruneFileSourcePartitionsSuite.scala --- @@ -66,4 +68,45 @@ class PruneFileSourcePa

[GitHub] spark issue #17267: [SPARK-19926][PYSPARK] Make pyspark exception more user-...

2017-06-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17267 LGTM too but hope there would be a test if possible. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #17164: [SPARK-16844][SQL] Support codegen for sort-based aggrea...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17164 @maropu Maybe we can close this PR at first? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark issue #18258: [SPARK-21051][SQL] Add hash map metrics to aggregate

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18258 **[Test build #77974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77974/testReport)** for PR 18258 at commit [`c7de74c`](https://github.com/apache/spark/commit/c7

[GitHub] spark issue #16735: [SPARK-19228][SQL] Introduce tryParseDate method to proc...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16735 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #18205: [SPARK-20986] [SQL] Reset table's statistics afte...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18205#discussion_r121594015 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PruneFileSourcePartitions.scala --- @@ -59,8 +60,11 @@ private[sql] object P

[GitHub] spark issue #18258: [SPARK-21051][SQL] Add hash map metrics to aggregate

2017-06-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18258 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #17267: [SPARK-19926][PYSPARK] Make pyspark exception more user-...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17267 cc @ueshin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18285: [SPARK-20338][CORE]Spaces in spark.eventLog.dir are not ...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18285 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #16747: SPARK-16636 Add CalendarIntervalType to documentation

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16747 @terma To avoid confusing the Spark SQL users, we might not document it? How about closing this PR now? Thanks! --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request #18193: [SPARK-15616] [SQL] CatalogRelation should fallba...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18193#discussion_r121593505 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -139,6 +138,54 @@ class DetermineTableStats(session: SparkSession)

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #77973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77973/testReport)** for PR 17758 at commit [`36f6849`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77973/ Test FAILed. ---

[GitHub] spark issue #13687: [SPARK-15970][SQL]: avoid warning message for hive metas...

2017-06-12 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/13687 Let me rebase and code and try again . Will close it if we don't have any issue. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark pull request #18285: [SPARK-20338]Spaces in spark.eventLog.dir are not...

2017-06-12 Thread zuotingbing
GitHub user zuotingbing opened a pull request: https://github.com/apache/spark/pull/18285 [SPARK-20338]Spaces in spark.eventLog.dir are not correctly handled ## What changes were proposed in this pull request? “spark.eventLog.dir” supports with space characters.

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #77973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77973/testReport)** for PR 17758 at commit [`36f6849`](https://github.com/apache/spark/commit/36

[GitHub] spark pull request #18193: [SPARK-15616] [SQL] CatalogRelation should fallba...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18193#discussion_r121593150 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -139,6 +138,54 @@ class DetermineTableStats(session: SparkSession)

[GitHub] spark pull request #12147: [SPARK-14361][SQL]Window function exclude clause

2017-06-12 Thread xwu0226
Github user xwu0226 commented on a diff in the pull request: https://github.com/apache/spark/pull/12147#discussion_r121593031 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala --- @@ -262,19 +270,55 @@ object SpecifiedWindowFra

[GitHub] spark issue #14191: [SPARK-16217][SQL] Support SELECT INTO statement

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14191 @wuxianxingkong Are you still working on this? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request #18193: [SPARK-15616] [SQL] CatalogRelation should fallba...

2017-06-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18193#discussion_r121592996 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -139,6 +138,54 @@ class DetermineTableStats(session: SparkSession)

[GitHub] spark pull request #14191: [SPARK-16217][SQL] Support SELECT INTO statement

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14191#discussion_r121592866 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -395,6 +414,15 @@ class AstBuilder extends SqlBaseBas

[GitHub] spark pull request #12147: [SPARK-14361][SQL]Window function exclude clause

2017-06-12 Thread xwu0226
Github user xwu0226 commented on a diff in the pull request: https://github.com/apache/spark/pull/12147#discussion_r121592843 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1825,6 +1847,18 @@ class Analyzer( }

[GitHub] spark pull request #18262: [SPARK-21045][PYSPARK]Fixed executor blocked beca...

2017-06-12 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18262#discussion_r121592903 --- Diff: python/pyspark/worker.py --- @@ -177,8 +177,13 @@ def process(): process() except Exception: try: +

[GitHub] spark pull request #12147: [SPARK-14361][SQL]Window function exclude clause

2017-06-12 Thread xwu0226
Github user xwu0226 commented on a diff in the pull request: https://github.com/apache/spark/pull/12147#discussion_r121592724 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -631,6 +631,17 @@ frameBound | expression boundType=(

[GitHub] spark issue #18258: [SPARK-21051][SQL] Add hash map metrics to aggregate

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18258 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77961/ Test FAILed. ---

[GitHub] spark issue #18258: [SPARK-21051][SQL] Add hash map metrics to aggregate

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18258 **[Test build #77961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77961/testReport)** for PR 18258 at commit [`c7de74c`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #18258: [SPARK-21051][SQL] Add hash map metrics to aggregate

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18258 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #77972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77972/testReport)** for PR 15178 at commit [`ecebb3f`](https://github.com/apache/spark/commit/ec

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77971/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #77971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77971/testReport)** for PR 17758 at commit [`ac3dcc3`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #77971 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77971/testReport)** for PR 17758 at commit [`ac3dcc3`](https://github.com/apache/spark/commit/ac

[GitHub] spark pull request #17758: [SPARK-20460][SQL] Make it more consistent to han...

2017-06-12 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17758#discussion_r121591640 --- Diff: sql/core/src/test/resources/sql-tests/inputs/create.sql --- @@ -0,0 +1,5 @@ +-- Check name duplication in a regular case +CREATE TABLE t (c

[GitHub] spark issue #18205: [SPARK-20986] [SQL] Reset table's statistics after Prune...

2017-06-12 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/18205 LGTM, ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77968/ Test FAILed. ---

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #77968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77968/testReport)** for PR 15178 at commit [`59d96d7`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16766 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77969/ Test FAILed. ---

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16766 **[Test build #77969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77969/testReport)** for PR 16766 at commit [`d4bde0b`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16766 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13687: [SPARK-15970][SQL]: avoid warning message for hive metas...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13687 @xwu0226 We did a major refactoring in the codes. Do we still face the same issue? If not, maybe we can close it? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16766 **[Test build #77969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77969/testReport)** for PR 16766 at commit [`d4bde0b`](https://github.com/apache/spark/commit/d4

[GitHub] spark issue #16365: [SPARK-18950][SQL] Report conflicting fields when mergin...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16365 **[Test build #77970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77970/testReport)** for PR 16365 at commit [`9bc9f8a`](https://github.com/apache/spark/commit/9b

[GitHub] spark pull request #16877: [WIP] [SPARK-19538] Explicitly tell the DAGSchedu...

2017-06-12 Thread kayousterhout
Github user kayousterhout closed the pull request at: https://github.com/apache/spark/pull/16877 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #16365: [SPARK-18950][SQL] Report conflicting fields when mergin...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16365 @bravo-zhang Sorry for the late response. Could you please also add a test case for capturing the new error message? --- If your project is set up for it, you can reply to this email and have yo

[GitHub] spark pull request #18262: [SPARK-21045][PYSPARK]Fixed executor blocked beca...

2017-06-12 Thread dataknocker
Github user dataknocker commented on a diff in the pull request: https://github.com/apache/spark/pull/18262#discussion_r121590988 --- Diff: python/pyspark/worker.py --- @@ -177,8 +177,13 @@ def process(): process() except Exception: try: +

[GitHub] spark pull request #16365: [SPARK-18950][SQL] Report conflicting fields when...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16365#discussion_r121590984 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala --- @@ -469,9 +469,16 @@ object StructType extends AbstractDataType {

[GitHub] spark issue #16365: [SPARK-18950][SQL] Report conflicting fields when mergin...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16365 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16995: [SPARK-19340][SQL] CSV file will result in an exception ...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16995 Since this could cause the behavior change, how about we first close this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16766 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16766 Sorry for the late reply. @mariusvniekerk Could you please update the PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #18268: [SPARK-21054] [SQL] Reset Command support reset s...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18268#discussion_r121590269 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scala --- @@ -146,6 +162,22 @@ class SQLConfSuite extends QueryTest with Sh

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #77968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77968/testReport)** for PR 15178 at commit [`59d96d7`](https://github.com/apache/spark/commit/59

[GitHub] spark pull request #18277: [SPARK-20947][PYTHON] Fix encoding/decoding error...

2017-06-12 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18277#discussion_r121589809 --- Diff: python/pyspark/rdd.py --- @@ -751,7 +751,7 @@ def func(iterator): def pipe_objs(out): for obj in it

[GitHub] spark pull request #18268: [SPARK-21054] [SQL] Reset Command support reset s...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18268#discussion_r121588954 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -86,7 +86,12 @@ class SparkSqlAstBuilder(conf: SQLConf) exte

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77967/ Test FAILed. ---

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #77967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77967/testReport)** for PR 15178 at commit [`4b31c7e`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #77967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77967/testReport)** for PR 15178 at commit [`4b31c7e`](https://github.com/apache/spark/commit/4b

[GitHub] spark issue #18238: [SPARK-21016][core]Improve code fault tolerance for conv...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18238 **[Test build #77966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77966/testReport)** for PR 18238 at commit [`c09eaa1`](https://github.com/apache/spark/commit/c0

[GitHub] spark issue #18262: [SPARK-21045][PYSPARK]Fixed executor blocked because tra...

2017-06-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18262 Also, I think we need a small test to check if it really fixes the problem. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark issue #18258: [SPARK-21051][SQL] Add hash map metrics to aggregate

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18258 LGTM pending Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18238: [SPARK-21016][core]Improve code fault tolerance for conv...

2017-06-12 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/18238 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #18262: [SPARK-21045][PYSPARK]Fixed executor blocked beca...

2017-06-12 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18262#discussion_r121586590 --- Diff: python/pyspark/worker.py --- @@ -177,8 +177,13 @@ def process(): process() except Exception: try: +

[GitHub] spark pull request #18268: [SPARK-21054] [SQL] Reset Command support reset s...

2017-06-12 Thread ericsahit
Github user ericsahit commented on a diff in the pull request: https://github.com/apache/spark/pull/18268#discussion_r121586370 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -86,7 +86,12 @@ class SparkSqlAstBuilder(conf: SQLConf) exten

[GitHub] spark issue #18268: [SPARK-21054] [SQL] Reset Command support reset specific...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18268 **[Test build #77965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77965/testReport)** for PR 18268 at commit [`9f29f7b`](https://github.com/apache/spark/commit/9f

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #77963 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77963/testReport)** for PR 15178 at commit [`34a49d5`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77963/ Test FAILed. ---

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15178 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18259: [SPARK-21006][TESTS][FOLLOW-UP]Some Worker's RpcEnv is l...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18259 **[Test build #77964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77964/testReport)** for PR 18259 at commit [`4787b9b`](https://github.com/apache/spark/commit/47

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17222 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15178: [SPARK-17556][SQL] Executor side broadcast for broadcast...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15178 **[Test build #77963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77963/testReport)** for PR 15178 at commit [`34a49d5`](https://github.com/apache/spark/commit/34

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17222 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77962/ Test FAILed. ---

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17222 **[Test build #77962 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77962/testReport)** for PR 17222 at commit [`c020cb4`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14783: SPARK-16785 R dapply doesn't return array or raw columns

2017-06-12 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14783 @catlain could you please open a JIRA. like this, set component to SparkR https://issues.apache.org/jira/browse/SPARK-21068?filter=12333531 --- If your project is set up for it, you can re

[GitHub] spark issue #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-06-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18075 @cloud-fan can you have a time to look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark issue #18284: [SPARK-21072][SQL] `TreeNode.mapChildren` should only ap...

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18284 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #18284: [SPARK-21072] `TreeNode.mapChildren` should only apply t...

2017-06-12 Thread ConeyLiu
Github user ConeyLiu commented on the issue: https://github.com/apache/spark/pull/18284 @cloud-fan Would you mind take a look? Thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request #18284: [SPARK-21072] `TreeNode.mapChildren` should only ...

2017-06-12 Thread ConeyLiu
GitHub user ConeyLiu opened a pull request: https://github.com/apache/spark/pull/18284 [SPARK-21072] `TreeNode.mapChildren` should only apply to the children node. ## What changes were proposed in this pull request? Just as the function name and comments of `TreeNode.mapChil

[GitHub] spark pull request #18283: [TEST][SPARKR][CORE] Fix broken SparkSubmitSuite

2017-06-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18283 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18283: [TEST][SPARKR][CORE] Fix broken SparkSubmitSuite

2017-06-12 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18283 merged to master/2.2 like the other PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18283: [TEST][SPARKR][CORE] Fix broken SparkSubmitSuite

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18283 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18283: [TEST][SPARKR][CORE] Fix broken SparkSubmitSuite

2017-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18283 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77960/ Test PASSed. ---

[GitHub] spark issue #18271: [MINOR][DOCS] Improve Running R Tests docs

2017-06-12 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18271 the list is on https://github.com/apache/spark/blob/master/R/pkg/DESCRIPTION#L20 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18283: [TEST][SPARKR][CORE] Fix broken SparkSubmitSuite

2017-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18283 **[Test build #77960 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77960/testReport)** for PR 18283 at commit [`17b598b`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #18271: [MINOR][DOCS] Improve Running R Tests docs

2017-06-12 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18271#discussion_r121582955 --- Diff: docs/building-spark.md --- @@ -218,9 +218,11 @@ The run-tests script also can be limited to a specific Python version or a speci ##

[GitHub] spark issue #18084: [SPARK-19900][core]Remove driver when relaunching.

2017-06-12 Thread liyichao
Github user liyichao commented on the issue: https://github.com/apache/spark/pull/18084 OK, another scenario: * driver with driverId1 started on worker1 * worker1 lost * master add driverId1 to waitingDrivers * worker1 reconnects and sends DriverStateChanged(driverI

[GitHub] spark issue #15240: [SPARK-17556] [CORE] [SQL] Executor side broadcast for b...

2017-06-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15240 @jiangxb1987 there's another solution to this JIRA at #15178. You can also take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request #17251: [SPARK-19910][SQL] `stack` should not reject NULL...

2017-06-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17251 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #18261: [SPARK-21045][PYSPARK] Fixed executor blocked bec...

2017-06-12 Thread dataknocker
Github user dataknocker closed the pull request at: https://github.com/apache/spark/pull/18261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17251 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #18261: [SPARK-21045][PYSPARK] Fixed executor blocked bec...

2017-06-12 Thread dataknocker
Github user dataknocker commented on a diff in the pull request: https://github.com/apache/spark/pull/18261#discussion_r121579335 --- Diff: python/pyspark/worker.py --- @@ -178,7 +178,7 @@ def process(): except Exception: try: write_int(Special

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-06-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17251 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

  1   2   3   4   5   >