[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

2021-01-31 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Description: Problem: Currently when using 'Dataset.union.distinct.union.distinct' to union

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

2021-01-31 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Summary: Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.u

[jira] [Commented] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274135#comment-17274135 ] Zhichao Zhang commented on SPARK-34283: I will handle this issue > Combines al

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Description: Problem: Currently when using 'Dataset.union.distinct' to union some datasets,

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Description: Problem: Currently when using 'Dataset.union.distinct' to union some datasets,

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Description: Problem: Currently when using 'Dataset.union.distinct' to union some datasets,

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Description: Problem: Currently when using 'Dataset.union.distinct' to union some datasets,

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Attachment: image-2021-01-29-11-14-42-700.png > Combines all adjacent 'Union' operators into

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Attachment: image-2021-01-29-11-14-08-822.png > Combines all adjacent 'Union' operators into

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Attachment: image-2021-01-29-11-13-42-055.png > Combines all adjacent 'Union' operators into

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Attachment: image-2021-01-29-11-12-44-112.png > Combines all adjacent 'Union' operators into

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Summary: Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.u

[jira] [Updated] (SPARK-34283) all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Description: Problem: Currently when using 'Dataset.union.distinct' to union some datasets,

[jira] [Updated] (SPARK-34283) all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

2021-01-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Summary: all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.dist

[jira] [Created] (SPARK-34283) Combine 'Deduplicate(columns, Union)' operators into a single union

2021-01-28 Thread Zhichao Zhang (Jira)
Zhichao Zhang created SPARK-34283: -- Summary: Combine 'Deduplicate(columns, Union)' operators into a single union Key: SPARK-34283 URL: https://issues.apache.org/jira/browse/SPARK-34283 Project: Spar

[jira] [Updated] (SPARK-27643) Add supported Hive version list in doc

2019-05-06 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-27643: --- Description: Add supported Hive version list for each spark version in doc. (was: Add suppo

[jira] [Created] (SPARK-27643) Add supported Hive version in doc

2019-05-06 Thread Zhichao Zhang (JIRA)
Zhichao Zhang created SPARK-27643: -- Summary: Add supported Hive version in doc Key: SPARK-27643 URL: https://issues.apache.org/jira/browse/SPARK-27643 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-27643) Add supported Hive version list in doc

2019-05-06 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-27643: --- Summary: Add supported Hive version list in doc (was: Add supported Hive version in doc) >

[jira] [Resolved] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-09-05 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved SPARK-25279. Resolution: Won't Fix > Throw exception: zzcclp java.io.NotSerializableException: > org

[jira] [Closed] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-09-05 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang closed SPARK-25279. -- > Throw exception: zzcclp java.io.NotSerializableException: > org.apache.spark.sql.TypedColumn

[jira] [Commented] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-09-05 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604604#comment-16604604 ] Zhichao Zhang commented on SPARK-25279: [~viirya], Thanks. I closed this issue.

[jira] [Comment Edited] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-09-03 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602308#comment-16602308 ] Zhichao Zhang edited comment on SPARK-25279 at 9/3/18 4:12 PM: --

[jira] [Commented] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-09-03 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602308#comment-16602308 ] Zhichao Zhang commented on SPARK-25279: [~dkbiswal], I followed your steps to r

[jira] [Commented] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-09-01 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599574#comment-16599574 ] Zhichao Zhang commented on SPARK-25279: [~dkbiswal], thank you. you mean that u

[jira] [Created] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-08-30 Thread Zhichao Zhang (JIRA)
Zhichao Zhang created SPARK-25279: -- Summary: Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc Key: SPARK-25279 URL: https://iss

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15158471#comment-15158471 ] Zhichao Zhang commented on SPARK-13431: I can't build it with sbt because downlo

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15158429#comment-15158429 ] Zhichao Zhang commented on SPARK-13431: I meet the same problem with maven, how

[jira] [Commented] (SPARK-12260) Graceful Shutdown with In-Memory State

2016-01-25 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116487#comment-15116487 ] Zhichao Zhang commented on SPARK-12260: [~srowen], thanks for your reply. Are th

[jira] [Commented] (SPARK-12260) Graceful Shutdown with In-Memory State

2016-01-25 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114966#comment-15114966 ] Zhichao Zhang commented on SPARK-12260: Hi, [~mwws], why this issue is closed, i

[jira] [Commented] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-04-22 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508271#comment-14508271 ] Zhichao Zhang commented on SPARK-5206: --- [~tdas], thanks for your reply. Looking for

[jira] [Comment Edited] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-04-22 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507322#comment-14507322 ] Zhichao Zhang edited comment on SPARK-5206 at 4/22/15 4:23 PM:

[jira] [Comment Edited] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-04-22 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507322#comment-14507322 ] Zhichao Zhang edited comment on SPARK-5206 at 4/22/15 4:10 PM:

[jira] [Commented] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-04-22 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507322#comment-14507322 ] Zhichao Zhang commented on SPARK-5206: --- according to the way what you said, it word

[jira] [Commented] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-04-22 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506770#comment-14506770 ] Zhichao Zhang commented on SPARK-5206: --- [~tdas], thanks for you advice. there are s

[jira] [Commented] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-04-21 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506272#comment-14506272 ] Zhichao Zhang commented on SPARK-5206: --- how to solve this, no progress yet? > Accu

[jira] [Commented] (SPARK-6930) Build with Hive Thrift Server error, because of missing guava

2015-04-15 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495939#comment-14495939 ] Zhichao Zhang commented on SPARK-6930: --- Sorry, My mistake > Build with Hive Thrift

[jira] [Created] (SPARK-6930) Build with Hive Thrift Server error, because of missing guava

2015-04-15 Thread Zhichao Zhang (JIRA)
Zhichao Zhang created SPARK-6930: - Summary: Build with Hive Thrift Server error, because of missing guava Key: SPARK-6930 URL: https://issues.apache.org/jira/browse/SPARK-6930 Project: Spark

[jira] [Closed] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang closed SPARK-6547. - Resolution: Duplicate It is duplicate [SPARK-6546](https://issues.apache.org/jira/browse/SPARK-654

[jira] [Updated] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-25 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-6547: -- Description: missing import Files, build error as follows: {quote} [error] /opt/spark-master/sq

[jira] [Updated] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-25 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-6547: -- Description: missing import Files, build error as follows: {quote} [error] /opt/spark-master/sq

[jira] [Created] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-25 Thread Zhichao Zhang (JIRA)
Zhichao Zhang created SPARK-6547: - Summary: Missing import Files in InsertIntoHiveTableSuite.scala Key: SPARK-6547 URL: https://issues.apache.org/jira/browse/SPARK-6547 Project: Spark Issue