[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as day-time interval types

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse multiple unit fields interval literals as day-time interval types (was: Pars

[jira] [Updated] (SPARK-568) Document configuration options

2021-06-15 Thread Louella Martin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Louella Martin updated SPARK-568: - Attachment: results.xsl > Document configuration options > -- > >

[jira] [Created] (SPARK-35764) Assign pretty names to TimestampWithoutTZType

2021-06-15 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35764: -- Summary: Assign pretty names to TimestampWithoutTZType Key: SPARK-35764 URL: https://issues.apache.org/jira/browse/SPARK-35764 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35764) Assign pretty names to TimestampWithoutTZType

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35764: Assignee: (was: Apache Spark) > Assign pretty names to TimestampWithoutTZType > -

[jira] [Assigned] (SPARK-35764) Assign pretty names to TimestampWithoutTZType

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35764: Assignee: Apache Spark > Assign pretty names to TimestampWithoutTZType >

[jira] [Commented] (SPARK-35764) Assign pretty names to TimestampWithoutTZType

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363443#comment-17363443 ] Apache Spark commented on SPARK-35764: -- User 'gengliangwang' has created a pull req

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Summary: Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x (was:

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Affects Version/s: 3.2.0 > Update the document about building Spark with Hadoop for Hadoop 2

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Component/s: (was: Spark Core) docs > Update the document about buildin

[jira] [Assigned] (SPARK-35064) Group exception messages in spark/sql (catalyst)

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35064: Assignee: (was: Apache Spark) > Group exception messages in spark/sql (catalyst) > --

[jira] [Assigned] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35758: Assignee: (was: Apache Spark) > Update the document about building Spark with Hadoop

[jira] [Commented] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363455#comment-17363455 ] Apache Spark commented on SPARK-35758: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-35064) Group exception messages in spark/sql (catalyst)

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363454#comment-17363454 ] Apache Spark commented on SPARK-35064: -- User 'dgd-contributor' has created a pull r

[jira] [Assigned] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35758: Assignee: Apache Spark > Update the document about building Spark with Hadoop for Hadoop

[jira] [Assigned] (SPARK-35064) Group exception messages in spark/sql (catalyst)

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35064: Assignee: Apache Spark > Group exception messages in spark/sql (catalyst) > -

[jira] [Assigned] (SPARK-35742) Expression.semanticEquals should be symmetrical

2021-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35742: --- Assignee: Wenchen Fan > Expression.semanticEquals should be symmetrical > -

[jira] [Resolved] (SPARK-35742) Expression.semanticEquals should be symmetrical

2021-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35742. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32885 [https://gith

[jira] [Resolved] (SPARK-35764) Assign pretty names to TimestampWithoutTZType

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35764. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32915 [https://github.com

[jira] [Assigned] (SPARK-35764) Assign pretty names to TimestampWithoutTZType

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35764: Assignee: Gengliang Wang > Assign pretty names to TimestampWithoutTZType > --

[jira] [Updated] (SPARK-35756) unionByName should support nested struct also

2021-06-15 Thread Wassim Almaaoui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wassim Almaaoui updated SPARK-35756: Description: It would be cool if `unionByName` supports also nested struct. I don't kwon i

[jira] [Resolved] (SPARK-35056) Group exception messages in execution/streaming

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35056. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32880 [https://github.com

[jira] [Assigned] (SPARK-35056) Group exception messages in execution/streaming

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35056: Assignee: jiaan.geng > Group exception messages in execution/streaming >

[jira] [Commented] (SPARK-35065) Group exception messages in spark/sql (core)

2021-06-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363525#comment-17363525 ] jiaan.geng commented on SPARK-35065: I'm working on. > Group exception messages in

[jira] [Commented] (SPARK-33603) Group exception messages in execution/command

2021-06-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363530#comment-17363530 ] jiaan.geng commented on SPARK-33603: [~pingsutw] When you to fix this issue? > Grou

[jira] [Comment Edited] (SPARK-33603) Group exception messages in execution/command

2021-06-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363530#comment-17363530 ] jiaan.geng edited comment on SPARK-33603 at 6/15/21, 10:29 AM: ---

[jira] [Assigned] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35758: Assignee: Kousuke Saruta > Update the document about building Spark with Hadoop for Hadoo

[jira] [Resolved] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35758. -- Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-35765) Distinct aggs are not duplicate sensitive

2021-06-15 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-35765: -- Summary: Distinct aggs are not duplicate sensitive Key: SPARK-35765 URL: https://issues.apache.org/jira/browse/SPARK-35765 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-35765) Distinct aggs are not duplicate sensitive

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35765: Assignee: Apache Spark > Distinct aggs are not duplicate sensitive >

[jira] [Assigned] (SPARK-35765) Distinct aggs are not duplicate sensitive

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35765: Assignee: (was: Apache Spark) > Distinct aggs are not duplicate sensitive > -

[jira] [Commented] (SPARK-35765) Distinct aggs are not duplicate sensitive

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363589#comment-17363589 ] Apache Spark commented on SPARK-35765: -- User 'tanelk' has created a pull request fo

[jira] [Commented] (SPARK-35765) Distinct aggs are not duplicate sensitive

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363590#comment-17363590 ] Apache Spark commented on SPARK-35765: -- User 'tanelk' has created a pull request fo

[jira] [Commented] (SPARK-35622) DataFrame's count function do not need groupBy and avoid shuffle

2021-06-15 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363605#comment-17363605 ] xiepengjie commented on SPARK-35622: [~hyukjin.kwon] [~dc-heros], Sorry, I was on va

[jira] [Assigned] (SPARK-35765) Distinct aggs are not duplicate sensitive

2021-06-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35765: Assignee: Tanel Kiis > Distinct aggs are not duplicate sensitive > --

[jira] [Resolved] (SPARK-35765) Distinct aggs are not duplicate sensitive

2021-06-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35765. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32904 [https://gi

[jira] [Commented] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

2021-06-15 Thread Domagoj (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363657#comment-17363657 ] Domagoj commented on SPARK-35089: - I can create similar solution with creating snapshot

[jira] [Resolved] (SPARK-35722) wait until something does get queued

2021-06-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35722. -- Fix Version/s: (was: 3.2.0) Resolution: Not A Problem > wait until something does g

[jira] [Created] (SPARK-35766) Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35766: -- Summary: Break down CastSuite/AnsiCastSuite into multiple files Key: SPARK-35766 URL: https://issues.apache.org/jira/browse/SPARK-35766 Project: Spark Is

[jira] [Updated] (SPARK-35766) Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35766: --- Priority: Minor (was: Major) > Break down CastSuite/AnsiCastSuite into multiple files > ---

[jira] [Assigned] (SPARK-35766) Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35766: Assignee: Apache Spark (was: Gengliang Wang) > Break down CastSuite/AnsiCastSuite into m

[jira] [Assigned] (SPARK-35766) Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35766: Assignee: Gengliang Wang (was: Apache Spark) > Break down CastSuite/AnsiCastSuite into m

[jira] [Commented] (SPARK-35766) Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363682#comment-17363682 ] Apache Spark commented on SPARK-35766: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-35378) Eagerly execute commands in QueryExecution instead of caller sides

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363730#comment-17363730 ] Apache Spark commented on SPARK-35378: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-35767) [SQL] CoalesceExec can execute child plan twice

2021-06-15 Thread Andy Grove (Jira)
Andy Grove created SPARK-35767: -- Summary: [SQL] CoalesceExec can execute child plan twice Key: SPARK-35767 URL: https://issues.apache.org/jira/browse/SPARK-35767 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-35767) [SQL] CoalesceExec can execute child plan twice

2021-06-15 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-35767: --- Priority: Minor (was: Major) > [SQL] CoalesceExec can execute child plan twice > --

[jira] [Resolved] (SPARK-35766) Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35766. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32918 [https:

[jira] [Assigned] (SPARK-35129) Construct year-month interval column from integral fields

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35129: Assignee: angerszhu > Construct year-month interval column from integral fields > ---

[jira] [Resolved] (SPARK-35129) Construct year-month interval column from integral fields

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35129. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32645 [https://github.com

[jira] [Commented] (SPARK-35767) [SQL] CoalesceExec can execute child plan twice

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363756#comment-17363756 ] Apache Spark commented on SPARK-35767: -- User 'andygrove' has created a pull request

[jira] [Assigned] (SPARK-35767) [SQL] CoalesceExec can execute child plan twice

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35767: Assignee: Apache Spark > [SQL] CoalesceExec can execute child plan twice > --

[jira] [Assigned] (SPARK-35767) [SQL] CoalesceExec can execute child plan twice

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35767: Assignee: (was: Apache Spark) > [SQL] CoalesceExec can execute child plan twice > ---

[jira] [Updated] (SPARK-35768) Take into account year-month interval fields in cast

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35768: - Description: Take into account year-month interval fields in casts of input values (strings for example)

[jira] [Created] (SPARK-35768) Take into account year-month interval fields in cast

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35768: Summary: Take into account year-month interval fields in cast Key: SPARK-35768 URL: https://issues.apache.org/jira/browse/SPARK-35768 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-35769) Truncate java.time.Period by fields of year-month interval type

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35769: Summary: Truncate java.time.Period by fields of year-month interval type Key: SPARK-35769 URL: https://issues.apache.org/jira/browse/SPARK-35769 Project: Spark Issu

[jira] [Updated] (SPARK-35769) Truncate java.time.Period by fields of year-month interval type

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35769: - Description: Truncate input java.time.Period instances using fields of YearMonthIntervalType. For exampl

[jira] [Created] (SPARK-35770) Parse YearMonthIntervalType from JSON

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35770: Summary: Parse YearMonthIntervalType from JSON Key: SPARK-35770 URL: https://issues.apache.org/jira/browse/SPARK-35770 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35770) Parse YearMonthIntervalType from JSON

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35770: - Description: Allow (de-)serialization of the YearMonthIntervalType class to JSON. See DataType.parseData

[jira] [Created] (SPARK-35771) Format year-month intervals using type fields

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35771: Summary: Format year-month intervals using type fields Key: SPARK-35771 URL: https://issues.apache.org/jira/browse/SPARK-35771 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35771) Format year-month intervals using type fields

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35771: - Description: Format year-month interval to strings using the start and end fields of YearMonthIntervalTy

[jira] [Created] (SPARK-35772) Check all year-month interval types in HiveInspectors tests

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35772: Summary: Check all year-month interval types in HiveInspectors tests Key: SPARK-35772 URL: https://issues.apache.org/jira/browse/SPARK-35772 Project: Spark Issue Ty

[jira] [Updated] (SPARK-35772) Check all year-month interval types in HiveInspectors tests

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35772: - Description: Check all year-month interval types are supported by HiveInspectors: # INTERVAL YEAR # INTE

[jira] [Created] (SPARK-35773) Parse year-month interval literals to tightest types

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35773: Summary: Parse year-month interval literals to tightest types Key: SPARK-35773 URL: https://issues.apache.org/jira/browse/SPARK-35773 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-35773) Parse year-month interval literals to tightest types

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35773: - Description: Modify AstBuilder.visitInterval to parse year-month interval literals to tightest types. F

[jira] [Updated] (SPARK-35774) Parse any year-month interval types in SQL

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35774: - Description: Extend the parser rules to be able to parse the following types: # INTERVAL YEAR # INTERVAL

[jira] [Created] (SPARK-35774) Parse any year-month interval types in SQL

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35774: Summary: Parse any year-month interval types in SQL Key: SPARK-35774 URL: https://issues.apache.org/jira/browse/SPARK-35774 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-35775) Check all year-month interval types in aggregate expressions

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35775: Summary: Check all year-month interval types in aggregate expressions Key: SPARK-35775 URL: https://issues.apache.org/jira/browse/SPARK-35775 Project: Spark Issue T

[jira] [Updated] (SPARK-35775) Check all year-month interval types in aggregate expressions

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35775: - Description: Check all supported combination of YearMonthIntervalType fields in the aggregate expression

[jira] [Created] (SPARK-35776) Check all year-month interval types in arrow

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35776: Summary: Check all year-month interval types in arrow Key: SPARK-35776 URL: https://issues.apache.org/jira/browse/SPARK-35776 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35776) Check all year-month interval types in arrow

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35776: - Description: Add tests to check that all year-month interval types are supported in (de-)serialization f

[jira] [Created] (SPARK-35777) Check all year-month interval types in UDF

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35777: Summary: Check all year-month interval types in UDF Key: SPARK-35777 URL: https://issues.apache.org/jira/browse/SPARK-35777 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35777) Check all year-month interval types in UDF

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35777: - Description: Check all year-month interval types in UDF: # INTERVAL YEAR # INTERVAL YEAR TO MONTH # INTE

[jira] [Updated] (SPARK-35778) Check multiply/divide of year-month intervals of any fields by numeric

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35778: - Description: Write tests that checks multiply/divide of the following intervals by numeric: # INTERVAL Y

[jira] [Created] (SPARK-35778) Check multiply/divide of year-month intervals of any fields by numeric

2021-06-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-35778: Summary: Check multiply/divide of year-month intervals of any fields by numeric Key: SPARK-35778 URL: https://issues.apache.org/jira/browse/SPARK-35778 Project: Spark

[jira] [Resolved] (SPARK-34847) Simplify ResolveAggregateFunctions

2021-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34847. - Resolution: Duplicate > Simplify ResolveAggregateFunctions > --

[jira] [Updated] (SPARK-35767) [SQL] CoalesceExec can execute child plan twice

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35767: -- Affects Version/s: 3.2.0 > [SQL] CoalesceExec can execute child plan twice > -

[jira] [Updated] (SPARK-35767) CoalesceExec can execute child plan twice

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35767: -- Summary: CoalesceExec can execute child plan twice (was: [SQL] CoalesceExec can execute child

[jira] [Resolved] (SPARK-35767) CoalesceExec can execute child plan twice

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35767. --- Fix Version/s: 3.1.3 3.2.0 3.0.3 Assignee: And

[jira] [Updated] (SPARK-35767) CoalesceExec can execute child plan twice

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35767: -- Affects Version/s: 2.3.0 2.3.4 2.4.0

[jira] [Resolved] (SPARK-35680) Support fields by year-month interval type

2021-06-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35680. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32909 [https://github.com

[jira] [Created] (SPARK-35779) Support dynamic filtering for v2 tables

2021-06-15 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-35779: Summary: Support dynamic filtering for v2 tables Key: SPARK-35779 URL: https://issues.apache.org/jira/browse/SPARK-35779 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-35344) Make conversion from/to literals data-type-based

2021-06-15 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363906#comment-17363906 ] Xinrong Meng commented on SPARK-35344: -- I'd like to work on this ticket. > Make co

[jira] [Updated] (SPARK-35344) Make conversion from/to literals data-type-based

2021-06-15 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35344: - Description: Aim to achieve {{F}}{{*.*}}{{lit(np}}{{*.*}}{{int64(1)).}} We can define {{def lit

[jira] [Assigned] (SPARK-35779) Support dynamic filtering for v2 tables

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35779: Assignee: Apache Spark > Support dynamic filtering for v2 tables > --

[jira] [Commented] (SPARK-35779) Support dynamic filtering for v2 tables

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363919#comment-17363919 ] Apache Spark commented on SPARK-35779: -- User 'aokolnychyi' has created a pull reque

[jira] [Assigned] (SPARK-35779) Support dynamic filtering for v2 tables

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35779: Assignee: (was: Apache Spark) > Support dynamic filtering for v2 tables > ---

[jira] [Commented] (SPARK-35779) Support dynamic filtering for v2 tables

2021-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363920#comment-17363920 ] Apache Spark commented on SPARK-35779: -- User 'aokolnychyi' has created a pull reque

[jira] [Assigned] (SPARK-35429) Remove commons-httpclient due to EOL and CVEs

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35429: - Assignee: Sumeet > Remove commons-httpclient due to EOL and CVEs >

[jira] [Updated] (SPARK-35429) Remove commons-httpclient due to EOL and CVEs

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35429: -- Fix Version/s: 3.2.0 > Remove commons-httpclient due to EOL and CVEs > ---

[jira] [Commented] (SPARK-35429) Remove commons-httpclient due to EOL and CVEs

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363922#comment-17363922 ] Dongjoon Hyun commented on SPARK-35429: --- This is resolved via https://github.com/a

[jira] [Commented] (SPARK-34403) Remove dependency to commons-httpclient, is not used and has vulnerabilities.

2021-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363924#comment-17363924 ] Dongjoon Hyun commented on SPARK-34403: --- This is partially resolved via SPARK-3542

[jira] [Resolved] (SPARK-35760) Fix the max rows check for broadcast exchange

2021-06-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35760. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-35691) addFile/addJar/addDirectory should put CanonicalFile

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35691. Fix Version/s: 3.2.0 Assignee: Kevin Su Resolution: Fixed Issue resolved i

[jira] [Updated] (SPARK-35669) fix special char in CSV header with filter pushdown

2021-06-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35669: - Description: This is a followup of [#31964|https://github.com/apache/spark/pull/31964]

[jira] [Resolved] (SPARK-35669) fix special char in CSV header with filter pushdown

2021-06-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35669. -- Fix Version/s: 3.2.0 Assignee: Wenchen Fan Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-35666) add new gemv to skip array shape checking

2021-06-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-35666. -- Assignee: zhengruifeng Resolution: Resolved > add new gemv to skip array shape checking

[jira] [Resolved] (SPARK-35707) optimize sparse GEMM by skipping bound checking

2021-06-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-35707. -- Assignee: zhengruifeng Resolution: Resolved > optimize sparse GEMM by skipping bound che

[jira] [Updated] (SPARK-35707) optimize sparse GEMM by skipping bound checking

2021-06-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-35707: - Affects Version/s: (was: 3.1.3) (was: 3.0.3) > optimize sparse GE

[jira] [Resolved] (SPARK-35203) Improve Repartition statistics estimation

2021-06-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35203. -- Fix Version/s: 3.2.0 Assignee: Yuming Wang Resolution: Fixed Resolved

[jira] [Created] (SPARK-35780) Support DATE/TIMESTAMP literals across the full range

2021-06-15 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-35780: --- Summary: Support DATE/TIMESTAMP literals across the full range Key: SPARK-35780 URL: https://issues.apache.org/jira/browse/SPARK-35780 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-35613) Cache commonly occurring strings from SQLMetrics, JsonProtocol and AccumulatorV2

2021-06-15 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-35613: --- Assignee: Venkata krishnan Sowrirajan > Cache commonly occurring strings fr

  1   2   >