[jira] [Commented] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236582#comment-17236582 ] Apache Spark commented on SPARK-28704: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236583#comment-17236583 ] Apache Spark commented on SPARK-28704: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236578#comment-17236578 ] Hyukjin Kwon commented on SPARK-21187: -- Awesome [~bryanc]. It was a super super long task :-). >

[jira] [Assigned] (SPARK-33505) Fix insert into `InMemoryPartitionTable`

[ https://issues.apache.org/jira/browse/SPARK-33505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33505: - Assignee: Maxim Gekk > Fix insert into `InMemoryPartitionTable` >

[jira] [Resolved] (SPARK-33505) Fix insert into `InMemoryPartitionTable`

[ https://issues.apache.org/jira/browse/SPARK-33505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33505. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30449

[jira] [Commented] (SPARK-33506) t 130038ERROR ContextCleaner:91 - Error cleaning broadcast

[ https://issues.apache.org/jira/browse/SPARK-33506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236534#comment-17236534 ] Takeshi Yamamuro commented on SPARK-33506: -- I think the description is not enough to reproduce

[jira] [Commented] (SPARK-33507) Improve and fix cache behavior in v1 and v2

[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236521#comment-17236521 ] Chao Sun commented on SPARK-33507: -- [~dongjoon] Yes this is for Spark 3.1 _mostly_ (some JIRAs are in

[jira] [Commented] (SPARK-33507) Improve and fix cache behavior in v1 and v2

[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236515#comment-17236515 ] Dongjoon Hyun commented on SPARK-33507: --- BTW, are you targeting this on Apache Spark 3.1? >

[jira] [Commented] (SPARK-33507) Improve and fix cache behavior in v1 and v2

[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236512#comment-17236512 ] Dongjoon Hyun commented on SPARK-33507: --- Thank you for working on this area, [~csun]. This looks

[jira] [Assigned] (SPARK-33507) Improve and fix cache behavior in v1 and v2

[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33507: - Assignee: Chao Sun > Improve and fix cache behavior in v1 and v2 >

[jira] [Resolved] (SPARK-32670) Group exception messages in Catalyst Analyzer in one file

[ https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32670. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29497

[jira] [Updated] (SPARK-33507) Improve and fix cache behavior in v1 and v2

[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33507: - Description: This is an umbrella JIRA to track fixes & improvements for caching behavior in Spark

[jira] [Updated] (SPARK-33305) DSv2: DROP TABLE command should also invalidate cache

[ https://issues.apache.org/jira/browse/SPARK-33305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33305: - Parent: (was: SPARK-33392) Issue Type: Bug (was: Sub-task) > DSv2: DROP TABLE command

[jira] [Updated] (SPARK-33290) REFRESH TABLE should invalidate cache even though the table itself may not be cached

[ https://issues.apache.org/jira/browse/SPARK-33290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33290: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > REFRESH TABLE should invalidate cache

[jira] [Updated] (SPARK-33305) DSv2: DROP TABLE command should also invalidate cache

[ https://issues.apache.org/jira/browse/SPARK-33305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33305: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > DSv2: DROP TABLE command should also

[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33435: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > DSv2: REFRESH TABLE should invalidate

[jira] [Updated] (SPARK-33492) DSv2: Append/Overwrite/ReplaceTable should invalidate cache

[ https://issues.apache.org/jira/browse/SPARK-33492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33492: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > DSv2: Append/Overwrite/ReplaceTable

[jira] [Created] (SPARK-33507) Improve and fix cache behavior in v1 and v2

Chao Sun created SPARK-33507: Summary: Improve and fix cache behavior in v1 and v2 Key: SPARK-33507 URL: https://issues.apache.org/jira/browse/SPARK-33507 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33492) DSv2: Append/Overwrite/ReplaceTable should invalidate cache

[ https://issues.apache.org/jira/browse/SPARK-33492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33492: -- Fix Version/s: (was: 3.2.0) 3.1.0 > DSv2:

[jira] [Resolved] (SPARK-33492) DSv2: Append/Overwrite/ReplaceTable should invalidate cache

[ https://issues.apache.org/jira/browse/SPARK-33492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33492. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30429

[jira] [Assigned] (SPARK-33492) DSv2: Append/Overwrite/ReplaceTable should invalidate cache

[ https://issues.apache.org/jira/browse/SPARK-33492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33492: - Assignee: Chao Sun > DSv2: Append/Overwrite/ReplaceTable should invalidate cache >

[jira] [Created] (SPARK-33506) t 130038ERROR ContextCleaner:91 - Error cleaning broadcast

amit sharma created SPARK-33506: --- Summary: t 130038ERROR ContextCleaner:91 - Error cleaning broadcast Key: SPARK-33506 URL: https://issues.apache.org/jira/browse/SPARK-33506 Project: Spark

[jira] [Commented] (SPARK-25316) Spark error - ERROR ContextCleaner: Error cleaning broadcast 22, Exception thrown in awaitResult:

[ https://issues.apache.org/jira/browse/SPARK-25316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236473#comment-17236473 ] amit sharma commented on SPARK-25316: - I am using spark 2.3.3  with 16 workers with 30 cores each. I

[jira] [Reopened] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reopened SPARK-33185: - > YARN: Print direct links to driver logs alongside application report in > cluster mode >

[jira] [Assigned] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33185: Assignee: Apache Spark (was: Erik Krogen) > YARN: Print direct links to driver logs

[jira] [Assigned] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33185: Assignee: Erik Krogen (was: Apache Spark) > YARN: Print direct links to driver logs

[jira] [Commented] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236464#comment-17236464 ] Apache Spark commented on SPARK-33185: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Commented] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236466#comment-17236466 ] Erik Krogen commented on SPARK-33185: - I found that the existing logic doesn't work properly in

[jira] [Commented] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236465#comment-17236465 ] Apache Spark commented on SPARK-33185: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Commented] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236434#comment-17236434 ] Arwin S Tio commented on SPARK-33502: - Note, running my program with "-Xss3072k" fixed it > Large

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Resolved] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-21187. -- Fix Version/s: 3.1.0 Resolution: Fixed With MapType now added, all basic types are

[jira] [Updated] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-21187: - Description: This is to track adding the remaining type support in Arrow Converters.

[jira] [Updated] (SPARK-32285) Add PySpark support for nested timestamps with arrow

[ https://issues.apache.org/jira/browse/SPARK-32285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-32285: - Parent: (was: SPARK-21187) Issue Type: Improvement (was: Sub-task) > Add PySpark

[jira] [Resolved] (SPARK-33466) Imputer support mode(most_frequent) strategy

[ https://issues.apache.org/jira/browse/SPARK-33466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33466. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30397

[jira] [Commented] (SPARK-33505) Fix insert into `InMemoryPartitionTable`

[ https://issues.apache.org/jira/browse/SPARK-33505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236389#comment-17236389 ] Apache Spark commented on SPARK-33505: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33505) Fix insert into `InMemoryPartitionTable`

[ https://issues.apache.org/jira/browse/SPARK-33505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33505: Assignee: (was: Apache Spark) > Fix insert into `InMemoryPartitionTable` >

[jira] [Assigned] (SPARK-33505) Fix insert into `InMemoryPartitionTable`

[ https://issues.apache.org/jira/browse/SPARK-33505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33505: Assignee: Apache Spark > Fix insert into `InMemoryPartitionTable` >

[jira] [Created] (SPARK-33505) Fix insert into `InMemoryPartitionTable`

Maxim Gekk created SPARK-33505: -- Summary: Fix insert into `InMemoryPartitionTable` Key: SPARK-33505 URL: https://issues.apache.org/jira/browse/SPARK-33505 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33472: -- Fix Version/s: 2.4.8 > IllegalArgumentException when applying RemoveRedundantSorts before >

[jira] [Resolved] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33472. --- Fix Version/s: 3.1.0 3.0.2 Assignee: Allison Wang

[jira] [Assigned] (SPARK-33466) Imputer support mode(most_frequent) strategy

[ https://issues.apache.org/jira/browse/SPARK-33466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33466: Assignee: zhengruifeng > Imputer support mode(most_frequent) strategy >

[jira] [Commented] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

[ https://issues.apache.org/jira/browse/SPARK-32381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236311#comment-17236311 ] Apache Spark commented on SPARK-32381: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28704: - Assignee: angerszhu > Test backward compatibility on JDK9+ once we have a version

[jira] [Updated] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28704: -- Fix Version/s: (was: 3.2.0) 3.1.0 > Test backward compatibility on

[jira] [Resolved] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28704. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30428

[jira] [Commented] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

[ https://issues.apache.org/jira/browse/SPARK-33504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236261#comment-17236261 ] Apache Spark commented on SPARK-33504: -- User 'akiyamaneko' has created a pull request for this

[jira] [Assigned] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

[ https://issues.apache.org/jira/browse/SPARK-33504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33504: Assignee: Apache Spark > The application log in the Spark history server contains

[jira] [Assigned] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

[ https://issues.apache.org/jira/browse/SPARK-33504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33504: Assignee: (was: Apache Spark) > The application log in the Spark history server

[jira] [Updated] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

[ https://issues.apache.org/jira/browse/SPARK-33504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated SPARK-33504: Attachment: SparkListernerJobStart-wrong.png > The application log in the Spark history server

[jira] [Updated] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

[ https://issues.apache.org/jira/browse/SPARK-33504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated SPARK-33504: Attachment: SparkListenerStageSubmitted-log-wrong.png > The application log in the Spark history

[jira] [Updated] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

[ https://issues.apache.org/jira/browse/SPARK-33504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated SPARK-33504: Attachment: SparkListenerEnvironmentUpdate log shows ok.png > The application log in the Spark

[jira] [Created] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

akiyamaneko created SPARK-33504: --- Summary: The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text Key: SPARK-33504 URL:

[jira] [Assigned] (SPARK-33468) ParseUrl should fail if input string is not a valid url

[ https://issues.apache.org/jira/browse/SPARK-33468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33468: --- Assignee: ulysses you > ParseUrl should fail if input string is not a valid url >

[jira] [Resolved] (SPARK-33468) ParseUrl should fail if input string is not a valid url

[ https://issues.apache.org/jira/browse/SPARK-33468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33468. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30399

[jira] [Assigned] (SPARK-33422) Incomplete menu item display in documention

[ https://issues.apache.org/jira/browse/SPARK-33422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33422: Assignee: liucht-inspur > Incomplete menu item display in documention >

[jira] [Resolved] (SPARK-33422) Incomplete menu item display in documention

[ https://issues.apache.org/jira/browse/SPARK-33422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33422. -- Fix Version/s: 3.2.0 3.0.2 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-33422) Incomplete menu item display in documention

[ https://issues.apache.org/jira/browse/SPARK-33422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33422: - Fix Version/s: (was: 3.2.0) 3.1.0 > Incomplete menu item display in

[jira] [Commented] (SPARK-33503) Refactor SortOrder class to allow multiple childrens

[ https://issues.apache.org/jira/browse/SPARK-33503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236139#comment-17236139 ] Apache Spark commented on SPARK-33503: -- User 'prakharjain09' has created a pull request for this

[jira] [Assigned] (SPARK-33503) Refactor SortOrder class to allow multiple childrens

[ https://issues.apache.org/jira/browse/SPARK-33503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33503: Assignee: (was: Apache Spark) > Refactor SortOrder class to allow multiple childrens

[jira] [Commented] (SPARK-33503) Refactor SortOrder class to allow multiple childrens

[ https://issues.apache.org/jira/browse/SPARK-33503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236138#comment-17236138 ] Apache Spark commented on SPARK-33503: -- User 'prakharjain09' has created a pull request for this

[jira] [Assigned] (SPARK-33503) Refactor SortOrder class to allow multiple childrens

[ https://issues.apache.org/jira/browse/SPARK-33503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33503: Assignee: Apache Spark > Refactor SortOrder class to allow multiple childrens >

[jira] [Created] (SPARK-33503) Refactor SortOrder class to allow multiple childrens

Prakhar Jain created SPARK-33503: Summary: Refactor SortOrder class to allow multiple childrens Key: SPARK-33503 URL: https://issues.apache.org/jira/browse/SPARK-33503 Project: Spark Issue

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Created] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

Arwin S Tio created SPARK-33502: --- Summary: Large number of SELECT columns causes StackOverflowError Key: SPARK-33502 URL: https://issues.apache.org/jira/browse/SPARK-33502 Project: Spark Issue

[jira] [Assigned] (SPARK-32919) Add support in Spark driver to coordinate the shuffle map stage in push-based shuffle by selecting external shuffle services for merging shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-32919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-32919: --- Assignee: Venkata krishnan Sowrirajan > Add support in Spark driver to

[jira] [Resolved] (SPARK-32919) Add support in Spark driver to coordinate the shuffle map stage in push-based shuffle by selecting external shuffle services for merging shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-32919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-32919. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-33501) Encoding is not working if multiLine option is true.

[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nilesh Patil updated SPARK-33501: - Attachment: 1605860036183.csv > Encoding is not working if multiLine option is true. >

[jira] [Updated] (SPARK-33501) Encoding is not working if multiLine option is true.

[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nilesh Patil updated SPARK-33501: - Description: If we read with mulitLine true and encoding with "ISO-8859-1" then we are getting 

[jira] [Created] (SPARK-33501) Encoding is not working if multiLine option is true.

Nilesh Patil created SPARK-33501: Summary: Encoding is not working if multiLine option is true. Key: SPARK-33501 URL: https://issues.apache.org/jira/browse/SPARK-33501 Project: Spark Issue

[jira] [Commented] (SPARK-33500) Support field "EPOCH" in datetime function extract/date_part

[ https://issues.apache.org/jira/browse/SPARK-33500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236083#comment-17236083 ] Apache Spark commented on SPARK-33500: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-33500) Support field "EPOCH" in datetime function extract/date_part

[ https://issues.apache.org/jira/browse/SPARK-33500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33500: Assignee: Apache Spark (was: Gengliang Wang) > Support field "EPOCH" in datetime

[jira] [Assigned] (SPARK-33500) Support field "EPOCH" in datetime function extract/date_part

[ https://issues.apache.org/jira/browse/SPARK-33500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33500: Assignee: Gengliang Wang (was: Apache Spark) > Support field "EPOCH" in datetime

[jira] [Updated] (SPARK-33500) Support field "EPOCH" in datetime function extract/date_part

[ https://issues.apache.org/jira/browse/SPARK-33500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33500: --- Summary: Support field "EPOCH" in datetime function extract/date_part (was: Support field

[jira] [Created] (SPARK-33500) Support field "EPOCH" in function extract/date_part

Gengliang Wang created SPARK-33500: -- Summary: Support field "EPOCH" in function extract/date_part Key: SPARK-33500 URL: https://issues.apache.org/jira/browse/SPARK-33500 Project: Spark

[jira] [Commented] (SPARK-32512) Add basic partition command for datasourcev2

[ https://issues.apache.org/jira/browse/SPARK-32512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236078#comment-17236078 ] Apache Spark commented on SPARK-32512: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-33499) Enable `-Wunused:imports` in Scala 2.13 SBT

[ https://issues.apache.org/jira/browse/SPARK-33499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33499: - Summary: Enable `-Wunused:imports` in Scala 2.13 SBT (was: Enabled `-Wunused:imports` in Scala 2.13

[jira] [Updated] (SPARK-33499) Enabled `-Wunused:imports` in Scala 2.13 SBT

[ https://issues.apache.org/jira/browse/SPARK-33499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33499: - Description: As the image, Scala 2.13 think `scala.language.higherKinds` is a {{unused import, }}but

[jira] [Updated] (SPARK-33499) Enabled `-Wunused:imports` in Scala 2.13 SBT

[ https://issues.apache.org/jira/browse/SPARK-33499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33499: - Attachment: (was: image-2020-11-20-18-50-14-328.png) > Enabled `-Wunused:imports` in Scala 2.13 SBT

[jira] [Updated] (SPARK-33499) Enabled `-Wunused:imports` in Scala 2.13 SBT

[ https://issues.apache.org/jira/browse/SPARK-33499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33499: - Attachment: image-2020-11-20-18-50-21-567.png > Enabled `-Wunused:imports` in Scala 2.13 SBT >

[jira] [Updated] (SPARK-33499) Enabled `-Wunused:imports` in Scala 2.13 SBT

[ https://issues.apache.org/jira/browse/SPARK-33499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33499: - Attachment: image-2020-11-20-18-50-14-328.png > Enabled `-Wunused:imports` in Scala 2.13 SBT >

[jira] [Created] (SPARK-33499) Enabled `-Wunused:imports` in Scala 2.13 SBT

Yang Jie created SPARK-33499: Summary: Enabled `-Wunused:imports` in Scala 2.13 SBT Key: SPARK-33499 URL: https://issues.apache.org/jira/browse/SPARK-33499 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-33497) Override maxRows in some LogicalPlan

[ https://issues.apache.org/jira/browse/SPARK-33497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33497: Assignee: (was: Apache Spark) > Override maxRows in some LogicalPlan >

[jira] [Commented] (SPARK-33497) Override maxRows in some LogicalPlan

[ https://issues.apache.org/jira/browse/SPARK-33497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236050#comment-17236050 ] Apache Spark commented on SPARK-33497: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-33497) Override maxRows in some LogicalPlan

[ https://issues.apache.org/jira/browse/SPARK-33497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33497: Assignee: Apache Spark > Override maxRows in some LogicalPlan >

[jira] [Commented] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236030#comment-17236030 ] Apache Spark commented on SPARK-33498: -- User 'leanken' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33498: Assignee: (was: Apache Spark) > Datetime parsing should fail if the input string

[jira] [Commented] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236028#comment-17236028 ] Apache Spark commented on SPARK-33498: -- User 'leanken' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33498: Assignee: Apache Spark > Datetime parsing should fail if the input string can't be

[jira] [Updated] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-33498: Summary: Datetime parsing should fail if the input string can't be parsed, or the pattern string

[jira] [Updated] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-33498: Description: Datetime parsing should fail if the input string can't be parsed, or the pattern