[jira] [Assigned] (SPARK-36967) Report accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36967: Assignee: (was: Apache Spark) > Report accurate block size threshold per reduce task

[jira] [Commented] (SPARK-36967) Report accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426737#comment-17426737 ] Apache Spark commented on SPARK-36967: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36967) Report accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36967: Assignee: Apache Spark > Report accurate block size threshold per reduce task >

[jira] [Assigned] (SPARK-36967) Report accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36967: Assignee: Apache Spark > Report accurate block size threshold per reduce task >

[jira] [Updated] (SPARK-36967) Report accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Summary: Report accurate block size threshold per reduce task (was: Update accurate block size threshold

[jira] [Updated] (SPARK-36967) Update accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Description: Now map task will report accurate shuffle block size if the block size is greater than

[jira] [Updated] (SPARK-36967) Update accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Attachment: map_status2.png > Update accurate block size threshold per reduce task >

[jira] [Updated] (SPARK-36967) Update accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Description: Now map task will report accurate shuffle block size if the block size is greater than

[jira] [Updated] (SPARK-36967) Update accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Attachment: map_status.png > Update accurate block size threshold per reduce task >

[jira] [Updated] (SPARK-36967) Update accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Attachment: (was: map_status.png) > Update accurate block size threshold per reduce task >

[jira] [Updated] (SPARK-36967) Update accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Attachment: map_status.png > Update accurate block size threshold per reduce task >

[jira] [Created] (SPARK-36967) Update accurate block size threshold per reduce task

Wan Kun created SPARK-36967: --- Summary: Update accurate block size threshold per reduce task Key: SPARK-36967 URL: https://issues.apache.org/jira/browse/SPARK-36967 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36967) Update accurate block size threshold per reduce task

[ https://issues.apache.org/jira/browse/SPARK-36967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-36967: Description: Now map task will report accurate shuffle block size if the block size is greater than

[jira] [Comment Edited] (SPARK-36936) spark-hadoop-cloud broken on release and only published via 3rd party repositories

[ https://issues.apache.org/jira/browse/SPARK-36936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426701#comment-17426701 ] Colin Williams edited comment on SPARK-36936 at 10/9/21, 8:38 PM: -- But

[jira] [Comment Edited] (SPARK-36936) spark-hadoop-cloud broken on release and only published via 3rd party repositories

[ https://issues.apache.org/jira/browse/SPARK-36936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426701#comment-17426701 ] Colin Williams edited comment on SPARK-36936 at 10/9/21, 8:36 PM: -- But

[jira] [Commented] (SPARK-36936) spark-hadoop-cloud broken on release and only published via 3rd party repositories

[ https://issues.apache.org/jira/browse/SPARK-36936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426701#comment-17426701 ] Colin Williams commented on SPARK-36936: But the Spark 3.1.2 documentation 

[jira] [Commented] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-36949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426617#comment-17426617 ] Max Gekk commented on SPARK-36949: -- [~cloud_fan] [~csun] FYI, even if I map Catalyst's ANSI interval

[jira] [Resolved] (SPARK-34198) Add RocksDB StateStore implementation

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34198. Assignee: Apache Spark Resolution: Fixed > Add RocksDB StateStore implementation >

[jira] [Resolved] (SPARK-36960) Pushdown filters with ANSI interval values to ORC

[ https://issues.apache.org/jira/browse/SPARK-36960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36960. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34224

[jira] [Assigned] (SPARK-36804) Using the verbose parameter in yarn mode would cause application submission failure

[ https://issues.apache.org/jira/browse/SPARK-36804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36804: Assignee: Jianmeng Li > Using the verbose parameter in yarn mode would cause application

[jira] [Resolved] (SPARK-36804) Using the verbose parameter in yarn mode would cause application submission failure

[ https://issues.apache.org/jira/browse/SPARK-36804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36804. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34046

[jira] [Commented] (SPARK-36958) Reading of legacy timestamps from Parquet confusing in Spark 3, related config values don't seem working

[ https://issues.apache.org/jira/browse/SPARK-36958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426591#comment-17426591 ] Hyukjin Kwon commented on SPARK-36958: -- Please refer to the docs at

[jira] [Created] (SPARK-36966) Spark evicts RDD partitions instead of allowing OOM

sam created SPARK-36966: --- Summary: Spark evicts RDD partitions instead of allowing OOM Key: SPARK-36966 URL: https://issues.apache.org/jira/browse/SPARK-36966 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-36958) Reading of legacy timestamps from Parquet confusing in Spark 3, related config values don't seem working

[ https://issues.apache.org/jira/browse/SPARK-36958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426571#comment-17426571 ] Dmitry Goldenberg commented on SPARK-36958: --- [~hyukjin.kwon] Hi, so which setting out of the

[jira] [Assigned] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36965: Assignee: Apache Spark (was: Attila Zsolt Piros) > Extend python test runner by logging

[jira] [Commented] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426553#comment-17426553 ] Apache Spark commented on SPARK-36965: -- User 'attilapiros' has created a pull request for this

[jira] [Assigned] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36965: Assignee: Attila Zsolt Piros (was: Apache Spark) > Extend python test runner by logging

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Description: I was running a python test which was extremely slow and I was

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Description: I was running a python test which was extremely slow and I was

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Description: I was running a python test which was extremely slow and I was

[jira] [Updated] (SPARK-36965) Extend python test runner by logging out the temp output files

[ https://issues.apache.org/jira/browse/SPARK-36965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36965: --- Priority: Minor (was: Major) > Extend python test runner by logging out the temp

[jira] [Created] (SPARK-36965) Extend python test runner by logging out the temp output files

Attila Zsolt Piros created SPARK-36965: -- Summary: Extend python test runner by logging out the temp output files Key: SPARK-36965 URL: https://issues.apache.org/jira/browse/SPARK-36965 Project:

[jira] [Commented] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426534#comment-17426534 ] Apache Spark commented on SPARK-35973: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Commented] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426533#comment-17426533 ] Apache Spark commented on SPARK-35973: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36964) Reuse CachedDNSToSwitchMapping for yarn container requests

[ https://issues.apache.org/jira/browse/SPARK-36964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36964: Assignee: (was: Apache Spark) > Reuse CachedDNSToSwitchMapping for yarn container

[jira] [Commented] (SPARK-36964) Reuse CachedDNSToSwitchMapping for yarn container requests

[ https://issues.apache.org/jira/browse/SPARK-36964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426521#comment-17426521 ] Apache Spark commented on SPARK-36964: -- User 'gaoyajun02' has created a pull request for this

[jira] [Commented] (SPARK-36964) Reuse CachedDNSToSwitchMapping for yarn container requests

[ https://issues.apache.org/jira/browse/SPARK-36964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426523#comment-17426523 ] Apache Spark commented on SPARK-36964: -- User 'gaoyajun02' has created a pull request for this

[jira] [Assigned] (SPARK-36964) Reuse CachedDNSToSwitchMapping for yarn container requests

[ https://issues.apache.org/jira/browse/SPARK-36964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36964: Assignee: Apache Spark > Reuse CachedDNSToSwitchMapping for yarn container requests >

[jira] [Created] (SPARK-36964) Reuse CachedDNSToSwitchMapping for yarn container requests

gaoyajun02 created SPARK-36964: -- Summary: Reuse CachedDNSToSwitchMapping for yarn container requests Key: SPARK-36964 URL: https://issues.apache.org/jira/browse/SPARK-36964 Project: Spark

[jira] [Commented] (SPARK-36839) Add daily build with Hadoop 2 profile in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-36839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426509#comment-17426509 ] Apache Spark commented on SPARK-36839: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-36839) Add daily build with Hadoop 2 profile in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-36839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426510#comment-17426510 ] Apache Spark commented on SPARK-36839: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-36897) Replace collections.namedtuple() by typing.NamedTuple

[ https://issues.apache.org/jira/browse/SPARK-36897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36897. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34228

[jira] [Assigned] (SPARK-36897) Replace collections.namedtuple() by typing.NamedTuple

[ https://issues.apache.org/jira/browse/SPARK-36897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36897: Assignee: Xinrong Meng > Replace collections.namedtuple() by typing.NamedTuple >