[jira] [Commented] (SPARK-30404) Fix wrong log for FetchFailed task's successful speculation

2020-01-01 Thread Xuesen Liang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006640#comment-17006640 ] Xuesen Liang commented on SPARK-30404: --  The following is spark driver log of the f

[jira] [Created] (SPARK-30406) OneForOneStreamManager use AtomicLong

2020-01-01 Thread Ajith S (Jira)
Ajith S created SPARK-30406: --- Summary: OneForOneStreamManager use AtomicLong Key: SPARK-30406 URL: https://issues.apache.org/jira/browse/SPARK-30406 Project: Spark Issue Type: Bug Compone

[jira] [Resolved] (SPARK-30405) ArrayKeyIndexType should use Arrays.hashCode

2020-01-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30405. -- Resolution: Duplicate > ArrayKeyIndexType should use Arrays.hashCode > ---

[jira] [Created] (SPARK-30405) ArrayKeyIndexType should use Arrays.hashCode

2020-01-01 Thread Ajith S (Jira)
Ajith S created SPARK-30405: --- Summary: ArrayKeyIndexType should use Arrays.hashCode Key: SPARK-30405 URL: https://issues.apache.org/jira/browse/SPARK-30405 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30404) Fix wrong log for FetchFailed task's successful speculation

2020-01-01 Thread Xuesen Liang (Jira)
Xuesen Liang created SPARK-30404: Summary: Fix wrong log for FetchFailed task's successful speculation Key: SPARK-30404 URL: https://issues.apache.org/jira/browse/SPARK-30404 Project: Spark

[jira] [Commented] (SPARK-24906) Adaptively set split size for columnar file to ensure the task read data size fit expectation

2020-01-01 Thread Jason Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006571#comment-17006571 ] Jason Guo commented on SPARK-24906: --- [~lio...@taboola.com] Yes, estimating with sampl

[jira] [Commented] (SPARK-26494) 【spark sql】Use spark to read oracle TIMESTAMP(6) WITH LOCAL TIME ZONE type can't be found,

2020-01-01 Thread Jarek Jarcec Cecho (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006564#comment-17006564 ] Jarek Jarcec Cecho commented on SPARK-26494: I believe that can explain thi

[jira] [Updated] (SPARK-30403) Fix the NoSuchElementException exception when enable AQE with InSubquery use case

2020-01-01 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-30403: --- Description: After merged [https://github.com/apache/spark/pull/25854], we also need to handle the Insubquer

[jira] [Updated] (SPARK-30403) Fix the NoSuchElementException exception when enable AQE with InSubquery use case

2020-01-01 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-30403: --- Description: After merged [link title|[https://github.com/apache/spark/pull/25854]], we also need to handle

[jira] [Updated] (SPARK-30403) Fix the NoSuchElementException exception when enable AQE with InSubquery use case

2020-01-01 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-30403: --- Description: After merged [PR25854|[https://github.com/apache/spark/pull/25854]], we also need to handle th

[jira] [Created] (SPARK-30403) Fix the NoSuchElementException exception when enable AQE with InSubquery use case

2020-01-01 Thread Ke Jia (Jira)
Ke Jia created SPARK-30403: -- Summary: Fix the NoSuchElementException exception when enable AQE with InSubquery use case Key: SPARK-30403 URL: https://issues.apache.org/jira/browse/SPARK-30403 Project: Spark

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-01-01 Thread Nasir Ali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006548#comment-17006548 ] Nasir Ali edited comment on SPARK-30162 at 1/2/20 3:05 AM: --- Th

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-01-01 Thread Nasir Ali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006548#comment-17006548 ] Nasir Ali edited comment on SPARK-30162 at 1/2/20 3:04 AM: --- Th

[jira] [Updated] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-01-01 Thread Nasir Ali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nasir Ali updated SPARK-30162: -- Attachment: Screenshot from 2020-01-01 21-01-32.png Screenshot from 2020-01-01 21-01-18

[jira] [Reopened] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-01-01 Thread Nasir Ali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nasir Ali reopened SPARK-30162: --- This issue has not been fixed. It shows pushed filters but it does not actually push filters. For examp

[jira] [Created] (SPARK-30402) Support push down for filters with cast expression

2020-01-01 Thread wuyi (Jira)
wuyi created SPARK-30402: Summary: Support push down for filters with cast expression Key: SPARK-30402 URL: https://issues.apache.org/jira/browse/SPARK-30402 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-23811) FetchFailed comes before Success of same task will cause child stage never succeed

2020-01-01 Thread Xiaoju Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006539#comment-17006539 ] Xiaoju Wu commented on SPARK-23811: --- [~XuanYuan] The issue seems still exist after pat

[jira] [Assigned] (SPARK-30401) Call requireNonStaticConf() only once

2020-01-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30401: Assignee: Maxim Gekk > Call requireNonStaticConf() only once > --

[jira] [Resolved] (SPARK-30401) Call requireNonStaticConf() only once

2020-01-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30401. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27062 [https://gi

[jira] [Commented] (SPARK-30401) Call requireNonStaticConf() only once

2020-01-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006392#comment-17006392 ] Maxim Gekk commented on SPARK-30401: I am working on it > Call requireNonStaticConf

[jira] [Created] (SPARK-30401) Call requireNonStaticConf() only once

2020-01-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30401: -- Summary: Call requireNonStaticConf() only once Key: SPARK-30401 URL: https://issues.apache.org/jira/browse/SPARK-30401 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24906) Adaptively set split size for columnar file to ensure the task read data size fit expectation

2020-01-01 Thread Lior Chaga (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006345#comment-17006345 ] Lior Chaga commented on SPARK-24906: [~habren] The suggested approach of using a mu