[jira] [Commented] (SPARK-29031) Materialized column to accelerate queries

2019-09-15 Thread ShuMing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930211#comment-16930211 ] ShuMing Li commented on SPARK-29031: This can be useful in cases when user's queries

[jira] [Commented] (SPARK-10816) EventTime based sessionization

2019-08-28 Thread ShuMing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918222#comment-16918222 ] ShuMing Li commented on SPARK-10816: Same Question: Is there any progress on this i

[jira] [Created] (SPARK-28729) Comparison between DecimalType and StringType may lead to wrong results

2019-08-14 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28729: -- Summary: Comparison between DecimalType and StringType may lead to wrong results Key: SPARK-28729 URL: https://issues.apache.org/jira/browse/SPARK-28729 Project: Spark

[jira] [Updated] (SPARK-28724) Throw error message when cast out range decimal to long

2019-08-13 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28724: --- Description: Maybe this is a bug in `Scala` when convert `BigDecimal` to `Long`, however Spark shou

[jira] [Created] (SPARK-28724) Throw error message when cast out range decimal to long

2019-08-13 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28724: -- Summary: Throw error message when cast out range decimal to long Key: SPARK-28724 URL: https://issues.apache.org/jira/browse/SPARK-28724 Project: Spark Issue Typ

[jira] [Commented] (SPARK-25185) CBO rowcount statistics doesn't work for partitioned parquet external table

2019-07-29 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895726#comment-16895726 ] ShuMing Li commented on SPARK-25185: Does Spark support `External Table`'s Statistic

[jira] [Commented] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

2019-07-29 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895725#comment-16895725 ] ShuMing Li commented on SPARK-27602: What's the progress of this problem? Is there s

[jira] [Comment Edited] (SPARK-28036) Built-in udf left/right has inconsistent behavior

2019-07-28 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877765#comment-16877765 ] ShuMing Li edited comment on SPARK-28036 at 7/28/19 2:28 PM: -

[jira] [Updated] (SPARK-28438) [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28438: --- Description: When users register a datasource table to Spark,  Spark only support complete schema e

[jira] [Updated] (SPARK-28438) [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28438: --- Description: When users register a datasource table to Spark,  Spark only support complete schema e

[jira] [Created] (SPARK-28438) [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28438: -- Summary: [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema Key: SPARK-28438 URL: https://issues.apache.org/jira/browse/SPARK-284

[jira] [Updated] (SPARK-28436) [SQL] Throw better exception when datasource's schema is not equal to user-specific shema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28436: --- Affects Version/s: 2.3.0 > [SQL] Throw better exception when datasource's schema is not equal to >

[jira] [Created] (SPARK-28436) [SQL] Throw better exception when datasource's schema is not equal to user-specific shema

2019-07-18 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28436: -- Summary: [SQL] Throw better exception when datasource's schema is not equal to user-specific shema Key: SPARK-28436 URL: https://issues.apache.org/jira/browse/SPARK-28436

[jira] [Updated] (SPARK-28436) [SQL] Throw better exception when datasource's schema is not equal to user-specific shema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28436: --- Description: When this exception is thrown, users cannot find what's the difference between datasou

[jira] [Commented] (SPARK-28036) Built-in udf left/right has inconsistent behavior

2019-07-03 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877765#comment-16877765 ] ShuMing Li commented on SPARK-28036: [~shivuson...@gmail.com] It's not the same with

[jira] [Commented] (SPARK-27877) Implement SQL-standard LATERAL subqueries

2019-07-02 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876865#comment-16876865 ] ShuMing Li commented on SPARK-27877: Can this issue assign to me?  Let me do it. >

[jira] [Created] (SPARK-28202) [Core] [Test] Avoid noises of system props in SparkConfSuite

2019-06-28 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28202: -- Summary: [Core] [Test] Avoid noises of system props in SparkConfSuite Key: SPARK-28202 URL: https://issues.apache.org/jira/browse/SPARK-28202 Project: Spark Iss

[jira] [Created] (SPARK-24738) [HistoryServer] FsHistoryProvider clean outdated event logs at start

2018-07-04 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-24738: -- Summary: [HistoryServer] FsHistoryProvider clean outdated event logs at start Key: SPARK-24738 URL: https://issues.apache.org/jira/browse/SPARK-24738 Project: Spark

[jira] [Commented] (SPARK-20882) Executor is waiting for ShuffleBlockFetcherIterator

2017-11-16 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256578#comment-16256578 ] ShuMing Li commented on SPARK-20882: Can I ask what `Still have 1 requests outstandi