[jira] [Created] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
Xiao Li created SPARK-32976: --- Summary: Support column list in INSERT statement Key: SPARK-32976 URL: https://issues.apache.org/jira/browse/SPARK-32976 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32931) Unevaluable Expressions are not foldable

2020-09-17 Thread Xiao Li (Jira)
Xiao Li created SPARK-32931: --- Summary: Unevaluable Expressions are not foldable Key: SPARK-32931 URL: https://issues.apache.org/jira/browse/SPARK-32931 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32760) Support for INET data type

2020-08-31 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188138#comment-17188138 ] Xiao Li commented on SPARK-32760: - supporting a new data type is very expensive. I suggested to close it

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

2020-08-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185494#comment-17185494 ] Xiao Li commented on SPARK-27733: - BTW, is Hive community will to introduce the version upgrade of Avro

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

2020-08-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185493#comment-17185493 ] Xiao Li commented on SPARK-27733: - Let us wait for one more month. If no one is complaining about the

[jira] [Updated] (SPARK-32670) Group exception messages in Catalyst Analyzer in one file

2020-08-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32670: Description: For standardization of error messages and its maintenance, we can try to group the exception

[jira] [Created] (SPARK-32670) Group exception messages in Catalyst Analyzer in one file

2020-08-20 Thread Xiao Li (Jira)
Xiao Li created SPARK-32670: --- Summary: Group exception messages in Catalyst Analyzer in one file Key: SPARK-32670 URL: https://issues.apache.org/jira/browse/SPARK-32670 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32609) Incorrect exchange reuse with DataSourceV2

2020-08-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32609: Affects Version/s: (was: 2.4.5) 2.4.0 > Incorrect exchange reuse with

[jira] [Assigned] (SPARK-32609) Incorrect exchange reuse with DataSourceV2

2020-08-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-32609: --- Assignee: Mingjia Liu > Incorrect exchange reuse with DataSourceV2 >

[jira] [Updated] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

2020-08-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32125: Fix Version/s: 3.1.0 > [UI] Support get taskList by status in Web UI and SHS Rest API >

[jira] [Assigned] (SPARK-32521) WithFields Expression should not be foldable

2020-08-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-32521: --- Assignee: fqaiser94 > WithFields Expression should not be foldable >

[jira] [Resolved] (SPARK-32521) WithFields Expression should not be foldable

2020-08-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-32521. - Fix Version/s: 3.1.0 Resolution: Fixed > WithFields Expression should not be foldable >

[jira] [Updated] (SPARK-32525) The layout of monitoring.html is broken

2020-08-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32525: Fix Version/s: 3.1.0 > The layout of monitoring.html is broken > ---

[jira] [Updated] (SPARK-31993) Generated code in 'concat_ws' fails to compile when splitting method is in effect

2020-07-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31993: Component/s: (was: Spark Core) SQL > Generated code in 'concat_ws' fails to compile

[jira] [Updated] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32330: Priority: Major (was: Trivial) > Preserve shuffled hash join build side partitioning >

[jira] [Updated] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-07-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32234: Priority: Blocker (was: Major) > Spark sql commands are failing on select Queries for the orc tables >

[jira] [Updated] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-07-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32234: Target Version/s: 3.0.1 > Spark sql commands are failing on select Queries for the orc tables >

[jira] [Commented] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause

2020-07-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156398#comment-17156398 ] Xiao Li commented on SPARK-24163: - [~Qin Yao]  [~dkbiswal] Are you interested in this?   cc

[jira] [Updated] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause

2020-07-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24163: Labels: (was: bulk-closed) > Support "ANY" or sub-query for Pivot "IN" clause >

[jira] [Reopened] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause

2020-07-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-24163: - > Support "ANY" or sub-query for Pivot "IN" clause > > >

[jira] [Updated] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32257: Description: {code:java} SET spark.sql.ansi.enabled true{code} The above SQL command does not change

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154739#comment-17154739 ] Xiao Li commented on SPARK-32257: - [~beliefer] [~maropu] Are you interested in this? > [SQL Parser]

[jira] [Created] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread Xiao Li (Jira)
Xiao Li created SPARK-32257: --- Summary: [SQL Parser] Report Error for invalid usage of SET command Key: SPARK-32257 URL: https://issues.apache.org/jira/browse/SPARK-32257 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31525) Inconsistent result of df.head(1) and df.head()

2020-06-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146026#comment-17146026 ] Xiao Li commented on SPARK-31525: - cc [~hyukjin.kwon] and [~ueshin] > Inconsistent result of df.head(1)

[jira] [Created] (SPARK-32078) Add a redirect to sql-ref from sql-reference

2020-06-23 Thread Xiao Li (Jira)
Xiao Li created SPARK-32078: --- Summary: Add a redirect to sql-ref from sql-reference Key: SPARK-32078 URL: https://issues.apache.org/jira/browse/SPARK-32078 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-32069) Improve error message on reading unexpected directory which is not a table partition

2020-06-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142703#comment-17142703 ] Xiao Li commented on SPARK-32069: - [~hyukjin.kwon] If we can improve the error message, the stack trace

[jira] [Updated] (SPARK-32069) Improve error message on reading unexpected directory which is not a table partition

2020-06-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32069: Labels: starter (was: ) > Improve error message on reading unexpected directory which is not a table >

[jira] [Updated] (SPARK-32069) Improve error message on reading unexpected directory which is not a table partition

2020-06-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32069: Affects Version/s: (was: 3.1.0) 3.0.0 > Improve error message on reading

[jira] [Updated] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-26905: Fix Version/s: 3.1.0 > Revisit reserved/non-reserved keywords based on the ANSI SQL standard >

[jira] [Updated] (SPARK-31950) Extract SQL keywords from the generated parser class in TableIdentifierParserSuite

2020-06-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31950: Fix Version/s: 3.1.0 > Extract SQL keywords from the generated parser class in >

[jira] [Updated] (SPARK-31230) use statement plans in DataFrameWriter(V2)

2020-06-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31230: Fix Version/s: 3.1.0 > use statement plans in DataFrameWriter(V2) >

[jira] [Updated] (SPARK-31584) NullPointerException when parsing event log with InMemoryStore

2020-06-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31584: Fix Version/s: 3.1.0 > NullPointerException when parsing event log with InMemoryStore >

[jira] [Updated] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

2020-06-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31918: Target Version/s: 3.0.1 > SparkR CRAN check gives a warning with R 4.0.0 on OSX >

[jira] [Updated] (SPARK-31956) Do not fail if there is no ambiguous self join

2020-06-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31956: Fix Version/s: 3.1.0 > Do not fail if there is no ambiguous self join >

[jira] [Updated] (SPARK-32017) Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-06-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32017: Target Version/s: 3.1.0 > Make Pyspark Hadoop 3.2+ Variant available in PyPI >

[jira] [Updated] (SPARK-32016) Why spark does not preserve the original timestamp format while writing dataset to file or hdfs

2020-06-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32016: Fix Version/s: (was: 3.0.0) > Why spark does not preserve the original timestamp format while writing

[jira] [Updated] (SPARK-32016) Why spark does not preserve the original timestamp format while writing dataset to file or hdfs

2020-06-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32016: Target Version/s: (was: 3.0.0) > Why spark does not preserve the original timestamp format while

[jira] [Commented] (SPARK-31976) use MemoryUsage to control the size of block

2020-06-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136102#comment-17136102 ] Xiao Li commented on SPARK-31976: - I think [~podongfeng] just wants to target this feature in Spark 3.1

[jira] [Updated] (SPARK-31976) use MemoryUsage to control the size of block

2020-06-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31976: Target Version/s: 3.1.0 Priority: Major (was: Blocker) > use MemoryUsage to control the size

[jira] [Commented] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135272#comment-17135272 ] Xiao Li commented on SPARK-31990: - [~XuanYuan] just identified the problem when fixing the test failure

[jira] [Commented] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135271#comment-17135271 ] Xiao Li commented on SPARK-31967: - [~Gengliang.Wang] Please also change the fix versions when you merged

[jira] [Updated] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31967: Fix Version/s: 2.4.7 > Loading jobs UI page takes 40 seconds > - > >

[jira] [Commented] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135270#comment-17135270 ] Xiao Li commented on SPARK-31967: - nvm. This has been merged to 2.4 branch.  > Loading jobs UI page

[jira] [Commented] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135269#comment-17135269 ] Xiao Li commented on SPARK-31967: - Do we need to resolve the  same issue in 2.4.6? > Loading jobs UI

[jira] [Updated] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31967: Affects Version/s: 2.4.6 > Loading jobs UI page takes 40 seconds > -

[jira] [Commented] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135268#comment-17135268 ] Xiao Li commented on SPARK-31990: - cc [~maropu] [~sowen] [~sekikn] > Streaming's state store

[jira] [Assigned] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-31990: --- Assignee: (was: Yuanjian Li) > Streaming's state store compatibility is broken >

[jira] [Updated] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31990: Target Version/s: 3.0.1 > Streaming's state store compatibility is broken >

[jira] [Updated] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31990: Priority: Blocker (was: Major) > Streaming's state store compatibility is broken >

[jira] [Created] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
Xiao Li created SPARK-31990: --- Summary: Streaming's state store compatibility is broken Key: SPARK-31990 URL: https://issues.apache.org/jira/browse/SPARK-31990 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31990: Environment: (was: [This

[jira] [Updated] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31990: Description: [This

[jira] [Updated] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31967: Fix Version/s: 3.1.0 > Loading jobs UI page takes 40 seconds > - > >

[jira] [Updated] (SPARK-31967) Loading jobs UI page takes 40 seconds

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31967: Fix Version/s: 3.0.1 > Loading jobs UI page takes 40 seconds > - > >

[jira] [Updated] (SPARK-29429) Support Prometheus monitoring natively

2020-06-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29429: Fix Version/s: 3.0.0 > Support Prometheus monitoring natively > -- >

[jira] [Commented] (SPARK-29429) Support Prometheus monitoring natively

2020-06-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134911#comment-17134911 ] Xiao Li commented on SPARK-29429: - [~dongjoon] Can we resolve this? > Support Prometheus monitoring

[jira] [Commented] (SPARK-30968) Upgrade aws-java-sdk-sts to 1.11.655

2020-06-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134861#comment-17134861 ] Xiao Li commented on SPARK-30968: - Added the release note based on the issue we identified.  > Upgrade

[jira] [Updated] (SPARK-30968) Upgrade aws-java-sdk-sts to 1.11.655

2020-06-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30968: Docs Text: With AWS SDK upgrade to 1.11.655, we strongly encourage the users that use S3N file system

[jira] [Updated] (SPARK-30968) Upgrade aws-java-sdk-sts to 1.11.655

2020-06-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30968: Labels: release-notes (was: ) > Upgrade aws-java-sdk-sts to 1.11.655 >

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129732#comment-17129732 ] Xiao Li commented on SPARK-26905: - cc [~maropu] > Revisit reserved/non-reserved keywords based on the

[jira] [Resolved] (SPARK-26904) API Auditing

2020-06-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26904. - Resolution: Done > API Auditing > > > Key: SPARK-26904 >

[jira] [Assigned] (SPARK-30990) Binary incompatibility changes

2020-06-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30990: --- Assignee: Huaxin Gao > Binary incompatibility changes > -- > >

[jira] [Resolved] (SPARK-30990) Binary incompatibility changes

2020-06-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30990. - Resolution: Done > Binary incompatibility changes > -- > >

[jira] [Updated] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

2020-06-02 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28067: Target Version/s: (was: 3.0.0) > Incorrect results in decimal aggregation with whole-stage code gen

[jira] [Commented] (SPARK-31819) Add a workaround for Java 8u251+/K8s 1.17 and update integration test cases

2020-05-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116845#comment-17116845 ] Xiao Li commented on SPARK-31819: - [~dongjoon]This is 2.4 only? > Add a workaround for Java 8u251+/K8s

[jira] [Updated] (SPARK-31706) add back the support of streaming update mode

2020-05-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31706: Priority: Blocker (was: Major) > add back the support of streaming update mode >

[jira] [Updated] (SPARK-27471) Reorganize public v2 catalog API

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27471: Fix Version/s: 3.0.0 > Reorganize public v2 catalog API > > >

[jira] [Updated] (SPARK-27886) Add Apache Spark project to https://python3statement.org/

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27886: Fix Version/s: 3.0.0 > Add Apache Spark project to https://python3statement.org/ >

[jira] [Updated] (SPARK-28413) sizeInByte is Not updated for parquet datasource on Next Insert.

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28413: Fix Version/s: 3.0.0 > sizeInByte is Not updated for parquet datasource on Next Insert. >

[jira] [Updated] (SPARK-28426) Metadata Handling in Thrift Server

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28426: Fix Version/s: 3.0.0 > Metadata Handling in Thrift Server > -- > >

[jira] [Updated] (SPARK-27885) Announce deprecation of Python 2 support

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27885: Fix Version/s: 3.0.0 > Announce deprecation of Python 2 support >

[jira] [Updated] (SPARK-31201) add an individual config for skewed partition threshold

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31201: Fix Version/s: 3.0.0 > add an individual config for skewed partition threshold >

[jira] [Updated] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27763: Fix Version/s: 3.0.0 > Port test cases from PostgreSQL to Spark SQL >

[jira] [Updated] (SPARK-18486) Access of SparkUI after task completion

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18486: Component/s: (was: Optimizer) > Access of SparkUI after task completion >

[jira] [Updated] (SPARK-29436) Support executor for selecting scheduler through scheduler name in the case of k8s multi-scheduler scenario.

2020-05-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29436: Issue Type: Improvement (was: New Feature) > Support executor for selecting scheduler through scheduler

[jira] [Assigned] (SPARK-25876) Simplify configuration types in k8s backend

2020-05-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25876: --- Assignee: Marcelo Masiero Vanzin > Simplify configuration types in k8s backend >

[jira] [Assigned] (SPARK-31387) HiveThriftServer2Listener update methods fail with unknown operation/session id

2020-05-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-31387: --- Assignee: Ali Smesseim (was: Ali Afroozeh) > HiveThriftServer2Listener update methods fail with

[jira] [Resolved] (SPARK-31387) HiveThriftServer2Listener update methods fail with unknown operation/session id

2020-05-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31387. - Fix Version/s: 3.0.0 Assignee: Ali Afroozeh Resolution: Fixed >

[jira] [Resolved] (SPARK-31658) SQL UI doesn't show write commands of AQE plan

2020-05-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31658. - Fix Version/s: 3.0.0 Resolution: Fixed > SQL UI doesn't show write commands of AQE plan >

[jira] [Assigned] (SPARK-31658) SQL UI doesn't show write commands of AQE plan

2020-05-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-31658: --- Assignee: Manu Zhang > SQL UI doesn't show write commands of AQE plan >

[jira] [Updated] (SPARK-27990) Recursive data loading from file sources

2020-05-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27990: Summary: Recursive data loading from file sources (was: Provide a way to recursively load data from

[jira] [Updated] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21117: Target Version/s: 3.1.0 > Built-in SQL Function Support - WIDTH_BUCKET >

[jira] [Updated] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21117: Labels: (was: bulk-closed) > Built-in SQL Function Support - WIDTH_BUCKET >

[jira] [Reopened] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21117: - > Built-in SQL Function Support - WIDTH_BUCKET > > >

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2020-04-29 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095222#comment-17095222 ] Xiao Li commented on SPARK-12312: - I am trying to find out the potential conflicts if we implement a

[jira] [Commented] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095093#comment-17095093 ] Xiao Li commented on SPARK-31480: - let me assign it to [~dkbiswal]  > Improve the EXPLAIN FORMATTED's

[jira] [Comment Edited] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2020-04-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092884#comment-17092884 ] Xiao Li edited comment on SPARK-12312 at 4/26/20, 11:03 PM: How does the

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2020-04-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092884#comment-17092884 ] Xiao Li commented on SPARK-12312: - How the current solution handle Kerberos renewals? > JDBC connection

[jira] [Updated] (SPARK-31381) Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31381: Parent: SPARK-28684 Issue Type: Sub-task (was: Improvement) > Upgrade built-in Hive 2.3.6 to

[jira] [Updated] (SPARK-25390) Data source V2 API refactoring

2020-04-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25390: Summary: Data source V2 API refactoring (was: data source V2 API refactoring) > Data source V2 API

[jira] [Resolved] (SPARK-31234) ResetCommand should not wipe out all configs

2020-04-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31234. - Resolution: Fixed > ResetCommand should not wipe out all configs >

[jira] [Updated] (SPARK-17636) Parquet predicate pushdown for nested fields

2020-04-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17636: Priority: Critical (was: Minor) > Parquet predicate pushdown for nested fields >

[jira] [Resolved] (SPARK-31475) Broadcast stage in AQE did not timeout

2020-04-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31475. - Fix Version/s: 3.0.0 Assignee: Wei Xue Resolution: Fixed > Broadcast stage in AQE did

[jira] [Commented] (SPARK-31234) ResetCommand should not wipe out all configs

2020-04-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087142#comment-17087142 ] Xiao Li commented on SPARK-31234: - I reopened the ticket and target it to Spark 2.4.6. > ResetCommand

[jira] [Updated] (SPARK-31234) ResetCommand should not wipe out all configs

2020-04-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31234: Target Version/s: 2.4.6 > ResetCommand should not wipe out all configs >

[jira] [Updated] (SPARK-31234) ResetCommand should not wipe out all configs

2020-04-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31234: Priority: Blocker (was: Major) > ResetCommand should not wipe out all configs >

[jira] [Reopened] (SPARK-31234) ResetCommand should not wipe out all configs

2020-04-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-31234: - > ResetCommand should not wipe out all configs > > >

[jira] [Commented] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086585#comment-17086585 ] Xiao Li commented on SPARK-31480: - cc [~beliefer] Are you interested in this? > Improve the EXPLAIN

[jira] [Updated] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31480: Description: Below is the EXPLAIN OUTPUT when using the *DSV2*  *Output of EXPLAIN EXTENDED* 

[jira] [Created] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-18 Thread Xiao Li (Jira)
Xiao Li created SPARK-31480: --- Summary: Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node Key: SPARK-31480 URL: https://issues.apache.org/jira/browse/SPARK-31480 Project: Spark Issue

<    1   2   3   4   5   6   7   8   9   10   >