[jira] [Commented] (SPARK-35441) InMemoryFileIndex load all files into memroy

2021-05-23 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350221#comment-17350221 ] Zhang Jianguo commented on SPARK-35441: --- [~hyukjin.kwon] 20,000,000 files > InMemoryFileIndex

[jira] [Created] (SPARK-35441) InMemoryFileIndex load all files into memroy

2021-05-19 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-35441: - Summary: InMemoryFileIndex load all files into memroy Key: SPARK-35441 URL: https://issues.apache.org/jira/browse/SPARK-35441 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34616) SessionCatalog#requireDbExists is called too many times affects SQL performance

2021-03-04 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34616: -- Description: Almost all SQL need to check if database exist before execution. Usually

[jira] [Updated] (SPARK-34616) SessionCatalog#requireDbExists is called too many times affects SQL performance

2021-03-04 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34616: -- Description: Almost all SQL need to check if database exist before execution. Every check

[jira] [Created] (SPARK-34616) SessionCatalog#requireDbExists is called too many times affects SQL performance

2021-03-04 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-34616: - Summary: SessionCatalog#requireDbExists is called too many times affects SQL performance Key: SPARK-34616 URL: https://issues.apache.org/jira/browse/SPARK-34616

[jira] [Updated] (SPARK-34616) SessionCatalog#requireDbExists is called too many times affects SQL performance

2021-03-04 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34616: -- Attachment: db_existance.PNG > SessionCatalog#requireDbExists is called too many times

[jira] [Commented] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294269#comment-17294269 ] Zhang Jianguo commented on SPARK-34594: --- [~dongjoon] This issue occured with

[jira] [Comment Edited] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293670#comment-17293670 ] Zhang Jianguo edited comment on SPARK-34594 at 3/2/21, 12:37 PM: -

[jira] [Comment Edited] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293670#comment-17293670 ] Zhang Jianguo edited comment on SPARK-34594 at 3/2/21, 12:35 PM: -

[jira] [Updated] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34594: -- Attachment: report_01.PNG > OrcColumnarBatchReader uncaught exception >

[jira] [Commented] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293670#comment-17293670 ] Zhang Jianguo commented on SPARK-34594: --- [~dongjoon] Yeah, I have an external table. Other

[jira] [Updated] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34594: -- Description: RecordReaderInterator#hasNext doesn't handle exception thrown from

[jira] [Updated] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34594: -- Description: RecordReaderInterator#hasNext doesn't handle exception thrown from

[jira] [Created] (SPARK-34594) OrcColumnarBatchReader uncaught exception

2021-03-02 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-34594: - Summary: OrcColumnarBatchReader uncaught exception Key: SPARK-34594 URL: https://issues.apache.org/jira/browse/SPARK-34594 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-34462) thriftserver create many empty files

2021-02-18 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286837#comment-17286837 ] Zhang Jianguo edited comment on SPARK-34462 at 2/19/21, 6:08 AM: -

[jira] [Commented] (SPARK-34462) thriftserver create many empty files

2021-02-18 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286837#comment-17286837 ] Zhang Jianguo commented on SPARK-34462: --- [~yumwang] I updated the description. > thriftserver

[jira] [Updated] (SPARK-34462) thriftserver create many empty files

2021-02-18 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34462: -- Description: I found there are too many empty files generated by thriftserver in HDFS.  It

[jira] [Updated] (SPARK-34462) thriftserver create many empty files

2021-02-18 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34462: -- Description: I found there are too many empty files generated by thriftserver in HDFS.  It

[jira] [Updated] (SPARK-34462) thriftserver create many empty files

2021-02-18 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34462: -- Attachment: empty_file.PNG > thriftserver create many empty files >

[jira] [Updated] (SPARK-34462) thriftserver create many empty files

2021-02-17 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34462: -- Priority: Minor (was: Major) > thriftserver create many empty files >

[jira] [Created] (SPARK-34462) thriftserver create many empty files

2021-02-17 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-34462: - Summary: thriftserver create many empty files Key: SPARK-34462 URL: https://issues.apache.org/jira/browse/SPARK-34462 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34177) DESC command returns wrong data type

2021-01-20 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268458#comment-17268458 ] Zhang Jianguo commented on SPARK-34177: --- Not clear if it also affect 2.4.5 version. I'll retest

[jira] [Created] (SPARK-34177) DESC command returns wrong data type

2021-01-20 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-34177: - Summary: DESC command returns wrong data type Key: SPARK-34177 URL: https://issues.apache.org/jira/browse/SPARK-34177 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34025) 【UI】JDBC/ODBC server shows -445 session(s) are online

2021-01-06 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34025: -- Description: My spark version is 2.3.2 JDBC/ODBC server UI shows -445 sessions online which

[jira] [Updated] (SPARK-34025) 【UI】JDBC/ODBC server shows -445 session(s) are online

2021-01-06 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34025: -- Description: My spark version is 2.3.2 JDBC/ODBC server UI shows -445 sessions online which

[jira] [Created] (SPARK-34025) 【UI】JDBC/ODBC server shows -445 session(s) are online

2021-01-06 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-34025: - Summary: 【UI】JDBC/ODBC server shows -445 session(s) are online Key: SPARK-34025 URL: https://issues.apache.org/jira/browse/SPARK-34025 Project: Spark

[jira] [Comment Edited] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-04 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258109#comment-17258109 ] Zhang Jianguo edited comment on SPARK-33958 at 1/4/21, 9:50 AM:

[jira] [Commented] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-04 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258109#comment-17258109 ] Zhang Jianguo commented on SPARK-33958: --- [~yumwang] Gauss and Oracle return 0. And it looks mathe

[jira] [Updated] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-33958: -- Description: spark version: 2.3.2 {code:java} create table test_zjg(a double); insert into

[jira] [Updated] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-33958: -- Description: spark version: 2.3.2 {code:java} create table test_zjg(a double); insert into

[jira] [Updated] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-33958: -- Description: spark version: 2.3.2 {code:java} create table test_zjg(a double); insert into

[jira] [Updated] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-33958: -- Description: spark version: 2.3.2   ```sql create table test_zjg(a double); insert into

[jira] [Updated] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-02 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-33958: -- Description: spark version: 2.3.2   ```sql create table test_zjg(a double); insert into

[jira] [Created] (SPARK-33958) spark sql DoubleType(0 * (-1)) return "-0.0"

2021-01-02 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-33958: - Summary: spark sql DoubleType(0 * (-1)) return "-0.0" Key: SPARK-33958 URL: https://issues.apache.org/jira/browse/SPARK-33958 Project: Spark Issue Type:

[jira] [Created] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

2020-12-17 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-33826: - Summary: InsertIntoHiveTable generate HDFS file with invalid user Key: SPARK-33826 URL: https://issues.apache.org/jira/browse/SPARK-33826 Project: Spark

[jira] [Updated] (SPARK-33708) Error display of Spark SQL

2020-12-08 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-33708: -- Description: SQL displayed in the following table shows it starts from a wrong time. I can't

[jira] [Created] (SPARK-33708) Error display of Spark SQL

2020-12-08 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-33708: - Summary: Error display of Spark SQL Key: SPARK-33708 URL: https://issues.apache.org/jira/browse/SPARK-33708 Project: Spark Issue Type: Bug