[jira] [Created] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-16 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-34770: --- Summary: InMemoryCatalog.tableExists should not fail if database doesn't exist Key: SPARK-34770 URL: https://issues.apache.org/jira/browse/SPARK-34770 Project: Spark

[jira] [Assigned] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34768: Assignee: Apache Spark > Respect the default input buffer size in Univocity >

[jira] [Assigned] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34769: Assignee: Gengliang Wang (was: Apache Spark) > AnsiTypeCoercion: return narrowest

[jira] [Assigned] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34768: Assignee: (was: Apache Spark) > Respect the default input buffer size in Univocity >

[jira] [Assigned] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34769: Assignee: Apache Spark (was: Gengliang Wang) > AnsiTypeCoercion: return narrowest

[jira] [Commented] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303095#comment-17303095 ] Apache Spark commented on SPARK-34769: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303094#comment-17303094 ] Apache Spark commented on SPARK-34768: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34769: -- Summary: AnsiTypeCoercion: return narrowest convertible type among TypeCollection Key: SPARK-34769 URL: https://issues.apache.org/jira/browse/SPARK-34769

[jira] [Updated] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34768: - Issue Type: Bug (was: Improvement) > Respect the default input buffer size in Univocity >

[jira] [Updated] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34768: - Affects Version/s: 3.0.2 > Respect the default input buffer size in Univocity >

[jira] [Created] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34768: Summary: Respect the default input buffer size in Univocity Key: SPARK-34768 URL: https://issues.apache.org/jira/browse/SPARK-34768 Project: Spark Issue

[jira] [Comment Edited] (SPARK-10697) Lift Calculation in Association Rule mining

2021-03-16 Thread Yashwanth Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303086#comment-17303086 ] Yashwanth Kumar edited comment on SPARK-10697 at 3/17/21, 4:36 AM: ---

[jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining

2021-03-16 Thread Yashwanth Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303086#comment-17303086 ] Yashwanth Kumar commented on SPARK-10697: - Glad that the change proposed by me 5 yrs back got

[jira] [Resolved] (SPARK-34767) sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34767. -- Resolution: Incomplete > sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法 >

[jira] [Commented] (SPARK-34767) sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303082#comment-17303082 ] Hyukjin Kwon commented on SPARK-34767: -- 1. Please use English to communicate other maintainers.

[jira] [Resolved] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34504. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34504: --- Assignee: Wenchen Fan > Avoid unnecessary view resolving and remove the `performCheck`

[jira] [Created] (SPARK-34767) sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法

2021-03-16 Thread MrYang (Jira)
MrYang created SPARK-34767: -- Summary: sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法 Key: SPARK-34767 URL: https://issues.apache.org/jira/browse/SPARK-34767 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-28220) join foldable condition not pushed down when parent filter is totally pushed down

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303058#comment-17303058 ] Apache Spark commented on SPARK-28220: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-28220) join foldable condition not pushed down when parent filter is totally pushed down

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303057#comment-17303057 ] Apache Spark commented on SPARK-28220: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303053#comment-17303053 ] Yang Jie commented on SPARK-34762: -- [~dongjoon]  It seems that the problem still exists, such as

[jira] [Commented] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303022#comment-17303022 ] Apache Spark commented on SPARK-34766: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34766: Assignee: Apache Spark > Do not capture maven config for views >

[jira] [Assigned] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34766: Assignee: (was: Apache Spark) > Do not capture maven config for views >

[jira] [Updated] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34766: Description: Due to the bad network, we always use the thirdparty maven repo to run test. e.g.,

[jira] [Updated] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34766: Environment: (was: Due to the bad network, we always use the thirdparty maven repo to run

[jira] [Created] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread ulysses you (Jira)
ulysses you created SPARK-34766: --- Summary: Do not capture maven config for views Key: SPARK-34766 URL: https://issues.apache.org/jira/browse/SPARK-34766 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34765) Linear Models standardization optimization

2021-03-16 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34765: - Description: Existing impl of standardization in linear models does *NOT* center the vectors

[jira] [Updated] (SPARK-34765) Linear Models standardization optimization

2021-03-16 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34765: - Issue Type: Umbrella (was: Improvement) > Linear Models standardization optimization >

[jira] [Resolved] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34714. -- Fix Version/s: 3.1.2 Resolution: Fixed > collect_list(struct()) fails when

[jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303009#comment-17303009 ] Takeshi Yamamuro commented on SPARK-34714: -- Ah, I've checked the latest branch-3.1 again and I

[jira] [Created] (SPARK-34765) Linear Models standardization optimization

2021-03-16 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-34765: Summary: Linear Models standardization optimization Key: SPARK-34765 URL: https://issues.apache.org/jira/browse/SPARK-34765 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303001#comment-17303001 ] Nivas Umapathy edited comment on SPARK-34751 at 3/17/21, 12:53 AM: ---

[jira] [Comment Edited] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303001#comment-17303001 ] Nivas Umapathy edited comment on SPARK-34751 at 3/17/21, 12:52 AM: ---

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303001#comment-17303001 ] Nivas Umapathy commented on SPARK-34751: the schema is extracted from the same file, before

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302988#comment-17302988 ] Takeshi Yamamuro commented on SPARK-34751: -- Could you describe more to reproduce the issue?

[jira] [Updated] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34751: - Affects Version/s: 3.1.1 > Parquet with invalid chars on column name reads double as

[jira] [Comment Edited] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302672#comment-17302672 ] Nivas Umapathy edited comment on SPARK-34751 at 3/16/21, 7:56 PM: -- I

[jira] [Commented] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302796#comment-17302796 ] Dongjoon Hyun commented on SPARK-25935: --- Please let me know if the previous status, `Resolution =

[jira] [Comment Edited] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302792#comment-17302792 ] Dongjoon Hyun edited comment on SPARK-25935 at 3/16/21, 6:38 PM: - I

[jira] [Commented] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302792#comment-17302792 ] Dongjoon Hyun commented on SPARK-25935: --- I removed the `Fix Version = 3.0.0` from this issue

[jira] [Updated] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25935: -- Fix Version/s: (was: 3.0.0) > Prevent null rows from JSON parser >

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-03-16 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302777#comment-17302777 ] Shane Knapp commented on SPARK-34738: - i'll be doing this next tuesday (3/23) and teaching one of my

[jira] [Created] (SPARK-34764) Propagate reason for executor loss to the UI

2021-03-16 Thread Holden Karau (Jira)
Holden Karau created SPARK-34764: Summary: Propagate reason for executor loss to the UI Key: SPARK-34764 URL: https://issues.apache.org/jira/browse/SPARK-34764 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302731#comment-17302731 ] Apache Spark commented on SPARK-34761: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34761: Assignee: Max Gekk (was: Apache Spark) > Add a day-time interval to a timestamp >

[jira] [Assigned] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34761: Assignee: Apache Spark (was: Max Gekk) > Add a day-time interval to a timestamp >

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302729#comment-17302729 ] Dongjoon Hyun commented on SPARK-34762: --- Thank you for reporting, [~LuciferYang] . There was

[jira] [Updated] (SPARK-33428) conv UDF returns incorrect value

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33428: -- Fix Version/s: (was: 3.2.0) > conv UDF returns incorrect value >

[jira] [Reopened] (SPARK-33428) conv UDF returns incorrect value

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-33428: --- Assignee: (was: angerszhu) > conv UDF returns incorrect value >

[jira] [Commented] (SPARK-33428) conv UDF returns incorrect value

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302694#comment-17302694 ] Dongjoon Hyun commented on SPARK-33428: --- The commit is reverted. > conv UDF returns incorrect

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302672#comment-17302672 ] Nivas Umapathy commented on SPARK-34751: I ran it on 3.1.1 and it still has the same problem.

[jira] [Commented] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302622#comment-17302622 ] Apache Spark commented on SPARK-34763: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302621#comment-17302621 ] Apache Spark commented on SPARK-34763: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34763: Assignee: Kousuke Saruta (was: Apache Spark) > col(), $"" and df("name") should handle

[jira] [Assigned] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34763: Assignee: Apache Spark (was: Kousuke Saruta) > col(), $"" and df("name") should handle

[jira] [Updated] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34763: --- Summary: col(), $"" and df("name") should handle quoted column names properly. (was:

[jira] [Created] (SPARK-34763) col(), $"" and df("name") should handle quoted column name properly.

2021-03-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34763: -- Summary: col(), $"" and df("name") should handle quoted column name properly. Key: SPARK-34763 URL: https://issues.apache.org/jira/browse/SPARK-34763 Project:

[jira] [Commented] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302584#comment-17302584 ] Apache Spark commented on SPARK-34504: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302583#comment-17302583 ] Apache Spark commented on SPARK-34504: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34504: Assignee: (was: Apache Spark) > Avoid unnecessary view resolving and remove the

[jira] [Assigned] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34504: Assignee: Apache Spark > Avoid unnecessary view resolving and remove the `performCheck`

[jira] [Updated] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-34762: - Description: PR with Scala 2.13 build failure includes  * [https://github.com/apache/spark/pull/31849]

[jira] [Resolved] (SPARK-34680) Spark hangs when out of diskspace

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34680. -- Resolution: Not A Problem > Spark hangs when out of diskspace >

[jira] [Commented] (SPARK-34680) Spark hangs when out of diskspace

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302578#comment-17302578 ] Takeshi Yamamuro commented on SPARK-34680: -- Not enough information to reproduce the issue, so

[jira] [Updated] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34751: - Target Version/s: (was: 2.4.3) > Parquet with invalid chars on column name reads

[jira] [Updated] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34751: - Fix Version/s: (was: 2.4.8) > Parquet with invalid chars on column name reads

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302573#comment-17302573 ] Takeshi Yamamuro commented on SPARK-34751: -- Could you try newer Spark, e.g., 2.4.7, 3.0.2, or

[jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302570#comment-17302570 ] Takeshi Yamamuro commented on SPARK-34714: -- I've checked that branch-3.1 still has this issue

[jira] [Updated] (SPARK-34694) Improve Spark SQL Source Filter to allow pushdown of filters span multiple columns

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34694: - Component/s: (was: Spark Core) SQL > Improve Spark SQL Source

[jira] [Updated] (SPARK-34661) Replaces `OriginalType` with `LogicalTypeAnnotation` in VectorizedColumnReader

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-34661: - Description: {{OriginalType}} and {{DecimalMetadata}} has been marked as {{@Deprecated}} in new

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302544#comment-17302544 ] Yang Jie commented on SPARK-34762: -- Maven compilation seems not failed cc [~dongjoon] [~srowen]

[jira] [Created] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-34762: Summary: Many PR's Scala 2.13 build action failed Key: SPARK-34762 URL: https://issues.apache.org/jira/browse/SPARK-34762 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302502#comment-17302502 ] Apache Spark commented on SPARK-34759: -- User 'zengruios' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34759: Assignee: (was: Apache Spark) > run JavaSparkSQLExample failed with Exception. >

[jira] [Commented] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302501#comment-17302501 ] Apache Spark commented on SPARK-34759: -- User 'zengruios' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34759: Assignee: Apache Spark > run JavaSparkSQLExample failed with Exception. >

[jira] [Commented] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302497#comment-17302497 ] Apache Spark commented on SPARK-34760: -- User 'zengruios' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34760: Assignee: Apache Spark > run JavaSQLDataSourceExample failed with Exception in >

[jira] [Commented] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302496#comment-17302496 ] Apache Spark commented on SPARK-34760: -- User 'zengruios' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34760: Assignee: (was: Apache Spark) > run JavaSQLDataSourceExample failed with Exception

[jira] [Updated] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-34760: Description: run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample(). when excecute

[jira] [Updated] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-34760: Summary: run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample(). (was: run

[jira] [Commented] (SPARK-21449) Hive client's SessionState was not closed properly in HiveExternalCatalog

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302439#comment-17302439 ] Apache Spark commented on SPARK-21449: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-21449) Hive client's SessionState was not closed properly in HiveExternalCatalog

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302438#comment-17302438 ] Apache Spark commented on SPARK-21449: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Max Gekk (Jira)
Max Gekk created SPARK-34761: Summary: Add a day-time interval to a timestamp Key: SPARK-34761 URL: https://issues.apache.org/jira/browse/SPARK-34761 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34761: - Description: Support adding of DayTimeIntervalType values to TIMESTAMP values. (was: Support adding of

[jira] [Updated] (SPARK-34754) sparksql 'add jar' not support hdfs ha mode in k8s

2021-03-16 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-34754: -- Description: Submit app to K8S,  the executors meet exception 

[jira] [Created] (SPARK-34760) run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
zengrui created SPARK-34760: --- Summary: run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample(). Key: SPARK-34760 URL: https://issues.apache.org/jira/browse/SPARK-34760 Project: Spark

[jira] [Assigned] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34757: Assignee: (was: Apache Spark) > Spark submit should ignore cache for SNAPSHOT

[jira] [Commented] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302373#comment-17302373 ] Apache Spark commented on SPARK-34757: -- User 'bozhang2820' has created a pull request for this

[jira] [Assigned] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34757: Assignee: Apache Spark > Spark submit should ignore cache for SNAPSHOT dependencies >

[jira] [Assigned] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34757: Assignee: Apache Spark > Spark submit should ignore cache for SNAPSHOT dependencies >

[jira] [Created] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread zengrui (Jira)
zengrui created SPARK-34759: --- Summary: run JavaSparkSQLExample failed with Exception. Key: SPARK-34759 URL: https://issues.apache.org/jira/browse/SPARK-34759 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34758) Simplify Analyzer.resolveLiteralFunction

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302354#comment-17302354 ] Apache Spark commented on SPARK-34758: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34758) Simplify Analyzer.resolveLiteralFunction

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34758: Assignee: Apache Spark > Simplify Analyzer.resolveLiteralFunction >

[jira] [Commented] (SPARK-34758) Simplify Analyzer.resolveLiteralFunction

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302353#comment-17302353 ] Apache Spark commented on SPARK-34758: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34758) Simplify Analyzer.resolveLiteralFunction

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34758: Assignee: (was: Apache Spark) > Simplify Analyzer.resolveLiteralFunction >

[jira] [Created] (SPARK-34758) Simplify Analyzer.resolveLiteralFunction

2021-03-16 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-34758: --- Summary: Simplify Analyzer.resolveLiteralFunction Key: SPARK-34758 URL: https://issues.apache.org/jira/browse/SPARK-34758 Project: Spark Issue Type:

[jira] [Created] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Bo Zhang (Jira)
Bo Zhang created SPARK-34757: Summary: Spark submit should ignore cache for SNAPSHOT dependencies Key: SPARK-34757 URL: https://issues.apache.org/jira/browse/SPARK-34757 Project: Spark Issue

  1   2   >