[jira] [Assigned] (SPARK-38186) Improve the README of Spark docs

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38186: Assignee: Gengliang Wang (was: Apache Spark) > Improve the README of Spark docs >

[jira] [Assigned] (SPARK-38186) Improve the README of Spark docs

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38186: Assignee: Apache Spark (was: Gengliang Wang) > Improve the README of Spark docs >

[jira] [Commented] (SPARK-38186) Improve the README of Spark docs

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490721#comment-17490721 ] Apache Spark commented on SPARK-38186: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-38186) Improve the README of Spark docs

2022-02-10 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-38186: -- Summary: Improve the README of Spark docs Key: SPARK-38186 URL: https://issues.apache.org/jira/browse/SPARK-38186 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38185) Fix data incorrect if aggregate function is empty

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38185: Assignee: (was: Apache Spark) > Fix data incorrect if aggregate function is empty >

[jira] [Assigned] (SPARK-38185) Fix data incorrect if aggregate function is empty

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38185: Assignee: Apache Spark > Fix data incorrect if aggregate function is empty >

[jira] [Commented] (SPARK-38185) Fix data incorrect if aggregate function is empty

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490709#comment-17490709 ] Apache Spark commented on SPARK-38185: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-38185) Fix data incorrect if aggregate function is empty

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490710#comment-17490710 ] Apache Spark commented on SPARK-38185: -- User 'ulysses-you' has created a pull request for this

[jira] [Updated] (SPARK-38185) Fix data incorrect if aggregate function is empty

2022-02-10 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38185: -- Summary: Fix data incorrect if aggregate function is empty (was: Fix data incorrect if aggregate is

[jira] [Assigned] (SPARK-37970) Introduce a new interface on streaming data source to notify the latest seen offset

2022-02-10 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li reassigned SPARK-37970: --- Assignee: Jungtaek Lim > Introduce a new interface on streaming data source to notify the

[jira] [Resolved] (SPARK-37970) Introduce a new interface on streaming data source to notify the latest seen offset

2022-02-10 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li resolved SPARK-37970. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35259

[jira] [Updated] (SPARK-38185) Fix data incorrect if aggregate is group only with empty function

2022-02-10 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38185: -- Description: The group only condition should check if the aggregate expression is empty. In

[jira] [Created] (SPARK-38185) Fix data incorrect if aggregate is group only with empty function

2022-02-10 Thread XiDuo You (Jira)
XiDuo You created SPARK-38185: - Summary: Fix data incorrect if aggregate is group only with empty function Key: SPARK-38185 URL: https://issues.apache.org/jira/browse/SPARK-38185 Project: Spark

[jira] [Assigned] (SPARK-38184) Fix malformatted ExpressionDescription of `decode`

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38184: Assignee: (was: Apache Spark) > Fix malformatted ExpressionDescription of `decode` >

[jira] [Assigned] (SPARK-38184) Fix malformatted ExpressionDescription of `decode`

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38184: Assignee: Apache Spark > Fix malformatted ExpressionDescription of `decode` >

[jira] [Commented] (SPARK-38184) Fix malformatted ExpressionDescription of `decode`

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490685#comment-17490685 ] Apache Spark commented on SPARK-38184: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38183) Show warning when creating pandas-on-Spark session under ANSI mode.

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38183: Assignee: (was: Apache Spark) > Show warning when creating pandas-on-Spark session

[jira] [Assigned] (SPARK-38183) Show warning when creating pandas-on-Spark session under ANSI mode.

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38183: Assignee: Apache Spark > Show warning when creating pandas-on-Spark session under ANSI

[jira] [Commented] (SPARK-38183) Show warning when creating pandas-on-Spark session under ANSI mode.

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490681#comment-17490681 ] Apache Spark commented on SPARK-38183: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-38184) Fix malformatted ExpressionDescription of `decode`

2022-02-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490680#comment-17490680 ] Xinrong Meng commented on SPARK-38184: -- Working on this. > Fix malformatted ExpressionDescription

[jira] [Created] (SPARK-38184) Fix malformatted ExpressionDescription of `decode`

2022-02-10 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-38184: Summary: Fix malformatted ExpressionDescription of `decode` Key: SPARK-38184 URL: https://issues.apache.org/jira/browse/SPARK-38184 Project: Spark Issue

[jira] [Commented] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490679#comment-17490679 ] Apache Spark commented on SPARK-38182: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490678#comment-17490678 ] Apache Spark commented on SPARK-38182: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38182: Assignee: (was: Apache Spark) > Fix NoSuchElementException if pushed filter does not

[jira] [Assigned] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38182: Assignee: Apache Spark > Fix NoSuchElementException if pushed filter does not contain

[jira] [Commented] (SPARK-38183) Show warning when creating pandas-on-Spark session under ANSI mode.

2022-02-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490674#comment-17490674 ] Haejoon Lee commented on SPARK-38183: - I'm working on this > Show warning when creating

[jira] [Created] (SPARK-38183) Show warning when creating pandas-on-Spark session under ANSI mode.

2022-02-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-38183: --- Summary: Show warning when creating pandas-on-Spark session under ANSI mode. Key: SPARK-38183 URL: https://issues.apache.org/jira/browse/SPARK-38183 Project: Spark

[jira] [Updated] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-10 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38182: -- Description: reproduce: {code:java} CREATE TABLE t (c1 int) USING PARQUET; SET

[jira] [Assigned] (SPARK-38177) Fix wrong transformExpressions in Optimizer

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38177: --- Assignee: XiDuo You > Fix wrong transformExpressions in Optimizer >

[jira] [Resolved] (SPARK-38177) Fix wrong transformExpressions in Optimizer

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38177. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35479

[jira] [Created] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-10 Thread XiDuo You (Jira)
XiDuo You created SPARK-38182: - Summary: Fix NoSuchElementException if pushed filter does not contain any references Key: SPARK-38182 URL: https://issues.apache.org/jira/browse/SPARK-38182 Project: Spark

[jira] [Updated] (SPARK-38063) Support SQL split_part function

2022-02-10 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-38063: - Description: `split_part()` is a commonly supported function by other systems such as Postgres and

[jira] [Updated] (SPARK-38063) Support SQL split_part function

2022-02-10 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-38063: - Description: `split_part()` is a commonly supported function by other systems such as Postgres and

[jira] [Resolved] (SPARK-38176) ANSI mode: allow implicitly casting String to other simple types

2022-02-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38176. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35478

[jira] [Commented] (SPARK-38037) Spark MLlib FPGrowth not working with 40+ items in Frequent Item set

2022-02-10 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490654#comment-17490654 ] zhengruifeng commented on SPARK-38037: -- I can reproduce it by: {code:java} import

[jira] [Resolved] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38178. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed This is resolved via

[jira] [Assigned] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38178: - Assignee: Yun Tang > Correct the logic to measure the memory usage of RocksDB >

[jira] [Updated] (SPARK-38125) Use static factory methods instead of the deprecated `Byte/Short/Integer/Long` constructors

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38125: -- Summary: Use static factory methods instead of the deprecated `Byte/Short/Integer/Long`

[jira] [Resolved] (SPARK-38125) Use static factory methods instead of the deprecated Integer constructors.

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38125. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35414

[jira] [Commented] (SPARK-37954) old columns should not be available after select or drop

2022-02-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490639#comment-17490639 ] L. C. Hsieh commented on SPARK-37954: - I quickly scanned what we did and it looks like intentional

[jira] [Resolved] (SPARK-37767) Follow-up Improvements of Hidden File Metadata Support for Spark SQL

2022-02-10 Thread Yaohua Zhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaohua Zhao resolved SPARK-37767. - Resolution: Fixed > Follow-up Improvements of Hidden File Metadata Support for Spark SQL >

[jira] [Commented] (SPARK-37954) old columns should not be available after select or drop

2022-02-10 Thread Andrew Murphy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490630#comment-17490630 ] Andrew Murphy commented on SPARK-37954: ---  Hi all, Super excited to report on this one, this is my

[jira] [Resolved] (SPARK-38159) Minor refactor of MetadataAttribute unapply method

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38159. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35459

[jira] [Commented] (SPARK-38161) when clean data hope to spilt one dataframe or dataset to two dataframe

2022-02-10 Thread gaokui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490625#comment-17490625 ] gaokui commented on SPARK-38161: do you mean that need twice tranformation in one spark dag? can this

[jira] [Assigned] (SPARK-38159) Minor refactor of MetadataAttribute unapply method

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38159: --- Assignee: Yaohua Zhao > Minor refactor of MetadataAttribute unapply method >

[jira] [Commented] (SPARK-38161) when clean data hope to spilt one dataframe or dataset to two dataframe

2022-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490611#comment-17490611 ] Hyukjin Kwon commented on SPARK-38161: -- You can use one condition: {code} cond=... df1=

[jira] [Commented] (SPARK-38161) when clean data hope to spilt one dataframe or dataset to two dataframe

2022-02-10 Thread gaokui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490606#comment-17490606 ] gaokui commented on SPARK-38161: ok, but why not use one condition , get two dataframe or dataframe list 

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

2022-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33598: - Affects Version/s: 3.1.2 (was: 2.4.7) > Support Java Class with

[jira] [Resolved] (SPARK-38174) SparkR documentation build fails in CI

2022-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38174. -- Resolution: Cannot Reproduce > SparkR documentation build fails in CI >

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

2022-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490590#comment-17490590 ] Hyukjin Kwon commented on SPARK-38174: -- Thanks for investigation and monitoring [~zero323] and

[jira] [Closed] (SPARK-37912) Add benchmark for delta binary encoding

2022-02-10 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra closed SPARK-37912. - > Add benchmark for delta binary encoding > --- > >

[jira] [Resolved] (SPARK-37912) Add benchmark for delta binary encoding

2022-02-10 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra resolved SPARK-37912. --- Resolution: Fixed resolved by  SPARK-37928 > Add benchmark for delta binary encoding >

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

2022-02-10 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490574#comment-17490574 ] Maciej Szymkiewicz commented on SPARK-38174: I also compared the last failing log and the

[jira] [Assigned] (SPARK-38180) Allow safe up-cast expressions in correlated equality predicates

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38180: Assignee: Apache Spark > Allow safe up-cast expressions in correlated equality

[jira] [Assigned] (SPARK-38180) Allow safe up-cast expressions in correlated equality predicates

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38180: Assignee: (was: Apache Spark) > Allow safe up-cast expressions in correlated

[jira] [Commented] (SPARK-38180) Allow safe up-cast expressions in correlated equality predicates

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490554#comment-17490554 ] Apache Spark commented on SPARK-38180: -- User 'allisonwang-db' has created a pull request for this

[jira] [Resolved] (SPARK-38134) Upgrade Arrow to 7.0.0

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38134. --- Fix Version/s: 3.3.0 Assignee: Chao Sun Resolution: Fixed This is resolved

[jira] [Commented] (SPARK-38181) Update comments for KafkaDataConsumer

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490486#comment-17490486 ] Apache Spark commented on SPARK-38181: -- User 'ArvinZheng' has created a pull request for this

[jira] [Assigned] (SPARK-38181) Update comments for KafkaDataConsumer

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38181: Assignee: (was: Apache Spark) > Update comments for KafkaDataConsumer >

[jira] [Commented] (SPARK-38181) Update comments for KafkaDataConsumer

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490485#comment-17490485 ] Apache Spark commented on SPARK-38181: -- User 'ArvinZheng' has created a pull request for this

[jira] [Assigned] (SPARK-38181) Update comments for KafkaDataConsumer

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38181: Assignee: Apache Spark > Update comments for KafkaDataConsumer >

[jira] [Commented] (SPARK-38181) Update comments for KafkaDataConsumer

2022-02-10 Thread Arvin Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490484#comment-17490484 ] Arvin Zheng commented on SPARK-38181: - [https://github.com/apache/spark/pull/35484] PR created >

[jira] [Created] (SPARK-38181) Update comments for KafkaDataConsumer

2022-02-10 Thread Arvin Zheng (Jira)
Arvin Zheng created SPARK-38181: --- Summary: Update comments for KafkaDataConsumer Key: SPARK-38181 URL: https://issues.apache.org/jira/browse/SPARK-38181 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-38180) Allow safe up-cast expressions in correlated equality predicates

2022-02-10 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-38180: - Description: Relax the constraint added in SPARK-35080 by allowing safe up-cast expressions in

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490457#comment-17490457 ] Dongjoon Hyun commented on SPARK-38174: --- Yes, it's green now. It must be some transient issue. -

[jira] [Updated] (SPARK-38180) Allow safe up-cast expressions in correlated equality predicates

2022-02-10 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-38180: - Description: Relax the constraint added in SPARK-35080 by allowing safe up-cast expressions in

[jira] [Created] (SPARK-38180) Allow safe up cast expressions in correlated equality predicates

2022-02-10 Thread Allison Wang (Jira)
Allison Wang created SPARK-38180: Summary: Allow safe up cast expressions in correlated equality predicates Key: SPARK-38180 URL: https://issues.apache.org/jira/browse/SPARK-38180 Project: Spark

[jira] [Updated] (SPARK-38180) Allow safe up-cast expressions in correlated equality predicates

2022-02-10 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-38180: - Summary: Allow safe up-cast expressions in correlated equality predicates (was: Allow safe up

[jira] [Commented] (SPARK-38179) Improve WritableColumnVector to better support null struct

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490450#comment-17490450 ] Apache Spark commented on SPARK-38179: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38179) Improve WritableColumnVector to better support null struct

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38179: Assignee: (was: Apache Spark) > Improve WritableColumnVector to better support null

[jira] [Assigned] (SPARK-38179) Improve WritableColumnVector to better support null struct

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38179: Assignee: Apache Spark > Improve WritableColumnVector to better support null struct >

[jira] [Created] (SPARK-38179) Improve WritableColumnVector to better support null struct

2022-02-10 Thread Chao Sun (Jira)
Chao Sun created SPARK-38179: Summary: Improve WritableColumnVector to better support null struct Key: SPARK-38179 URL: https://issues.apache.org/jira/browse/SPARK-38179 Project: Spark Issue

[jira] [Updated] (SPARK-31357) DataSourceV2: Catalog API for view metadata

2022-02-10 Thread John Zhuge (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-31357: --- Target Version/s: 3.3.0 (was: 3.2.0) > DataSourceV2: Catalog API for view metadata >

[jira] [Updated] (SPARK-31357) DataSourceV2: Catalog API for view metadata

2022-02-10 Thread John Zhuge (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-31357: --- Summary: DataSourceV2: Catalog API for view metadata (was: SPIP: Catalog API for view metadata) >

[jira] [Resolved] (SPARK-38171) Upgrade ORC to 1.7.3

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38171. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35474

[jira] [Assigned] (SPARK-38171) Upgrade ORC to 1.7.3

2022-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38171: - Assignee: Dongjoon Hyun > Upgrade ORC to 1.7.3 > > >

[jira] [Assigned] (SPARK-38008) Fix the method description of refill

2022-02-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38008: Assignee: weixiuli > Fix the method description of refill >

[jira] [Resolved] (SPARK-38008) Fix the method description of refill

2022-02-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38008. -- Fix Version/s: 3.3.0 Resolution: Fixed > Fix the method description of refill >

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

2022-02-10 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490344#comment-17490344 ] Maciej Szymkiewicz commented on SPARK-38174: And now, it is green again :/ > SparkR

[jira] [Commented] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490335#comment-17490335 ] Apache Spark commented on SPARK-38178: -- User 'Myasuka' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38178: Assignee: (was: Apache Spark) > Correct the logic to measure the memory usage of

[jira] [Assigned] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38178: Assignee: Apache Spark > Correct the logic to measure the memory usage of RocksDB >

[jira] [Commented] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490333#comment-17490333 ] Apache Spark commented on SPARK-38178: -- User 'Myasuka' has created a pull request for this issue:

[jira] [Created] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

2022-02-10 Thread Yun Tang (Jira)
Yun Tang created SPARK-38178: Summary: Correct the logic to measure the memory usage of RocksDB Key: SPARK-38178 URL: https://issues.apache.org/jira/browse/SPARK-38178 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38177) Fix wrong transformExpressions in Optimizer

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490302#comment-17490302 ] Apache Spark commented on SPARK-38177: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-38177) Fix wrong transformExpressions in Optimizer

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38177: Assignee: Apache Spark > Fix wrong transformExpressions in Optimizer >

[jira] [Assigned] (SPARK-38177) Fix wrong transformExpressions in Optimizer

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38177: Assignee: (was: Apache Spark) > Fix wrong transformExpressions in Optimizer >

[jira] [Updated] (SPARK-38177) Fix wrong transformExpressions in Optimizer

2022-02-10 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38177: -- Description: `transformExpressions` can only traverse all expressions in this current query plan, so

[jira] [Created] (SPARK-38177) Fix wrong transformExpressions in Optimizer

2022-02-10 Thread XiDuo You (Jira)
XiDuo You created SPARK-38177: - Summary: Fix wrong transformExpressions in Optimizer Key: SPARK-38177 URL: https://issues.apache.org/jira/browse/SPARK-38177 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37993) Avoid multiple calls to configuration parameter values

2022-02-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37993. -- Resolution: Won't Fix > Avoid multiple calls to configuration parameter values >

[jira] [Updated] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35531: Fix Version/s: 3.1.4 > Can not insert into hive bucket table if create table with upper case

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

2022-02-10 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490227#comment-17490227 ] Maciej Szymkiewicz commented on SPARK-38174: I run R doc builds against

[jira] [Resolved] (SPARK-38054) DS V2 supports list namespaces of MySQL

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38054. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35355

[jira] [Assigned] (SPARK-38054) DS V2 supports list namespaces of MySQL

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38054: --- Assignee: jiaan.geng > DS V2 supports list namespaces of MySQL >

[jira] [Resolved] (SPARK-37960) A new framework to represent catalyst expressions in DS v2 APIs

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37960. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35248

[jira] [Assigned] (SPARK-37960) A new framework to represent catalyst expressions in DS v2 APIs

2022-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37960: --- Assignee: jiaan.geng > A new framework to represent catalyst expressions in DS v2 APIs >

[jira] [Assigned] (SPARK-38176) ANSI mode: allow implicitly casting String to other simple types

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38176: Assignee: Gengliang Wang (was: Apache Spark) > ANSI mode: allow implicitly casting

[jira] [Commented] (SPARK-38176) ANSI mode: allow implicitly casting String to other simple types

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490184#comment-17490184 ] Apache Spark commented on SPARK-38176: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38176) ANSI mode: allow implicitly casting String to other simple types

2022-02-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38176: Assignee: Apache Spark (was: Gengliang Wang) > ANSI mode: allow implicitly casting

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

2022-02-10 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490180#comment-17490180 ] Maciej Szymkiewicz commented on SPARK-38174: The most obvious change, but maybe unrelated is

  1   2   >