[jira] [Created] (SPARK-36672) Using value from map in grouping sets result org.apache.spark.sql.AnalysisException

Jack Hu created SPARK-36672: --- Summary: Using value from map in grouping sets result org.apache.spark.sql.AnalysisException Key: SPARK-36672 URL: https://issues.apache.org/jira/browse/SPARK-36672 Project:

[jira] [Resolved] (SPARK-36660) Cotangent is not supported by Dataframe

[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36660. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33906

[jira] [Assigned] (SPARK-36660) Cotangent is not supported by Dataframe

[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36660: Assignee: Yuto Akutsu > Cotangent is not supported by Dataframe >

[jira] [Commented] (SPARK-36622) spark.history.kerberos.principal doesn't take value _HOST

[ https://issues.apache.org/jira/browse/SPARK-36622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410319#comment-17410319 ] angerszhu commented on SPARK-36622: --- +1 on this > spark.history.kerberos.principal doesn't take value

[jira] [Updated] (SPARK-36671) Support __and__ in num_ops.py

[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36671: Description: {code:python} >>> pser1 = pd.Series([1, 2, 3]) >>> pser2 = pd.Series([4, 5,

[jira] [Updated] (SPARK-36671) Support __and__ in num_ops.py

[ https://issues.apache.org/jira/browse/SPARK-36671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36671: Description: {code:python} >>> pser1 = pd.Series([1, 2, 3]) >>> pser2 = pd.Series([4, 5,

[jira] [Created] (SPARK-36671) Support __and__ in num_ops.py

dgd_contributor created SPARK-36671: --- Summary: Support __and__ in num_ops.py Key: SPARK-36671 URL: https://issues.apache.org/jira/browse/SPARK-36671 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36337) decimal('Nan') is unsupported in net.razorvine.pickle

[ https://issues.apache.org/jira/browse/SPARK-36337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410304#comment-17410304 ] Hyukjin Kwon commented on SPARK-36337: -- First way seems fine. For second way, we could try if we

[jira] [Commented] (SPARK-36651) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

[ https://issues.apache.org/jira/browse/SPARK-36651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410303#comment-17410303 ] Yang Jie commented on SPARK-36651: -- [~sshikov] You can try with Spark 2.4.8 first, but Spark 2.4.x will

[jira] [Comment Edited] (SPARK-36337) decimal('Nan') is unsupported in net.razorvine.pickle

[ https://issues.apache.org/jira/browse/SPARK-36337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410300#comment-17410300 ] Yikun Jiang edited comment on SPARK-36337 at 9/6/21, 2:37 AM: -- Good news:

[jira] [Comment Edited] (SPARK-36337) decimal('Nan') is unsupported in net.razorvine.pickle

[ https://issues.apache.org/jira/browse/SPARK-36337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410300#comment-17410300 ] Yikun Jiang edited comment on SPARK-36337 at 9/6/21, 2:36 AM: -- Good news:

[jira] [Commented] (SPARK-36337) decimal('Nan') is unsupported in net.razorvine.pickle

[ https://issues.apache.org/jira/browse/SPARK-36337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410300#comment-17410300 ] Yikun Jiang commented on SPARK-36337: - Good news: the doubel Nan pickled issue solved in

[jira] [Assigned] (SPARK-36667) Close resources properly in StateStoreSuite/RocksDBStateStoreSuite

[ https://issues.apache.org/jira/browse/SPARK-36667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36667: Assignee: Apache Spark > Close resources properly in

[jira] [Assigned] (SPARK-36667) Close resources properly in StateStoreSuite/RocksDBStateStoreSuite

[ https://issues.apache.org/jira/browse/SPARK-36667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36667: Assignee: (was: Apache Spark) > Close resources properly in

[jira] [Commented] (SPARK-36667) Close resources properly in StateStoreSuite/RocksDBStateStoreSuite

[ https://issues.apache.org/jira/browse/SPARK-36667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410293#comment-17410293 ] Apache Spark commented on SPARK-36667: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses

[ https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410280#comment-17410280 ] Hyukjin Kwon commented on SPARK-22674: -- i plan to fix it in Spark 3.3 fwiw. > PySpark breaks

[jira] [Resolved] (SPARK-36603) Use WeakReference over SoftReference in LevelDB to avoid retaining iterator refs

[ https://issues.apache.org/jira/browse/SPARK-36603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36603. Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved in

[jira] [Resolved] (SPARK-36635) spark-sql do NOT support that select name expression as string type now

[ https://issues.apache.org/jira/browse/SPARK-36635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36635. Resolution: Not A Problem [~weixiuli] I'll close this. If you can justify that it should

[jira] [Updated] (SPARK-36660) Cotangent is not supported by Dataframe

[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36660: --- Issue Type: Improvement (was: Bug) > Cotangent is not supported by Dataframe >

[jira] [Updated] (SPARK-36664) Log time spent waiting for cluster resources

[ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36664: --- Issue Type: Improvement (was: Bug) > Log time spent waiting for cluster resources >

[jira] [Comment Edited] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410248#comment-17410248 ] Dongjoon Hyun edited comment on SPARK-36663 at 9/5/21, 8:40 PM: This may

[jira] [Commented] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410248#comment-17410248 ] Dongjoon Hyun commented on SPARK-36663: --- This may be a feature parity issue, but this is not a

[jira] [Updated] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36663: -- Priority: Major (was: Critical) > When the existing field name is a number, an error will be

[jira] [Updated] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36663: -- Issue Type: Improvement (was: Bug) > When the existing field name is a number, an error will

[jira] [Assigned] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36663: Assignee: Apache Spark > When the existing field name is a number, an error will be

[jira] [Commented] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410182#comment-17410182 ] Apache Spark commented on SPARK-36663: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36663: Assignee: (was: Apache Spark) > When the existing field name is a number, an error

[jira] [Resolved] (SPARK-36613) The return value of the Table.capabilities should use EnumSet instead of HashSet

[ https://issues.apache.org/jira/browse/SPARK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36613. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33867

[jira] [Assigned] (SPARK-36613) The return value of the Table.capabilities should use EnumSet instead of HashSet

[ https://issues.apache.org/jira/browse/SPARK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36613: Assignee: Yang Jie > The return value of the Table.capabilities should use EnumSet

[jira] [Resolved] (SPARK-36602) Clean up redundant asInstanceOf casts

[ https://issues.apache.org/jira/browse/SPARK-36602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36602. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33852

[jira] [Assigned] (SPARK-36602) Clean up redundant asInstanceOf casts

[ https://issues.apache.org/jira/browse/SPARK-36602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36602: Assignee: Yang Jie > Clean up redundant asInstanceOf casts >

[jira] [Commented] (SPARK-32268) Bloom Filter Join

[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410137#comment-17410137 ] Apache Spark commented on SPARK-32268: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-32268) Bloom Filter Join

[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410138#comment-17410138 ] Apache Spark commented on SPARK-32268: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410129#comment-17410129 ] liuzruzi commented on SPARK-36668: -- ok， thanks > py4j.protocol.Py4JJavaError:

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410126#comment-17410126 ] Kousuke Saruta commented on SPARK-36668: [~ruzi]I meant that 2.4.8 is the last release of 2.4.x

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410121#comment-17410121 ] liuzruzi commented on SPARK-36668: -- HuaWei Spark.2.4.5, Am I misplaced? >

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410112#comment-17410112 ] Kousuke Saruta commented on SPARK-36668: [~ruzi] No more 2.4.x will be released. Does this issue