[jira] [Commented] (SPARK-34713) group by CreateStruct with ExtractValue fails analysis

[ https://issues.apache.org/jira/browse/SPARK-34713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299392#comment-17299392 ] Apache Spark commented on SPARK-34713: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

Lauri Koobas created SPARK-34714: Summary: collect_list(struct()) fails when used with GROUP BY Key: SPARK-34714 URL: https://issues.apache.org/jira/browse/SPARK-34714 Project: Spark Issue

[jira] [Commented] (SPARK-34713) group by CreateStruct with ExtractValue fails analysis

[ https://issues.apache.org/jira/browse/SPARK-34713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299391#comment-17299391 ] Apache Spark commented on SPARK-34713: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34713) group by CreateStruct with ExtractValue fails analysis

[ https://issues.apache.org/jira/browse/SPARK-34713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34713: Assignee: (was: Apache Spark) > group by CreateStruct with ExtractValue fails

[jira] [Assigned] (SPARK-34713) group by CreateStruct with ExtractValue fails analysis

[ https://issues.apache.org/jira/browse/SPARK-34713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34713: Assignee: Apache Spark > group by CreateStruct with ExtractValue fails analysis >

[jira] [Commented] (SPARK-34679) inferTimestamp option is missing from the list of options in DataFrameReader.json.

[ https://issues.apache.org/jira/browse/SPARK-34679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299389#comment-17299389 ] Prashanth Babu commented on SPARK-34679: Thanks [~hyukjin.kwon]. I will create a PR. >

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299388#comment-17299388 ] Dongjoon Hyun commented on SPARK-34507: --- It's a daily snapshot, [~vincenzobaz]. If you didn't see

[jira] [Created] (SPARK-34713) group by CreateStruct with ExtractValue fails analysis

Wenchen Fan created SPARK-34713: --- Summary: group by CreateStruct with ExtractValue fails analysis Key: SPARK-34713 URL: https://issues.apache.org/jira/browse/SPARK-34713 Project: Spark Issue

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299373#comment-17299373 ] Dongjoon Hyun commented on SPARK-34675: --- Thank you for checking those, [~maxgekk] . In that case,

[jira] [Assigned] (SPARK-34711) Exercise code-gen enable/disable code paths for SHJ in join test suites

[ https://issues.apache.org/jira/browse/SPARK-34711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34711: - Assignee: Cheng Su > Exercise code-gen enable/disable code paths for SHJ in join test

[jira] [Resolved] (SPARK-34711) Exercise code-gen enable/disable code paths for SHJ in join test suites

[ https://issues.apache.org/jira/browse/SPARK-34711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34711. --- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299376#comment-17299376 ] Dongjoon Hyun commented on SPARK-34675: --- I linked those issue as `Superceded by` links. >

[jira] [Resolved] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34675. --- Fix Version/s: 3.2.0 Resolution: Duplicate > TimeZone inconsistencies when JVM and

[jira] [Commented] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml)

[ https://issues.apache.org/jira/browse/SPARK-24964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299364#comment-17299364 ] Frank Wettstein commented on SPARK-24964: - We are using the latest version of spark (3.1.1),

[jira] [Comment Edited] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml)

[ https://issues.apache.org/jira/browse/SPARK-24964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299364#comment-17299364 ] Frank Wettstein edited comment on SPARK-24964 at 3/11/21, 7:19 AM: --- We

[jira] [Commented] (SPARK-34712) Refactor UT about hive UT

[ https://issues.apache.org/jira/browse/SPARK-34712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299358#comment-17299358 ] Apache Spark commented on SPARK-34712: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34712) Refactor UT about hive UT

[ https://issues.apache.org/jira/browse/SPARK-34712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34712: Assignee: Apache Spark > Refactor UT about hive UT > - > >

[jira] [Assigned] (SPARK-34712) Refactor UT about hive UT

[ https://issues.apache.org/jira/browse/SPARK-34712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34712: Assignee: (was: Apache Spark) > Refactor UT about hive UT >

[jira] [Commented] (SPARK-34712) Refactor UT about hive UT

[ https://issues.apache.org/jira/browse/SPARK-34712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299357#comment-17299357 ] Apache Spark commented on SPARK-34712: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34711) Exercise code-gen enable/disable code paths for SHJ in join test suites

[ https://issues.apache.org/jira/browse/SPARK-34711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34711: Assignee: (was: Apache Spark) > Exercise code-gen enable/disable code paths for SHJ

[jira] [Assigned] (SPARK-34711) Exercise code-gen enable/disable code paths for SHJ in join test suites

[ https://issues.apache.org/jira/browse/SPARK-34711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34711: Assignee: Apache Spark > Exercise code-gen enable/disable code paths for SHJ in join

[jira] [Created] (SPARK-34712) Refactor UT about hive UT

angerszhu created SPARK-34712: - Summary: Refactor UT about hive UT Key: SPARK-34712 URL: https://issues.apache.org/jira/browse/SPARK-34712 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34711) Exercise code-gen enable/disable code paths for SHJ in join test suites

[ https://issues.apache.org/jira/browse/SPARK-34711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299352#comment-17299352 ] Apache Spark commented on SPARK-34711: -- User 'c21' has created a pull request for this issue:

[jira] [Updated] (SPARK-34711) Exercise code-gen enable/disable code paths for SHJ in join test suites

[ https://issues.apache.org/jira/browse/SPARK-34711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34711: - Summary: Exercise code-gen enable/disable code paths for SHJ in join test suites (was: Exercise

[jira] [Created] (SPARK-34711) Exercise code-gen enable/disable code paths in join test suites

Cheng Su created SPARK-34711: Summary: Exercise code-gen enable/disable code paths in join test suites Key: SPARK-34711 URL: https://issues.apache.org/jira/browse/SPARK-34711 Project: Spark

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299347#comment-17299347 ] vincenzobaz commented on SPARK-34507: - Thank you [~srowen] for the quick fix! Do you know when it

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299345#comment-17299345 ] Maxim Gekk commented on SPARK-34675: > Could you link the original related patch and close this

[jira] [Resolved] (SPARK-34457) DataSource V2: Add default null ordering to SortDirection

[ https://issues.apache.org/jira/browse/SPARK-34457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34457. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31580

[jira] [Updated] (SPARK-34491) Move data source options docs for Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-34491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34491: Description: Currently we documents options of various data sources for Python and Scala in a

[jira] [Resolved] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

[ https://issues.apache.org/jira/browse/SPARK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34546. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31652

[jira] [Assigned] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

[ https://issues.apache.org/jira/browse/SPARK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34546: --- Assignee: Terry Kim > AlterViewAs.query should be analyzed during the analysis phase >

[jira] [Updated] (SPARK-34698) Temporary views should be analyzed during the analysis phase for all applicable commands

[ https://issues.apache.org/jira/browse/SPARK-34698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34698: -- Description: There are commands such as "CREATE TEMP VIEW", "ALTER VIEW AS", "CREATE TEMP VIEW

[jira] [Commented] (SPARK-34669) Spark SQL uses the function[ length()] to return the length of the string rather than the length of the character

[ https://issues.apache.org/jira/browse/SPARK-34669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299290#comment-17299290 ] Hyukjin Kwon commented on SPARK-34669: -- I am suggesting to check the behaviours of length function

[jira] [Commented] (SPARK-33436) PySpark equivalent of SparkContext.hadoopConfiguration

[ https://issues.apache.org/jira/browse/SPARK-33436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299283#comment-17299283 ] Nicholas Chammas commented on SPARK-33436: -- [~hyukjin.kwon] - Can you clarify please why this

[jira] [Commented] (SPARK-34710) Add isView for SHOW TABLES to distinguish view and tables

[ https://issues.apache.org/jira/browse/SPARK-34710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299265#comment-17299265 ] Apache Spark commented on SPARK-34710: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34710) Add isView for SHOW TABLES to distinguish view and tables

[ https://issues.apache.org/jira/browse/SPARK-34710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34710: Assignee: Apache Spark > Add isView for SHOW TABLES to distinguish view and tables >

[jira] [Assigned] (SPARK-34710) Add isView for SHOW TABLES to distinguish view and tables

[ https://issues.apache.org/jira/browse/SPARK-34710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34710: Assignee: (was: Apache Spark) > Add isView for SHOW TABLES to distinguish view and

[jira] [Commented] (SPARK-34710) Add isView for SHOW TABLES to distinguish view and tables

[ https://issues.apache.org/jira/browse/SPARK-34710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299264#comment-17299264 ] Apache Spark commented on SPARK-34710: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-34710) Add isView for SHOW TABLES to distinguish view and tables

Kent Yao created SPARK-34710: Summary: Add isView for SHOW TABLES to distinguish view and tables Key: SPARK-34710 URL: https://issues.apache.org/jira/browse/SPARK-34710 Project: Spark Issue

[jira] [Commented] (SPARK-34669) Spark SQL uses the function[ length()] to return the length of the string rather than the length of the character

[ https://issues.apache.org/jira/browse/SPARK-34669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299257#comment-17299257 ] zhishun luan commented on SPARK-34669: -- Since spark SQL is a unified SQL programming interface,

[jira] [Resolved] (SPARK-34703) Fix pyspark test when using sort_values on Pandas

[ https://issues.apache.org/jira/browse/SPARK-34703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34703. --- Fix Version/s: 2.4.8 Resolution: Fixed This is resolved via 

[jira] [Updated] (SPARK-34702) Avoid unnecessary code generation in JoinCodegenSupport.genBuildSideVars

[ https://issues.apache.org/jira/browse/SPARK-34702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34702: - Parent: SPARK-34706 Issue Type: Sub-task (was: Improvement) > Avoid unnecessary code

[jira] [Updated] (SPARK-34702) Avoid unnecessary code generation in JoinCodegenSupport.genBuildSideVars

[ https://issues.apache.org/jira/browse/SPARK-34702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34702: - Issue Type: Improvement (was: Bug) > Avoid unnecessary code generation in

[jira] [Updated] (SPARK-34533) Eliminate LEFT ANTI join to empty relation in AQE

[ https://issues.apache.org/jira/browse/SPARK-34533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34533: - Parent: SPARK-34706 Issue Type: Sub-task (was: Improvement) > Eliminate LEFT ANTI join to

[jira] [Updated] (SPARK-34709) Code-gen broadcast nested loop join (defaultJoin)

[ https://issues.apache.org/jira/browse/SPARK-34709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34709: - Parent: SPARK-34706 Issue Type: Sub-task (was: Improvement) > Code-gen broadcast nested loop

[jira] [Updated] (SPARK-34708) Code-gen broadcast nested loop join (left semi/left anti)

[ https://issues.apache.org/jira/browse/SPARK-34708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34708: - Parent: SPARK-34706 Issue Type: Sub-task (was: Improvement) > Code-gen broadcast nested loop

[jira] [Updated] (SPARK-34707) Code-gen broadcast nested loop join (left outer/right outer)

[ https://issues.apache.org/jira/browse/SPARK-34707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34707: - Parent: SPARK-34706 Issue Type: Sub-task (was: Improvement) > Code-gen broadcast nested loop

[jira] [Created] (SPARK-34709) Code-gen broadcast nested loop join (defaultJoin)

Cheng Su created SPARK-34709: Summary: Code-gen broadcast nested loop join (defaultJoin) Key: SPARK-34709 URL: https://issues.apache.org/jira/browse/SPARK-34709 Project: Spark Issue Type:

[jira] [Created] (SPARK-34708) Code-gen broadcast nested loop join (left semi/left anti)

Cheng Su created SPARK-34708: Summary: Code-gen broadcast nested loop join (left semi/left anti) Key: SPARK-34708 URL: https://issues.apache.org/jira/browse/SPARK-34708 Project: Spark Issue

[jira] [Created] (SPARK-34707) Code-gen broadcast nested loop join (left outer/right outer)

Cheng Su created SPARK-34707: Summary: Code-gen broadcast nested loop join (left outer/right outer) Key: SPARK-34707 URL: https://issues.apache.org/jira/browse/SPARK-34707 Project: Spark Issue

[jira] [Commented] (SPARK-34706) Broadcast nested loop join improvement

[ https://issues.apache.org/jira/browse/SPARK-34706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299247#comment-17299247 ] Cheng Su commented on SPARK-34706: -- FYI we are working on individual sub-tasks now. Target is to finish

[jira] [Updated] (SPARK-34620) Code-gen broadcast nested loop join (inner/cross)

[ https://issues.apache.org/jira/browse/SPARK-34620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34620: - Parent: SPARK-34706 Issue Type: Sub-task (was: Improvement) > Code-gen broadcast nested loop

[jira] [Updated] (SPARK-34593) Preserve broadcast nested loop join output partitioning and ordering

[ https://issues.apache.org/jira/browse/SPARK-34593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34593: - Parent: SPARK-34706 Issue Type: Sub-task (was: Improvement) > Preserve broadcast nested loop

[jira] [Created] (SPARK-34706) Broadcast nested loop join improvement

Cheng Su created SPARK-34706: Summary: Broadcast nested loop join improvement Key: SPARK-34706 URL: https://issues.apache.org/jira/browse/SPARK-34706 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-34705) Add code-gen for all join types of sort merge join

Cheng Su created SPARK-34705: Summary: Add code-gen for all join types of sort merge join Key: SPARK-34705 URL: https://issues.apache.org/jira/browse/SPARK-34705 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34705) Add code-gen for all join types of sort merge join

[ https://issues.apache.org/jira/browse/SPARK-34705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299243#comment-17299243 ] Cheng Su commented on SPARK-34705: -- FYI, we are working on the PR, and will raise one soon. > Add

[jira] [Created] (SPARK-34704) Add code-gen support for all join types of sort merge join

Cheng Su created SPARK-34704: Summary: Add code-gen support for all join types of sort merge join Key: SPARK-34704 URL: https://issues.apache.org/jira/browse/SPARK-34704 Project: Spark Issue

[jira] [Commented] (SPARK-34658) Kryo serializer not working with Spark SQL module

[ https://issues.apache.org/jira/browse/SPARK-34658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299225#comment-17299225 ] Hyukjin Kwon commented on SPARK-34658: -- For mailing list, please take a look here:

[jira] [Updated] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34507: - Fix Version/s: 3.0.3 3.1.2 2.4.8 > Spark artefacts built

[jira] [Commented] (SPARK-34703) Fix pyspark test when using sort_values on Pandas

[ https://issues.apache.org/jira/browse/SPARK-34703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299218#comment-17299218 ] Apache Spark commented on SPARK-34703: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34703) Fix pyspark test when using sort_values on Pandas

[ https://issues.apache.org/jira/browse/SPARK-34703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34703: Assignee: L. C. Hsieh (was: Apache Spark) > Fix pyspark test when using sort_values on

[jira] [Assigned] (SPARK-34703) Fix pyspark test when using sort_values on Pandas

[ https://issues.apache.org/jira/browse/SPARK-34703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34703: Assignee: Apache Spark (was: L. C. Hsieh) > Fix pyspark test when using sort_values on

[jira] [Resolved] (SPARK-34588) Support int64 buffer lengths in Java for pyspark Pandas UDF as buffer expanding

[ https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34588. -- Fix Version/s: 3.1.1 Resolution: Duplicate > Support int64 buffer lengths in Java for

[jira] [Commented] (SPARK-34588) Support int64 buffer lengths in Java for pyspark Pandas UDF as buffer expanding

[ https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299215#comment-17299215 ] Hyukjin Kwon commented on SPARK-34588: -- That's incredible [~dishka_krauch]! > Support int64 buffer

[jira] [Updated] (SPARK-34703) Fix pyspark test when using sort_values on Pandas

[ https://issues.apache.org/jira/browse/SPARK-34703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34703: Description: Three PySpark tests are currently failed in Jenkins 2.4 build: test_column_order,

[jira] [Created] (SPARK-34703) Fix pyspark test when using sort_values on Pandas

L. C. Hsieh created SPARK-34703: --- Summary: Fix pyspark test when using sort_values on Pandas Key: SPARK-34703 URL: https://issues.apache.org/jira/browse/SPARK-34703 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34507: Assignee: Sean R. Owen > Spark artefacts built against Scala 2.13 incorrectly depend on

[jira] [Resolved] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34507. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31801

[jira] [Resolved] (SPARK-33436) PySpark equivalent of SparkContext.hadoopConfiguration

[ https://issues.apache.org/jira/browse/SPARK-33436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33436. -- Resolution: Won't Fix > PySpark equivalent of SparkContext.hadoopConfiguration >

[jira] [Assigned] (SPARK-34702) Avoid unnecessary code generation in JoinCodegenSupport.genBuildSideVars

[ https://issues.apache.org/jira/browse/SPARK-34702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34702: Assignee: (was: Apache Spark) > Avoid unnecessary code generation in

[jira] [Assigned] (SPARK-34702) Avoid unnecessary code generation in JoinCodegenSupport.genBuildSideVars

[ https://issues.apache.org/jira/browse/SPARK-34702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34702: Assignee: Apache Spark > Avoid unnecessary code generation in

[jira] [Commented] (SPARK-34702) Avoid unnecessary code generation in JoinCodegenSupport.genBuildSideVars

[ https://issues.apache.org/jira/browse/SPARK-34702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299195#comment-17299195 ] Apache Spark commented on SPARK-34702: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-34702) Avoid unnecessary code generation in JoinCodegenSupport.genBuildSideVars

Cheng Su created SPARK-34702: Summary: Avoid unnecessary code generation in JoinCodegenSupport.genBuildSideVars Key: SPARK-34702 URL: https://issues.apache.org/jira/browse/SPARK-34702 Project: Spark

[jira] [Commented] (SPARK-34658) Kryo serializer not working with Spark SQL module

[ https://issues.apache.org/jira/browse/SPARK-34658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299185#comment-17299185 ] Nafis Sadat commented on SPARK-34658: - Hey [~hyukjin.kwon], thanks for your reply! Could you point

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299160#comment-17299160 ] Sean R. Owen commented on SPARK-34507: -- I opened https://github.com/apache/spark/pull/31801 with a

[jira] [Assigned] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34507: Assignee: (was: Apache Spark) > Spark artefacts built against Scala 2.13 incorrectly

[jira] [Assigned] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34507: Assignee: Apache Spark > Spark artefacts built against Scala 2.13 incorrectly depend on

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299158#comment-17299158 ] Apache Spark commented on SPARK-34507: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299157#comment-17299157 ] Apache Spark commented on SPARK-34507: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to d

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian King updated SPARK-34591: Affects Version/s: 2.4.4 > Pyspark undertakes pruning of decision trees and random forests

[jira] [Updated] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to d

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian King updated SPARK-34591: Priority: Critical (was: Major) > Pyspark undertakes pruning of decision trees and random

[jira] [Updated] (SPARK-34698) Temporary views should be analyzed during the analysis phase for all applicable commands

[ https://issues.apache.org/jira/browse/SPARK-34698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34698: -- Description: There are commands such as "CREATE TEMP VIEW", "ALTER VIEW AS", "CREATE TEMP VIEW

[jira] [Updated] (SPARK-34698) Temporary views should be analyzed during the analysis phase for all applicable commands

[ https://issues.apache.org/jira/browse/SPARK-34698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34698: -- Summary: Temporary views should be analyzed during the analysis phase for all applicable commands

[jira] [Created] (SPARK-34701) Remove analyzing temp view again in CreateViewCommand

Terry Kim created SPARK-34701: - Summary: Remove analyzing temp view again in CreateViewCommand Key: SPARK-34701 URL: https://issues.apache.org/jira/browse/SPARK-34701 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33000) cleanCheckpoints config does not clean all checkpointed RDDs on shutdown

[ https://issues.apache.org/jira/browse/SPARK-33000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-33000: - Description: Maybe it's just that the documentation needs to be updated, but I found

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string concatenation operator).

[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string concatenation

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299115#comment-17299115 ] Dongjoon Hyun commented on SPARK-34675: --- According to [~maxgekk]'s result, it seems that we close

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299086#comment-17299086 ] Maxim Gekk commented on SPARK-34675: Here is the output on the current master (the same result for

[jira] [Created] (SPARK-34700) SessionCatalog's createTempView/createGlobalTempView should accept TemporaryViewRelation

Terry Kim created SPARK-34700: - Summary: SessionCatalog's createTempView/createGlobalTempView should accept TemporaryViewRelation Key: SPARK-34700 URL: https://issues.apache.org/jira/browse/SPARK-34700

[jira] [Created] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

Terry Kim created SPARK-34699: - Summary: 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views Key: SPARK-34699 URL: https://issues.apache.org/jira/browse/SPARK-34699 Project:

[jira] [Updated] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

[ https://issues.apache.org/jira/browse/SPARK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34546: -- Parent: SPARK-34698 Issue Type: Sub-task (was: Improvement) > AlterViewAs.query should be

[jira] [Updated] (SPARK-34152) CreateViewStatement.child should be a real child

[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34152: -- Parent: SPARK-34698 Issue Type: Sub-task (was: Improvement) > CreateViewStatement.child

[jira] [Created] (SPARK-34698) Use TemporaryViewRelation for storing local/global temporary views for all commands

Terry Kim created SPARK-34698: - Summary: Use TemporaryViewRelation for storing local/global temporary views for all commands Key: SPARK-34698 URL: https://issues.apache.org/jira/browse/SPARK-34698

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299059#comment-17299059 ] L. C. Hsieh commented on SPARK-34675: - Thanks for ping me [~dongjoon]. So looks like even in Spark

[jira] [Commented] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299030#comment-17299030 ] Apache Spark commented on SPARK-34697: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34697: Assignee: Kousuke Saruta (was: Apache Spark) > Allow DESCRIBE FUNCTION and SHOW

[jira] [Assigned] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34697: Assignee: Apache Spark (was: Kousuke Saruta) > Allow DESCRIBE FUNCTION and SHOW

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Description: SHOW FUNCTIONS command doesn't show the || operator and DESCRIBE FUNCTION ||

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation

[jira] [Created] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTION explain about || (string cocatenation operator).

Kousuke Saruta created SPARK-34697: -- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTION explain about || (string cocatenation operator). Key: SPARK-34697 URL: https://issues.apache.org/jira/browse/SPARK-34697

  1   2   >