[jira] [Updated] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

[ https://issues.apache.org/jira/browse/SPARK-35084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keunhyun Oh updated SPARK-35084: Affects Version/s: (was: 3.1.1) > [k8s] On Spark 3, jars listed in spark.jars and

[jira] [Updated] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

[ https://issues.apache.org/jira/browse/SPARK-35084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keunhyun Oh updated SPARK-35084: Description: I'm trying to migrate spark 2 to spark 3 in k8s.   In my environment, on Spark

[jira] [Created] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

Keunhyun Oh created SPARK-35084: --- Summary: [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext Key: SPARK-35084 URL: https://issues.apache.org/jira/browse/SPARK-35084

[jira] [Assigned] (SPARK-34789) Introduce Jetty based construct for integration tests where HTTP(S) is used

[ https://issues.apache.org/jira/browse/SPARK-34789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34789: - Assignee: Attila Zsolt Piros > Introduce Jetty based construct for integration tests

[jira] [Resolved] (SPARK-34789) Introduce Jetty based construct for integration tests where HTTP(S) is used

[ https://issues.apache.org/jira/browse/SPARK-34789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34789. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31935

[jira] [Resolved] (SPARK-35071) Rename Koalas to pandas-on-Spark in main codes

[ https://issues.apache.org/jira/browse/SPARK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35071. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32166

[jira] [Assigned] (SPARK-35071) Rename Koalas to pandas-on-Spark in main codes

[ https://issues.apache.org/jira/browse/SPARK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35071: Assignee: Hyukjin Kwon > Rename Koalas to pandas-on-Spark in main codes >

[jira] [Assigned] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

[ https://issues.apache.org/jira/browse/SPARK-35082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35082: Assignee: Yikun Jiang > Use permissive and squashed merge when syncing to the latest

[jira] [Resolved] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

[ https://issues.apache.org/jira/browse/SPARK-35082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35082. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32182

[jira] [Assigned] (SPARK-35083) Support remote scheduler pool file

[ https://issues.apache.org/jira/browse/SPARK-35083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35083: Assignee: (was: Apache Spark) > Support remote scheduler pool file >

[jira] [Commented] (SPARK-35083) Support remote scheduler pool file

[ https://issues.apache.org/jira/browse/SPARK-35083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321880#comment-17321880 ] Apache Spark commented on SPARK-35083: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-35083) Support remote scheduler pool file

[ https://issues.apache.org/jira/browse/SPARK-35083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35083: Assignee: Apache Spark > Support remote scheduler pool file >

[jira] [Created] (SPARK-35083) Support remote scheduler pool file

ulysses you created SPARK-35083: --- Summary: Support remote scheduler pool file Key: SPARK-35083 URL: https://issues.apache.org/jira/browse/SPARK-35083 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

[ https://issues.apache.org/jira/browse/SPARK-35082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321874#comment-17321874 ] Apache Spark commented on SPARK-35082: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

[ https://issues.apache.org/jira/browse/SPARK-35082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321873#comment-17321873 ] Apache Spark commented on SPARK-35082: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

[ https://issues.apache.org/jira/browse/SPARK-35082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35082: Assignee: (was: Apache Spark) > Use permissive and squashed merge when syncing to

[jira] [Assigned] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

[ https://issues.apache.org/jira/browse/SPARK-35082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35082: Assignee: Apache Spark > Use permissive and squashed merge when syncing to the latest

[jira] [Commented] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

[ https://issues.apache.org/jira/browse/SPARK-35082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321871#comment-17321871 ] Apache Spark commented on SPARK-35082: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-35082) Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing

Hyukjin Kwon created SPARK-35082: Summary: Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing Key: SPARK-35082 URL: https://issues.apache.org/jira/browse/SPARK-35082

[jira] [Assigned] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35034: Assignee: Xinrong Meng > Port Koalas miscellaneous unit tests into PySpark >

[jira] [Resolved] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35034. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32152

[jira] [Created] (SPARK-35081) Add Data Source Option links to `to_xxx`, `from_xxx`.

Haejoon Lee created SPARK-35081: --- Summary: Add Data Source Option links to `to_xxx`, `from_xxx`. Key: SPARK-35081 URL: https://issues.apache.org/jira/browse/SPARK-35081 Project: Spark Issue

[jira] [Commented] (SPARK-35080) Correlated subqueries with equality predicates can return wrong results

[ https://issues.apache.org/jira/browse/SPARK-35080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321829#comment-17321829 ] Apache Spark commented on SPARK-35080: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-35080) Correlated subqueries with equality predicates can return wrong results

[ https://issues.apache.org/jira/browse/SPARK-35080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35080: Assignee: Apache Spark > Correlated subqueries with equality predicates can return wrong

[jira] [Assigned] (SPARK-35080) Correlated subqueries with equality predicates can return wrong results

[ https://issues.apache.org/jira/browse/SPARK-35080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35080: Assignee: (was: Apache Spark) > Correlated subqueries with equality predicates can

[jira] [Updated] (SPARK-35080) Correlated subqueries with equality predicates can return wrong results

[ https://issues.apache.org/jira/browse/SPARK-35080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-35080: - Description: Correlated subqueries with aggregate that pass CheckAnalysis (with only

[jira] [Updated] (SPARK-35080) Correlated subqueries with equality predicates can return wrong results

[ https://issues.apache.org/jira/browse/SPARK-35080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-35080: - Description: Correlated subqueries with aggregate that passes CheckAnalysis (with only

[jira] [Created] (SPARK-35080) Correlated subqueries with equality predicates can return wrong results

Allison Wang created SPARK-35080: Summary: Correlated subqueries with equality predicates can return wrong results Key: SPARK-35080 URL: https://issues.apache.org/jira/browse/SPARK-35080 Project:

[jira] [Updated] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-35079: -- Description: i think this is a correctness bug in spark 3.1.1 the behavior is correct in

[jira] [Created] (SPARK-35079) Transform with udf gives incorrect result

koert kuipers created SPARK-35079: - Summary: Transform with udf gives incorrect result Key: SPARK-35079 URL: https://issues.apache.org/jira/browse/SPARK-35079 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34999) Consolidate PySpark testing utils

[ https://issues.apache.org/jira/browse/SPARK-34999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321311#comment-17321311 ] Apache Spark commented on SPARK-34999: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-34999) Consolidate PySpark testing utils

[ https://issues.apache.org/jira/browse/SPARK-34999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321308#comment-17321308 ] Apache Spark commented on SPARK-34999: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-34999) Consolidate PySpark testing utils

[ https://issues.apache.org/jira/browse/SPARK-34999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34999: Assignee: Apache Spark > Consolidate PySpark testing utils >

[jira] [Assigned] (SPARK-34999) Consolidate PySpark testing utils

[ https://issues.apache.org/jira/browse/SPARK-34999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34999: Assignee: (was: Apache Spark) > Consolidate PySpark testing utils >

[jira] [Resolved] (SPARK-35055) Fix BitSet.union

[ https://issues.apache.org/jira/browse/SPARK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingyi Bu resolved SPARK-35055. --- Resolution: Not A Problem > Fix BitSet.union > > > Key:

[jira] [Created] (SPARK-35078) Migrate to Migrate to transformWithPruning or resolveWithPruning for expression rules

Yingyi Bu created SPARK-35078: - Summary: Migrate to Migrate to transformWithPruning or resolveWithPruning for expression rules Key: SPARK-35078 URL: https://issues.apache.org/jira/browse/SPARK-35078

[jira] [Created] (SPARK-35077) Migrate to Migrate to transformWithPruning or resolveWithPruning for pushdown rules

Yingyi Bu created SPARK-35077: - Summary: Migrate to Migrate to transformWithPruning or resolveWithPruning for pushdown rules Key: SPARK-35077 URL: https://issues.apache.org/jira/browse/SPARK-35077

[jira] [Assigned] (SPARK-35076) Parse interval literals as ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-35076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35076: Assignee: Apache Spark (was: Max Gekk) > Parse interval literals as ANSI intervals >

[jira] [Commented] (SPARK-35076) Parse interval literals as ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-35076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321287#comment-17321287 ] Apache Spark commented on SPARK-35076: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35076) Parse interval literals as ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-35076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35076: Assignee: Max Gekk (was: Apache Spark) > Parse interval literals as ANSI intervals >

[jira] [Created] (SPARK-35076) Parse interval literals as ANSI intervals

Max Gekk created SPARK-35076: Summary: Parse interval literals as ANSI intervals Key: SPARK-35076 URL: https://issues.apache.org/jira/browse/SPARK-35076 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35075) Migrate to transformWithPruning or resolveWithPruning for subquery related rules

[ https://issues.apache.org/jira/browse/SPARK-35075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingyi Bu updated SPARK-35075: -- Summary: Migrate to transformWithPruning or resolveWithPruning for subquery related rules (was:

[jira] [Created] (SPARK-35075) Migrate to transformXxxWithPruning or resolveXxWithPruning for subquery related rules

Yingyi Bu created SPARK-35075: - Summary: Migrate to transformXxxWithPruning or resolveXxWithPruning for subquery related rules Key: SPARK-35075 URL: https://issues.apache.org/jira/browse/SPARK-35075

[jira] [Commented] (SPARK-34780) Cached Table (parquet) with old Configs Used

[ https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321270#comment-17321270 ] Michael Chen commented on SPARK-34780: -- Hi [~csun]. Also sorry for late reply. My understanding is

[jira] [Commented] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

[ https://issues.apache.org/jira/browse/SPARK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321236#comment-17321236 ] Apache Spark commented on SPARK-35048: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-35074) spark.jars.xxx configs should be moved to config/package.scala

[ https://issues.apache.org/jira/browse/SPARK-35074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321225#comment-17321225 ] Minchu Yang commented on SPARK-35074: - Will work on this Jira. > spark.jars.xxx configs should be

[jira] [Commented] (SPARK-34999) Consolidate PySpark testing utils

[ https://issues.apache.org/jira/browse/SPARK-34999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321200#comment-17321200 ] Xinrong Meng commented on SPARK-34999: -- I would like to work on this ticket. > Consolidate PySpark

[jira] [Assigned] (SPARK-35044) Support retrieve hadoop configurations via SET syntax

[ https://issues.apache.org/jira/browse/SPARK-35044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35044: Assignee: Kent Yao > Support retrieve hadoop configurations via SET syntax >

[jira] [Resolved] (SPARK-35044) Support retrieve hadoop configurations via SET syntax

[ https://issues.apache.org/jira/browse/SPARK-35044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35044. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32144

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Description: [~shaneknapp] as we discussed [on the mailing

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Description: [~shaneknapp] as we discussed [on the mailing

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Description: [~shaneknapp] as we discussed [on the mailing

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Description: [~shaneknapp] as we discussed [on the mailing

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Summary: Upgrade Minikube and kubernetes and move to docker 'virtualization' layer (was: Upgrade

[jira] [Commented] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321153#comment-17321153 ] Apache Spark commented on SPARK-35002: -- User 'lhotari' has created a pull request for this issue:

[jira] [Commented] (SPARK-35044) Support retrieve hadoop configurations via SET syntax

[ https://issues.apache.org/jira/browse/SPARK-35044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321151#comment-17321151 ] Apache Spark commented on SPARK-35044: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-34834) There is a potential Netty memory leak in TransportResponseHandler.

[ https://issues.apache.org/jira/browse/SPARK-34834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34834: - Fix Version/s: (was: 2.4.8) 2.4.9 Priority: Minor (was: Major)

[jira] [Resolved] (SPARK-34834) There is a potential Netty memory leak in TransportResponseHandler.

[ https://issues.apache.org/jira/browse/SPARK-34834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34834. -- Fix Version/s: 3.0.3 3.1.2 2.4.8

[jira] [Assigned] (SPARK-34834) There is a potential Netty memory leak in TransportResponseHandler.

[ https://issues.apache.org/jira/browse/SPARK-34834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34834: Assignee: weixiuli > There is a potential Netty memory leak in TransportResponseHandler.

[jira] [Resolved] (SPARK-33882) Add a vectorized BLAS implementation

[ https://issues.apache.org/jira/browse/SPARK-33882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33882. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30810

[jira] [Assigned] (SPARK-33882) Add a vectorized BLAS implementation

[ https://issues.apache.org/jira/browse/SPARK-33882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33882: Assignee: Ludovic Henry > Add a vectorized BLAS implementation >

[jira] [Assigned] (SPARK-35051) Add a day-time interval to a date

[ https://issues.apache.org/jira/browse/SPARK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35051: Assignee: Max Gekk > Add a day-time interval to a date > - > >

[jira] [Resolved] (SPARK-35051) Add a day-time interval to a date

[ https://issues.apache.org/jira/browse/SPARK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35051. -- Resolution: Fixed Issue resolved by pull request 32170 [https://github.com/apache/spark/pull/32170]

[jira] [Created] (SPARK-35074) spark.jars.xxx configs should be moved to config/package.scala

Shardul Mahadik created SPARK-35074: --- Summary: spark.jars.xxx configs should be moved to config/package.scala Key: SPARK-35074 URL: https://issues.apache.org/jira/browse/SPARK-35074 Project: Spark

[jira] [Commented] (SPARK-35051) Add a day-time interval to a date

[ https://issues.apache.org/jira/browse/SPARK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321086#comment-17321086 ] Apache Spark commented on SPARK-35051: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35051) Add a day-time interval to a date

[ https://issues.apache.org/jira/browse/SPARK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35051: Assignee: (was: Apache Spark) > Add a day-time interval to a date >

[jira] [Assigned] (SPARK-35051) Add a day-time interval to a date

[ https://issues.apache.org/jira/browse/SPARK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35051: Assignee: Apache Spark > Add a day-time interval to a date >

[jira] [Updated] (SPARK-35072) spark.jars.ivysettings should support local:// and hdfs:// schemes

[ https://issues.apache.org/jira/browse/SPARK-35072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shardul Mahadik updated SPARK-35072: Description: During reviews of SPARK-34472, there was a desire to support local:// and

[jira] [Created] (SPARK-35073) SparkContext.addJar with an ivy path should not fail with a custom ivySettings file in non-YARN cluster modes

Shardul Mahadik created SPARK-35073: --- Summary: SparkContext.addJar with an ivy path should not fail with a custom ivySettings file in non-YARN cluster modes Key: SPARK-35073 URL:

[jira] [Created] (SPARK-35072) spark.jars.ivysettings should support local:// and hdfs:// schemes

Shardul Mahadik created SPARK-35072: --- Summary: spark.jars.ivysettings should support local:// and hdfs:// schemes Key: SPARK-35072 URL: https://issues.apache.org/jira/browse/SPARK-35072 Project:

[jira] [Resolved] (SPARK-35061) Upgrade pycodestyle from 2.6.0 to 2.7.0

[ https://issues.apache.org/jira/browse/SPARK-35061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35061. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32160

[jira] [Assigned] (SPARK-35061) Upgrade pycodestyle from 2.6.0 to 2.7.0

[ https://issues.apache.org/jira/browse/SPARK-35061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35061: - Assignee: Hyukjin Kwon > Upgrade pycodestyle from 2.6.0 to 2.7.0 >

[jira] [Assigned] (SPARK-35069) TRANSFORM forbiden DISTINCT/ALL and make the error message clear

[ https://issues.apache.org/jira/browse/SPARK-35069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35069: --- Assignee: angerszhu > TRANSFORM forbiden DISTINCT/ALL and make the error message clear >

[jira] [Resolved] (SPARK-35069) TRANSFORM forbiden DISTINCT/ALL and make the error message clear

[ https://issues.apache.org/jira/browse/SPARK-35069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35069. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32149

[jira] [Assigned] (SPARK-35009) Avoid creating multiple Monitor threads for reused python workers for the same TaskContext

[ https://issues.apache.org/jira/browse/SPARK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35009: Assignee: Attila Zsolt Piros (was: Apache Spark) > Avoid creating multiple Monitor

[jira] [Assigned] (SPARK-35009) Avoid creating multiple Monitor threads for reused python workers for the same TaskContext

[ https://issues.apache.org/jira/browse/SPARK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35009: Assignee: Apache Spark (was: Attila Zsolt Piros) > Avoid creating multiple Monitor

[jira] [Commented] (SPARK-35009) Avoid creating multiple Monitor threads for reused python workers for the same TaskContext

[ https://issues.apache.org/jira/browse/SPARK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321065#comment-17321065 ] Apache Spark commented on SPARK-35009: -- User 'attilapiros' has created a pull request for this

[jira] [Commented] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321026#comment-17321026 ] Apache Spark commented on SPARK-35067: -- User 'zengruios' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35067: Assignee: Apache Spark > Test case for function COALESCE() does not cover the CodeGen

[jira] [Assigned] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35067: Assignee: (was: Apache Spark) > Test case for function COALESCE() does not cover the

[jira] [Commented] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321025#comment-17321025 ] Apache Spark commented on SPARK-35067: -- User 'zengruios' has created a pull request for this issue:

[jira] [Updated] (SPARK-35067) Test case for function COALESCE() does not coverage the CodeGen support

[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-35067: Description: The test case in org.apache.spark.sql.SQLQuerySuite named "Add Parser of SQL COALESCE" does

[jira] [Updated] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-35067: Summary: Test case for function COALESCE() does not cover the CodeGen support (was: Test case for

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320926#comment-17320926 ] Xu Guang Lv edited comment on SPARK-11844 at 4/14/21, 11:31 AM: I got

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320926#comment-17320926 ] Xu Guang Lv commented on SPARK-11844: - I got the same error too, but I can definitely reproduce the

[jira] [Assigned] (SPARK-35071) Rename Koalas to pandas-on-Spark in main codes

[ https://issues.apache.org/jira/browse/SPARK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35071: Assignee: (was: Apache Spark) > Rename Koalas to pandas-on-Spark in main codes >

[jira] [Assigned] (SPARK-35071) Rename Koalas to pandas-on-Spark in main codes

[ https://issues.apache.org/jira/browse/SPARK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35071: Assignee: Apache Spark > Rename Koalas to pandas-on-Spark in main codes >

[jira] [Commented] (SPARK-35071) Rename Koalas to pandas-on-Spark in main codes

[ https://issues.apache.org/jira/browse/SPARK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320915#comment-17320915 ] Apache Spark commented on SPARK-35071: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-35071) Rename Koalas to pandas-on-Spark in main codes

Hyukjin Kwon created SPARK-35071: Summary: Rename Koalas to pandas-on-Spark in main codes Key: SPARK-35071 URL: https://issues.apache.org/jira/browse/SPARK-35071 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35002: - Fix Version/s: 3.0.3 3.1.2 > Fix the java.net.BindException when testing

[jira] [Commented] (SPARK-35070) TRANSFORM should not support ALIAS in input expression seq

[ https://issues.apache.org/jira/browse/SPARK-35070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320878#comment-17320878 ] Apache Spark commented on SPARK-35070: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-35070) TRANSFORM should not support ALIAS in input expression seq

[ https://issues.apache.org/jira/browse/SPARK-35070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320876#comment-17320876 ] Apache Spark commented on SPARK-35070: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-35070) TRANSFORM should not support ALIAS in input expression seq

[ https://issues.apache.org/jira/browse/SPARK-35070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35070: Assignee: (was: Apache Spark) > TRANSFORM should not support ALIAS in input

[jira] [Assigned] (SPARK-35070) TRANSFORM should not support ALIAS in input expression seq

[ https://issues.apache.org/jira/browse/SPARK-35070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35070: Assignee: Apache Spark > TRANSFORM should not support ALIAS in input expression seq >

[jira] [Assigned] (SPARK-35069) TRANSFORM forbiden DISTINCT/ALL and make the error message clear

[ https://issues.apache.org/jira/browse/SPARK-35069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35069: Assignee: (was: Apache Spark) > TRANSFORM forbiden DISTINCT/ALL and make the error

[jira] [Commented] (SPARK-35069) TRANSFORM forbiden DISTINCT/ALL and make the error message clear

[ https://issues.apache.org/jira/browse/SPARK-35069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320834#comment-17320834 ] Apache Spark commented on SPARK-35069: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-35069) TRANSFORM forbiden DISTINCT/ALL and make the error message clear

[ https://issues.apache.org/jira/browse/SPARK-35069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35069: Assignee: Apache Spark > TRANSFORM forbiden DISTINCT/ALL and make the error message

[jira] [Created] (SPARK-35070) TRANSFORM should not support ALIAS in input expression seq

angerszhu created SPARK-35070: - Summary: TRANSFORM should not support ALIAS in input expression seq Key: SPARK-35070 URL: https://issues.apache.org/jira/browse/SPARK-35070 Project: Spark Issue

[jira] [Commented] (SPARK-31936) Implement ScriptTransform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320819#comment-17320819 ] Apache Spark commented on SPARK-31936: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-35069) TRANSFORM forbiden DISTINCT/ALL and make the error message clear

angerszhu created SPARK-35069: - Summary: TRANSFORM forbiden DISTINCT/ALL and make the error message clear Key: SPARK-35069 URL: https://issues.apache.org/jira/browse/SPARK-35069 Project: Spark

  1   2   >