[jira] [Commented] (SPARK-33202) Fix BlockManagerDecommissioner to return the correct migration status

[ https://issues.apache.org/jira/browse/SPARK-33202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218124#comment-17218124 ] Apache Spark commented on SPARK-33202: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33202) Fix BlockManagerDecommissioner to return the correct migration status

[ https://issues.apache.org/jira/browse/SPARK-33202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33202: Assignee: Apache Spark > Fix BlockManagerDecommissioner to return the correct migration

[jira] [Assigned] (SPARK-33202) Fix BlockManagerDecommissioner to return the correct migration status

[ https://issues.apache.org/jira/browse/SPARK-33202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33202: Assignee: (was: Apache Spark) > Fix BlockManagerDecommissioner to return the correct

[jira] [Commented] (SPARK-33202) Fix BlockManagerDecommissioner to return the correct migration status

[ https://issues.apache.org/jira/browse/SPARK-33202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218123#comment-17218123 ] Apache Spark commented on SPARK-33202: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33202) Fix BlockManagerDecommissioner to return the correct migration status

Dongjoon Hyun created SPARK-33202: - Summary: Fix BlockManagerDecommissioner to return the correct migration status Key: SPARK-33202 URL: https://issues.apache.org/jira/browse/SPARK-33202 Project:

[jira] [Resolved] (SPARK-33201) Mesos dispatcher service is not working due to empty --pyFiles conf in cluster mode which is the default

[ https://issues.apache.org/jira/browse/SPARK-33201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amandeep resolved SPARK-33201. -- Resolution: Duplicate > Mesos dispatcher service is not working due to empty --pyFiles conf in >

[jira] [Commented] (SPARK-33104) Fix `YarnClusterSuite.yarn-cluster should respect conf overrides in SparkHadoopUtil`

[ https://issues.apache.org/jira/browse/SPARK-33104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218119#comment-17218119 ] Hyukjin Kwon commented on SPARK-33104: -- cc [~Ngone51] FYI since you're taking a look for this. >

[jira] [Commented] (SPARK-32675) --py-files option is appended without passing value for it

[ https://issues.apache.org/jira/browse/SPARK-32675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218109#comment-17218109 ] Rob Russo commented on SPARK-32675: --- I see this is targeted for 3.1.0, but is this also going into

[jira] [Assigned] (SPARK-33200) Validate that all shuffle files are migrated during E2E testing

[ https://issues.apache.org/jira/browse/SPARK-33200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33200: Assignee: (was: Apache Spark) > Validate that all shuffle files are migrated during

[jira] [Assigned] (SPARK-33200) Validate that all shuffle files are migrated during E2E testing

[ https://issues.apache.org/jira/browse/SPARK-33200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33200: Assignee: Apache Spark > Validate that all shuffle files are migrated during E2E testing

[jira] [Commented] (SPARK-33200) Validate that all shuffle files are migrated during E2E testing

[ https://issues.apache.org/jira/browse/SPARK-33200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218106#comment-17218106 ] Apache Spark commented on SPARK-33200: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

[ https://issues.apache.org/jira/browse/SPARK-31964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218101#comment-17218101 ] Apache Spark commented on SPARK-31964: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-33201) Mesos dispatcher service is not working due to empty --pyFiles conf in cluster mode which is the default

[ https://issues.apache.org/jira/browse/SPARK-33201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amandeep updated SPARK-33201: - Description: In MesosCluster mode, all of the spark jobs fail to run because by default "--py-files"

[jira] [Updated] (SPARK-33201) Mesos dispatcher service is not working due to empty --pyFiles conf in cluster mode which is the default

[ https://issues.apache.org/jira/browse/SPARK-33201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amandeep updated SPARK-33201: - Description: In MesosCluster mode, all of the spark jobs fail to run because by default "--py-files"

[jira] [Updated] (SPARK-33201) Mesos dispatcher service is not working due to empty --pyFiles conf in cluster mode which is the default

[ https://issues.apache.org/jira/browse/SPARK-33201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amandeep updated SPARK-33201: - Description: In MesosCluster mode, all of the spark jobs fail to run because by default "--py-files"

[jira] [Updated] (SPARK-33201) Mesos dispatcher service is not working due to empty --pyFiles conf in cluster mode which is the default

[ https://issues.apache.org/jira/browse/SPARK-33201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amandeep updated SPARK-33201: - Description: In MesosCluster mode, all of the spark jobs fail to run because by default "--py-files"

[jira] [Created] (SPARK-33201) Mesos dispatcher service is not working due to empty --pyFiles conf in cluster mode which is the default

Amandeep created SPARK-33201: Summary: Mesos dispatcher service is not working due to empty --pyFiles conf in cluster mode which is the default Key: SPARK-33201 URL: https://issues.apache.org/jira/browse/SPARK-33201

[jira] [Commented] (SPARK-32785) interval with dangling part should not results null

[ https://issues.apache.org/jira/browse/SPARK-32785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218085#comment-17218085 ] Apache Spark commented on SPARK-32785: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218056#comment-17218056 ] Liu Runzhong edited comment on SPARK-24434 at 10/21/20, 2:34 AM: - I

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218056#comment-17218056 ] Liu Runzhong commented on SPARK-24434: -- I think yes, you need to provide a pod template file when

[jira] [Commented] (SPARK-25985) Verify the SPARK-24613 Cache with UDF could not be matched with subsequent dependent caches

[ https://issues.apache.org/jira/browse/SPARK-25985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218019#comment-17218019 ] Aoyuan Liao commented on SPARK-25985: - [~smilegator] I think recacheByCondition doesn't keep the

[jira] [Assigned] (SPARK-33199) Mesos Task Failed when pyFiles and docker image option used together

[ https://issues.apache.org/jira/browse/SPARK-33199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33199: Assignee: Apache Spark > Mesos Task Failed when pyFiles and docker image option used

[jira] [Commented] (SPARK-33199) Mesos Task Failed when pyFiles and docker image option used together

[ https://issues.apache.org/jira/browse/SPARK-33199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218014#comment-17218014 ] Apache Spark commented on SPARK-33199: -- User 'farhan5900' has created a pull request for this

[jira] [Assigned] (SPARK-33199) Mesos Task Failed when pyFiles and docker image option used together

[ https://issues.apache.org/jira/browse/SPARK-33199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33199: Assignee: (was: Apache Spark) > Mesos Task Failed when pyFiles and docker image

[jira] [Resolved] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33189. -- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution:

[jira] [Created] (SPARK-33200) Validate that all shuffle files are migrated during E2E testing

Holden Karau created SPARK-33200: Summary: Validate that all shuffle files are migrated during E2E testing Key: SPARK-33200 URL: https://issues.apache.org/jira/browse/SPARK-33200 Project: Spark

[jira] [Assigned] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33189: Assignee: Bryan Cutler > Support PyArrow 2.0.0+ > -- > >

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218011#comment-17218011 ] Hyukjin Kwon commented on SPARK-32084: -- Thank you [~zero323] so much. > Replace dictionary-based

[jira] [Updated] (SPARK-29250) Upgrade to Hadoop 3.2.1 and move to shaded client

[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-29250: - Summary: Upgrade to Hadoop 3.2.1 and move to shaded client (was: Upgrade to Hadoop 3.2.1 Upgrade to

[jira] [Updated] (SPARK-33199) Mesos Task Failed when pyFiles and docker image option used together

[ https://issues.apache.org/jira/browse/SPARK-33199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Farhan Khan updated SPARK-33199: Description: It is a bug related to shell escaping in MesosClusterScheduler. As you can see in

[jira] [Created] (SPARK-33199) Mesos Task Failed when pyFiles and docker image option used together

Farhan Khan created SPARK-33199: --- Summary: Mesos Task Failed when pyFiles and docker image option used together Key: SPARK-33199 URL: https://issues.apache.org/jira/browse/SPARK-33199 Project: Spark

[jira] [Commented] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217984#comment-17217984 ] Apache Spark commented on SPARK-33189: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33189: Assignee: Apache Spark > Support PyArrow 2.0.0+ > -- > >

[jira] [Commented] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217983#comment-17217983 ] Apache Spark commented on SPARK-33189: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33189: Assignee: (was: Apache Spark) > Support PyArrow 2.0.0+ > -- > >

[jira] [Resolved] (SPARK-33198) getMigrationBlocks should not fail at missing files

[ https://issues.apache.org/jira/browse/SPARK-33198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33198. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30110

[jira] [Assigned] (SPARK-33198) getMigrationBlocks should not fail at missing files

[ https://issues.apache.org/jira/browse/SPARK-33198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33198: - Assignee: Dongjoon Hyun > getMigrationBlocks should not fail at missing files >

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217914#comment-17217914 ] Maciej Szymkiewicz commented on SPARK-32084: I got that part and I fully agree. At the end

[jira] [Assigned] (SPARK-33198) getMigrationBlocks should not fail at missing files

[ https://issues.apache.org/jira/browse/SPARK-33198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33198: Assignee: (was: Apache Spark) > getMigrationBlocks should not fail at missing files

[jira] [Assigned] (SPARK-33198) getMigrationBlocks should not fail at missing files

[ https://issues.apache.org/jira/browse/SPARK-33198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33198: Assignee: Apache Spark > getMigrationBlocks should not fail at missing files >

[jira] [Commented] (SPARK-33198) getMigrationBlocks should not fail at missing files

[ https://issues.apache.org/jira/browse/SPARK-33198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217892#comment-17217892 ] Apache Spark commented on SPARK-33198: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33198) getMigrationBlocks should not fail at missing files

Dongjoon Hyun created SPARK-33198: - Summary: getMigrationBlocks should not fail at missing files Key: SPARK-33198 URL: https://issues.apache.org/jira/browse/SPARK-33198 Project: Spark Issue

[jira] [Commented] (SPARK-22236) CSV I/O: does not respect RFC 4180

[ https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217875#comment-17217875 ] Walt Elder commented on SPARK-22236: [~snemmal], try:  {quote}.option("quote", """){quote}

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217861#comment-17217861 ] Shane Knapp commented on SPARK-33044: - hey!  sorry about the delay – i've been slammed these past

[jira] [Commented] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

[ https://issues.apache.org/jira/browse/SPARK-33197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217857#comment-17217857 ] Apache Spark commented on SPARK-33197: -- User 'yuningzh-db' has created a pull request for this

[jira] [Commented] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

[ https://issues.apache.org/jira/browse/SPARK-33197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217856#comment-17217856 ] Apache Spark commented on SPARK-33197: -- User 'yuningzh-db' has created a pull request for this

[jira] [Assigned] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

[ https://issues.apache.org/jira/browse/SPARK-33197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33197: Assignee: Apache Spark > Changes to spark.sql.analyzer.maxIterations do not take effect

[jira] [Assigned] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

[ https://issues.apache.org/jira/browse/SPARK-33197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33197: Assignee: (was: Apache Spark) > Changes to spark.sql.analyzer.maxIterations do not

[jira] [Updated] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

[ https://issues.apache.org/jira/browse/SPARK-33197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuning Zhang updated SPARK-33197: - Description: `spark.sql.analyzer.maxIterations` is not a static conf. However, changes to it do

[jira] [Created] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

Yuning Zhang created SPARK-33197: Summary: Changes to spark.sql.analyzer.maxIterations do not take effect at runtime Key: SPARK-33197 URL: https://issues.apache.org/jira/browse/SPARK-33197 Project:

[jira] [Commented] (SPARK-33196) Expose filtered aggregation API

[ https://issues.apache.org/jira/browse/SPARK-33196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217817#comment-17217817 ] Apache Spark commented on SPARK-33196: -- User 'tools4origins' has created a pull request for this

[jira] [Assigned] (SPARK-33196) Expose filtered aggregation API

[ https://issues.apache.org/jira/browse/SPARK-33196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33196: Assignee: (was: Apache Spark) > Expose filtered aggregation API >

[jira] [Commented] (SPARK-33196) Expose filtered aggregation API

[ https://issues.apache.org/jira/browse/SPARK-33196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217816#comment-17217816 ] Apache Spark commented on SPARK-33196: -- User 'tools4origins' has created a pull request for this

[jira] [Assigned] (SPARK-33196) Expose filtered aggregation API

[ https://issues.apache.org/jira/browse/SPARK-33196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33196: Assignee: Apache Spark > Expose filtered aggregation API >

[jira] [Created] (SPARK-33196) Expose filtered aggregation API

Erwang Guyomarc'h created SPARK-33196: - Summary: Expose filtered aggregation API Key: SPARK-33196 URL: https://issues.apache.org/jira/browse/SPARK-33196 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30894) The nullability of Size function should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217784#comment-17217784 ] Dongjoon Hyun commented on SPARK-30894: --- I labeled `correctness` according to the PR description

[jira] [Updated] (SPARK-30894) The nullability of Size function should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30894: -- Labels: correctness (was: ) > The nullability of Size function should not depend on

[jira] [Commented] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217779#comment-17217779 ] Bryan Cutler commented on SPARK-33189: -- There is an env var we can set that will use the old

[jira] [Assigned] (SPARK-33191) Fix PySpark test cases in YarnClusterSuite

[ https://issues.apache.org/jira/browse/SPARK-33191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33191: Assignee: Hyukjin Kwon > Fix PySpark test cases in YarnClusterSuite >

[jira] [Resolved] (SPARK-33191) Fix PySpark test cases in YarnClusterSuite

[ https://issues.apache.org/jira/browse/SPARK-33191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33191. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30099

[jira] [Updated] (SPARK-33195) stages/stage UI page fails to load when spark reverse proxy is enabled

[ https://issues.apache.org/jira/browse/SPARK-33195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liran updated SPARK-33195: -- Description: I think we have the same issue reported in SPARK-32467, reproduced with reverse proxy

[jira] [Comment Edited] (SPARK-33195) stages/stage UI page fails to load when spark reverse proxy is enabled

[ https://issues.apache.org/jira/browse/SPARK-33195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217686#comment-17217686 ] Liran edited comment on SPARK-33195 at 10/20/20, 3:30 PM: -- Running with Spark

[jira] [Commented] (SPARK-33195) stages/stage UI page fails to load when spark reverse proxy is enabled

[ https://issues.apache.org/jira/browse/SPARK-33195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217686#comment-17217686 ] Liran commented on SPARK-33195: --- Running in spark standalone on k8s, client mode. > stages/stage UI page

[jira] [Created] (SPARK-33195) stages/stage UI page fails to load when spark reverse proxy is enabled

Liran created SPARK-33195: - Summary: stages/stage UI page fails to load when spark reverse proxy is enabled Key: SPARK-33195 URL: https://issues.apache.org/jira/browse/SPARK-33195 Project: Spark

[jira] [Created] (SPARK-33194) Spark 3.0 streaming metrics are not in Prometheus

Jeremie Piotte created SPARK-33194: -- Summary: Spark 3.0 streaming metrics are not in Prometheus Key: SPARK-33194 URL: https://issues.apache.org/jira/browse/SPARK-33194 Project: Spark Issue

[jira] [Commented] (SPARK-33133) History server fails when loading invalid rolling event logs

[ https://issues.apache.org/jira/browse/SPARK-33133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217656#comment-17217656 ] Adam Binford commented on SPARK-33133: -- Now that the error on load is fixed, the next question is

[jira] [Updated] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33189: - Description: Some tests fail with PyArrow 2.0.0 in PySpark: {code}

[jira] [Commented] (SPARK-33192) on k8s dynamic resource allocation failed

[ https://issues.apache.org/jira/browse/SPARK-33192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217533#comment-17217533 ] Apache Spark commented on SPARK-33192: -- User 'hzyangkai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33192) on k8s dynamic resource allocation failed

[ https://issues.apache.org/jira/browse/SPARK-33192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33192: Assignee: (was: Apache Spark) > on k8s dynamic resource allocation failed >

[jira] [Assigned] (SPARK-33192) on k8s dynamic resource allocation failed

[ https://issues.apache.org/jira/browse/SPARK-33192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33192: Assignee: Apache Spark > on k8s dynamic resource allocation failed >

[jira] [Commented] (SPARK-33192) on k8s dynamic resource allocation failed

[ https://issues.apache.org/jira/browse/SPARK-33192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217532#comment-17217532 ] Apache Spark commented on SPARK-33192: -- User 'hzyangkai' has created a pull request for this issue:

[jira] [Commented] (SPARK-33193) Hive ThriftServer JDBC Database MetaData API Behavior Auditing

[ https://issues.apache.org/jira/browse/SPARK-33193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217530#comment-17217530 ] Apache Spark commented on SPARK-33193: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33193) Hive ThriftServer JDBC Database MetaData API Behavior Auditing

[ https://issues.apache.org/jira/browse/SPARK-33193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33193: Assignee: (was: Apache Spark) > Hive ThriftServer JDBC Database MetaData API

[jira] [Assigned] (SPARK-33193) Hive ThriftServer JDBC Database MetaData API Behavior Auditing

[ https://issues.apache.org/jira/browse/SPARK-33193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33193: Assignee: Apache Spark > Hive ThriftServer JDBC Database MetaData API Behavior Auditing

[jira] [Created] (SPARK-33193) Hive ThriftServer JDBC Database MetaData API Behavior Auditing

Kent Yao created SPARK-33193: Summary: Hive ThriftServer JDBC Database MetaData API Behavior Auditing Key: SPARK-33193 URL: https://issues.apache.org/jira/browse/SPARK-33193 Project: Spark

[jira] [Resolved] (SPARK-33190) Set upperbound of PyArrow version in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-33190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33190. -- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution:

[jira] [Created] (SPARK-33192) on k8s dynamic resource allocation failed

qinyu created SPARK-33192: - Summary: on k8s dynamic resource allocation failed Key: SPARK-33192 URL: https://issues.apache.org/jira/browse/SPARK-33192 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217416#comment-17217416 ] Hyukjin Kwon commented on SPARK-33189: -- cc [~bryanc] FYI > Support PyArrow 2.0.0+ >

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217412#comment-17217412 ] Hyukjin Kwon commented on SPARK-32084: -- Just for a bit of more context, I think we should have a

[jira] [Updated] (SPARK-28771) Join partitioned dataframes on superset of partitioning columns without shuffle

[ https://issues.apache.org/jira/browse/SPARK-28771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Bergkamp updated SPARK-28771: --- Description: Hi Spark developers. Few months ago I asked this question at 

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217407#comment-17217407 ] Hyukjin Kwon commented on SPARK-32084: -- Yeah, that's not valid anymore. But I think still we should

[jira] [Commented] (SPARK-33191) Fix PySpark test cases in YarnClusterSuite

[ https://issues.apache.org/jira/browse/SPARK-33191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217400#comment-17217400 ] Apache Spark commented on SPARK-33191: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33191) Fix PySpark test cases in YarnClusterSuite

[ https://issues.apache.org/jira/browse/SPARK-33191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217399#comment-17217399 ] Apache Spark commented on SPARK-33191: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33191) Fix PySpark test cases in YarnClusterSuite

[ https://issues.apache.org/jira/browse/SPARK-33191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33191: Assignee: (was: Apache Spark) > Fix PySpark test cases in YarnClusterSuite >

[jira] [Assigned] (SPARK-33191) Fix PySpark test cases in YarnClusterSuite

[ https://issues.apache.org/jira/browse/SPARK-33191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33191: Assignee: Apache Spark > Fix PySpark test cases in YarnClusterSuite >

[jira] [Created] (SPARK-33191) Fix PySpark test cases in YarnClusterSuite

Hyukjin Kwon created SPARK-33191: Summary: Fix PySpark test cases in YarnClusterSuite Key: SPARK-33191 URL: https://issues.apache.org/jira/browse/SPARK-33191 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217339#comment-17217339 ] Maciej Szymkiewicz commented on SPARK-32084: [~hyukjin.kwon] I can work on that, though I

[jira] [Assigned] (SPARK-33190) Set upperbound of PyArrow version in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-33190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33190: Assignee: Apache Spark > Set upperbound of PyArrow version in GitHub Actions >

[jira] [Assigned] (SPARK-33190) Set upperbound of PyArrow version in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-33190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33190: Assignee: (was: Apache Spark) > Set upperbound of PyArrow version in GitHub Actions

[jira] [Assigned] (SPARK-33190) Set upperbound of PyArrow version in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-33190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33190: Assignee: Apache Spark > Set upperbound of PyArrow version in GitHub Actions >

[jira] [Commented] (SPARK-33190) Set upperbound of PyArrow version in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-33190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217328#comment-17217328 ] Apache Spark commented on SPARK-33190: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-33190) Set upperbound of PyArrow version in GitHub Actions

Hyukjin Kwon created SPARK-33190: Summary: Set upperbound of PyArrow version in GitHub Actions Key: SPARK-33190 URL: https://issues.apache.org/jira/browse/SPARK-33190 Project: Spark Issue

[jira] [Updated] (SPARK-33189) Support PyArrow 2.0.0+

[ https://issues.apache.org/jira/browse/SPARK-33189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33189: - Affects Version/s: (was: 3.0.1) 3.1.0 > Support PyArrow 2.0.0+ >

[jira] [Created] (SPARK-33189) Support PyArrow 2.0.0+

Hyukjin Kwon created SPARK-33189: Summary: Support PyArrow 2.0.0+ Key: SPARK-33189 URL: https://issues.apache.org/jira/browse/SPARK-33189 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-32229) Application entry parsing fails because DriverWrapper registered instead of the normal driver

[ https://issues.apache.org/jira/browse/SPARK-32229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32229. -- Fix Version/s: 3.1.0 Assignee: Gabor Somogyi Resolution: Fixed

[jira] [Assigned] (SPARK-33160) Allow saving/loading INT96 in parquet w/o rebasing

[ https://issues.apache.org/jira/browse/SPARK-33160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33160: Assignee: Maxim Gekk > Allow saving/loading INT96 in parquet w/o rebasing >

[jira] [Resolved] (SPARK-33160) Allow saving/loading INT96 in parquet w/o rebasing

[ https://issues.apache.org/jira/browse/SPARK-33160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33160. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30056