[jira] [Commented] (SPARK-41181) Migrate the map options errors onto error classes

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635719#comment-17635719 ] BingKun Pan commented on SPARK-41181: - I work on it. > Migrate the map options errors onto error

[jira] [Commented] (SPARK-41179) Assign a name to the error class _LEGACY_ERROR_TEMP_1092

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635717#comment-17635717 ] Apache Spark commented on SPARK-41179: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-41179) Assign a name to the error class _LEGACY_ERROR_TEMP_1092

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41179: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] (SPARK-41179) Assign a name to the error class _LEGACY_ERROR_TEMP_1092

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41179 ] BingKun Pan deleted comment on SPARK-41179: - was (Author: panbingkun): I work on it > Assign a name to the error class _LEGACY_ERROR_TEMP_1092 >

[jira] [Assigned] (SPARK-41179) Assign a name to the error class _LEGACY_ERROR_TEMP_1092

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41179: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_1092 >

[jira] [Assigned] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41192: Assignee: (was: Apache Spark) > Task finished before speculative task scheduled

[jira] [Assigned] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41192: Assignee: Apache Spark > Task finished before speculative task scheduled leads to

[jira] [Commented] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635708#comment-17635708 ] Apache Spark commented on SPARK-41192: -- User 'toujours33' has created a pull request for this

[jira] [Commented] (SPARK-41194) Add log4j2.properties for testing to the protobuf module

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635697#comment-17635697 ] Apache Spark commented on SPARK-41194: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41194) Add log4j2.properties for testing to the protobuf module

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41194: Assignee: (was: Apache Spark) > Add log4j2.properties for testing to the protobuf

[jira] [Assigned] (SPARK-41194) Add log4j2.properties for testing to the protobuf module

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41194: Assignee: Apache Spark > Add log4j2.properties for testing to the protobuf module >

[jira] [Commented] (SPARK-41179) Assign a name to the error class _LEGACY_ERROR_TEMP_1092

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635694#comment-17635694 ] BingKun Pan commented on SPARK-41179: - I work on it > Assign a name to the error class

[jira] [Created] (SPARK-41194) Add log4j2.properties for testing to the protobuf module

2022-11-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-41194: Summary: Add log4j2.properties for testing to the protobuf module Key: SPARK-41194 URL: https://issues.apache.org/jira/browse/SPARK-41194 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41174) Propagate an error class to users for invalid `format` of `to_binary()`

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635685#comment-17635685 ] BingKun Pan commented on SPARK-41174: - I work on it. > Propagate an error class to users for

[jira] (SPARK-41176) Assign a name to the error class _LEGACY_ERROR_TEMP_1042

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41176 ] BingKun Pan deleted comment on SPARK-41176: - was (Author: panbingkun): I work on it. > Assign a name to the error class _LEGACY_ERROR_TEMP_1042 >

[jira] [Commented] (SPARK-41176) Assign a name to the error class _LEGACY_ERROR_TEMP_1042

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635670#comment-17635670 ] Apache Spark commented on SPARK-41176: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-41176) Assign a name to the error class _LEGACY_ERROR_TEMP_1042

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41176: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_1042 >

[jira] [Assigned] (SPARK-41176) Assign a name to the error class _LEGACY_ERROR_TEMP_1042

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41176: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Commented] (SPARK-41176) Assign a name to the error class _LEGACY_ERROR_TEMP_1042

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635669#comment-17635669 ] Apache Spark commented on SPARK-41176: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-41173) Move `require()` out from the constructors of string expressions

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41173: Assignee: Apache Spark > Move `require()` out from the constructors of string

[jira] [Assigned] (SPARK-41173) Move `require()` out from the constructors of string expressions

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41173: Assignee: (was: Apache Spark) > Move `require()` out from the constructors of string

[jira] [Commented] (SPARK-41173) Move `require()` out from the constructors of string expressions

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635665#comment-17635665 ] Apache Spark commented on SPARK-41173: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

2022-11-17 Thread Yazhi Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yazhi Wang updated SPARK-41192: --- Description: When task finished before speculative task has been scheduled by DAGScheduler, then

[jira] [Updated] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

2022-11-17 Thread Yazhi Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yazhi Wang updated SPARK-41192: --- Attachment: dynamic-executors > Task finished before speculative task scheduled leads to holding

[jira] [Updated] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

2022-11-17 Thread Yazhi Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yazhi Wang updated SPARK-41192: --- Attachment: dynamic-log > Task finished before speculative task scheduled leads to holding idle >

[jira] [Resolved] (SPARK-41122) Explain API can support different modes

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41122. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38638

[jira] [Assigned] (SPARK-41122) Explain API can support different modes

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41122: Assignee: Rui Wang > Explain API can support different modes >

[jira] [Assigned] (SPARK-41193) Ignore `collect data with single partition larger than 2GB bytes array limit` in `DatasetLargeResultCollectingSuite` as default

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41193: Assignee: Apache Spark > Ignore `collect data with single partition larger than 2GB

[jira] [Commented] (SPARK-41193) Ignore `collect data with single partition larger than 2GB bytes array limit` in `DatasetLargeResultCollectingSuite` as default

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635658#comment-17635658 ] Apache Spark commented on SPARK-41193: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41193) Ignore `collect data with single partition larger than 2GB bytes array limit` in `DatasetLargeResultCollectingSuite` as default

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41193: Assignee: (was: Apache Spark) > Ignore `collect data with single partition larger

[jira] [Updated] (SPARK-41193) Ignore `collect data with single partition larger than 2GB bytes array limit` in `DatasetLargeResultCollectingSuite` as default

2022-11-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41193: - Description: Test this suite with **Java 8/11/17** on Linux/MacOS On Apple Silicon with following

[jira] [Created] (SPARK-41193) Ignore `collect data with single partition larger than 2GB bytes array limit` in `DatasetLargeResultCollectingSuite`

2022-11-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-41193: Summary: Ignore `collect data with single partition larger than 2GB bytes array limit` in `DatasetLargeResultCollectingSuite` Key: SPARK-41193 URL:

[jira] [Updated] (SPARK-41193) Ignore `collect data with single partition larger than 2GB bytes array limit` in `DatasetLargeResultCollectingSuite` as default

2022-11-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41193: - Summary: Ignore `collect data with single partition larger than 2GB bytes array limit` in

[jira] [Commented] (SPARK-41191) Cache Table is not working while nested caches exist

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635651#comment-17635651 ] Apache Spark commented on SPARK-41191: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Assigned] (SPARK-41191) Cache Table is not working while nested caches exist

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41191: Assignee: (was: Apache Spark) > Cache Table is not working while nested caches exist

[jira] [Assigned] (SPARK-41191) Cache Table is not working while nested caches exist

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41191: Assignee: Apache Spark > Cache Table is not working while nested caches exist >

[jira] [Commented] (SPARK-41191) Cache Table is not working while nested caches exist

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635650#comment-17635650 ] Apache Spark commented on SPARK-41191: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Created] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

2022-11-17 Thread Yazhi Wang (Jira)
Yazhi Wang created SPARK-41192: -- Summary: Task finished before speculative task scheduled leads to holding idle executors Key: SPARK-41192 URL: https://issues.apache.org/jira/browse/SPARK-41192 Project:

[jira] [Created] (SPARK-41191) Cache Table is not working while nested caches exist

2022-11-17 Thread mcdull_zhang (Jira)
mcdull_zhang created SPARK-41191: Summary: Cache Table is not working while nested caches exist Key: SPARK-41191 URL: https://issues.apache.org/jira/browse/SPARK-41191 Project: Spark Issue

[jira] [Assigned] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41187: Assignee: Apache Spark > [Core] LiveExecutor MemoryLeak in AppStatusListener when

[jira] [Commented] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635638#comment-17635638 ] Apache Spark commented on SPARK-41187: -- User 'wineternity' has created a pull request for this

[jira] [Assigned] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41187: Assignee: (was: Apache Spark) > [Core] LiveExecutor MemoryLeak in AppStatusListener

[jira] [Commented] (SPARK-41189) Add an environment to switch on and off namedtuple hack

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635636#comment-17635636 ] Apache Spark commented on SPARK-41189: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41189) Add an environment to switch on and off namedtuple hack

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41189: Assignee: (was: Apache Spark) > Add an environment to switch on and off namedtuple

[jira] [Commented] (SPARK-41189) Add an environment to switch on and off namedtuple hack

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635637#comment-17635637 ] Apache Spark commented on SPARK-41189: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41189) Add an environment to switch on and off namedtuple hack

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41189: Assignee: Apache Spark > Add an environment to switch on and off namedtuple hack >

[jira] [Created] (SPARK-41190) The default sparksession catalog name is not scalable and is fixed as spark_catalog

2022-11-17 Thread ganfengtan (Jira)
ganfengtan created SPARK-41190: -- Summary: The default sparksession catalog name is not scalable and is fixed as spark_catalog Key: SPARK-41190 URL: https://issues.apache.org/jira/browse/SPARK-41190

[jira] [Resolved] (SPARK-41178) fix parser rule precedence between JOIN and comma

2022-11-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41178. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38691

[jira] [Assigned] (SPARK-41178) fix parser rule precedence between JOIN and comma

2022-11-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41178: --- Assignee: Wenchen Fan > fix parser rule precedence between JOIN and comma >

[jira] [Created] (SPARK-41189) Add an environment to switch on and off namedtuple hack

2022-11-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41189: Summary: Add an environment to switch on and off namedtuple hack Key: SPARK-41189 URL: https://issues.apache.org/jira/browse/SPARK-41189 Project: Spark

[jira] [Assigned] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41188: Assignee: Apache Spark (was: Weichen Xu) > Set executorEnv OMP_NUM_THREADS to be

[jira] [Assigned] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41188: Assignee: Weichen Xu (was: Apache Spark) > Set executorEnv OMP_NUM_THREADS to be

[jira] [Commented] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635632#comment-17635632 ] Apache Spark commented on SPARK-41188: -- User 'WeichenXu123' has created a pull request for this

[jira] [Updated] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-41188: --- Component/s: Spark Core > Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for

[jira] [Updated] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-41188: --- Description: Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor

[jira] [Assigned] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-41188: -- Assignee: Weichen Xu > Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for

[jira] [Updated] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-41188: --- Description: Limit the thread number for OpenBLAS routine to the number of cores assigned to this

[jira] [Created] (SPARK-41188) Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes

2022-11-17 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-41188: -- Summary: Set executorEnv OMP_NUM_THREADS to be spark.task.cpus by default for spark executor JVM processes Key: SPARK-41188 URL: https://issues.apache.org/jira/browse/SPARK-41188

[jira] [Updated] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread wineternity (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-41187: Description: We have a long running thriftserver, which we found memory leak happened. One of

[jira] [Updated] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread wineternity (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-41187: Attachment: image-2022-11-18-11-09-34-760.png > [Core] LiveExecutor MemoryLeak in

[jira] [Commented] (SPARK-41186) Fix doctest for new version mlfow

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635626#comment-17635626 ] Apache Spark commented on SPARK-41186: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41186) Fix doctest for new version mlfow

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41186: Assignee: Apache Spark > Fix doctest for new version mlfow >

[jira] [Commented] (SPARK-41186) Fix doctest for new version mlfow

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635625#comment-17635625 ] Apache Spark commented on SPARK-41186: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41186) Fix doctest for new version mlfow

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41186: Assignee: (was: Apache Spark) > Fix doctest for new version mlfow >

[jira] [Updated] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread wineternity (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-41187: Attachment: image-2022-11-18-11-01-57-435.png > [Core] LiveExecutor MemoryLeak in

[jira] [Updated] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread wineternity (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-41187: Attachment: image-2022-11-18-10-57-49-230.png > [Core] LiveExecutor MemoryLeak in

[jira] [Updated] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread wineternity (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-41187: Description: We have a long running thriftserver, which we found memory leak happened。One of the

[jira] [Updated] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread wineternity (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-41187: Description: We have a long running thriftserver, which we found memory leak happened。 > [Core]

[jira] [Created] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-11-17 Thread wineternity (Jira)
wineternity created SPARK-41187: --- Summary: [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen Key: SPARK-41187 URL: https://issues.apache.org/jira/browse/SPARK-41187 Project:

[jira] [Resolved] (SPARK-41177) maven test `protobuf` module failed

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41177. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38690

[jira] [Assigned] (SPARK-41177) maven test `protobuf` module failed

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41177: Assignee: Yang Jie > maven test `protobuf` module failed >

[jira] [Commented] (SPARK-41118) to_number/try_to_number throws NullPointerException when format is null

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635603#comment-17635603 ] Apache Spark commented on SPARK-41118: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-41118) to_number/try_to_number throws NullPointerException when format is null

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635602#comment-17635602 ] Apache Spark commented on SPARK-41118: -- User 'bersprockets' has created a pull request for this

[jira] [Created] (SPARK-41186) Fix doctest for new version mlfow

2022-11-17 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-41186: --- Summary: Fix doctest for new version mlfow Key: SPARK-41186 URL: https://issues.apache.org/jira/browse/SPARK-41186 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-41176) Assign a name to the error class _LEGACY_ERROR_TEMP_1042

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635600#comment-17635600 ] BingKun Pan commented on SPARK-41176: - I work on it. > Assign a name to the error class

[jira] (SPARK-41175) Assign a name to the error class _LEGACY_ERROR_TEMP_1078

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41175 ] BingKun Pan deleted comment on SPARK-41175: - was (Author: panbingkun): I work on it > Assign a name to the error class _LEGACY_ERROR_TEMP_1078 >

[jira] [Assigned] (SPARK-41175) Assign a name to the error class _LEGACY_ERROR_TEMP_1078

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41175: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Commented] (SPARK-41175) Assign a name to the error class _LEGACY_ERROR_TEMP_1078

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635593#comment-17635593 ] Apache Spark commented on SPARK-41175: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-41175) Assign a name to the error class _LEGACY_ERROR_TEMP_1078

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41175: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_1078 >

[jira] [Created] (SPARK-41185) YuniKorn on ARM incorrectly documented as not supported

2022-11-17 Thread Wilfred Spiegelenburg (Jira)
Wilfred Spiegelenburg created SPARK-41185: - Summary: YuniKorn on ARM incorrectly documented as not supported Key: SPARK-41185 URL: https://issues.apache.org/jira/browse/SPARK-41185 Project:

[jira] [Commented] (SPARK-41175) Assign a name to the error class _LEGACY_ERROR_TEMP_1078

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635590#comment-17635590 ] BingKun Pan commented on SPARK-41175: - I work on it > Assign a name to the error class

[jira] (SPARK-41166) Check errorSubClass of DataTypeMismatch in *ExpressionSuites

2022-11-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41166 ] BingKun Pan deleted comment on SPARK-41166: - was (Author: panbingkun): I work on it. > Check errorSubClass of DataTypeMismatch in *ExpressionSuites >

[jira] [Resolved] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40593. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38609

[jira] [Assigned] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40593: Assignee: Yang Jie > protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14 >

[jira] [Resolved] (SPARK-41165) Arrow collect should factor in failures

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41165. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38681

[jira] [Assigned] (SPARK-41184) Fill NA tests are flaky

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41184: Assignee: Herman van Hövell > Fill NA tests are flaky > --- > >

[jira] [Resolved] (SPARK-41184) Fill NA tests are flaky

2022-11-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41184. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38694

[jira] [Commented] (SPARK-41184) Fill NA tests are flaky

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635511#comment-17635511 ] Apache Spark commented on SPARK-41184: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-41184) Fill NA tests are flaky

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41184: Assignee: (was: Apache Spark) > Fill NA tests are flaky > --- >

[jira] [Assigned] (SPARK-41184) Fill NA tests are flaky

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41184: Assignee: Apache Spark > Fill NA tests are flaky > --- > >

[jira] [Commented] (SPARK-41184) Fill NA tests are flaky

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635510#comment-17635510 ] Apache Spark commented on SPARK-41184: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-41184) Fill NA tests are flaky

2022-11-17 Thread Jira
Herman van Hövell created SPARK-41184: - Summary: Fill NA tests are flaky Key: SPARK-41184 URL: https://issues.apache.org/jira/browse/SPARK-41184 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-41133) Integrate UNSCALED_VALUE_TOO_LARGE_FOR_PRECISION into NUMERIC_VALUE_OUT_OF_RANGE

2022-11-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41133. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38647

[jira] [Assigned] (SPARK-41133) Integrate UNSCALED_VALUE_TOO_LARGE_FOR_PRECISION into NUMERIC_VALUE_OUT_OF_RANGE

2022-11-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41133: Assignee: Haejoon Lee > Integrate UNSCALED_VALUE_TOO_LARGE_FOR_PRECISION into >

[jira] [Assigned] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41183: Assignee: Apache Spark > Add an extension API to do plan normalization for caching >

[jira] [Assigned] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41183: Assignee: (was: Apache Spark) > Add an extension API to do plan normalization for

[jira] [Commented] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635459#comment-17635459 ] Apache Spark commented on SPARK-41183: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-41182) Assign a name to the error class _LEGACY_ERROR_TEMP_1102

2022-11-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41182: - Description: Assign a proper name to the legacy error class _LEGACY_ERROR_TEMP_1102 and make it

[jira] [Created] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41183: --- Summary: Add an extension API to do plan normalization for caching Key: SPARK-41183 URL: https://issues.apache.org/jira/browse/SPARK-41183 Project: Spark

[jira] [Created] (SPARK-41182) Assign a name to the error class _LEGACY_ERROR_TEMP_1102

2022-11-17 Thread Max Gekk (Jira)
Max Gekk created SPARK-41182: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1102 Key: SPARK-41182 URL: https://issues.apache.org/jira/browse/SPARK-41182 Project: Spark Issue Type:

  1   2   >