[jira] [Assigned] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41677: Assignee: Apache Spark (was: Yang Jie) > Protobuf serializer for

[jira] [Assigned] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41677: Assignee: Yang Jie (was: Apache Spark) > Protobuf serializer for

[jira] [Commented] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679416#comment-17679416 ] Apache Spark commented on SPARK-42143: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679415#comment-17679415 ] Apache Spark commented on SPARK-42143: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42143: Assignee: Gengliang Wang (was: Apache Spark) > Handle null string values in >

[jira] [Assigned] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42143: Assignee: Apache Spark (was: Gengliang Wang) > Handle null string values in >

[jira] [Assigned] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42143: -- Assignee: Gengliang Wang > Handle null string values in >

[jira] [Resolved] (SPARK-41777) Add Integration Tests

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41777. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39637

[jira] [Assigned] (SPARK-41777) Add Integration Tests

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41777: Assignee: Rithwik Ediga Lakhamsani > Add Integration Tests > - > >

[jira] [Assigned] (SPARK-41593) Implement logging from the executor nodes

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41593: Assignee: Rithwik Ediga Lakhamsani > Implement logging from the executor nodes >

[jira] [Resolved] (SPARK-41593) Implement logging from the executor nodes

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41593. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39299

[jira] [Assigned] (SPARK-40264) Add helper function for DL model inference in pyspark.ml.functions

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40264: Assignee: Lee Yang > Add helper function for DL model inference in pyspark.ml.functions

[jira] [Resolved] (SPARK-40264) Add helper function for DL model inference in pyspark.ml.functions

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40264. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39628

[jira] [Commented] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679411#comment-17679411 ] Apache Spark commented on SPARK-42142: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679410#comment-17679410 ] Apache Spark commented on SPARK-42142: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42142: Assignee: Gengliang Wang (was: Apache Spark) > Handle null string values in

[jira] [Assigned] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42142: Assignee: Apache Spark (was: Gengliang Wang) > Handle null string values in

[jira] [Commented] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679409#comment-17679409 ] Gengliang Wang commented on SPARK-42143: I am working on this one > Handle null string values

[jira] [Assigned] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42140: Assignee: (was: Apache Spark) > Handle null string values in >

[jira] [Assigned] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42140: Assignee: Apache Spark > Handle null string values in >

[jira] [Commented] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679408#comment-17679408 ] Apache Spark commented on SPARK-42140: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42056) Add missing options for Protobuf functions.

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42056: Assignee: Raghu Angadi > Add missing options for Protobuf functions. >

[jira] [Resolved] (SPARK-42056) Add missing options for Protobuf functions.

2023-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42056. -- Resolution: Fixed Issue resolved by pull request 39550

[jira] [Commented] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679406#comment-17679406 ] Gengliang Wang commented on SPARK-42142: I am working on this one > Handle null string values

[jira] [Assigned] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42142: -- Assignee: Gengliang Wang > Handle null string values in

[jira] [Commented] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper

2023-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679405#comment-17679405 ] Gengliang Wang commented on SPARK-42140: PairStrings can be null > Handle null string values in

[jira] [Resolved] (SPARK-42138) Handle null string values in JobData/TaskDataWrapper/ExecutorStageSummaryWrapper

2023-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42138. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39680

[jira] [Comment Edited] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679374#comment-17679374 ] Yang Jie edited comment on SPARK-42140 at 1/21/23 6:30 AM: --- PairStrings should

[jira] [Commented] (SPARK-42141) Handle null string values in ApplicationInfo/ApplicationAttemptInfo

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679402#comment-17679402 ] Yang Jie commented on SPARK-42141: -- Too small, merge into SPARK-42140 > Handle null string values in

[jira] [Resolved] (SPARK-42141) Handle null string values in ApplicationInfo/ApplicationAttemptInfo

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-42141. -- Resolution: Duplicate > Handle null string values in ApplicationInfo/ApplicationAttemptInfo >

[jira] [Commented] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679401#comment-17679401 ] Yang Jie commented on SPARK-42140: -- working on this > Handle null string values in >

[jira] [Updated] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42140: - Summary: Handle null string values in ApplicationEnvironmentInfoWrapper/ApplicationInfoWrapper (was:

[jira] [Updated] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfoWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42140: - Summary: Handle null string values in ApplicationEnvironmentInfoWrapper (was: Handle null string

[jira] [Assigned] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42144: Assignee: (was: Apache Spark) > Handle null string values in

[jira] [Commented] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679397#comment-17679397 ] Apache Spark commented on SPARK-42144: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42144: Assignee: Apache Spark > Handle null string values in

[jira] [Commented] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679389#comment-17679389 ] Yang Jie commented on SPARK-42144: -- working on this > Handle null string values in

[jira] [Updated] (SPARK-41415) SASL Request Retries

2023-01-20 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-41415: Fix Version/s: 3.2.4 3.3.2 > SASL Request Retries >

[jira] [Resolved] (SPARK-42145) Handle null string values in SparkPlanGraphNode/SparkPlanGraphClusterWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-42145. -- Resolution: Duplicate > Handle null string values in SparkPlanGraphNode/SparkPlanGraphClusterWrapper

[jira] [Commented] (SPARK-42145) Handle null string values in SparkPlanGraphNode/SparkPlanGraphClusterWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679388#comment-17679388 ] Yang Jie commented on SPARK-42145: -- Too small, will complete with SPARK-42139   > Handle null string

[jira] [Updated] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric/SparkPlanGraphWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42139: - Summary: Handle null string values in SQLExecutionUIData/SQLPlanMetric/SparkPlanGraphWrapper (was:

[jira] [Assigned] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42139: Assignee: (was: Apache Spark) > Handle null string values in

[jira] [Commented] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679386#comment-17679386 ] Apache Spark commented on SPARK-42139: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679387#comment-17679387 ] Apache Spark commented on SPARK-42139: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42139: Assignee: Apache Spark > Handle null string values in SQLExecutionUIData/SQLPlanMetric >

[jira] [Resolved] (SPARK-42134) Fix getPartitionFiltersAndDataFilters() to handle filters without referenced attributes

2023-01-20 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-42134. Fix Version/s: 3.3.2 3.4.0 Assignee: Peter Toth Resolution:

[jira] [Commented] (SPARK-18011) SparkR serialize "NA" throws exception

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679385#comment-17679385 ] Apache Spark commented on SPARK-18011: -- User 'joveyuan-db' has created a pull request for this

[jira] [Resolved] (SPARK-41987) createDataFrame supports column with map type.

2023-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41987. --- Resolution: Resolved > createDataFrame supports column with map type. >

[jira] [Commented] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679384#comment-17679384 ] Yang Jie commented on SPARK-42139: -- work on this one > Handle null string values in

[jira] [Resolved] (SPARK-41845) Fix `count(expr("*"))` function

2023-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41845. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39622

[jira] [Assigned] (SPARK-42099) Make `count(*)` work correctly

2023-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42099: - Assignee: Ruifeng Zheng > Make `count(*)` work correctly >

[jira] [Assigned] (SPARK-41845) Fix `count(expr("*"))` function

2023-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41845: - Assignee: Ruifeng Zheng > Fix `count(expr("*"))` function >

[jira] [Resolved] (SPARK-42099) Make `count(*)` work correctly

2023-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42099. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39622

[jira] [Created] (SPARK-42145) Handle null string values in SparkPlanGraphNode/SparkPlanGraphClusterWrapper

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42145: Summary: Handle null string values in SparkPlanGraphNode/SparkPlanGraphClusterWrapper Key: SPARK-42145 URL: https://issues.apache.org/jira/browse/SPARK-42145 Project: Spark

[jira] [Reopened] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-41677: -- Restore this one > Protobuf serializer for StreamingQueryProgressWrapper >

[jira] [Updated] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42144: - Summary: Handle null string values in StageData/StreamBlockData/StreamingQueryData (was: Handle null

[jira] [Updated] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42144: - Component/s: SQL Web UI > Handle null string values in

[jira] [Created] (SPARK-42144) Handle null string values in StageData/StreamBlockData

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42144: Summary: Handle null string values in StageData/StreamBlockData Key: SPARK-42144 URL: https://issues.apache.org/jira/browse/SPARK-42144 Project: Spark Issue Type:

[jira] [Created] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42143: Summary: Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo Key: SPARK-42143 URL: https://issues.apache.org/jira/browse/SPARK-42143 Project:

[jira] [Created] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42142: Summary: Handle null string values in CachedQuantile/ExecutorSummary/PoolData Key: SPARK-42142 URL: https://issues.apache.org/jira/browse/SPARK-42142 Project: Spark

[jira] [Assigned] (SPARK-42137) Enable spark.kryo.unsafe by default

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42137: - Assignee: Dongjoon Hyun > Enable spark.kryo.unsafe by default >

[jira] [Resolved] (SPARK-42137) Enable spark.kryo.unsafe by default

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42137. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39679

[jira] [Created] (SPARK-42141) Handle null string values in ApplicationInfo/ApplicationAttemptInfo

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42141: Summary: Handle null string values in ApplicationInfo/ApplicationAttemptInfo Key: SPARK-42141 URL: https://issues.apache.org/jira/browse/SPARK-42141 Project: Spark

[jira] [Commented] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfo/RuntimeInfo/PairStrings/ExecutorResourceRequest/TaskResourceRequest

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679374#comment-17679374 ] Yang Jie commented on SPARK-42140: -- RuntimeInfo and PairStrings should not be null String,  can they be

[jira] [Created] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfo/RuntimeInfo/PairStrings/ExecutorResourceRequest/TaskResourceRequest

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42140: Summary: Handle null string values in ApplicationEnvironmentInfo/RuntimeInfo/PairStrings/ExecutorResourceRequest/TaskResourceRequest Key: SPARK-42140 URL:

[jira] [Created] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42139: Summary: Handle null string values in SQLExecutionUIData/SQLPlanMetric Key: SPARK-42139 URL: https://issues.apache.org/jira/browse/SPARK-42139 Project: Spark Issue

[jira] [Commented] (SPARK-42138) Handle null string values in JobData/TaskDataWrapper/ExecutorStageSummaryWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679359#comment-17679359 ] Apache Spark commented on SPARK-42138: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42138) Handle null string values in JobData/TaskDataWrapper/ExecutorStageSummaryWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42138: Assignee: Apache Spark (was: Gengliang Wang) > Handle null string values in >

[jira] [Commented] (SPARK-42138) Handle null string values in JobData/TaskDataWrapper/ExecutorStageSummaryWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679358#comment-17679358 ] Apache Spark commented on SPARK-42138: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42138) Handle null string values in JobData/TaskDataWrapper/ExecutorStageSummaryWrapper

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42138: Assignee: Gengliang Wang (was: Apache Spark) > Handle null string values in >

[jira] [Created] (SPARK-42138) Handle null string values in JobData/TaskDataWrapper/ExecutorStageSummaryWrapper

2023-01-20 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-42138: -- Summary: Handle null string values in JobData/TaskDataWrapper/ExecutorStageSummaryWrapper Key: SPARK-42138 URL: https://issues.apache.org/jira/browse/SPARK-42138

[jira] [Updated] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40817: -- Fix Version/s: 3.2.4 > Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

[jira] [Assigned] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40817: - Assignee: Anton Ippolitov > Remote spark.jars URIs ignored for Spark on Kubernetes in

[jira] [Resolved] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40817. --- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Remote spark.jars

[jira] [Assigned] (SPARK-42137) Enable spark.kryo.unsafe by default

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42137: Assignee: (was: Apache Spark) > Enable spark.kryo.unsafe by default >

[jira] [Assigned] (SPARK-42137) Enable spark.kryo.unsafe by default

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42137: Assignee: Apache Spark > Enable spark.kryo.unsafe by default >

[jira] [Commented] (SPARK-42137) Enable spark.kryo.unsafe by default

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679340#comment-17679340 ] Apache Spark commented on SPARK-42137: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-42137) Enable spark.kryo.unsafe by default

2023-01-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42137: - Summary: Enable spark.kryo.unsafe by default Key: SPARK-42137 URL: https://issues.apache.org/jira/browse/SPARK-42137 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42130) Handle null string values in AccumulableInfo and ProcessSummary

2023-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42130. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39666

[jira] [Updated] (SPARK-41916) Address General Fixes

2023-01-20 Thread Rithwik Ediga Lakhamsani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani updated SPARK-41916: - Description: We want the distributor to have the ability to run

[jira] [Updated] (SPARK-41916) Address General Fizes

2023-01-20 Thread Rithwik Ediga Lakhamsani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani updated SPARK-41916: - Summary: Address General Fizes (was: Address

[jira] [Resolved] (SPARK-41776) Implement support for PyTorch Lightning

2023-01-20 Thread Rithwik Ediga Lakhamsani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani resolved SPARK-41776. -- Resolution: Fixed Not needed, since we are now using

[jira] [Updated] (SPARK-41916) Address `spark.task.resource.gpu.amount > 1`

2023-01-20 Thread Rithwik Ediga Lakhamsani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani updated SPARK-41916: - Description: We want the distributor to have the ability to run multiple

[jira] [Updated] (SPARK-41916) Address General Fixes

2023-01-20 Thread Rithwik Ediga Lakhamsani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani updated SPARK-41916: - Summary: Address General Fixes (was: Address General Fizes) > Address

[jira] [Assigned] (SPARK-16484) Incremental Cardinality estimation operations with Hyperloglog

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16484: Assignee: (was: Apache Spark) > Incremental Cardinality estimation operations with

[jira] [Commented] (SPARK-16484) Incremental Cardinality estimation operations with Hyperloglog

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679252#comment-17679252 ] Apache Spark commented on SPARK-16484: -- User 'RyanBerti' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16484) Incremental Cardinality estimation operations with Hyperloglog

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16484: Assignee: Apache Spark > Incremental Cardinality estimation operations with Hyperloglog

[jira] [Assigned] (SPARK-40303) The performance will be worse after codegen

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40303: - Assignee: Yuming Wang > The performance will be worse after codegen >

[jira] [Resolved] (SPARK-40303) The performance will be worse after codegen

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40303. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39671

[jira] [Commented] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679220#comment-17679220 ] Apache Spark commented on SPARK-42136: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-42043) Basic Scala Client Result Implementation

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679219#comment-17679219 ] Apache Spark commented on SPARK-42043: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42136: Assignee: Apache Spark > Refactor BroadcastHashJoinExec output partitioning generation >

[jira] [Assigned] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42136: Assignee: (was: Apache Spark) > Refactor BroadcastHashJoinExec output partitioning

[jira] [Created] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-01-20 Thread Peter Toth (Jira)
Peter Toth created SPARK-42136: -- Summary: Refactor BroadcastHashJoinExec output partitioning generation Key: SPARK-42136 URL: https://issues.apache.org/jira/browse/SPARK-42136 Project: Spark

[jira] [Created] (SPARK-42135) Scala Client Proper logging for the client

2023-01-20 Thread Zhen Li (Jira)
Zhen Li created SPARK-42135: --- Summary: Scala Client Proper logging for the client Key: SPARK-42135 URL: https://issues.apache.org/jira/browse/SPARK-42135 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42134) Fix getPartitionFiltersAndDataFilters() to handle filters without referenced attributes

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42134: Assignee: Apache Spark > Fix getPartitionFiltersAndDataFilters() to handle filters

[jira] [Commented] (SPARK-42134) Fix getPartitionFiltersAndDataFilters() to handle filters without referenced attributes

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679156#comment-17679156 ] Apache Spark commented on SPARK-42134: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-42134) Fix getPartitionFiltersAndDataFilters() to handle filters without referenced attributes

2023-01-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42134: Assignee: (was: Apache Spark) > Fix getPartitionFiltersAndDataFilters() to handle

[jira] [Created] (SPARK-42134) Fix getPartitionFiltersAndDataFilters() to handle filters without referenced attributes

2023-01-20 Thread Peter Toth (Jira)
Peter Toth created SPARK-42134: -- Summary: Fix getPartitionFiltersAndDataFilters() to handle filters without referenced attributes Key: SPARK-42134 URL: https://issues.apache.org/jira/browse/SPARK-42134

[jira] [Assigned] (SPARK-42129) Upgrade rocksdbjni to 7.9.2

2023-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42129: - Assignee: Yang Jie > Upgrade rocksdbjni to 7.9.2 > --- > >

  1   2   >