[jira] [Commented] (SPARK-42071) Register scala.math.Ordering$Reverse to KyroSerializer

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676986#comment-17676986 ] Apache Spark commented on SPARK-42071: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-42071) Register scala.math.Ordering$Reverse to KyroSerializer

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42071: Assignee: Apache Spark > Register scala.math.Ordering$Reverse to KyroSerializer > ---

[jira] [Assigned] (SPARK-42071) Register scala.math.Ordering$Reverse to KyroSerializer

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42071: Assignee: (was: Apache Spark) > Register scala.math.Ordering$Reverse to KyroSerialize

[jira] [Commented] (SPARK-42071) Register scala.math.Ordering$Reverse to KyroSerializer

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676985#comment-17676985 ] Apache Spark commented on SPARK-42071: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-42071) Register scala.math.Ordering$Reverse to KyroSerializer

2023-01-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42071: - Summary: Register scala.math.Ordering$Reverse to KyroSerializer Key: SPARK-42071 URL: https://issues.apache.org/jira/browse/SPARK-42071 Project: Spark Issu

[jira] [Updated] (SPARK-42071) Register scala.math.Ordering$Reverse to KyroSerializer

2023-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42071: -- Description: Scala 2.12.12 added a new class 'Reverse' via https://github.com/scala/scala/pull

[jira] [Assigned] (SPARK-41990) Filtering by composite field name like `field name` doesn't work with pushDownPredicate = true

2023-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41990: - Assignee: Huaxin Gao > Filtering by composite field name like `field name` doesn't work

[jira] [Resolved] (SPARK-41990) Filtering by composite field name like `field name` doesn't work with pushDownPredicate = true

2023-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41990. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39564 [https://

[jira] [Assigned] (SPARK-41415) SASL Request Retries

2023-01-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41415: --- Assignee: Aravind Patnam (was: Aravind Patnam) > SASL Request Retries > --

[jira] [Resolved] (SPARK-41415) SASL Request Retries

2023-01-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41415. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 389

[jira] [Assigned] (SPARK-41415) SASL Request Retries

2023-01-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41415: --- Assignee: Aravind Patnam > SASL Request Retries > > >

[jira] [Assigned] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42070: Assignee: (was: Apache Spark) > Change the default value of argument of Mask udf from

[jira] [Commented] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676979#comment-17676979 ] Apache Spark commented on SPARK-42070: -- User 'vinodkc' has created a pull request f

[jira] [Assigned] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42070: Assignee: Apache Spark > Change the default value of argument of Mask udf from -1 to NULL

[jira] [Created] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

2023-01-14 Thread Vinod KC (Jira)
Vinod KC created SPARK-42070: Summary: Change the default value of argument of Mask udf from -1 to NULL Key: SPARK-42070 URL: https://issues.apache.org/jira/browse/SPARK-42070 Project: Spark Iss

[jira] [Updated] (SPARK-42069) Data duplicate or data lost with non-deterministic function

2023-01-14 Thread Jarred Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarred Li updated SPARK-42069: -- Description: When write table with shuffle data and non-deterministic function, data may be duplicate

[jira] [Created] (SPARK-42069) Data duplicate or data lost with non-deterministic function

2023-01-14 Thread Jarred Li (Jira)
Jarred Li created SPARK-42069: - Summary: Data duplicate or data lost with non-deterministic function Key: SPARK-42069 URL: https://issues.apache.org/jira/browse/SPARK-42069 Project: Spark Issue

[jira] [Updated] (SPARK-42068) Parallelization in Scala is not working with Java 11 and spark3

2023-01-14 Thread Srinivas Rishindra Pothireddi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-42068: -- Description: The following code snippet fails with java 11 wit

[jira] [Updated] (SPARK-42068) Parallelization in Scala is not working with Java 11 and spark3

2023-01-14 Thread Srinivas Rishindra Pothireddi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-42068: -- Environment: spark version 3.3.1 Using Scala version 2.12.15 (O

[jira] [Created] (SPARK-42068) Parallelization in Scala is not working with Java 11 and spark3

2023-01-14 Thread Srinivas Rishindra Pothireddi (Jira)
Srinivas Rishindra Pothireddi created SPARK-42068: - Summary: Parallelization in Scala is not working with Java 11 and spark3 Key: SPARK-42068 URL: https://issues.apache.org/jira/browse/SPARK-42068

[jira] [Assigned] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

2023-01-14 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-35084: -- Assignee: Keunhyun Oh > [k8s] On Spark 3, jars listed in spark.jars and spark

[jira] [Assigned] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

2023-01-14 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-35084: -- Assignee: (was: Attila Zsolt Piros) > [k8s] On Spark 3, jars listed in sp

[jira] [Commented] (SPARK-42067) Upgrade buf from 1.11.0 to 1.12.0

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676967#comment-17676967 ] Apache Spark commented on SPARK-42067: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-42067) Upgrade buf from 1.11.0 to 1.12.0

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42067: Assignee: (was: Apache Spark) > Upgrade buf from 1.11.0 to 1.12.0 > -

[jira] [Assigned] (SPARK-42067) Upgrade buf from 1.11.0 to 1.12.0

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42067: Assignee: Apache Spark > Upgrade buf from 1.11.0 to 1.12.0 >

[jira] [Resolved] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

2023-01-14 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-35084. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38828

[jira] [Assigned] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

2023-01-14 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-35084: -- Assignee: Attila Zsolt Piros > [k8s] On Spark 3, jars listed in spark.jars an

[jira] [Created] (SPARK-42067) Upgrade buf from 1.11.0 to 1.12.0

2023-01-14 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42067: --- Summary: Upgrade buf from 1.11.0 to 1.12.0 Key: SPARK-42067 URL: https://issues.apache.org/jira/browse/SPARK-42067 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42058: Assignee: (was: Apache Spark) > Harden SQLSTATE usage for error classes (2) > ---

[jira] [Commented] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676960#comment-17676960 ] Apache Spark commented on SPARK-42058: -- User 'srielau' has created a pull request f

[jira] [Commented] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676959#comment-17676959 ] Apache Spark commented on SPARK-42058: -- User 'srielau' has created a pull request f

[jira] [Assigned] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42058: Assignee: Apache Spark > Harden SQLSTATE usage for error classes (2) > --

[jira] [Assigned] (SPARK-42012) Implement DataFrameReader.orc

2023-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42012: - Assignee: Sandeep Singh > Implement DataFrameReader.orc > -

[jira] [Resolved] (SPARK-42012) Implement DataFrameReader.orc

2023-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42012. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39567 [https://

[jira] [Created] (SPARK-42066) The DATATYPE_MISMATCH error class contains inappropriate and duplicating subclasses

2023-01-14 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-42066: Summary: The DATATYPE_MISMATCH error class contains inappropriate and duplicating subclasses Key: SPARK-42066 URL: https://issues.apache.org/jira/browse/SPARK-42066 P

[jira] [Updated] (SPARK-42065) Remove duplicated test_freqItems

2023-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-42065: Component/s: Tests > Remove duplicated test_freqItems > >

[jira] [Commented] (SPARK-42065) Remove duplicated test_freqItems

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676944#comment-17676944 ] Apache Spark commented on SPARK-42065: -- User 'bjornjorgensen' has created a pull re

[jira] [Assigned] (SPARK-42065) Remove duplicated test_freqItems

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42065: Assignee: Apache Spark > Remove duplicated test_freqItems > -

[jira] [Assigned] (SPARK-42065) Remove duplicated test_freqItems

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42065: Assignee: (was: Apache Spark) > Remove duplicated test_freqItems > --

[jira] [Created] (SPARK-42065) Remove duplicated test_freqItems

2023-01-14 Thread Jira
Bjørn Jørgensen created SPARK-42065: --- Summary: Remove duplicated test_freqItems Key: SPARK-42065 URL: https://issues.apache.org/jira/browse/SPARK-42065 Project: Spark Issue Type: Improvemen

[jira] [Assigned] (SPARK-39979) IndexOutOfBoundsException on groupby + apply pandas grouped map udf function

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39979: Assignee: Apache Spark > IndexOutOfBoundsException on groupby + apply pandas grouped map

[jira] [Commented] (SPARK-39979) IndexOutOfBoundsException on groupby + apply pandas grouped map udf function

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676914#comment-17676914 ] Apache Spark commented on SPARK-39979: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-39979) IndexOutOfBoundsException on groupby + apply pandas grouped map udf function

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39979: Assignee: (was: Apache Spark) > IndexOutOfBoundsException on groupby + apply pandas g

[jira] [Commented] (SPARK-39979) IndexOutOfBoundsException on groupby + apply pandas grouped map udf function

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676915#comment-17676915 ] Apache Spark commented on SPARK-39979: -- User 'Kimahriman' has created a pull reques

[jira] [Resolved] (SPARK-42063) Register `byte[][]` to KyroSerializer

2023-01-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42063. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39569 [https://gith

[jira] [Assigned] (SPARK-42063) Register `byte[][]` to KyroSerializer

2023-01-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42063: --- Assignee: Dongjoon Hyun > Register `byte[][]` to KyroSerializer > -

[jira] [Assigned] (SPARK-42064) Implement bloom filter join hint

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42064: Assignee: Apache Spark > Implement bloom filter join hint > -

[jira] [Assigned] (SPARK-42064) Implement bloom filter join hint

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42064: Assignee: (was: Apache Spark) > Implement bloom filter join hint > --

[jira] [Commented] (SPARK-42064) Implement bloom filter join hint

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676902#comment-17676902 ] Apache Spark commented on SPARK-42064: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-42064) Implement bloom filter join hint

2023-01-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-42064: --- Summary: Implement bloom filter join hint Key: SPARK-42064 URL: https://issues.apache.org/jira/browse/SPARK-42064 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-40480) Remove push-based shuffle data after query finished

2023-01-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40480: --- Assignee: Wan Kun > Remove push-based shuffle data after query finished > -

[jira] [Resolved] (SPARK-40480) Remove push-based shuffle data after query finished

2023-01-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40480. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 379

[jira] [Commented] (SPARK-41903) Support data type ndarray

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676881#comment-17676881 ] Apache Spark commented on SPARK-41903: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-41903) Support data type ndarray

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676882#comment-17676882 ] Apache Spark commented on SPARK-41903: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41903) Support data type ndarray

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41903: Assignee: (was: Apache Spark) > Support data type ndarray > -

[jira] [Assigned] (SPARK-41903) Support data type ndarray

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41903: Assignee: Apache Spark > Support data type ndarray > - > >

[jira] [Resolved] (SPARK-38651) Writing out empty or nested empty schemas in Datasource should be configurable

2023-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38651. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35969 [https://

[jira] [Assigned] (SPARK-38651) Writing out empty or nested empty schemas in Datasource should be configurable

2023-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38651: - Assignee: Thejdeep Gudivada > Writing out empty or nested empty schemas in Datasource s

[jira] [Assigned] (SPARK-42063) Register `byte[][]` to KyroSerializer

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42063: Assignee: (was: Apache Spark) > Register `byte[][]` to KyroSerializer > -

[jira] [Commented] (SPARK-42063) Register `byte[][]` to KyroSerializer

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676876#comment-17676876 ] Apache Spark commented on SPARK-42063: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-42063) Register `byte[][]` to KyroSerializer

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42063: Assignee: Apache Spark > Register `byte[][]` to KyroSerializer >

[jira] [Created] (SPARK-42063) Register `byte[][]` to KyroSerializer

2023-01-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42063: - Summary: Register `byte[][]` to KyroSerializer Key: SPARK-42063 URL: https://issues.apache.org/jira/browse/SPARK-42063 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-41847) DataFrame mapfield,structlist invalid type

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676875#comment-17676875 ] Apache Spark commented on SPARK-41847: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-41847) DataFrame mapfield,structlist invalid type

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676874#comment-17676874 ] Apache Spark commented on SPARK-41847: -- User 'zhengruifeng' has created a pull requ

[jira] [Resolved] (SPARK-41832) DataFrame.unionByName output is wrong

2023-01-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41832. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39451 [https://

[jira] [Assigned] (SPARK-41832) DataFrame.unionByName output is wrong

2023-01-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41832: - Assignee: Sandeep Singh > DataFrame.unionByName output is wrong > -

[jira] [Assigned] (SPARK-42012) Implement DataFrameReader.orc

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42012: Assignee: Apache Spark > Implement DataFrameReader.orc > - >

[jira] [Commented] (SPARK-42012) Implement DataFrameReader.orc

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676863#comment-17676863 ] Apache Spark commented on SPARK-42012: -- User 'techaddict' has created a pull reques

[jira] [Assigned] (SPARK-42012) Implement DataFrameReader.orc

2023-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42012: Assignee: (was: Apache Spark) > Implement DataFrameReader.orc > -