[jira] [Resolved] (SPARK-42013) Implement DataFrameReader.text to take multiple paths

2023-01-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42013. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39553

[jira] [Assigned] (SPARK-42041) DataFrameReader should support list of paths

2023-01-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42041: Assignee: Ruifeng Zheng > DataFrameReader should support list of paths >

[jira] [Assigned] (SPARK-42013) Implement DataFrameReader.text to take multiple paths

2023-01-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42013: Assignee: Ruifeng Zheng > Implement DataFrameReader.text to take multiple paths >

[jira] [Resolved] (SPARK-42041) DataFrameReader should support list of paths

2023-01-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42041. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39553

[jira] [Resolved] (SPARK-42060) Support overriding the driver/executors container name

2023-01-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42060. --- Resolution: Duplicate Thank you for making a JIRA issue, but Apache Spark already supports

[jira] [Resolved] (SPARK-42062) Enforce scalafmt for connect-common

2023-01-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42062. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39565

[jira] [Assigned] (SPARK-42062) Enforce scalafmt for connect-common

2023-01-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42062: - Assignee: Ruifeng Zheng > Enforce scalafmt for connect-common >

[jira] [Assigned] (SPARK-41896) Filtering by row_index always returns empty results

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41896: --- Assignee: Jan-Ole Sasse > Filtering by row_index always returns empty results >

[jira] [Assigned] (SPARK-42057) Avoid losing exception info in Protobuf errors

2023-01-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42057: -- Assignee: Raghu Angadi > Avoid losing exception info in Protobuf errors >

[jira] [Resolved] (SPARK-41896) Filtering by row_index always returns empty results

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41896. - Resolution: Fixed Issue resolved by pull request 39408

[jira] [Resolved] (SPARK-42057) Avoid losing exception info in Protobuf errors

2023-01-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42057. Resolution: Fixed Issue resolved by pull request 39536

[jira] [Commented] (SPARK-42062) Enforce scalafmt for connect-common

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676830#comment-17676830 ] Apache Spark commented on SPARK-42062: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42062) Enforce scalafmt for connect-common

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42062: Assignee: (was: Apache Spark) > Enforce scalafmt for connect-common >

[jira] [Assigned] (SPARK-42062) Enforce scalafmt for connect-common

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42062: Assignee: Apache Spark > Enforce scalafmt for connect-common >

[jira] [Commented] (SPARK-42062) Enforce scalafmt for connect-common

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676829#comment-17676829 ] Apache Spark commented on SPARK-42062: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-42062) Enforce scalafmt for connect-common

2023-01-13 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42062: - Summary: Enforce scalafmt for connect-common Key: SPARK-42062 URL: https://issues.apache.org/jira/browse/SPARK-42062 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-42001) Unexpected schema set to DefaultSource plan (ReadwriterTests.test_save_and_load)

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42001: - Assignee: Ruifeng Zheng > Unexpected schema set to DefaultSource plan >

[jira] [Resolved] (SPARK-42001) Unexpected schema set to DefaultSource plan (ReadwriterTests.test_save_and_load)

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42001. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39552

[jira] [Resolved] (SPARK-41900) Support data type int8

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41900. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39551

[jira] [Assigned] (SPARK-41900) Support data type int8

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41900: - Assignee: Ruifeng Zheng > Support data type int8 > -- > >

[jira] [Resolved] (SPARK-42047) Literal should support numpy datatypes

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42047. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39551

[jira] [Assigned] (SPARK-42047) Literal should support numpy datatypes

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42047: - Assignee: Ruifeng Zheng > Literal should support numpy datatypes >

[jira] [Assigned] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41965: - Assignee: Ruifeng Zheng > Add DataFrameWriterV2 to PySpark API references >

[jira] [Resolved] (SPARK-41965) Add DataFrameWriterV2 to PySpark API references

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41965. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39493

[jira] [Assigned] (SPARK-41961) Support table-valued functions with LATERAL

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41961: --- Assignee: Allison Wang > Support table-valued functions with LATERAL >

[jira] [Resolved] (SPARK-41961) Support table-valued functions with LATERAL

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41961. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39479

[jira] [Created] (SPARK-42061) Mark Expressions that have state has stateful

2023-01-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42061: --- Summary: Mark Expressions that have state has stateful Key: SPARK-42061 URL: https://issues.apache.org/jira/browse/SPARK-42061 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42059) Update ORC to 1.8.2

2023-01-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42059: - Assignee: William Hyun > Update ORC to 1.8.2 > --- > >

[jira] [Resolved] (SPARK-42059) Update ORC to 1.8.2

2023-01-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42059. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39561

[jira] [Commented] (SPARK-41990) Filtering by composite field name like `field name` doesn't work with pushDownPredicate = true

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676815#comment-17676815 ] Apache Spark commented on SPARK-41990: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-41990) Filtering by composite field name like `field name` doesn't work with pushDownPredicate = true

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676813#comment-17676813 ] Apache Spark commented on SPARK-41990: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-42060) Support overriding the driver/executors container name

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676800#comment-17676800 ] Apache Spark commented on SPARK-42060: -- User 'hussein-awala' has created a pull request for this

[jira] [Commented] (SPARK-42060) Support overriding the driver/executors container name

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676801#comment-17676801 ] Apache Spark commented on SPARK-42060: -- User 'hussein-awala' has created a pull request for this

[jira] [Assigned] (SPARK-42060) Support overriding the driver/executors container name

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42060: Assignee: (was: Apache Spark) > Support overriding the driver/executors container

[jira] [Assigned] (SPARK-42060) Support overriding the driver/executors container name

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42060: Assignee: Apache Spark > Support overriding the driver/executors container name >

[jira] [Created] (SPARK-42060) Support overriding the driver/executors container name

2023-01-13 Thread Hussein Awala (Jira)
Hussein Awala created SPARK-42060: - Summary: Support overriding the driver/executors container name Key: SPARK-42060 URL: https://issues.apache.org/jira/browse/SPARK-42060 Project: Spark

[jira] [Commented] (SPARK-41964) Add the unsupported function list

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676797#comment-17676797 ] Apache Spark commented on SPARK-41964: -- User 'techaddict' has created a pull request for this

[jira] [Commented] (SPARK-41964) Add the unsupported function list

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676796#comment-17676796 ] Apache Spark commented on SPARK-41964: -- User 'techaddict' has created a pull request for this

[jira] [Commented] (SPARK-42059) Update ORC to 1.8.2

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676795#comment-17676795 ] Apache Spark commented on SPARK-42059: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-42059) Update ORC to 1.8.2

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42059: Assignee: Apache Spark > Update ORC to 1.8.2 > --- > >

[jira] [Assigned] (SPARK-42059) Update ORC to 1.8.2

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42059: Assignee: (was: Apache Spark) > Update ORC to 1.8.2 > --- > >

[jira] [Commented] (SPARK-42059) Update ORC to 1.8.2

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676794#comment-17676794 ] Apache Spark commented on SPARK-42059: -- User 'williamhyun' has created a pull request for this

[jira] [Created] (SPARK-42059) Update ORC to 1.8.2

2023-01-13 Thread William Hyun (Jira)
William Hyun created SPARK-42059: Summary: Update ORC to 1.8.2 Key: SPARK-42059 URL: https://issues.apache.org/jira/browse/SPARK-42059 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

2023-01-13 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-42058: Summary: Harden SQLSTATE usage for error classes (2) Key: SPARK-42058 URL: https://issues.apache.org/jira/browse/SPARK-42058 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42012) Implement DataFrameReader.orc

2023-01-13 Thread Sandeep Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676751#comment-17676751 ] Sandeep Singh commented on SPARK-42012: --- working on this. > Implement DataFrameReader.orc >

[jira] [Commented] (SPARK-42011) Implement DataFrameReader.csv

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676748#comment-17676748 ] Apache Spark commented on SPARK-42011: -- User 'techaddict' has created a pull request for this

[jira] [Assigned] (SPARK-42011) Implement DataFrameReader.csv

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42011: Assignee: Apache Spark > Implement DataFrameReader.csv > - >

[jira] [Commented] (SPARK-42011) Implement DataFrameReader.csv

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676747#comment-17676747 ] Apache Spark commented on SPARK-42011: -- User 'techaddict' has created a pull request for this

[jira] [Assigned] (SPARK-42011) Implement DataFrameReader.csv

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42011: Assignee: (was: Apache Spark) > Implement DataFrameReader.csv >

[jira] [Commented] (SPARK-41982) When the inserted partition type is of string type, similar `dt=01` will be converted to `dt=1`

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676737#comment-17676737 ] Apache Spark commented on SPARK-41982: -- User 'smallzhongfeng' has created a pull request for this

[jira] [Commented] (SPARK-41982) When the inserted partition type is of string type, similar `dt=01` will be converted to `dt=1`

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676734#comment-17676734 ] Apache Spark commented on SPARK-41982: -- User 'smallzhongfeng' has created a pull request for this

[jira] [Assigned] (SPARK-41982) When the inserted partition type is of string type, similar `dt=01` will be converted to `dt=1`

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41982: Assignee: Apache Spark > When the inserted partition type is of string type, similar

[jira] [Assigned] (SPARK-41982) When the inserted partition type is of string type, similar `dt=01` will be converted to `dt=1`

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41982: Assignee: (was: Apache Spark) > When the inserted partition type is of string type,

[jira] [Commented] (SPARK-42045) Round/Bround should return an error on integral overflow

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676731#comment-17676731 ] Apache Spark commented on SPARK-42045: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-42045) Round/Bround should return an error on integral overflow

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676728#comment-17676728 ] Apache Spark commented on SPARK-42045: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42057) Avoid losing exception info in Protobuf errors

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42057: Assignee: (was: Apache Spark) > Avoid losing exception info in Protobuf errors >

[jira] [Commented] (SPARK-42057) Avoid losing exception info in Protobuf errors

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676722#comment-17676722 ] Apache Spark commented on SPARK-42057: -- User 'rangadi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42057) Avoid losing exception info in Protobuf errors

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42057: Assignee: Apache Spark > Avoid losing exception info in Protobuf errors >

[jira] [Assigned] (SPARK-42056) Add missing options for Protobuf functions.

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42056: Assignee: (was: Apache Spark) > Add missing options for Protobuf functions. >

[jira] [Assigned] (SPARK-42056) Add missing options for Protobuf functions.

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42056: Assignee: Apache Spark > Add missing options for Protobuf functions. >

[jira] [Commented] (SPARK-42056) Add missing options for Protobuf functions.

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676721#comment-17676721 ] Apache Spark commented on SPARK-42056: -- User 'rangadi' has created a pull request for this issue:

[jira] [Updated] (SPARK-42056) Add missing options for Protobuf functions.

2023-01-13 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated SPARK-42056: - Summary: Add missing options for Protobuf functions. (was: Add missing options arg for

[jira] [Created] (SPARK-42057) Avoid losing exception info in Protobuf errors

2023-01-13 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-42057: Summary: Avoid losing exception info in Protobuf errors Key: SPARK-42057 URL: https://issues.apache.org/jira/browse/SPARK-42057 Project: Spark Issue Type:

[jira] [Created] (SPARK-42056) Add missing options arg for Protobuf functions.

2023-01-13 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-42056: Summary: Add missing options arg for Protobuf functions. Key: SPARK-42056 URL: https://issues.apache.org/jira/browse/SPARK-42056 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42045) Round/Bround should return an error on integral overflow

2023-01-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42045. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39546

[jira] [Commented] (SPARK-42005) SparkR cannot collect dataframe with NA in a date column along with another timestamp column

2023-01-13 Thread Vivek Atal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676710#comment-17676710 ] Vivek Atal commented on SPARK-42005: [~gurwls223], could you please check this issue? I don't have

[jira] [Resolved] (SPARK-42055) Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0

2023-01-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42055. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39554

[jira] [Assigned] (SPARK-42055) Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0

2023-01-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42055: - Assignee: BingKun Pan > Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0 >

[jira] [Updated] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2023-01-13 Thread Anton Ippolitov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Ippolitov updated SPARK-40817: Affects Version/s: 3.4.0 > Remote spark.jars URIs ignored for Spark on Kubernetes in

[jira] [Assigned] (SPARK-42049) Improve AliasAwareOutputExpression

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42049: Assignee: Apache Spark > Improve AliasAwareOutputExpression >

[jira] [Assigned] (SPARK-42049) Improve AliasAwareOutputExpression

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42049: Assignee: (was: Apache Spark) > Improve AliasAwareOutputExpression >

[jira] [Commented] (SPARK-42049) Improve AliasAwareOutputExpression

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676655#comment-17676655 ] Apache Spark commented on SPARK-42049: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2023-01-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676635#comment-17676635 ] Bjørn Jørgensen commented on SPARK-40817: - If this affects 3.4 you must upgrade the "Affects

[jira] [Assigned] (SPARK-39217) Makes DPP support the pruning side has Union

2023-01-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39217: --- Assignee: Wan Kun > Makes DPP support the pruning side has Union >

[jira] [Resolved] (SPARK-39217) Makes DPP support the pruning side has Union

2023-01-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39217. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39460

[jira] [Commented] (SPARK-39979) IndexOutOfBoundsException on groupby + apply pandas grouped map udf function

2023-01-13 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676610#comment-17676610 ] Adam Binford commented on SPARK-39979: -- We have encountered this as well and I'm am working on a

[jira] [Assigned] (SPARK-42046) Add `connect-client-jvm` to connect module

2023-01-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42046: Assignee: Dongjoon Hyun > Add `connect-client-jvm` to connect module >

[jira] [Resolved] (SPARK-42046) Add `connect-client-jvm` to connect module

2023-01-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42046. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39549

[jira] [Assigned] (SPARK-42051) Codegen Support for HiveGenericUDF

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42051: Assignee: (was: Apache Spark) > Codegen Support for HiveGenericUDF >

[jira] [Assigned] (SPARK-42051) Codegen Support for HiveGenericUDF

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42051: Assignee: Apache Spark > Codegen Support for HiveGenericUDF >

[jira] [Commented] (SPARK-42051) Codegen Support for HiveGenericUDF

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676582#comment-17676582 ] Apache Spark commented on SPARK-42051: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-42051) Codegen Support for HiveGenericUDF

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676581#comment-17676581 ] Apache Spark commented on SPARK-42051: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42055) Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42055: Assignee: Apache Spark > Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0 >

[jira] [Assigned] (SPARK-42055) Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42055: Assignee: (was: Apache Spark) > Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0 >

[jira] [Commented] (SPARK-42055) Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676573#comment-17676573 ] Apache Spark commented on SPARK-42055: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-42055) Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0

2023-01-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42055: --- Summary: Upgrade scalatest-maven-plugin from 2.1.0 to 2.2.0 Key: SPARK-42055 URL: https://issues.apache.org/jira/browse/SPARK-42055 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42013) Implement DataFrameReader.text to take multiple paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676570#comment-17676570 ] Apache Spark commented on SPARK-42013: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42013) Implement DataFrameReader.text to take multiple paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42013: Assignee: (was: Apache Spark) > Implement DataFrameReader.text to take multiple

[jira] [Commented] (SPARK-42041) DataFrameReader should support list of paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676568#comment-17676568 ] Apache Spark commented on SPARK-42041: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42013) Implement DataFrameReader.text to take multiple paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676569#comment-17676569 ] Apache Spark commented on SPARK-42013: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42013) Implement DataFrameReader.text to take multiple paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42013: Assignee: Apache Spark > Implement DataFrameReader.text to take multiple paths >

[jira] [Assigned] (SPARK-42041) DataFrameReader should support list of paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42041: Assignee: Apache Spark > DataFrameReader should support list of paths >

[jira] [Assigned] (SPARK-42041) DataFrameReader should support list of paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42041: Assignee: (was: Apache Spark) > DataFrameReader should support list of paths >

[jira] [Commented] (SPARK-42041) DataFrameReader should support list of paths

2023-01-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676567#comment-17676567 ] Apache Spark commented on SPARK-42041: -- User 'zhengruifeng' has created a pull request for this

[jira] [Updated] (SPARK-42041) DataFrameReader should support list of paths

2023-01-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42041: -- Summary: DataFrameReader should support list of paths (was: DataFrameReader should support

[jira] [Created] (SPARK-42054) Codegen Support for HiveUDAFFunction

2023-01-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-42054: Summary: Codegen Support for HiveUDAFFunction Key: SPARK-42054 URL: https://issues.apache.org/jira/browse/SPARK-42054 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-01-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-42052: Summary: Codegen Support for HiveSimpleUDF Key: SPARK-42052 URL: https://issues.apache.org/jira/browse/SPARK-42052 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-42053) Codegen Support for HiveGenericUDTF

2023-01-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-42053: Summary: Codegen Support for HiveGenericUDTF Key: SPARK-42053 URL: https://issues.apache.org/jira/browse/SPARK-42053 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-42051) Codegen Support for HiveGenericUDF

2023-01-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-42051: Summary: Codegen Support for HiveGenericUDF Key: SPARK-42051 URL: https://issues.apache.org/jira/browse/SPARK-42051 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-42050) Hive UDF Codegen Support

2023-01-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-42050: Summary: Hive UDF Codegen Support Key: SPARK-42050 URL: https://issues.apache.org/jira/browse/SPARK-42050 Project: Spark Issue Type: Umbrella Components:

  1   2   >