[jira] [Commented] (SPARK-44280) Add convertJavaTimestampToTimestamp in JDBCDialect API

2023-07-05 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740393#comment-17740393 ] Snoot.io commented on SPARK-44280: -- User 'mingkangli-db' has created a pull request for this issue:

[jira] [Commented] (SPARK-44317) Define the computing logic through PartitionEvaluator API and use it in ShuffledHashJoinExec

2023-07-05 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740392#comment-17740392 ] Snoot.io commented on SPARK-44317: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Commented] (SPARK-44317) Define the computing logic through PartitionEvaluator API and use it in ShuffledHashJoinExec

2023-07-05 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740391#comment-17740391 ] Snoot.io commented on SPARK-44317: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Created] (SPARK-44317) Define the computing logic through PartitionEvaluator API and use it in ShuffledHashJoinExec

2023-07-05 Thread Vinod KC (Jira)
Vinod KC created SPARK-44317: Summary: Define the computing logic through PartitionEvaluator API and use it in ShuffledHashJoinExec Key: SPARK-44317 URL: https://issues.apache.org/jira/browse/SPARK-44317

[jira] [Commented] (SPARK-44268) Add tests to ensure error-classes.json and docs are in sync

2023-07-05 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740388#comment-17740388 ] Snoot.io commented on SPARK-44268: -- User 'Hisoka-X' has created a pull request for this issue:

[jira] [Commented] (SPARK-44314) Add a new checkstyle rule to prohibit the use of `@Test(expected = SomeException.class)`

2023-07-05 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740386#comment-17740386 ] Snoot.io commented on SPARK-44314: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Created] (SPARK-44316) Upgrade Jersey to 2.40

2023-07-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44316: --- Summary: Upgrade Jersey to 2.40 Key: SPARK-44316 URL: https://issues.apache.org/jira/browse/SPARK-44316 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-44252) Add error class for the case when loading state from DFS fails

2023-07-05 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740381#comment-17740381 ] Hudson commented on SPARK-44252: User 'lucyyao-db' has created a pull request for this issue:

[jira] [Created] (SPARK-44315) Move DefinedByConstructorParams to sql/api

2023-07-05 Thread Rui Wang (Jira)
Rui Wang created SPARK-44315: Summary: Move DefinedByConstructorParams to sql/api Key: SPARK-44315 URL: https://issues.apache.org/jira/browse/SPARK-44315 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-44303) Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324]

2023-07-05 Thread Mike K (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740380#comment-17740380 ] Mike K commented on SPARK-44303: User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-44314) Add a new checkstyle rule to prohibit the use of `@Test(expected = SomeException.class)`

2023-07-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-44314: Summary: Add a new checkstyle rule to prohibit the use of `@Test(expected = SomeException.class)` Key: SPARK-44314 URL: https://issues.apache.org/jira/browse/SPARK-44314

[jira] [Resolved] (SPARK-44313) Generated column expression validation fails if there is a char/varchar column anywhere in the schema

2023-07-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44313. -- Fix Version/s: 3.5.0 3.4.2 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-44313) Generated column expression validation fails if there is a char/varchar column anywhere in the schema

2023-07-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44313: Assignee: Allison Portis > Generated column expression validation fails if there is a

[jira] [Commented] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-05 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740368#comment-17740368 ] Mridul Muralidharan commented on SPARK-44215: - Issue resolved by pull request 41762

[jira] [Updated] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-05 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-44215: Fix Version/s: 3.3.3 > Client receives zero number of chunks in merge meta

[jira] [Resolved] (SPARK-44154) Bitmap functions

2023-07-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44154. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41623

[jira] [Assigned] (SPARK-44310) The Connect Server startup log should display the hostname and port

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44310: Assignee: BingKun Pan > The Connect Server startup log should display the hostname and

[jira] [Resolved] (SPARK-44310) The Connect Server startup log should display the hostname and port

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44310. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41862

[jira] [Created] (SPARK-44313) Generated column expression validation fails if there is a char/varchar column anywhere in the schema

2023-07-05 Thread Allison Portis (Jira)
Allison Portis created SPARK-44313: -- Summary: Generated column expression validation fails if there is a char/varchar column anywhere in the schema Key: SPARK-44313 URL:

[jira] [Resolved] (SPARK-44281) Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors

2023-07-05 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44281. -- Resolution: Fixed > Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors >

[jira] [Created] (SPARK-44312) [PYTHON][CONNECT] Use SPARK_CONNECT_USER_AGENT environment variable for the user agent

2023-07-05 Thread Robert Dillitz (Jira)
Robert Dillitz created SPARK-44312: -- Summary: [PYTHON][CONNECT] Use SPARK_CONNECT_USER_AGENT environment variable for the user agent Key: SPARK-44312 URL: https://issues.apache.org/jira/browse/SPARK-44312

[jira] [Resolved] (SPARK-43416) Fix the bug where the ProduceEncoder#tuples fields names are different from server

2023-07-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-43416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43416. --- Fix Version/s: 3.5.0 Assignee: Niranjan Jayakar Resolution: Fixed >

[jira] [Resolved] (SPARK-44282) Split of DataType parsing for Connect

2023-07-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44282. --- Fix Version/s: 3.5.0 Resolution: Fixed > Split of DataType parsing for

[jira] [Commented] (SPARK-43416) Fix the bug where the ProduceEncoder#tuples fields names are different from server

2023-07-05 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740312#comment-17740312 ] Zhen Li commented on SPARK-43416: - [~hvanhovell] Yes. Fixed by

[jira] [Commented] (SPARK-43416) Fix the bug where the ProduceEncoder#tuples fields names are different from server

2023-07-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-43416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740302#comment-17740302 ] Herman van Hövell commented on SPARK-43416: --- [~zhenli] has this been fixed? > Fix the bug

[jira] [Resolved] (SPARK-44291) [CONNECT][SCALA] range query returns incorrect schema

2023-07-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44291. --- Fix Version/s: 3.5.0 Assignee: Niranjan Jayakar Resolution: Fixed >

[jira] [Created] (SPARK-44311) UDF should support function taking value classes

2023-07-05 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-44311: -- Summary: UDF should support function taking value classes Key: SPARK-44311 URL: https://issues.apache.org/jira/browse/SPARK-44311 Project: Spark Issue

[jira] [Updated] (SPARK-42554) Spark Connect Scala Client

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42554: - Fix Version/s: (was: 3.5.0) > Spark Connect Scala Client > -- > >

[jira] [Reopened] (SPARK-42554) Spark Connect Scala Client

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-42554: -- > Spark Connect Scala Client > -- > > Key: SPARK-42554 >

[jira] [Resolved] (SPARK-44193) Implement GRPC exceptions interception for conversion

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44193. -- Assignee: Yihong He Resolution: Fixed Fixed in

[jira] [Created] (SPARK-44310) The Connect Server startup log should display the hostname and port

2023-07-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44310: --- Summary: The Connect Server startup log should display the hostname and port Key: SPARK-44310 URL: https://issues.apache.org/jira/browse/SPARK-44310 Project: Spark

[jira] [Commented] (SPARK-44299) Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8]

2023-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740126#comment-17740126 ] ASF GitHub Bot commented on SPARK-44299: User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-44193) Implement GRPC exceptions interception for conversion

2023-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740123#comment-17740123 ] ASF GitHub Bot commented on SPARK-44193: User 'heyihong' has created a pull request for this

[jira] [Resolved] (SPARK-42554) Spark Connect Scala Client

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42554. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41743

[jira] [Created] (SPARK-44309) Display Add/Remove Time of Executors on ExecutorsTab

2023-07-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-44309: Summary: Display Add/Remove Time of Executors on ExecutorsTab Key: SPARK-44309 URL: https://issues.apache.org/jira/browse/SPARK-44309 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-44294) HeapHistogram column shows unexpectedly w/ select-all-box

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44294: Assignee: Kent Yao > HeapHistogram column shows unexpectedly w/ select-all-box >

[jira] [Resolved] (SPARK-44294) HeapHistogram column shows unexpectedly w/ select-all-box

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44294. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41847

[jira] [Comment Edited] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-05 Thread 7mming7 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740018#comment-17740018 ] 7mming7 edited comment on SPARK-44305 at 7/5/23 7:35 AM: - cc [~yuming]  

[jira] [Commented] (SPARK-43438) Fix mismatched column list error on INSERT

2023-07-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740048#comment-17740048 ] Max Gekk commented on SPARK-43438: -- Current behaviour on the recent OSS master: {code:sql} spark-sql

[jira] [Assigned] (SPARK-44277) Upgrade Avro to version 1.11.2

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44277: Assignee: Ismaël Mejía > Upgrade Avro to version 1.11.2 > --

[jira] [Resolved] (SPARK-44277) Upgrade Avro to version 1.11.2

2023-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44277. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41830

[jira] [Created] (SPARK-44308) Spark 3.0.1 functions.scala -> posexplode_outer API not flattening data

2023-07-05 Thread Chirag Sanghvi (Jira)
Chirag Sanghvi created SPARK-44308: -- Summary: Spark 3.0.1 functions.scala -> posexplode_outer API not flattening data Key: SPARK-44308 URL: https://issues.apache.org/jira/browse/SPARK-44308 Project: