[jira] [Commented] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740726#comment-17740726 ] koert kuipers commented on SPARK-37829: --- since this behavior of returning a Row wi

[jira] [Comment Edited] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740726#comment-17740726 ] koert kuipers edited comment on SPARK-37829 at 7/6/23 5:23 PM: ---

[jira] [Comment Edited] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740726#comment-17740726 ] koert kuipers edited comment on SPARK-37829 at 7/6/23 5:32 PM: ---

[jira] [Created] (SPARK-44324) Move CaseInsensitiveMap to sql/api

Rui Wang created SPARK-44324: Summary: Move CaseInsensitiveMap to sql/api Key: SPARK-44324 URL: https://issues.apache.org/jira/browse/SPARK-44324 Project: Spark Issue Type: Sub-task Com

[jira] [Comment Edited] (SPARK-44323) Scala None shows up as null for Aggregator BUF or OUT

[ https://issues.apache.org/jira/browse/SPARK-44323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740744#comment-17740744 ] koert kuipers edited comment on SPARK-44323 at 7/6/23 6:28 PM: ---

[jira] [Commented] (SPARK-44323) Scala None shows up as null for Aggregator BUF or OUT

[ https://issues.apache.org/jira/browse/SPARK-44323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740744#comment-17740744 ] koert kuipers commented on SPARK-44323: --- i think the issue is that Nones inside Tu

[jira] [Commented] (SPARK-43438) Fix mismatched column list error on INSERT

[ https://issues.apache.org/jira/browse/SPARK-43438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740789#comment-17740789 ] Serge Rielau commented on SPARK-43438: -- spark-sql (default)> INSERT INTO tabtest SE

[jira] [Comment Edited] (SPARK-43438) Fix mismatched column list error on INSERT

[ https://issues.apache.org/jira/browse/SPARK-43438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740789#comment-17740789 ] Serge Rielau edited comment on SPARK-43438 at 7/6/23 8:17 PM:

[jira] [Resolved] (SPARK-43321) Impl Dataset#JoinWith

[ https://issues.apache.org/jira/browse/SPARK-43321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43321. --- Fix Version/s: 3.5.0 Assignee: Zhen Li Resolution: Fixed > Impl Data

[jira] [Created] (SPARK-44325) Define the computing logic through PartitionEvaluator API and use it in SortMergeJoinExec

Vinod KC created SPARK-44325: Summary: Define the computing logic through PartitionEvaluator API and use it in SortMergeJoinExec Key: SPARK-44325 URL: https://issues.apache.org/jira/browse/SPARK-44325 Pro

[jira] [Commented] (SPARK-44325) Define the computing logic through PartitionEvaluator API and use it in SortMergeJoinExec

[ https://issues.apache.org/jira/browse/SPARK-44325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740836#comment-17740836 ] ci-cassandra.apache.org commented on SPARK-44325: - User 'vinodkc' has cr

[jira] [Resolved] (SPARK-44315) Move DefinedByConstructorParams to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44315. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41873 [https://gith

[jira] [Created] (SPARK-44326) Move utils that are used from Scala client to the common modules

Rui Wang created SPARK-44326: Summary: Move utils that are used from Scala client to the common modules Key: SPARK-44326 URL: https://issues.apache.org/jira/browse/SPARK-44326 Project: Spark Iss

[jira] [Assigned] (SPARK-43660) Enable `resample` with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43660: - Assignee: Haejoon Lee > Enable `resample` with Spark Connect >

[jira] [Resolved] (SPARK-43660) Enable `resample` with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43660. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41877 [https://

[jira] [Created] (SPARK-44327) Add functions any and len to Scala

Ruifeng Zheng created SPARK-44327: - Summary: Add functions any and len to Scala Key: SPARK-44327 URL: https://issues.apache.org/jira/browse/SPARK-44327 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44328) Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2329]

jiaan.geng created SPARK-44328: -- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2329] Key: SPARK-44328 URL: https://issues.apache.org/jira/browse/SPARK-44328 Project: Spark I

[jira] [Updated] (SPARK-44275) Support client-side retries in Spark Connect Scala client

[ https://issues.apache.org/jira/browse/SPARK-44275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44275: - Affects Version/s: 3.5.0 (was: 3.4.1) > Support client-side retries i

[jira] [Resolved] (SPARK-44275) Support client-side retries in Spark Connect Scala client

[ https://issues.apache.org/jira/browse/SPARK-44275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44275. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41829 [https://gi

[jira] [Assigned] (SPARK-44275) Support client-side retries in Spark Connect Scala client

[ https://issues.apache.org/jira/browse/SPARK-44275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44275: Assignee: Robert Dillitz > Support client-side retries in Spark Connect Scala client > --

[jira] [Resolved] (SPARK-44312) [PYTHON][CONNECT] Use SPARK_CONNECT_USER_AGENT environment variable for the user agent

[ https://issues.apache.org/jira/browse/SPARK-44312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44312. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41866 [https://gi

[jira] [Assigned] (SPARK-44312) [PYTHON][CONNECT] Use SPARK_CONNECT_USER_AGENT environment variable for the user agent

[ https://issues.apache.org/jira/browse/SPARK-44312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44312: Assignee: Robert Dillitz > [PYTHON][CONNECT] Use SPARK_CONNECT_USER_AGENT environment var

[jira] [Created] (SPARK-44329) Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

Ruifeng Zheng created SPARK-44329: - Summary: Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python Key: SPARK-44329 URL: https://issues.apache.org/jira/browse/SPARK-44329

[jira] [Created] (SPARK-44330) Define the computing logic through PartitionEvaluator API and use it in BroadcastNestedLoopJoinExec & BroadcastHashJoinExec

Vinod KC created SPARK-44330: Summary: Define the computing logic through PartitionEvaluator API and use it in BroadcastNestedLoopJoinExec & BroadcastHashJoinExec Key: SPARK-44330 URL: https://issues.apache.org/jira/b

[jira] [Created] (SPARK-44331) Add bitmap functions to Scala and Python

Ruifeng Zheng created SPARK-44331: - Summary: Add bitmap functions to Scala and Python Key: SPARK-44331 URL: https://issues.apache.org/jira/browse/SPARK-44331 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-44327) Add functions any and len to Scala

[ https://issues.apache.org/jira/browse/SPARK-44327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44327: - Assignee: Ruifeng Zheng > Add functions any and len to Scala >

[jira] [Updated] (SPARK-44328) Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2328]

[ https://issues.apache.org/jira/browse/SPARK-44328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-44328: --- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2328] (was: Assign names to the e

[jira] [Created] (SPARK-44332) The Executor ID should start with 1 when running on Spark cluster of [N, cores, memory] locally mode

BingKun Pan created SPARK-44332: --- Summary: The Executor ID should start with 1 when running on Spark cluster of [N, cores, memory] locally mode Key: SPARK-44332 URL: https://issues.apache.org/jira/browse/SPARK-44332

[jira] [Assigned] (SPARK-44299) Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8]

[ https://issues.apache.org/jira/browse/SPARK-44299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44299: Assignee: BingKun Pan > Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8] > -

[jira] [Resolved] (SPARK-44299) Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8]

[ https://issues.apache.org/jira/browse/SPARK-44299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44299. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41858 [https://github.com

[jira] [Created] (SPARK-44319) Migrate jersey 2 to jersey 3

Yang Jie created SPARK-44319: Summary: Migrate jersey 2 to jersey 3 Key: SPARK-44319 URL: https://issues.apache.org/jira/browse/SPARK-44319 Project: Spark Issue Type: Sub-task Component

[jira] [Commented] (SPARK-44319) Migrate jersey 2 to jersey 3

[ https://issues.apache.org/jira/browse/SPARK-44319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740463#comment-17740463 ] BingKun Pan commented on SPARK-44319: - 👍🏻 > Migrate jersey 2 to jersey 3 >

[jira] [Created] (SPARK-44320) Assign names to the error class _LEGACY_ERROR_TEMP_[1067,1150,1220,1265,1277

BingKun Pan created SPARK-44320: --- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[1067,1150,1220,1265,1277 Key: SPARK-44320 URL: https://issues.apache.org/jira/browse/SPARK-44320 Project: S

[jira] [Updated] (SPARK-44320) Assign names to the error class _LEGACY_ERROR_TEMP_[1067,1150,1220,1265,1277]

[ https://issues.apache.org/jira/browse/SPARK-44320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44320: Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[1067,1150,1220,1265,1277] (was: Assi

[jira] [Commented] (SPARK-44307) Bloom filter is not added for left outer join if the left side table is smaller than broadcast threshold.

[ https://issues.apache.org/jira/browse/SPARK-44307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740565#comment-17740565 ] Nikita Awasthi commented on SPARK-44307: User 'maheshk114' has created a pull re

[jira] [Commented] (SPARK-44275) Support client-side retries in Spark Connect Scala client

[ https://issues.apache.org/jira/browse/SPARK-44275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740568#comment-17740568 ] Nikita Awasthi commented on SPARK-44275: User 'dillitz' has created a pull reque

[jira] [Resolved] (SPARK-44284) Introduce simpe conf system for sql/api

[ https://issues.apache.org/jira/browse/SPARK-44284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44284. --- Fix Version/s: 3.5.0 Resolution: Fixed > Introduce simpe conf system for sql/

[jira] [Resolved] (SPARK-44303) Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324]

[ https://issues.apache.org/jira/browse/SPARK-44303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44303. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41863 [https://github.com

[jira] [Assigned] (SPARK-44303) Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324]

[ https://issues.apache.org/jira/browse/SPARK-44303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44303: Assignee: jiaan.geng > Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324] > -

[jira] [Created] (SPARK-44321) Move ParseException to SQL/API

Herman van Hövell created SPARK-44321: - Summary: Move ParseException to SQL/API Key: SPARK-44321 URL: https://issues.apache.org/jira/browse/SPARK-44321 Project: Spark Issue Type: New Feat

[jira] [Resolved] (SPARK-44283) Move Origin to api

[ https://issues.apache.org/jira/browse/SPARK-44283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44283. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move Origin to api > ---

[jira] [Created] (SPARK-44322) Make parser use SqlApiConf

Herman van Hövell created SPARK-44322: - Summary: Make parser use SqlApiConf Key: SPARK-44322 URL: https://issues.apache.org/jira/browse/SPARK-44322 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-44314) Add a new checkstyle rule to prohibit the use of `@Test(expected = SomeException.class)`

[ https://issues.apache.org/jira/browse/SPARK-44314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44314. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41872 [https://github.com

[jira] [Assigned] (SPARK-44314) Add a new checkstyle rule to prohibit the use of `@Test(expected = SomeException.class)`

[ https://issues.apache.org/jira/browse/SPARK-44314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44314: Assignee: Yang Jie > Add a new checkstyle rule to prohibit the use of `@Test(expected = > SomeEx

[jira] [Assigned] (SPARK-44316) Upgrade Jersey to 2.40

[ https://issues.apache.org/jira/browse/SPARK-44316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44316: - Assignee: BingKun Pan > Upgrade Jersey to 2.40 > -- > >

[jira] [Resolved] (SPARK-44316) Upgrade Jersey to 2.40

[ https://issues.apache.org/jira/browse/SPARK-44316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44316. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41874 [https://

[jira] [Updated] (SPARK-44316) Upgrade Jersey to 2.40

[ https://issues.apache.org/jira/browse/SPARK-44316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44316: -- Parent: SPARK-43831 Issue Type: Sub-task (was: Improvement) > Upgrade Jersey to 2.40

[jira] [Created] (SPARK-44323) Scala None shows up as null for Aggregator BUF or OUT

koert kuipers created SPARK-44323: - Summary: Scala None shows up as null for Aggregator BUF or OUT Key: SPARK-44323 URL: https://issues.apache.org/jira/browse/SPARK-44323 Project: Spark Iss

[jira] [Updated] (SPARK-44323) Scala None shows up as null for Aggregator BUF or OUT

[ https://issues.apache.org/jira/browse/SPARK-44323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-44323: -- Description: when doing an upgrade from spark 3.3.1 to spark 3.4.1 we suddenly started gettin