[jira] [Commented] (SPARK-37330) Migrate ReplaceTableStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-37330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443609#comment-17443609 ] dch nguyen commented on SPARK-37330: I am working on this > Migrate ReplaceTableStatement to v2

[jira] [Created] (SPARK-37330) Migrate ReplaceTableStatement to v2 command

dch nguyen created SPARK-37330: -- Summary: Migrate ReplaceTableStatement to v2 command Key: SPARK-37330 URL: https://issues.apache.org/jira/browse/SPARK-37330 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37329) File system delegation tokens are leaked

Wei-Chiu Chuang created SPARK-37329: --- Summary: File system delegation tokens are leaked Key: SPARK-37329 URL: https://issues.apache.org/jira/browse/SPARK-37329 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied onn whole plan innstead of new stage plan

[ https://issues.apache.org/jira/browse/SPARK-37328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lietong Liu updated SPARK-37328: Description: Since OptimizeSkewedJoin was moved from queryStageOptimizerRules to 

[jira] [Created] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied onn whole plan innstead of new stage plan

Lietong Liu created SPARK-37328: --- Summary: SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied onn whole plan innstead of new stage plan Key: SPARK-37328 URL:

[jira] [Assigned] (SPARK-37327) Silence the to_pandas() advice log for internal usage

[ https://issues.apache.org/jira/browse/SPARK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37327: Assignee: Apache Spark > Silence the to_pandas() advice log for internal usage >

[jira] [Commented] (SPARK-37327) Silence the to_pandas() advice log for internal usage

[ https://issues.apache.org/jira/browse/SPARK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443552#comment-17443552 ] Apache Spark commented on SPARK-37327: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37327) Silence the to_pandas() advice log for internal usage

[ https://issues.apache.org/jira/browse/SPARK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37327: Assignee: (was: Apache Spark) > Silence the to_pandas() advice log for internal

[jira] [Updated] (SPARK-37327) Silence the to_pandas() advice log for internal usage

[ https://issues.apache.org/jira/browse/SPARK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37327: Description: Raised from comment 

[jira] [Updated] (SPARK-37327) Silence the to_pandas() advice log for internal usage

[ https://issues.apache.org/jira/browse/SPARK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37327: Summary: Silence the to_pandas() advice log for internal usage (was: Silence the advice log for

[jira] (SPARK-37299) Fix Python linter failure in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37299 ] Haejoon Lee deleted comment on SPARK-37299: - was (Author: itholic): Resolved at https://issues.apache.org/jira/browse/SPARK-37323 > Fix Python linter failure in branch-3.1 >

[jira] [Commented] (SPARK-37299) Fix Python linter failure in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443544#comment-17443544 ] Haejoon Lee commented on SPARK-37299: - Resolved at https://issues.apache.org/jira/browse/SPARK-37323

[jira] [Commented] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443538#comment-17443538 ] Apache Spark commented on SPARK-36533: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-37326) Support TimestampNTZ in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-37326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443537#comment-17443537 ] Apache Spark commented on SPARK-37326: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37326) Support TimestampNTZ in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-37326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37326: Assignee: Apache Spark > Support TimestampNTZ in CSV data source >

[jira] [Assigned] (SPARK-37326) Support TimestampNTZ in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-37326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37326: Assignee: (was: Apache Spark) > Support TimestampNTZ in CSV data source >

[jira] [Created] (SPARK-37327) Silence the advice log for internal usage

Haejoon Lee created SPARK-37327: --- Summary: Silence the advice log for internal usage Key: SPARK-37327 URL: https://issues.apache.org/jira/browse/SPARK-37327 Project: Spark Issue Type:

[jira] [Created] (SPARK-37326) Support TimestampNTZ in CSV data source

Ivan Sadikov created SPARK-37326: Summary: Support TimestampNTZ in CSV data source Key: SPARK-37326 URL: https://issues.apache.org/jira/browse/SPARK-37326 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-37325) Result vector from pandas_udf was not the required length

[ https://issues.apache.org/jira/browse/SPARK-37325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu updated SPARK-37325: Description: schema = StructType([ StructField("node", StringType()) ]) {{rdd =

[jira] [Updated] (SPARK-37325) Result vector from pandas_udf was not the required length

[ https://issues.apache.org/jira/browse/SPARK-37325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu updated SPARK-37325: Description: schema = StructType([ StructField("node", StringType()) ]) {{rdd =

[jira] [Created] (SPARK-37325) Result vector from pandas_udf was not the required length

liu created SPARK-37325: --- Summary: Result vector from pandas_udf was not the required length Key: SPARK-37325 URL: https://issues.apache.org/jira/browse/SPARK-37325 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-37309) Add available_now to PySpark trigger function

[ https://issues.apache.org/jira/browse/SPARK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443517#comment-17443517 ] Jungtaek Lim commented on SPARK-37309: -- Ah wait... My follow-up PR included the method doc in

[jira] [Resolved] (SPARK-37309) Add available_now to PySpark trigger function

[ https://issues.apache.org/jira/browse/SPARK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-37309. -- Resolution: Duplicate I'm resolving this as duplicated. Thanks for reporting! > Add

[jira] [Comment Edited] (SPARK-37309) Add available_now to PySpark trigger function

[ https://issues.apache.org/jira/browse/SPARK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443514#comment-17443514 ] Jungtaek Lim edited comment on SPARK-37309 at 11/15/21, 3:03 AM: - This

[jira] [Commented] (SPARK-37309) Add available_now to PySpark trigger function

[ https://issues.apache.org/jira/browse/SPARK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443514#comment-17443514 ] Jungtaek Lim commented on SPARK-37309: -- This is resolved today via

[jira] [Resolved] (SPARK-37276) Support YearMonthIntervalType in Arrow

[ https://issues.apache.org/jira/browse/SPARK-37276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37276. -- Resolution: Later There's no corresponding mapping with Python instance. I am resolving this

[jira] [Resolved] (SPARK-37280) Support YearMonthIntervalType in Py4J

[ https://issues.apache.org/jira/browse/SPARK-37280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37280. -- Resolution: Later There's no corresponding mapping with Python instance. I am resolving this

[jira] [Resolved] (SPARK-37278) Support YearMonthIntervalType in createDataFrame/toPandas and Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-37278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37278. -- Resolution: Later There's no corresponding mapping with Python instance. I am resolving this

[jira] [Resolved] (SPARK-37295) illegal reflective access operation has occurred; Please consider reporting this to the maintainers

[ https://issues.apache.org/jira/browse/SPARK-37295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37295. -- Resolution: Won't Fix I'm resolving this - there isn't any easy way to avoid this than

[jira] [Updated] (SPARK-37295) illegal reflective access operation has occurred; Please consider reporting this to the maintainers

[ https://issues.apache.org/jira/browse/SPARK-37295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37295: - Priority: Major (was: Critical) > illegal reflective access operation has occurred; Please

[jira] [Commented] (SPARK-37309) Add available_now to PySpark trigger function

[ https://issues.apache.org/jira/browse/SPARK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443500#comment-17443500 ] Hyukjin Kwon commented on SPARK-37309: -- cc [~kabhwan] [~bozhang] FYI > Add available_now to

[jira] [Resolved] (SPARK-37299) Fix Python linter failure in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37299. -- Resolution: Duplicate > Fix Python linter failure in branch-3.1 >

[jira] [Resolved] (SPARK-37319) Support K8s image building with Java 17

[ https://issues.apache.org/jira/browse/SPARK-37319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37319. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved in

[jira] [Commented] (SPARK-35345) Add BloomFilter Benchmark test for Parquet

[ https://issues.apache.org/jira/browse/SPARK-35345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443498#comment-17443498 ] Apache Spark commented on SPARK-35345: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-35345) Add BloomFilter Benchmark test for Parquet

[ https://issues.apache.org/jira/browse/SPARK-35345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443497#comment-17443497 ] Apache Spark commented on SPARK-35345: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37228) Implement DataFrame.mapInArrow in Python

[ https://issues.apache.org/jira/browse/SPARK-37228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37228. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34505

[jira] [Assigned] (SPARK-37228) Implement DataFrame.mapInArrow in Python

[ https://issues.apache.org/jira/browse/SPARK-37228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37228: Assignee: Hyukjin Kwon > Implement DataFrame.mapInArrow in Python >

[jira] [Assigned] (SPARK-37323) Pin `docutils` in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37323: Assignee: Dongjoon Hyun > Pin `docutils` in branch-3.1 > >

[jira] [Resolved] (SPARK-37323) Pin `docutils` in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37323. -- Fix Version/s: 3.1.3 Resolution: Fixed Issue resolved by pull request 34591

[jira] [Commented] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN

[ https://issues.apache.org/jira/browse/SPARK-37324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443488#comment-17443488 ] Apache Spark commented on SPARK-37324: -- User 'sathiyapk' has created a pull request for this issue:

[jira] [Commented] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443489#comment-17443489 ] Apache Spark commented on SPARK-36533: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443487#comment-17443487 ] Apache Spark commented on SPARK-36533: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN

[ https://issues.apache.org/jira/browse/SPARK-37324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37324: Assignee: (was: Apache Spark) > Support Decimal RoundingMode.UP, DOWN, HALF_DOWN >

[jira] [Commented] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN

[ https://issues.apache.org/jira/browse/SPARK-37324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443486#comment-17443486 ] Apache Spark commented on SPARK-37324: -- User 'sathiyapk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN

[ https://issues.apache.org/jira/browse/SPARK-37324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37324: Assignee: Apache Spark > Support Decimal RoundingMode.UP, DOWN, HALF_DOWN >

[jira] [Updated] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN

[ https://issues.apache.org/jira/browse/SPARK-37324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathiya Kumar updated SPARK-37324: -- Description: Currently we support only Decimal RoundingModes : HALF_UP (round) and HALF_EVEN

[jira] [Assigned] (SPARK-37323) Pin `docutils` in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37323: Assignee: Apache Spark > Pin `docutils` in branch-3.1 > > >

[jira] [Commented] (SPARK-37323) Pin `docutils` in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443460#comment-17443460 ] Apache Spark commented on SPARK-37323: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37323) Pin `docutils` in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37323: Assignee: (was: Apache Spark) > Pin `docutils` in branch-3.1 >

[jira] [Updated] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN

[ https://issues.apache.org/jira/browse/SPARK-37324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathiya Kumar updated SPARK-37324: -- Description: Currently we have support for  > Support Decimal RoundingMode.UP, DOWN,

[jira] [Created] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN

Sathiya Kumar created SPARK-37324: - Summary: Support Decimal RoundingMode.UP, DOWN, HALF_DOWN Key: SPARK-37324 URL: https://issues.apache.org/jira/browse/SPARK-37324 Project: Spark Issue

[jira] [Updated] (SPARK-37323) Pin `docutils` in branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-37323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37323: -- Description: `docutils` 0.18 is released October 26 and causes Python linter failure in

[jira] [Created] (SPARK-37323) Pin `docutils` in branch-3.1

Dongjoon Hyun created SPARK-37323: - Summary: Pin `docutils` in branch-3.1 Key: SPARK-37323 URL: https://issues.apache.org/jira/browse/SPARK-37323 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption

[ https://issues.apache.org/jira/browse/SPARK-37289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37289: -- Affects Version/s: (was: 3.2.0) 3.3.0 > Refactoring:remove the

[jira] [Assigned] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption

[ https://issues.apache.org/jira/browse/SPARK-37289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37289: - Assignee: tenglei > Refactoring:remove the unnecessary function with

[jira] [Resolved] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption

[ https://issues.apache.org/jira/browse/SPARK-37289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37289. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34582

[jira] [Assigned] (SPARK-37322) `run_scala_tests` should respect test module order

[ https://issues.apache.org/jira/browse/SPARK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37322: - Assignee: William Hyun > `run_scala_tests` should respect test module order >

[jira] [Resolved] (SPARK-37322) `run_scala_tests` should respect test module order

[ https://issues.apache.org/jira/browse/SPARK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37322. --- Fix Version/s: 3.2.1 3.1.3 3.3.0 Resolution:

[jira] [Commented] (SPARK-37322) `run_scala_tests` should respect test module order

[ https://issues.apache.org/jira/browse/SPARK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443425#comment-17443425 ] Apache Spark commented on SPARK-37322: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-37322) `run_scala_tests` should respect test module order

[ https://issues.apache.org/jira/browse/SPARK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37322: Assignee: (was: Apache Spark) > `run_scala_tests` should respect test module order >

[jira] [Assigned] (SPARK-37322) `run_scala_tests` should respect test module order

[ https://issues.apache.org/jira/browse/SPARK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37322: Assignee: Apache Spark > `run_scala_tests` should respect test module order >

[jira] [Commented] (SPARK-37322) `run_scala_tests` should respect test module order

[ https://issues.apache.org/jira/browse/SPARK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443424#comment-17443424 ] Apache Spark commented on SPARK-37322: -- User 'williamhyun' has created a pull request for this

[jira] [Created] (SPARK-37322) `run_scala_tests` should respect test module order

William Hyun created SPARK-37322: Summary: `run_scala_tests` should respect test module order Key: SPARK-37322 URL: https://issues.apache.org/jira/browse/SPARK-37322 Project: Spark Issue

[jira] [Updated] (SPARK-37321) Wrong size estimation leads to "Cannot broadcast the table that is larger than 8GB: 8 GB"

[ https://issues.apache.org/jira/browse/SPARK-37321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-37321: Description: When CBO is enabled then a situation occurs where spark tries to broadcast

[jira] [Updated] (SPARK-37317) Reduce weights in GaussianMixtureSuite

[ https://issues.apache.org/jira/browse/SPARK-37317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37317: -- Fix Version/s: 3.2.1 > Reduce weights in GaussianMixtureSuite >

[jira] [Resolved] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes

[ https://issues.apache.org/jira/browse/SPARK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37320. --- Fix Version/s: 3.3.0 3.2.1 3.1.3 Resolution:

[jira] [Resolved] (SPARK-37317) Reduce weights in GaussianMixtureSuite

[ https://issues.apache.org/jira/browse/SPARK-37317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37317. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34584

[jira] [Commented] (SPARK-32567) Code-gen for full outer shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443369#comment-17443369 ] Apache Spark commented on SPARK-32567: -- User 'jerqi' has created a pull request for this issue:

[jira] [Updated] (SPARK-37321) Wrong size estimation that leads to "Cannot broadcast the table that is larger than 8GB: 8 GB"

[ https://issues.apache.org/jira/browse/SPARK-37321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-37321: Summary: Wrong size estimation that leads to "Cannot broadcast the table that is larger

[jira] [Updated] (SPARK-37321) Wrong size estimation leads to "Cannot broadcast the table that is larger than 8GB: 8 GB"

[ https://issues.apache.org/jira/browse/SPARK-37321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-37321: Component/s: SQL > Wrong size estimation leads to "Cannot broadcast the table that is

[jira] [Updated] (SPARK-37321) Wrong size estimation leads to "Cannot broadcast the table that is larger than 8GB: 8 GB"

[ https://issues.apache.org/jira/browse/SPARK-37321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-37321: Summary: Wrong size estimation leads to "Cannot broadcast the table that is larger than

[jira] [Updated] (SPARK-37321) Wrong size estimation that leads to Cannot broadcast the table that is larger than 8GB: 8 GB

[ https://issues.apache.org/jira/browse/SPARK-37321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-37321: Description: When CBO is enabled then a situation occurs where spark tries to broadcast

[jira] [Created] (SPARK-37321) Wrong size estimation that leads to Cannot broadcast the table that is larger than 8GB: 8 GB

Izek Greenfield created SPARK-37321: --- Summary: Wrong size estimation that leads to Cannot broadcast the table that is larger than 8GB: 8 GB Key: SPARK-37321 URL:

[jira] [Commented] (SPARK-36934) Timestamp are written as array bytes.

[ https://issues.apache.org/jira/browse/SPARK-36934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443343#comment-17443343 ] Bjørn Jørgensen commented on SPARK-36934: - This is now fixed in Apache Drill

[jira] [Assigned] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes

[ https://issues.apache.org/jira/browse/SPARK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37320: Assignee: Kousuke Saruta (was: Apache Spark) > Delete py_container_checks.zip after the

[jira] [Commented] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes

[ https://issues.apache.org/jira/browse/SPARK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443269#comment-17443269 ] Apache Spark commented on SPARK-37320: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes

[ https://issues.apache.org/jira/browse/SPARK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37320: Assignee: Apache Spark (was: Kousuke Saruta) > Delete py_container_checks.zip after the

[jira] [Assigned] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS

[ https://issues.apache.org/jira/browse/SPARK-37318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37318: - Assignee: Dongjoon Hyun > Make FallbackStorageSuite robust in terms of DNS >

[jira] [Resolved] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS

[ https://issues.apache.org/jira/browse/SPARK-37318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37318. --- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes

[ https://issues.apache.org/jira/browse/SPARK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37320: --- Description: When K8s integration tests run, py_container_checks.zip still remains in

[jira] [Created] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes

Kousuke Saruta created SPARK-37320: -- Summary: Delete py_container_checks.zip after the test in DepsTestsSuite finishes Key: SPARK-37320 URL: https://issues.apache.org/jira/browse/SPARK-37320