[jira] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

[ https://issues.apache.org/jira/browse/SPARK-36357 ] jiaan.geng deleted comment on SPARK-36357: was (Author: beliefer): I'm working on. > Support pushdown Timestamp with local time zone for orc >

[jira] [Assigned] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

[ https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36357: Assignee: (was: Apache Spark) > Support pushdown Timestamp with local time zone for

[jira] [Assigned] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

[ https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36357: Assignee: Apache Spark > Support pushdown Timestamp with local time zone for orc >

[jira] [Commented] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

[ https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445691#comment-17445691 ] Apache Spark commented on SPARK-36357: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

[ https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36357: --- Description: Now that ORC datasources support timestampNTZ, it's great to be able to push down

[jira] [Commented] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3

[ https://issues.apache.org/jira/browse/SPARK-37370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445686#comment-17445686 ] Apache Spark commented on SPARK-37370: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3

[ https://issues.apache.org/jira/browse/SPARK-37370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37370: Assignee: Apache Spark > Add SQL configs to control newly added join code-gen in 3.3 >

[jira] [Assigned] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3

[ https://issues.apache.org/jira/browse/SPARK-37370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37370: Assignee: (was: Apache Spark) > Add SQL configs to control newly added join code-gen

[jira] [Created] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3

Cheng Su created SPARK-37370: Summary: Add SQL configs to control newly added join code-gen in 3.3 Key: SPARK-37370 URL: https://issues.apache.org/jira/browse/SPARK-37370 Project: Spark Issue

[jira] [Assigned] (SPARK-37224) Optimize write path on RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-37224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-37224: Assignee: Jungtaek Lim > Optimize write path on RocksDB state store provider >

[jira] [Resolved] (SPARK-37224) Optimize write path on RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-37224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-37224. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34502

[jira] [Resolved] (SPARK-37368) Deflake TPC-DS build

[ https://issues.apache.org/jira/browse/SPARK-37368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37368. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34641

[jira] [Resolved] (SPARK-37281) Support DayTimeIntervalType in Py4J

[ https://issues.apache.org/jira/browse/SPARK-37281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37281. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34625

[jira] [Assigned] (SPARK-37368) Deflake TPC-DS build

[ https://issues.apache.org/jira/browse/SPARK-37368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37368: Assignee: Hyukjin Kwon > Deflake TPC-DS build > - > >

[jira] [Assigned] (SPARK-37281) Support DayTimeIntervalType in Py4J

[ https://issues.apache.org/jira/browse/SPARK-37281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37281: Assignee: Hyukjin Kwon > Support DayTimeIntervalType in Py4J >

[jira] [Assigned] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[ https://issues.apache.org/jira/browse/SPARK-37369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37369: Assignee: Apache Spark > Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[jira] [Assigned] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[ https://issues.apache.org/jira/browse/SPARK-37369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37369: Assignee: (was: Apache Spark) > Avoid redundant ColumnarToRow transistion on

[jira] [Commented] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[ https://issues.apache.org/jira/browse/SPARK-37369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445629#comment-17445629 ] Apache Spark commented on SPARK-37369: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

L. C. Hsieh created SPARK-37369: --- Summary: Avoid redundant ColumnarToRow transistion on InMemoryTableScan Key: SPARK-37369 URL: https://issues.apache.org/jira/browse/SPARK-37369 Project: Spark

[jira] [Resolved] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37308. -- Fix Version/s: 3.3.0 Assignee: Hyukjin Kwon Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Description: `Rebalance` provide a functionality that split the large reduce partition into smalls.

[jira] [Commented] (SPARK-37368) Deflake TPC-DS build

[ https://issues.apache.org/jira/browse/SPARK-37368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445607#comment-17445607 ] Apache Spark commented on SPARK-37368: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37368) Deflake TPC-DS build

[ https://issues.apache.org/jira/browse/SPARK-37368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37368: Assignee: Apache Spark > Deflake TPC-DS build > - > >

[jira] [Assigned] (SPARK-37368) Deflake TPC-DS build

[ https://issues.apache.org/jira/browse/SPARK-37368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37368: Assignee: (was: Apache Spark) > Deflake TPC-DS build > - > >

[jira] [Commented] (SPARK-37368) Deflake TPC-DS build

[ https://issues.apache.org/jira/browse/SPARK-37368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445606#comment-17445606 ] Apache Spark commented on SPARK-37368: -- User 'HyukjinKwon' has created a pull request for this

[jira] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346 ] jiaan.geng deleted comment on SPARK-36346: was (Author: beliefer): I'm working on. > Support TimestampNTZ type in Orc file source > > >

[jira] [Assigned] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36346: -- Assignee: jiaan.geng > Support TimestampNTZ type in Orc file source >

[jira] [Resolved] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36346. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33588

[jira] [Created] (SPARK-37368) Deflake TPC-DS build

Hyukjin Kwon created SPARK-37368: Summary: Deflake TPC-DS build Key: SPARK-37368 URL: https://issues.apache.org/jira/browse/SPARK-37368 Project: Spark Issue Type: Test Components:

[jira] [Updated] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic

[ https://issues.apache.org/jira/browse/SPARK-37367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37367: - Summary: Reenable exception test in DDLParserSuite.create view -- basic (was: Reeable

[jira] [Created] (SPARK-37367) Reeable exception test in DDLParserSuite.create view -- basic

Hyukjin Kwon created SPARK-37367: Summary: Reeable exception test in DDLParserSuite.create view -- basic Key: SPARK-37367 URL: https://issues.apache.org/jira/browse/SPARK-37367 Project: Spark

[jira] [Updated] (SPARK-37367) Reeable exception test in DDLParserSuite.create view -- basic

[ https://issues.apache.org/jira/browse/SPARK-37367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37367: - Description: SPARK-37308 disabled a test due to unknown flakiness. We should enable this back

[jira] [Created] (SPARK-37366) Add benchmark for Z-order

Cheng Su created SPARK-37366: Summary: Add benchmark for Z-order Key: SPARK-37366 URL: https://issues.apache.org/jira/browse/SPARK-37366 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-37361) Introduce Z-order for efficient data skipping

[ https://issues.apache.org/jira/browse/SPARK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37361: - Description: This is the umbrella Jira to track the progress of introducing Z-order in Spark. Z-order

[jira] [Updated] (SPARK-37361) Introduce Z-order for efficient data skipping

[ https://issues.apache.org/jira/browse/SPARK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37361: - Description: This is the umbrella Jira to track the progress of introducing Z-order in Spark. Z-order

[jira] [Assigned] (SPARK-31585) Support Z-order curve expression

[ https://issues.apache.org/jira/browse/SPARK-31585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31585: Assignee: (was: Apache Spark) > Support Z-order curve expression >

[jira] [Commented] (SPARK-31585) Support Z-order curve expression

[ https://issues.apache.org/jira/browse/SPARK-31585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445598#comment-17445598 ] Apache Spark commented on SPARK-31585: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31585) Support Z-order curve expression

[ https://issues.apache.org/jira/browse/SPARK-31585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31585: Assignee: Apache Spark > Support Z-order curve expression >

[jira] [Commented] (SPARK-37214) Fail query analysis earlier with invalid identifiers

[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445592#comment-17445592 ] Apache Spark commented on SPARK-37214: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445590#comment-17445590 ] Apache Spark commented on SPARK-37308: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37308: Assignee: (was: Apache Spark) > Flaky Test: DDLParserSuite.create view -- basic >

[jira] [Assigned] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37308: Assignee: Apache Spark > Flaky Test: DDLParserSuite.create view -- basic >

[jira] [Assigned] (SPARK-37360) Support TimestampNTZ in JSON data source

[ https://issues.apache.org/jira/browse/SPARK-37360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37360: Assignee: (was: Apache Spark) > Support TimestampNTZ in JSON data source >

[jira] [Assigned] (SPARK-37360) Support TimestampNTZ in JSON data source

[ https://issues.apache.org/jira/browse/SPARK-37360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37360: Assignee: Apache Spark > Support TimestampNTZ in JSON data source >

[jira] [Commented] (SPARK-37360) Support TimestampNTZ in JSON data source

[ https://issues.apache.org/jira/browse/SPARK-37360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445589#comment-17445589 ] Apache Spark commented on SPARK-37360: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-37361) Introduce Z-order for efficient data skipping

[ https://issues.apache.org/jira/browse/SPARK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445584#comment-17445584 ] Cheng Su commented on SPARK-37361: -- Just FYI, I am working on each sub-task now. Thanks. > Introduce

[jira] [Created] (SPARK-37365) Add ZORDER BY syntax and plan rule

Cheng Su created SPARK-37365: Summary: Add ZORDER BY syntax and plan rule Key: SPARK-37365 URL: https://issues.apache.org/jira/browse/SPARK-37365 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37364) Add code-gen evaluation for Z-order expression

Cheng Su created SPARK-37364: Summary: Add code-gen evaluation for Z-order expression Key: SPARK-37364 URL: https://issues.apache.org/jira/browse/SPARK-37364 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-37361) Introduce Z-order for efficient data skipping

[ https://issues.apache.org/jira/browse/SPARK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37361: - Description: This is the umbrella Jira to track the progress of introducing Z-order in Spark. Z-order

[jira] [Commented] (SPARK-37353) Resolved attribute(s) region_id#7993 missing from lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677 when doing left join

[ https://issues.apache.org/jira/browse/SPARK-37353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445581#comment-17445581 ] Hyukjin Kwon commented on SPARK-37353: -- [~anubhavprince100] mind showing self-contained reproducer?

[jira] [Created] (SPARK-37363) Support string type in Z-order expression

Cheng Su created SPARK-37363: Summary: Support string type in Z-order expression Key: SPARK-37363 URL: https://issues.apache.org/jira/browse/SPARK-37363 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37362) Support float type in Z-order expression

Cheng Su created SPARK-37362: Summary: Support float type in Z-order expression Key: SPARK-37362 URL: https://issues.apache.org/jira/browse/SPARK-37362 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-31585) Support Z-order curve expression

[ https://issues.apache.org/jira/browse/SPARK-31585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-31585: - Summary: Support Z-order curve expression (was: Support Z-order curve) > Support Z-order curve

[jira] [Updated] (SPARK-31585) Support Z-order curve expression

[ https://issues.apache.org/jira/browse/SPARK-31585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-31585: - Parent: SPARK-37361 Issue Type: Sub-task (was: New Feature) > Support Z-order curve expression

[jira] [Updated] (SPARK-37361) Introduce Z-order for efficient data skipping

[ https://issues.apache.org/jira/browse/SPARK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37361: - Description: This is the umbrella Jira to track the progress of introducing Z-order in Spark. Z-order

[jira] [Created] (SPARK-37361) Introduce Z-order for efficient data skipping

Cheng Su created SPARK-37361: Summary: Introduce Z-order for efficient data skipping Key: SPARK-37361 URL: https://issues.apache.org/jira/browse/SPARK-37361 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-37360) Support TimestampNTZ in JSON data source

Ivan Sadikov created SPARK-37360: Summary: Support TimestampNTZ in JSON data source Key: SPARK-37360 URL: https://issues.apache.org/jira/browse/SPARK-37360 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36646) Push down group by partition column for Aggregate (Min/Max/Count) for Parquet

[ https://issues.apache.org/jira/browse/SPARK-36646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36646. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34445

[jira] [Assigned] (SPARK-36646) Push down group by partition column for Aggregate (Min/Max/Count) for Parquet

[ https://issues.apache.org/jira/browse/SPARK-36646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36646: --- Assignee: Huaxin Gao > Push down group by partition column for Aggregate (Min/Max/Count)

[jira] [Assigned] (SPARK-37230) Document DataFrame.mapInArrow

[ https://issues.apache.org/jira/browse/SPARK-37230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37230: Assignee: Hyukjin Kwon > Document DataFrame.mapInArrow > - >

[jira] [Resolved] (SPARK-37230) Document DataFrame.mapInArrow

[ https://issues.apache.org/jira/browse/SPARK-37230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37230. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34624

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445558#comment-17445558 ] Manu Zhang commented on SPARK-31646: Only very shortly and by a small amount which I think is more

[jira] [Assigned] (SPARK-37349) Improve SQL Rest API Parsing

[ https://issues.apache.org/jira/browse/SPARK-37349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37349: Assignee: (was: Apache Spark) > Improve SQL Rest API Parsing >

[jira] [Assigned] (SPARK-37349) Improve SQL Rest API Parsing

[ https://issues.apache.org/jira/browse/SPARK-37349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37349: Assignee: Apache Spark > Improve SQL Rest API Parsing > > >

[jira] [Commented] (SPARK-37349) Improve SQL Rest API Parsing

[ https://issues.apache.org/jira/browse/SPARK-37349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1744#comment-1744 ] Apache Spark commented on SPARK-37349: -- User 'yliou' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37279) Support DayTimeIntervalType in createDataFrame/toPandas and Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-37279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37279: Assignee: Hyukjin Kwon > Support DayTimeIntervalType in createDataFrame/toPandas and

[jira] [Resolved] (SPARK-37279) Support DayTimeIntervalType in createDataFrame/toPandas and Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-37279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37279. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34614

[jira] [Commented] (SPARK-37348) PySpark pmod function

[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445547#comment-17445547 ] Hyukjin Kwon commented on SPARK-37348: -- See

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445513#comment-17445513 ] Siddharth Kumar edited comment on SPARK-18105 at 11/17/21, 10:28 PM: -

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445513#comment-17445513 ] Siddharth Kumar commented on SPARK-18105: - Hi, I saw a similar failure just as [~vladimir.prus].

[jira] [Updated] (SPARK-37359) Spark K8s tests are broken

[ https://issues.apache.org/jira/browse/SPARK-37359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-37359: - Description: For decom: We should look for "Decommission executors" instead of "Remove reason

[jira] [Updated] (SPARK-37359) Spark K8s tests are broken

[ https://issues.apache.org/jira/browse/SPARK-37359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-37359: - Summary: Spark K8s tests are broken (was: Spark K8s decom test looks for a non longer current

[jira] [Commented] (SPARK-37359) Spark K8s decom test looks for a non longer current string

[ https://issues.apache.org/jira/browse/SPARK-37359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445486#comment-17445486 ] Apache Spark commented on SPARK-37359: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37359) Spark K8s decom test looks for a non longer current string

[ https://issues.apache.org/jira/browse/SPARK-37359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37359: Assignee: Apache Spark (was: Holden Karau) > Spark K8s decom test looks for a non

[jira] [Assigned] (SPARK-37359) Spark K8s decom test looks for a non longer current string

[ https://issues.apache.org/jira/browse/SPARK-37359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37359: Assignee: Holden Karau (was: Apache Spark) > Spark K8s decom test looks for a non

[jira] [Commented] (SPARK-37359) Spark K8s decom test looks for a non longer current string

[ https://issues.apache.org/jira/browse/SPARK-37359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445485#comment-17445485 ] Apache Spark commented on SPARK-37359: -- User 'holdenk' has created a pull request for this issue:

[jira] [Created] (SPARK-37359) Spark K8s decom test looks for a non longer current string

Holden Karau created SPARK-37359: Summary: Spark K8s decom test looks for a non longer current string Key: SPARK-37359 URL: https://issues.apache.org/jira/browse/SPARK-37359 Project: Spark

[jira] [Updated] (SPARK-37358) Spark-on-K8S: Allow disabling of resources.limits.memory in executor pod spec

[ https://issues.apache.org/jira/browse/SPARK-37358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew de Quincey updated SPARK-37358: -- Description: When spark creates an executor pod on my Kubernetes cluster, it adds the

[jira] [Commented] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN

[ https://issues.apache.org/jira/browse/SPARK-37205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445395#comment-17445395 ] Apache Spark commented on SPARK-37205: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN

[ https://issues.apache.org/jira/browse/SPARK-37205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37205: Assignee: (was: Apache Spark) > Support mapreduce.job.send-token-conf when starting

[jira] [Assigned] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN

[ https://issues.apache.org/jira/browse/SPARK-37205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37205: Assignee: Apache Spark > Support mapreduce.job.send-token-conf when starting containers

[jira] [Updated] (SPARK-37358) Spark-on-K8S: Allow disabling of resources.limits.memory in executor pod spec

[ https://issues.apache.org/jira/browse/SPARK-37358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew de Quincey updated SPARK-37358: -- Description: When spark creates an executor pod on my Kubernetes cluster, it adds the

[jira] [Created] (SPARK-37358) Spark-on-K8S: Allow disabling of resources.limits.memory in executor pod spec

Andrew de Quincey created SPARK-37358: - Summary: Spark-on-K8S: Allow disabling of resources.limits.memory in executor pod spec Key: SPARK-37358 URL: https://issues.apache.org/jira/browse/SPARK-37358

[jira] [Commented] (SPARK-37348) PySpark pmod function

[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445273#comment-17445273 ] Tim Schwab commented on SPARK-37348: Interesting, it is surprising to me that this would not be

[jira] [Resolved] (SPARK-36924) CAST between ANSI intervals and numerics

[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36924. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34494

[jira] [Assigned] (SPARK-36924) CAST between ANSI intervals and numerics

[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36924: --- Assignee: PengLei > CAST between ANSI intervals and numerics >

[jira] [Assigned] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37357: Assignee: (was: Apache Spark) > Add merged last partition factor for rebalance >

[jira] [Commented] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445261#comment-17445261 ] Apache Spark commented on SPARK-37357: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37357: Assignee: Apache Spark > Add merged last partition factor for rebalance >

[jira] [Updated] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Description: `Rebalance` provide a functionality that split the large reduce partition into smalls.

[jira] [Updated] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Description: `Rebalance` provide a functionality that split the large reduce partition into smalls.

[jira] [Updated] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Summary: Add merged last partition factor for rebalance (was: Add merged last partition factor for

[jira] [Updated] (SPARK-37357) Add merged last partition factor for split skew partition

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Summary: Add merged last partition factor for split skew partition (was: Add merged last partition

[jira] [Updated] (SPARK-37357) Add merged last partition factor for split skew partition

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Description: For example `Rebalance` provide a functionality that split the large reduce partition

[jira] [Updated] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Description: `Rebalance` provide a functionality that split the large reduce partition into smalls.

[jira] [Updated] (SPARK-37357) Add merged last partition factor for rebalance

[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Description: `Rebalance` provide a functionality that split the large reduce partition into smalls.

[jira] [Resolved] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding

[ https://issues.apache.org/jira/browse/SPARK-37181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37181. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34619

[jira] [Assigned] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding

[ https://issues.apache.org/jira/browse/SPARK-37181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37181: Assignee: pralabhkumar > pyspark.pandas.read_csv() should support latin-1 encoding >

[jira] [Commented] (SPARK-37214) Fail query analysis earlier with invalid identifiers

[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445184#comment-17445184 ] Apache Spark commented on SPARK-37214: -- User 'linhongliu-db' has created a pull request for this

[jira] [Resolved] (SPARK-37316) Add code-gen for existence sort merge join

[ https://issues.apache.org/jira/browse/SPARK-37316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37316. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34601

  1   2   >