[jira] [Created] (SPARK-41446) Make `createDataFrame` support schema and more input dataset type

Ruifeng Zheng created SPARK-41446: - Summary: Make `createDataFrame` support schema and more input dataset type Key: SPARK-41446 URL: https://issues.apache.org/jira/browse/SPARK-41446 Project: Spark

[jira] [Commented] (SPARK-39948) exclude velocity 1.5 jar

[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644645#comment-17644645 ] Apache Spark commented on SPARK-39948: -- User 'zhouyifan279' has created a pull requ

[jira] [Commented] (SPARK-39948) exclude velocity 1.5 jar

[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644643#comment-17644643 ] Apache Spark commented on SPARK-39948: -- User 'zhouyifan279' has created a pull requ

[jira] [Assigned] (SPARK-41366) DF.groupby.agg() API should be compatible

[ https://issues.apache.org/jira/browse/SPARK-41366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41366: Assignee: Martin Grund > DF.groupby.agg() API should be compatible >

[jira] [Resolved] (SPARK-38277) Clear write batch after RocksDB state store's commit

[ https://issues.apache.org/jira/browse/SPARK-38277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38277. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-38277) Clear write batch after RocksDB state store's commit

[ https://issues.apache.org/jira/browse/SPARK-38277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-38277: Assignee: Yun Tang > Clear write batch after RocksDB state store's commit > -

[jira] [Commented] (SPARK-41445) Implement DataFrameReader.parquet

[ https://issues.apache.org/jira/browse/SPARK-41445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644623#comment-17644623 ] Apache Spark commented on SPARK-41445: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41445) Implement DataFrameReader.parquet

[ https://issues.apache.org/jira/browse/SPARK-41445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41445: Assignee: Apache Spark > Implement DataFrameReader.parquet >

[jira] [Assigned] (SPARK-41445) Implement DataFrameReader.parquet

[ https://issues.apache.org/jira/browse/SPARK-41445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41445: Assignee: (was: Apache Spark) > Implement DataFrameReader.parquet > -

[jira] [Commented] (SPARK-41444) Implement DataFrameReader.json

[ https://issues.apache.org/jira/browse/SPARK-41444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644620#comment-17644620 ] Apache Spark commented on SPARK-41444: -- User 'amaliujia' has created a pull request

[jira] [Updated] (SPARK-41444) Implement DataFrameReader.json

[ https://issues.apache.org/jira/browse/SPARK-41444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41444: - Summary: Implement DataFrameReader.json (was: Support read.json) > Implement DataFrameReader.js

[jira] [Created] (SPARK-41445) Implement DataFrameReader.parquet

Hyukjin Kwon created SPARK-41445: Summary: Implement DataFrameReader.parquet Key: SPARK-41445 URL: https://issues.apache.org/jira/browse/SPARK-41445 Project: Spark Issue Type: Sub-task

[jira] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284 ] Hyukjin Kwon deleted comment on SPARK-41284: -- was (Author: gurwls223): Issue resolved by pull request 38975 [https://github.com/apache/spark/pull/38975] > Feature parity: I/O in Spark Conne

[jira] [Commented] (SPARK-41444) Support read.json

[ https://issues.apache.org/jira/browse/SPARK-41444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644619#comment-17644619 ] Hyukjin Kwon commented on SPARK-41444: -- Fixed in https://github.com/apache/spark/pu

[jira] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284 ] Hyukjin Kwon deleted comment on SPARK-41284: -- was (Author: apachespark): User 'amaliujia' has created a pull request for this issue: https://github.com/apache/spark/pull/38975 > Feature par

[jira] [Resolved] (SPARK-41444) Support read.json

[ https://issues.apache.org/jira/browse/SPARK-41444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41444. -- Fix Version/s: 3.4.0 Resolution: Fixed > Support read.json > - > >

[jira] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284 ] Hyukjin Kwon deleted comment on SPARK-41284: -- was (Author: apachespark): User 'amaliujia' has created a pull request for this issue: https://github.com/apache/spark/pull/38975 > Feature par

[jira] [Reopened] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-41284: -- > Feature parity: I/O in Spark Connect > > >

[jira] [Resolved] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41284. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38975 [https://gi

[jira] [Resolved] (SPARK-41442) Only update SQLMetric value if merging with valid metric

[ https://issues.apache.org/jira/browse/SPARK-41442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41442. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38969 [https://

[jira] [Assigned] (SPARK-41442) Only update SQLMetric value if merging with valid metric

[ https://issues.apache.org/jira/browse/SPARK-41442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41442: - Assignee: L. C. Hsieh > Only update SQLMetric value if merging with valid metric >

[jira] [Commented] (SPARK-41366) DF.groupby.agg() API should be compatible

[ https://issues.apache.org/jira/browse/SPARK-41366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644604#comment-17644604 ] Apache Spark commented on SPARK-41366: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-41366) DF.groupby.agg() API should be compatible

[ https://issues.apache.org/jira/browse/SPARK-41366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644603#comment-17644603 ] Apache Spark commented on SPARK-41366: -- User 'dongjoon-hyun' has created a pull req

[jira] (SPARK-41439) Implement `DataFrame.melt`

[ https://issues.apache.org/jira/browse/SPARK-41439 ] jiaan.geng deleted comment on SPARK-41439: was (Author: beliefer): I'm working on. > Implement `DataFrame.melt` > -- > > Key: SPARK-41439 >

[jira] [Updated] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

[ https://issues.apache.org/jira/browse/SPARK-41350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41350: -- Fix Version/s: 3.3.2 > allow simple name access of using join hidden columns after subquery al

[jira] [Commented] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644593#comment-17644593 ] Apache Spark commented on SPARK-41284: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41284: Assignee: Rui Wang (was: Apache Spark) > Feature parity: I/O in Spark Connect >

[jira] [Commented] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644594#comment-17644594 ] Apache Spark commented on SPARK-41284: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-41284) Feature parity: I/O in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41284: Assignee: Apache Spark (was: Rui Wang) > Feature parity: I/O in Spark Connect >

[jira] [Created] (SPARK-41444) Support read.json

Rui Wang created SPARK-41444: Summary: Support read.json Key: SPARK-41444 URL: https://issues.apache.org/jira/browse/SPARK-41444 Project: Spark Issue Type: Sub-task Components: Connect

[jira] [Assigned] (SPARK-41439) Implement `DataFrame.melt`

[ https://issues.apache.org/jira/browse/SPARK-41439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41439: Assignee: Apache Spark > Implement `DataFrame.melt` > -- > >

[jira] [Assigned] (SPARK-41439) Implement `DataFrame.melt`

[ https://issues.apache.org/jira/browse/SPARK-41439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41439: Assignee: (was: Apache Spark) > Implement `DataFrame.melt` >

[jira] [Commented] (SPARK-41439) Implement `DataFrame.melt`

[ https://issues.apache.org/jira/browse/SPARK-41439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644576#comment-17644576 ] Apache Spark commented on SPARK-41439: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061

[ https://issues.apache.org/jira/browse/SPARK-41443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644575#comment-17644575 ] Apache Spark commented on SPARK-41443: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061

[ https://issues.apache.org/jira/browse/SPARK-41443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41443: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_1061 > -

[jira] [Commented] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061

[ https://issues.apache.org/jira/browse/SPARK-41443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644574#comment-17644574 ] Apache Spark commented on SPARK-41443: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061

[ https://issues.apache.org/jira/browse/SPARK-41443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41443: Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TEMP_1

[jira] [Created] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061

BingKun Pan created SPARK-41443: --- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1061 Key: SPARK-41443 URL: https://issues.apache.org/jira/browse/SPARK-41443 Project: Spark Issue

[jira] [Commented] (SPARK-41433) Make Max Arrow BatchSize configurable

[ https://issues.apache.org/jira/browse/SPARK-41433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644566#comment-17644566 ] Apache Spark commented on SPARK-41433: -- User 'zhengruifeng' has created a pull requ

[jira] [Updated] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41376: - Priority: Minor (was: Major) > Executor netty direct memory check should respect > spark.shuff

[jira] [Resolved] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41376. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38901 [https://gi

[jira] [Assigned] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41376: Assignee: Cheng Pan > Executor netty direct memory check should respect > spark.shuffle.

[jira] [Resolved] (SPARK-41378) Support Column Stats in DS V2

[ https://issues.apache.org/jira/browse/SPARK-41378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41378. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38904 [https://

[jira] [Assigned] (SPARK-41378) Support Column Stats in DS V2

[ https://issues.apache.org/jira/browse/SPARK-41378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41378: - Assignee: Huaxin Gao > Support Column Stats in DS V2 > - >

[jira] [Assigned] (SPARK-41412) Implement `Cast`

[ https://issues.apache.org/jira/browse/SPARK-41412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41412: Assignee: Rui Wang (was: Apache Spark) > Implement `Cast` > > >

[jira] [Commented] (SPARK-41412) Implement `Cast`

[ https://issues.apache.org/jira/browse/SPARK-41412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644513#comment-17644513 ] Apache Spark commented on SPARK-41412: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-41412) Implement `Cast`

[ https://issues.apache.org/jira/browse/SPARK-41412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41412: Assignee: Apache Spark (was: Rui Wang) > Implement `Cast` > > >

[jira] [Commented] (SPARK-41442) Only update SQLMetric value if merging with valid metric

[ https://issues.apache.org/jira/browse/SPARK-41442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644512#comment-17644512 ] Apache Spark commented on SPARK-41442: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-41442) Only update SQLMetric value if merging with valid metric

[ https://issues.apache.org/jira/browse/SPARK-41442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41442: Assignee: (was: Apache Spark) > Only update SQLMetric value if merging with valid met

[jira] [Assigned] (SPARK-41442) Only update SQLMetric value if merging with valid metric

[ https://issues.apache.org/jira/browse/SPARK-41442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41442: Assignee: Apache Spark > Only update SQLMetric value if merging with valid metric > -

[jira] [Commented] (SPARK-41442) Only update SQLMetric value if merging with valid metric

[ https://issues.apache.org/jira/browse/SPARK-41442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644511#comment-17644511 ] Apache Spark commented on SPARK-41442: -- User 'viirya' has created a pull request fo

[jira] [Created] (SPARK-41442) Only update SQLMetric value if merging with valid metric

L. C. Hsieh created SPARK-41442: --- Summary: Only update SQLMetric value if merging with valid metric Key: SPARK-41442 URL: https://issues.apache.org/jira/browse/SPARK-41442 Project: Spark Issue

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644500#comment-17644500 ] Apache Spark commented on SPARK-41233: -- User 'navinvishy' has created a pull reques

[jira] [Assigned] (SPARK-41233) High-order function: array_prepend

[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41233: Assignee: Apache Spark > High-order function: array_prepend > ---

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644499#comment-17644499 ] Apache Spark commented on SPARK-41233: -- User 'navinvishy' has created a pull reques

[jira] [Assigned] (SPARK-41233) High-order function: array_prepend

[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41233: Assignee: (was: Apache Spark) > High-order function: array_prepend >

[jira] [Comment Edited] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644498#comment-17644498 ] Kevin Cheung edited comment on SPARK-41344 at 12/7/22 7:53 PM: ---

[jira] [Comment Edited] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644498#comment-17644498 ] Kevin Cheung edited comment on SPARK-41344 at 12/7/22 7:52 PM: ---

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644498#comment-17644498 ] Kevin Cheung commented on SPARK-41344: -- [~wforget] I believe he just means duplicat

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644492#comment-17644492 ] Kevin Cheung commented on SPARK-41344: -- +1 [~planga82]. I like this approach of hav

[jira] [Commented] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644463#comment-17644463 ] Rui Wang commented on SPARK-41349: -- Keeping this issue as open given that there is pyth

[jira] [Reopened] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reopened SPARK-41349: -- > Implement `DataFrame.hint` > -- > > Key: SPARK-41349 >

[jira] [Assigned] (SPARK-41441) Allow Generate with no required child output to host outer references

[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41441: Assignee: (was: Apache Spark) > Allow Generate with no required child output to host

[jira] [Assigned] (SPARK-41441) Allow Generate with no required child output to host outer references

[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41441: Assignee: Apache Spark > Allow Generate with no required child output to host outer refer

[jira] [Commented] (SPARK-41441) Allow Generate with no required child output to host outer references

[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644459#comment-17644459 ] Apache Spark commented on SPARK-41441: -- User 'allisonwang-db' has created a pull re

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1765#comment-1765 ] Apache Spark commented on SPARK-41369: -- User 'hvanhovell' has created a pull reques

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1764#comment-1764 ] Apache Spark commented on SPARK-41369: -- User 'hvanhovell' has created a pull reques

[jira] [Created] (SPARK-41441) Allow Generate with no required child output to host outer references

Allison Wang created SPARK-41441: Summary: Allow Generate with no required child output to host outer references Key: SPARK-41441 URL: https://issues.apache.org/jira/browse/SPARK-41441 Project: Spark

[jira] [Commented] (SPARK-40801) Upgrade Apache Commons Text to 1.10

[ https://issues.apache.org/jira/browse/SPARK-40801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644430#comment-17644430 ] Kevin Appel commented on SPARK-40801: - thank you for working on this > Upgrade Apac

[jira] [Commented] (SPARK-41008) Isotonic regression result differs from sklearn implementation

[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644314#comment-17644314 ] Apache Spark commented on SPARK-41008: -- User 'ahmed-mahran' has created a pull requ

[jira] [Commented] (SPARK-41008) Isotonic regression result differs from sklearn implementation

[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644313#comment-17644313 ] Apache Spark commented on SPARK-41008: -- User 'ahmed-mahran' has created a pull requ

[jira] [Assigned] (SPARK-41008) Isotonic regression result differs from sklearn implementation

[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41008: Assignee: Apache Spark > Isotonic regression result differs from sklearn implementation >

[jira] [Assigned] (SPARK-41008) Isotonic regression result differs from sklearn implementation

[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41008: Assignee: (was: Apache Spark) > Isotonic regression result differs from sklearn imple

[jira] [Resolved] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41437. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38942 [https://gith

[jira] [Assigned] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41437: --- Assignee: Wenchen Fan > Do not optimize the input query twice for v1 write fallback > -

[jira] [Closed] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0

[ https://issues.apache.org/jira/browse/SPARK-41418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-41418. - > Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 > -- >

[jira] [Resolved] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0

[ https://issues.apache.org/jira/browse/SPARK-41418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41418. --- Resolution: Duplicate > Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 > ---

[jira] [Commented] (SPARK-41439) Implement `DataFrame.melt`

[ https://issues.apache.org/jira/browse/SPARK-41439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644258#comment-17644258 ] jiaan.geng commented on SPARK-41439: I'm working on. > Implement `DataFrame.melt` >

[jira] (SPARK-41438) Implement DataFrame. colRegex

[ https://issues.apache.org/jira/browse/SPARK-41438 ] jiaan.geng deleted comment on SPARK-41438: was (Author: beliefer): I'm working on. > Implement DataFrame. colRegex > - > > Key: SPARK-41438 >

[jira] [Commented] (SPARK-41438) Implement DataFrame. colRegex

[ https://issues.apache.org/jira/browse/SPARK-41438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644242#comment-17644242 ] jiaan.geng commented on SPARK-41438: I'm working on. > Implement DataFrame. colRege

[jira] [Created] (SPARK-41440) Implement DataFrame.randomSplit

Ruifeng Zheng created SPARK-41440: - Summary: Implement DataFrame.randomSplit Key: SPARK-41440 URL: https://issues.apache.org/jira/browse/SPARK-41440 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41439) Implement `DataFrame.melt`

Ruifeng Zheng created SPARK-41439: - Summary: Implement `DataFrame.melt` Key: SPARK-41439 URL: https://issues.apache.org/jira/browse/SPARK-41439 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-41438) Implement DataFrame. colRegex

Ruifeng Zheng created SPARK-41438: - Summary: Implement DataFrame. colRegex Key: SPARK-41438 URL: https://issues.apache.org/jira/browse/SPARK-41438 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41386) There are some small files when using rebalance(column)

[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644224#comment-17644224 ] Apache Spark commented on SPARK-41386: -- User 'Juerin-Dong' has created a pull reque

[jira] [Commented] (SPARK-41386) There are some small files when using rebalance(column)

[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644223#comment-17644223 ] Apache Spark commented on SPARK-41386: -- User 'Juerin-Dong' has created a pull reque

[jira] [Assigned] (SPARK-41386) There are some small files when using rebalance(column)

[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41386: Assignee: (was: Apache Spark) > There are some small files when using rebalance(colum

[jira] [Assigned] (SPARK-41386) There are some small files when using rebalance(column)

[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41386: Assignee: Apache Spark > There are some small files when using rebalance(column) > --

[jira] [Comment Edited] (SPARK-41386) There are some small files when using rebalance(column)

[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644141#comment-17644141 ] Zhe Dong edited comment on SPARK-41386 at 12/7/22 8:31 AM: --- Op

[jira] [Assigned] (SPARK-41433) Make Max Arrow BatchSize configurable

[ https://issues.apache.org/jira/browse/SPARK-41433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41433: - Assignee: Ruifeng Zheng > Make Max Arrow BatchSize configurable > -

[jira] [Resolved] (SPARK-41433) Make Max Arrow BatchSize configurable

[ https://issues.apache.org/jira/browse/SPARK-41433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41433. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38958 [https://

[jira] [Comment Edited] (SPARK-41386) There are some small files when using rebalance(column)

[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644141#comment-17644141 ] Zhe Dong edited comment on SPARK-41386 at 12/7/22 8:29 AM: --- Op

[jira] [Assigned] (SPARK-41403) Implement DataFrame.describe

[ https://issues.apache.org/jira/browse/SPARK-41403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41403: - Assignee: jiaan.geng > Implement DataFrame.describe > > >

[jira] [Resolved] (SPARK-41403) Implement DataFrame.describe

[ https://issues.apache.org/jira/browse/SPARK-41403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41403. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38938 [https://

[jira] [Resolved] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41349. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38899 [https://gith

[jira] [Assigned] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41349: --- Assignee: Deng Ziming > Implement `DataFrame.hint` > -- > >