[jira] [Updated] (SPARK-34788) Spark throws FileNotFoundException instead of IOException when disk is full

[ https://issues.apache.org/jira/browse/SPARK-34788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-34788: - Description: When the disk is full, Spark throws FileNotFoundException instead of IOException with the hint. It

[jira] [Commented] (SPARK-34788) Spark throws FileNotFoundException instead of IOException when disk is full

[ https://issues.apache.org/jira/browse/SPARK-34788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304581#comment-17304581 ] wuyi commented on SPARK-34788: -- [~dongjoon] I have pasted the error stack. It happened when

[jira] [Resolved] (SPARK-34719) fail if the view query has duplicated column names

[ https://issues.apache.org/jira/browse/SPARK-34719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34719. -- Fix Version/s: 3.1.2 Assignee: Wenchen Fan Resolution: Fixed Resolved

[jira] [Updated] (SPARK-34765) Linear Models standardization optimization

[ https://issues.apache.org/jira/browse/SPARK-34765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34765: - Issue Type: Improvement (was: Umbrella) > Linear Models standardization optimization >

[jira] [Updated] (SPARK-34765) Linear Models standardization optimization

[ https://issues.apache.org/jira/browse/SPARK-34765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34765: - Parent: SPARK-30641 Issue Type: Sub-task (was: Improvement) > Linear Models standardiza

[jira] [Updated] (SPARK-34788) Spark throws FileNotFoundException instead of IOException when disk is full

[ https://issues.apache.org/jira/browse/SPARK-34788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-34788: - Description: When the disk is full, Spark throws FileNotFoundException instead of IOException with the hint. It

[jira] [Created] (SPARK-34797) Refactor Logistic Aggregator

zhengruifeng created SPARK-34797: Summary: Refactor Logistic Aggregator Key: SPARK-34797 URL: https://issues.apache.org/jira/browse/SPARK-34797 Project: Spark Issue Type: Sub-task C

[jira] [Commented] (SPARK-34693) Support null in conversions to and from Arrow

[ https://issues.apache.org/jira/browse/SPARK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304583#comment-17304583 ] Hyukjin Kwon commented on SPARK-34693: -- Oh, okay. Seems like it's fixed in SPARK-33

[jira] [Updated] (SPARK-34797) Refactor Logistic Aggregator

[ https://issues.apache.org/jira/browse/SPARK-34797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34797: - Description: 1, add BinaryLogisticBlockAggregator and MultinomialLogisticBlockAggregator and re

[jira] [Commented] (SPARK-34782) Not equal functions (!=, <>) are missing in SQL doc

[ https://issues.apache.org/jira/browse/SPARK-34782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304585#comment-17304585 ] wuyi commented on SPARK-34782: -- Oh yea, thanks for catching it. I'll close this. > Not equ

[jira] [Resolved] (SPARK-34782) Not equal functions (!=, <>) are missing in SQL doc

[ https://issues.apache.org/jira/browse/SPARK-34782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-34782. -- Resolution: Duplicate > Not equal functions (!=, <>) are missing in SQL doc > ---

[jira] [Assigned] (SPARK-34797) Refactor Logistic Aggregator

[ https://issues.apache.org/jira/browse/SPARK-34797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34797: Assignee: Apache Spark > Refactor Logistic Aggregator > > >

[jira] [Assigned] (SPARK-34797) Refactor Logistic Aggregator

[ https://issues.apache.org/jira/browse/SPARK-34797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34797: Assignee: Apache Spark > Refactor Logistic Aggregator > > >

[jira] [Assigned] (SPARK-34797) Refactor Logistic Aggregator

[ https://issues.apache.org/jira/browse/SPARK-34797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34797: Assignee: (was: Apache Spark) > Refactor Logistic Aggregator > --

[jira] [Commented] (SPARK-34797) Refactor Logistic Aggregator

[ https://issues.apache.org/jira/browse/SPARK-34797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304590#comment-17304590 ] Apache Spark commented on SPARK-34797: -- User 'zhengruifeng' has created a pull requ

[jira] [Updated] (SPARK-34797) Refactor Logistic Aggregator - support virtual centering

[ https://issues.apache.org/jira/browse/SPARK-34797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34797: - Summary: Refactor Logistic Aggregator - support virtual centering (was: Refactor Logistic Aggre

[jira] [Created] (SPARK-34798) Replace `==` with `===` in join condition

Yuming Wang created SPARK-34798: --- Summary: Replace `==` with `===` in join condition Key: SPARK-34798 URL: https://issues.apache.org/jira/browse/SPARK-34798 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-30641) ML algs blockify input vectors

[ https://issues.apache.org/jira/browse/SPARK-30641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30641: - Affects Version/s: 3.2.0 > ML algs blockify input vectors > -- > >

[jira] [Commented] (SPARK-34788) Spark throws FileNotFoundException instead of IOException when disk is full

[ https://issues.apache.org/jira/browse/SPARK-34788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304603#comment-17304603 ] wuxiaofei commented on SPARK-34788: --- Please assign it to me, I will try to work it out

[jira] [Created] (SPARK-34799) Return User-defined types from Pandas UDF

Darcy Shen created SPARK-34799: -- Summary: Return User-defined types from Pandas UDF Key: SPARK-34799 URL: https://issues.apache.org/jira/browse/SPARK-34799 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34799) Return User-defined types from Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-34799: --- Description: Because Pandas UDF uses pyarrow to passing data, it does not currently support UserDef

[jira] [Updated] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-34600: --- Description: This is an umbrella ticket. (was: Because Pandas UDF uses pyarrow to passing data, it

[jira] [Commented] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304606#comment-17304606 ] Darcy Shen commented on SPARK-34600: [~hyukjin.kwon][~eddyxu] Let me move the PR to

[jira] [Comment Edited] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304606#comment-17304606 ] Darcy Shen edited comment on SPARK-34600 at 3/19/21, 3:14 AM:

[jira] [Created] (SPARK-34800) Use fine-grained lock in SessionCatalog.tableExists

rongchuan.jin created SPARK-34800: - Summary: Use fine-grained lock in SessionCatalog.tableExists Key: SPARK-34800 URL: https://issues.apache.org/jira/browse/SPARK-34800 Project: Spark Issue T

[jira] [Assigned] (SPARK-34798) Replace `==` with `===` in join condition

[ https://issues.apache.org/jira/browse/SPARK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34798: Assignee: (was: Apache Spark) > Replace `==` with `===` in join condition > -

[jira] [Commented] (SPARK-34798) Replace `==` with `===` in join condition

[ https://issues.apache.org/jira/browse/SPARK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304616#comment-17304616 ] Apache Spark commented on SPARK-34798: -- User 'opensky142857' has created a pull req

[jira] [Assigned] (SPARK-34798) Replace `==` with `===` in join condition

[ https://issues.apache.org/jira/browse/SPARK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34798: Assignee: Apache Spark > Replace `==` with `===` in join condition >

[jira] [Commented] (SPARK-34798) Replace `==` with `===` in join condition

[ https://issues.apache.org/jira/browse/SPARK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304617#comment-17304617 ] Apache Spark commented on SPARK-34798: -- User 'opensky142857' has created a pull req

[jira] [Updated] (SPARK-34798) Fix incorrect join condition

[ https://issues.apache.org/jira/browse/SPARK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34798: Summary: Fix incorrect join condition (was: Replace `==` with `===` in join condition) > Fix inc

[jira] [Commented] (SPARK-34800) Use fine-grained lock in SessionCatalog.tableExists

[ https://issues.apache.org/jira/browse/SPARK-34800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304619#comment-17304619 ] rongchuan.jin commented on SPARK-34800: --- PR link: https://github.com/apache/spark/

[jira] [Assigned] (SPARK-34800) Use fine-grained lock in SessionCatalog.tableExists

[ https://issues.apache.org/jira/browse/SPARK-34800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34800: Assignee: (was: Apache Spark) > Use fine-grained lock in SessionCatalog.tableExists >

[jira] [Assigned] (SPARK-34800) Use fine-grained lock in SessionCatalog.tableExists

[ https://issues.apache.org/jira/browse/SPARK-34800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34800: Assignee: Apache Spark > Use fine-grained lock in SessionCatalog.tableExists > --

[jira] [Commented] (SPARK-34800) Use fine-grained lock in SessionCatalog.tableExists

[ https://issues.apache.org/jira/browse/SPARK-34800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304620#comment-17304620 ] Apache Spark commented on SPARK-34800: -- User 'woyumen4597' has created a pull reque

[jira] [Updated] (SPARK-34800) Use fine-grained lock in SessionCatalog.tableExists

[ https://issues.apache.org/jira/browse/SPARK-34800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rongchuan.jin updated SPARK-34800: -- Description: We have modified the underlying hive meta store which a different hive database

[jira] [Commented] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304622#comment-17304622 ] L. C. Hsieh commented on SPARK-34776: - Thanks for ping. Let me take a look. > Catal

[jira] [Resolved] (SPARK-31897) Enable codegen for GenerateExec

[ https://issues.apache.org/jira/browse/SPARK-31897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-31897. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 28715 [https://gith

[jira] [Assigned] (SPARK-31897) Enable codegen for GenerateExec

[ https://issues.apache.org/jira/browse/SPARK-31897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-31897: --- Assignee: Karuppayya > Enable codegen for GenerateExec > --- >

[jira] [Resolved] (SPARK-34761) Add a day-time interval to a timestamp

[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34761. - Resolution: Fixed Issue resolved by pull request 31855 [https://github.com/apache/spark/pull/318

[jira] [Commented] (SPARK-34796) Codegen compilation error for query with LIMIT operator and without AQE

[ https://issues.apache.org/jira/browse/SPARK-34796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304641#comment-17304641 ] Apache Spark commented on SPARK-34796: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-34796) Codegen compilation error for query with LIMIT operator and without AQE

[ https://issues.apache.org/jira/browse/SPARK-34796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34796: Assignee: (was: Apache Spark) > Codegen compilation error for query with LIMIT operat

[jira] [Assigned] (SPARK-34796) Codegen compilation error for query with LIMIT operator and without AQE

[ https://issues.apache.org/jira/browse/SPARK-34796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34796: Assignee: Apache Spark > Codegen compilation error for query with LIMIT operator and with

[jira] [Resolved] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34772. - Fix Version/s: 3.0.3 3.1.2 3.2.0 Assignee: ulysses

[jira] [Updated] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hezuojiao updated SPARK-34790: -- Description: When set spark.io.encryption.enabled=true, lots of test cases in  AdaptiveQueryExecSuite

[jira] [Updated] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hezuojiao updated SPARK-34790: -- Description: When set spark.io.encryption.enabled=true, lots of test cases in  AdaptiveQueryExecSuite

[jira] [Updated] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hezuojiao updated SPARK-34790: -- Description: When set spark.io.encryption.enabled=true, lots of test cases in  AdaptiveQueryExecSuite

[jira] [Commented] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304651#comment-17304651 ] hezuojiao commented on SPARK-34790: --- Thanks for reply, I posted the failure message ab

[jira] [Commented] (SPARK-34792) Restore previous behaviour of randomSplit from spark-2.4.7 in spark-3

[ https://issues.apache.org/jira/browse/SPARK-34792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304654#comment-17304654 ] kondziolka9ld commented on SPARK-34792: --- [~dongjoon] > This doesn't look like a b

[jira] [Commented] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

[ https://issues.apache.org/jira/browse/SPARK-34774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304656#comment-17304656 ] Apache Spark commented on SPARK-34774: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34719) fail if the view query has duplicated column names

[ https://issues.apache.org/jira/browse/SPARK-34719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304657#comment-17304657 ] Apache Spark commented on SPARK-34719: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34128: Assignee: Apache Spark > Suppress excessive logging of TTransportExceptions in Spark Thr

[jira] [Commented] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304668#comment-17304668 ] Apache Spark commented on SPARK-34128: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34128: Assignee: (was: Apache Spark) > Suppress excessive logging of TTransportExceptions i

[jira] [Commented] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304669#comment-17304669 ] Apache Spark commented on SPARK-34128: -- User 'yaooqinn' has created a pull request

<    1   2