[jira] [Commented] (SPARK-30565) Regression in the ORC benchmark

[ https://issues.apache.org/jira/browse/SPARK-30565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057619#comment-17057619 ] Maxim Gekk commented on SPARK-30565: Per [~dongjoon] , default ORC reader doesn't fully cover

[jira] [Commented] (SPARK-30565) Regression in the ORC benchmark

[ https://issues.apache.org/jira/browse/SPARK-30565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057608#comment-17057608 ] Wenchen Fan commented on SPARK-30565: - Maybe we should report this to the Hive community. In Spark,

[jira] [Commented] (SPARK-30931) ML 3.0 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-30931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057592#comment-17057592 ] zhengruifeng commented on SPARK-30931: -- Thanks [~huaxingao] for your work > ML 3.0 QA: API: Python

[jira] [Resolved] (SPARK-30931) ML 3.0 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-30931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30931. -- Resolution: Fixed > ML 3.0 QA: API: Python API coverage > ---

[jira] [Commented] (SPARK-30935) Update MLlib, GraphX websites for 3.0

[ https://issues.apache.org/jira/browse/SPARK-30935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057587#comment-17057587 ] zhengruifeng commented on SPARK-30935: -- [~huaxingao] Thanks! > Update MLlib, GraphX websites for

[jira] [Resolved] (SPARK-30935) Update MLlib, GraphX websites for 3.0

[ https://issues.apache.org/jira/browse/SPARK-30935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30935. -- Resolution: Fixed > Update MLlib, GraphX websites for 3.0 >

[jira] [Resolved] (SPARK-31011) Failed to register signal handler for PWR

[ https://issues.apache.org/jira/browse/SPARK-31011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31011. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27832

[jira] [Assigned] (SPARK-31011) Failed to register signal handler for PWR

[ https://issues.apache.org/jira/browse/SPARK-31011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31011: - Assignee: Jungtaek Lim > Failed to register signal handler for PWR >

[jira] [Assigned] (SPARK-31032) GMM compute summary and update distributions in one pass

[ https://issues.apache.org/jira/browse/SPARK-31032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-31032: Assignee: zhengruifeng > GMM compute summary and update distributions in one pass >

[jira] [Resolved] (SPARK-31032) GMM compute summary and update distributions in one pass

[ https://issues.apache.org/jira/browse/SPARK-31032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31032. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27784

[jira] [Commented] (SPARK-31083) .ClassNotFoundException CoarseGrainedClusterMessages$RetrieveDelegationTokens

[ https://issues.apache.org/jira/browse/SPARK-31083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057555#comment-17057555 ] jiama commented on SPARK-31083: --- Yes, I used spark2.4 of the cdh6.2 suite, this error occurred when I

[jira] [Assigned] (SPARK-31126) Upgrade Kafka to 2.4.1

[ https://issues.apache.org/jira/browse/SPARK-31126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31126: - Assignee: Dongjoon Hyun > Upgrade Kafka to 2.4.1 > -- > >

[jira] [Resolved] (SPARK-31126) Upgrade Kafka to 2.4.1

[ https://issues.apache.org/jira/browse/SPARK-31126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31126. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27881

[jira] [Commented] (SPARK-30839) Add version information for Spark configuration

[ https://issues.apache.org/jira/browse/SPARK-30839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057524#comment-17057524 ] Hyukjin Kwon commented on SPARK-30839: -- [~beliefer] are there more jiras to add from your side? let

[jira] [Assigned] (SPARK-30911) Add version information to the configuration of Status

[ https://issues.apache.org/jira/browse/SPARK-30911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30911: Assignee: jiaan.geng > Add version information to the configuration of Status >

[jira] [Resolved] (SPARK-30911) Add version information to the configuration of Status

[ https://issues.apache.org/jira/browse/SPARK-30911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30911. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27848

[jira] [Resolved] (SPARK-31109) Add version information to the configuration of Mesos

[ https://issues.apache.org/jira/browse/SPARK-31109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31109. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27863

[jira] [Assigned] (SPARK-31109) Add version information to the configuration of Mesos

[ https://issues.apache.org/jira/browse/SPARK-31109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31109: Assignee: jiaan.geng > Add version information to the configuration of Mesos >

[jira] [Updated] (SPARK-30839) Add version information for Spark configuration

[ https://issues.apache.org/jira/browse/SPARK-30839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30839: --- Component/s: YARN Structured Streaming Spark Core

[jira] [Created] (SPARK-31128) Fix Uncaught TypeError in streaming statistics page

Gengliang Wang created SPARK-31128: -- Summary: Fix Uncaught TypeError in streaming statistics page Key: SPARK-31128 URL: https://issues.apache.org/jira/browse/SPARK-31128 Project: Spark

[jira] [Comment Edited] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057505#comment-17057505 ] Kyrill Alyoshin edited comment on SPARK-31074 at 3/12/20, 1:01 AM: ---

[jira] [Comment Edited] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057505#comment-17057505 ] Kyrill Alyoshin edited comment on SPARK-31074 at 3/12/20, 1:01 AM: ---

[jira] [Commented] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057505#comment-17057505 ] Kyrill Alyoshin commented on SPARK-31074: - Here you go. Avro schema:   {code:java} { "type":

[jira] [Assigned] (SPARK-31118) Add version information to the configuration of K8S

[ https://issues.apache.org/jira/browse/SPARK-31118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31118: Assignee: jiaan.geng > Add version information to the configuration of K8S >

[jira] [Resolved] (SPARK-31118) Add version information to the configuration of K8S

[ https://issues.apache.org/jira/browse/SPARK-31118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31118. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27875

[jira] [Resolved] (SPARK-31092) Add version information to the configuration of Yarn

[ https://issues.apache.org/jira/browse/SPARK-31092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31092. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27856

[jira] [Assigned] (SPARK-31092) Add version information to the configuration of Yarn

[ https://issues.apache.org/jira/browse/SPARK-31092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31092: Assignee: jiaan.geng > Add version information to the configuration of Yarn >

[jira] [Assigned] (SPARK-31002) Add version information to the configuration of Core

[ https://issues.apache.org/jira/browse/SPARK-31002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31002: Assignee: jiaan.geng > Add version information to the configuration of Core >

[jira] [Commented] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057500#comment-17057500 ] Hyukjin Kwon commented on SPARK-31074: -- Thanks, [~kyrill007]. If you already have the codes, can

[jira] [Commented] (SPARK-31039) Unable to use vendor specific datatypes with JDBC (MSSQL)

[ https://issues.apache.org/jira/browse/SPARK-31039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057497#comment-17057497 ] Hyukjin Kwon commented on SPARK-31039: -- When you describe an issue, it's best to be specific and

[jira] [Resolved] (SPARK-31110) refine sql doc for SELECT

[ https://issues.apache.org/jira/browse/SPARK-31110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31110. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27866

[jira] [Created] (SPARK-31127) Add abstract Selector

Huaxin Gao created SPARK-31127: -- Summary: Add abstract Selector Key: SPARK-31127 URL: https://issues.apache.org/jira/browse/SPARK-31127 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057472#comment-17057472 ] Dongjoon Hyun commented on SPARK-25987: --- I believe Janino is required in any way for stability,

[jira] [Created] (SPARK-31126) Upgrade Kafka to 2.4.1

Dongjoon Hyun created SPARK-31126: - Summary: Upgrade Kafka to 2.4.1 Key: SPARK-31126 URL: https://issues.apache.org/jira/browse/SPARK-31126 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057469#comment-17057469 ] John Lonergan commented on SPARK-19335: --- Streaming continous data from a fire hose source into a

[jira] [Resolved] (SPARK-31062) Improve Spark Decommissioning K8s test relability

[ https://issues.apache.org/jira/browse/SPARK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31062. -- Fix Version/s: 3.1.0 Resolution: Fixed > Improve Spark Decommissioning K8s test

[jira] [Created] (SPARK-31125) When processing new K8s state snapshots Spark treats Terminating nodes as terminated.

Holden Karau created SPARK-31125: Summary: When processing new K8s state snapshots Spark treats Terminating nodes as terminated. Key: SPARK-31125 URL: https://issues.apache.org/jira/browse/SPARK-31125

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057339#comment-17057339 ] L. C. Hsieh commented on SPARK-25987: - Hmm, thanks for checking, so currently we are not sure what

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057338#comment-17057338 ] Dongjoon Hyun commented on SPARK-25987: --- Yes. I agree that that was misleading. I removed the

[jira] [Commented] (SPARK-29183) Upgrade JDK 11 Installation to 11.0.6

[ https://issues.apache.org/jira/browse/SPARK-29183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057337#comment-17057337 ] Dongjoon Hyun commented on SPARK-29183: --- Thank you so much, [~shaneknapp]! > Upgrade JDK 11

[jira] [Closed] (SPARK-22523) Janino throws StackOverflowError on nested structs with many fields

[ https://issues.apache.org/jira/browse/SPARK-22523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-22523. - > Janino throws StackOverflowError on nested structs with many fields >

[jira] [Closed] (SPARK-22761) 64KB JVM bytecode limit problem with GLM

[ https://issues.apache.org/jira/browse/SPARK-22761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-22761. - > 64KB JVM bytecode limit problem with GLM > > >

[jira] [Updated] (SPARK-22523) Janino throws StackOverflowError on nested structs with many fields

[ https://issues.apache.org/jira/browse/SPARK-22523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22523: -- Parent: SPARK-22510 Issue Type: Sub-task (was: Bug) > Janino throws

[jira] [Commented] (SPARK-29183) Upgrade JDK 11 Installation to 11.0.6

[ https://issues.apache.org/jira/browse/SPARK-29183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057335#comment-17057335 ] Shane Knapp commented on SPARK-29183: - i'll get to this later this week/early next. > Upgrade JDK

[jira] [Assigned] (SPARK-29183) Upgrade JDK 11 Installation to 11.0.6

[ https://issues.apache.org/jira/browse/SPARK-29183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-29183: --- Assignee: Shane Knapp > Upgrade JDK 11 Installation to 11.0.6 >

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057334#comment-17057334 ] Dongjoon Hyun commented on SPARK-25987: --- Unfortunately, it seems that we need more patches from

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057330#comment-17057330 ] L. C. Hsieh commented on SPARK-25987: - Because I'm not sure how this got fixed. I can only see this

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057327#comment-17057327 ] Dongjoon Hyun commented on SPARK-25987: --- Do you mean in `branch-2.4`? Let me check that quickly.

[jira] [Assigned] (SPARK-31077) Remove ChiSqSelector dependency on mllib.ChiSqSelectorModel

[ https://issues.apache.org/jira/browse/SPARK-31077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-31077: Assignee: Huaxin Gao > Remove ChiSqSelector dependency on mllib.ChiSqSelectorModel >

[jira] [Resolved] (SPARK-31077) Remove ChiSqSelector dependency on mllib.ChiSqSelectorModel

[ https://issues.apache.org/jira/browse/SPARK-31077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31077. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27841

[jira] [Updated] (SPARK-31095) Upgrade netty-all to 4.1.47.Final

[ https://issues.apache.org/jira/browse/SPARK-31095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31095: -- Fix Version/s: 2.4.6 > Upgrade netty-all to 4.1.47.Final > -

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057309#comment-17057309 ] L. C. Hsieh commented on SPARK-25987: - Thanks [~dongjoon]. So upgrading Janino can fix this, right?

[jira] [Comment Edited] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057301#comment-17057301 ] Dongjoon Hyun edited comment on SPARK-25987 at 3/11/20, 6:29 PM: - Thank

[jira] [Resolved] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25987. --- Resolution: Duplicate > StackOverflowError when executing many operations on a table with

[jira] [Updated] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25987: -- Affects Version/s: (was: 3.0.0) 2.4.5 > StackOverflowError when

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057301#comment-17057301 ] Dongjoon Hyun commented on SPARK-25987: --- Thank you for commenting, [~viirya]. I confirmed that

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057283#comment-17057283 ] Dongjoon Hyun commented on SPARK-29295: --- I confirmed that Apache Spark 2.1.3 and older versions

[jira] [Updated] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29295: -- Affects Version/s: (was: 2.4.4) 2.4.5 > Duplicate result when

[jira] [Updated] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29295: -- Description: When we drop a partition of a external table and then overwrite it, if we set

[jira] [Updated] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29295: -- Affects Version/s: 2.2.3 > Duplicate result when dropping partition of an external table and

[jira] [Commented] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns

[ https://issues.apache.org/jira/browse/SPARK-25987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057280#comment-17057280 ] L. C. Hsieh commented on SPARK-25987: - Looks like Janino was upgraded, is this still an issue in

[jira] [Updated] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29295: -- Affects Version/s: 2.3.4 > Duplicate result when dropping partition of an external table and

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057260#comment-17057260 ] Dongjoon Hyun commented on SPARK-29295: --- I marked this as a `correctness` issue. > Duplicate

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057261#comment-17057261 ] Dongjoon Hyun commented on SPARK-29295: --- Hi, [~viirya]. Could you make a backport against

[jira] [Updated] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29295: -- Labels: correctness (was: ) > Duplicate result when dropping partition of an external table

[jira] [Commented] (SPARK-30989) TABLE.COLUMN reference doesn't work with new columns created by UDF

[ https://issues.apache.org/jira/browse/SPARK-30989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057255#comment-17057255 ] hemanth meka commented on SPARK-30989: -- The alias "cat" is defined as a dataframe having 2 columns

[jira] [Comment Edited] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057252#comment-17057252 ] Dongjoon Hyun edited comment on SPARK-25193 at 3/11/20, 5:37 PM: - This

[jira] [Updated] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25193: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Bug) > insert overwrite doesn't throw

[jira] [Resolved] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25193. --- Resolution: Duplicate This is fixed at 3.0.0 via SPARK-23710 > insert overwrite doesn't

[jira] [Reopened] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-25193: --- > insert overwrite doesn't throw exception when drop old data fails >

[jira] [Commented] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057251#comment-17057251 ] Dongjoon Hyun commented on SPARK-25193: --- I marked this as a correctness because the result after

[jira] [Updated] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25193: -- Labels: correctness (was: bulk-closed) > insert overwrite doesn't throw exception when drop

[jira] [Updated] (SPARK-31099) Create migration script for metastore_db

[ https://issues.apache.org/jira/browse/SPARK-31099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31099: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Create migration

[jira] [Commented] (SPARK-30565) Regression in the ORC benchmark

[ https://issues.apache.org/jira/browse/SPARK-30565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057224#comment-17057224 ] Peter Toth commented on SPARK-30565: I looked into this and the performance drop is due to the 1.2.1

[jira] [Commented] (SPARK-31099) Create migration script for metastore_db

[ https://issues.apache.org/jira/browse/SPARK-31099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057220#comment-17057220 ] Dongjoon Hyun commented on SPARK-31099: --- To [~kabhwan]. Yes. I mean that corner cases. It's the

[jira] [Closed] (SPARK-24640) size(null) returns null

[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-24640. - > size(null) returns null > > > Key: SPARK-24640 >

[jira] [Comment Edited] (SPARK-24640) size(null) returns null

[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057207#comment-17057207 ] Dongjoon Hyun edited comment on SPARK-24640 at 3/11/20, 4:57 PM: - This

[jira] [Updated] (SPARK-24640) size(null) returns null

[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24640: -- Fix Version/s: (was: 3.0.0) > size(null) returns null > > >

[jira] [Assigned] (SPARK-24640) size(null) returns null

[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-24640: - Assignee: (was: Maxim Gekk) > size(null) returns null >

[jira] [Resolved] (SPARK-24640) size(null) returns null

[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-24640. --- Resolution: Won't Do > size(null) returns null > > >

[jira] [Reopened] (SPARK-24640) size(null) returns null

[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-24640: --- This is reverted. > size(null) returns null > > >

[jira] [Resolved] (SPARK-31091) Revert SPARK-24640 "Return `NULL` from `size(NULL)` by default"

[ https://issues.apache.org/jira/browse/SPARK-31091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31091. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27834

[jira] [Updated] (SPARK-31076) Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via local date-time

[ https://issues.apache.org/jira/browse/SPARK-31076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31076: -- Labels: correctness (was: ) > Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via

[jira] [Commented] (SPARK-30935) Update MLlib, GraphX websites for 3.0

[ https://issues.apache.org/jira/browse/SPARK-30935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057154#comment-17057154 ] Huaxin Gao commented on SPARK-30935: cc [~podongfeng] I think all the docs are OK now. This can be

[jira] [Commented] (SPARK-30931) ML 3.0 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-30931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057146#comment-17057146 ] Huaxin Gao commented on SPARK-30931: cc [~podongfeng] I didn't see anything else need to be changed.

[jira] [Resolved] (SPARK-31117) reduce the test time of DateTimeUtilsSuite

[ https://issues.apache.org/jira/browse/SPARK-31117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31117. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27873

[jira] [Created] (SPARK-31124) change the default value of minPartitionNum in AQE

Wenchen Fan created SPARK-31124: --- Summary: change the default value of minPartitionNum in AQE Key: SPARK-31124 URL: https://issues.apache.org/jira/browse/SPARK-31124 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31081) Make the display of stageId/stageAttemptId/taskId of sql metrics configurable in UI

[ https://issues.apache.org/jira/browse/SPARK-31081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31081: - Summary: Make the display of stageId/stageAttemptId/taskId of sql metrics configurable in UI (was: Make

[jira] [Resolved] (SPARK-31041) Show Maven errors from within make-distribution.sh

[ https://issues.apache.org/jira/browse/SPARK-31041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31041. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27800

[jira] [Assigned] (SPARK-31041) Show Maven errors from within make-distribution.sh

[ https://issues.apache.org/jira/browse/SPARK-31041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-31041: Assignee: Nicholas Chammas > Show Maven errors from within make-distribution.sh >

[jira] [Assigned] (SPARK-31076) Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via local date-time

[ https://issues.apache.org/jira/browse/SPARK-31076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31076: --- Assignee: Maxim Gekk > Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via local

[jira] [Resolved] (SPARK-31076) Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via local date-time

[ https://issues.apache.org/jira/browse/SPARK-31076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31076. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27807

[jira] [Updated] (SPARK-31123) Drop does not work after join with aliases

[ https://issues.apache.org/jira/browse/SPARK-31123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikel San Vicente updated SPARK-31123: -- Description:   Hi, I am seeing a really strange behaviour in drop method after a

[jira] [Created] (SPARK-31123) Drop does not work after join with aliases

Mikel San Vicente created SPARK-31123: - Summary: Drop does not work after join with aliases Key: SPARK-31123 URL: https://issues.apache.org/jira/browse/SPARK-31123 Project: Spark Issue

[jira] [Commented] (SPARK-31074) Avro serializer should not fail when a nullable Spark field is written to a non-null Avro column

[ https://issues.apache.org/jira/browse/SPARK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056972#comment-17056972 ] Kyrill Alyoshin commented on SPARK-31074: - Yes, # Create a simple Avro schema file with 2

[jira] [Updated] (SPARK-31030) Backward Compatibility for Parsing and Formatting Datetime

[ https://issues.apache.org/jira/browse/SPARK-31030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-31030: Parent: SPARK-26904 Issue Type: Sub-task (was: Improvement) > Backward Compatibility for

[jira] [Deleted] (SPARK-31031) Backward Compatibility for Parsing Datetime

[ https://issues.apache.org/jira/browse/SPARK-31031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan deleted SPARK-31031: > Backward Compatibility for Parsing Datetime > --- > >

[jira] [Resolved] (SPARK-31111) Fix interval output issue in ExtractBenchmark

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-3. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27867

[jira] [Assigned] (SPARK-31111) Fix interval output issue in ExtractBenchmark

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-3: --- Assignee: Kent Yao > Fix interval output issue in ExtractBenchmark >

[jira] [Created] (SPARK-31122) Add support for sparse matrix multiplication

Alex Favaro created SPARK-31122: --- Summary: Add support for sparse matrix multiplication Key: SPARK-31122 URL: https://issues.apache.org/jira/browse/SPARK-31122 Project: Spark Issue Type: New

  1   2   >