[jira] [Commented] (SPARK-36860) Create the external hive table for HBase failed

2021-09-26 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420483#comment-17420483 ] Kousuke Saruta commented on SPARK-36860: [~yimo_yym] Spark doesn't support creating Hive table

[jira] [Commented] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420482#comment-17420482 ] Apache Spark commented on SPARK-36856: -- User 'copperybean' has created a pull request for this

[jira] [Commented] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420481#comment-17420481 ] Apache Spark commented on SPARK-36856: -- User 'copperybean' has created a pull request for this

[jira] [Assigned] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36856: Assignee: Apache Spark > Building by "./build/mvn" may be stuck on MacOS >

[jira] [Assigned] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36856: Assignee: (was: Apache Spark) > Building by "./build/mvn" may be stuck on MacOS >

[jira] [Updated] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

2021-09-26 Thread copperybean (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] copperybean updated SPARK-36856: Priority: Major (was: Minor) > Building by "./build/mvn" may be stuck on MacOS >

[jira] [Resolved] (SPARK-36740) collection operators should handle duplicated NaN

2021-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36740. - Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed > collection

[jira] [Commented] (SPARK-36835) Spark 3.2.0 POMs are no longer "dependency reduced"

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420473#comment-17420473 ] Apache Spark commented on SPARK-36835: -- User 'sunchao' has created a pull request for this issue:

[jira] [Created] (SPARK-36860) Create the external hive table for HBase failed

2021-09-26 Thread wineternity (Jira)
wineternity created SPARK-36860: --- Summary: Create the external hive table for HBase failed Key: SPARK-36860 URL: https://issues.apache.org/jira/browse/SPARK-36860 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36838) Improve InSet NaN check generated code performance

2021-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36838: - Priority: Minor (was: Major) > Improve InSet NaN check generated code performance >

[jira] [Resolved] (SPARK-36838) Improve InSet NaN check generated code performance

2021-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36838. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34097

[jira] [Updated] (SPARK-36838) Improve InSet NaN check generated code performance

2021-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36838: - Issue Type: Improvement (was: Bug) > Improve InSet NaN check generated code performance >

[jira] [Commented] (SPARK-36853) Code failing on checkstyle

2021-09-26 Thread Shockang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420438#comment-17420438 ] Shockang commented on SPARK-36853: -- OK > Code failing on checkstyle > -- > >

[jira] [Reopened] (SPARK-36853) Code failing on checkstyle

2021-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-36853: -- > Code failing on checkstyle > -- > > Key: SPARK-36853 >

[jira] [Commented] (SPARK-36853) Code failing on checkstyle

2021-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420417#comment-17420417 ] Hyukjin Kwon commented on SPARK-36853: -- okay, they look valid. I don't know why they are not caught

[jira] [Assigned] (SPARK-36859) Upgrade kubernetes-client to 5.8.0

2021-09-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36859: - Assignee: Dongjoon Hyun > Upgrade kubernetes-client to 5.8.0 >

[jira] [Resolved] (SPARK-36859) Upgrade kubernetes-client to 5.8.0

2021-09-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36859. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34109

[jira] [Commented] (SPARK-36802) Incorrect writing the string, containing symbols like "\" to Hive

2021-09-26 Thread Vladislav (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420397#comment-17420397 ] Vladislav commented on SPARK-36802: --- [~hyukjin.kwon], 3.x has the same problem. > Incorrect writing

[jira] [Commented] (SPARK-36859) Upgrade kubernetes-client to 5.8.0

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420383#comment-17420383 ] Apache Spark commented on SPARK-36859: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36859) Upgrade kubernetes-client to 5.8.0

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36859: Assignee: (was: Apache Spark) > Upgrade kubernetes-client to 5.8.0 >

[jira] [Assigned] (SPARK-36859) Upgrade kubernetes-client to 5.8.0

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36859: Assignee: Apache Spark > Upgrade kubernetes-client to 5.8.0 >

[jira] [Commented] (SPARK-36859) Upgrade kubernetes-client to 5.8.0

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420382#comment-17420382 ] Apache Spark commented on SPARK-36859: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-36859) Upgrade kubernetes-client to 5.8.0

2021-09-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36859: - Summary: Upgrade kubernetes-client to 5.8.0 Key: SPARK-36859 URL: https://issues.apache.org/jira/browse/SPARK-36859 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-36858) Spark API to apply same function to multiple columns

2021-09-26 Thread Armand BERGES (Jira)
Armand BERGES created SPARK-36858: - Summary: Spark API to apply same function to multiple columns Key: SPARK-36858 URL: https://issues.apache.org/jira/browse/SPARK-36858 Project: Spark Issue

[jira] [Comment Edited] (SPARK-36694) Unable to build Spark on Azure DevOps with ubuntu-latest

2021-09-26 Thread Armand BERGES (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420327#comment-17420327 ] Armand BERGES edited comment on SPARK-36694 at 9/26/21, 4:28 PM: - Didn't

[jira] [Reopened] (SPARK-36694) Unable to build Spark on Azure DevOps with ubuntu-latest

2021-09-26 Thread Armand BERGES (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Armand BERGES reopened SPARK-36694: --- Didn't last answer from [~sarutak], just answer now. > Unable to build Spark on Azure DevOps

[jira] [Commented] (SPARK-36694) Unable to build Spark on Azure DevOps with ubuntu-latest

2021-09-26 Thread Armand BERGES (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420326#comment-17420326 ] Armand BERGES commented on SPARK-36694: --- [~sarutak] is there any command you want me to test to

[jira] [Commented] (SPARK-36826) CVEs in libraries used in bundled jars

2021-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420296#comment-17420296 ] Sean R. Owen commented on SPARK-36826: -- A few things here - Static analysis output like this has

[jira] [Resolved] (SPARK-36826) CVEs in libraries used in bundled jars

2021-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36826. -- Resolution: Not A Problem > CVEs in libraries used in bundled jars >

[jira] [Commented] (SPARK-31602) memory leak of JobConf

2021-09-26 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420286#comment-17420286 ] muhong commented on SPARK-31602: we meet the same question on the spark driver side,but not find the

[jira] [Assigned] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

2021-09-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36851: -- Assignee: Peng Lei > Incorrect parsing of negative ANSI typed interval literals >

[jira] [Resolved] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

2021-09-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36851. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34107

[jira] [Updated] (SPARK-36857) structured streaming support backpressure for kafka source

2021-09-26 Thread baizhendong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] baizhendong updated SPARK-36857: Description: Spark streaming support backpressure for kafka, but in structured streaming, not

[jira] [Created] (SPARK-36857) structured streaming support backpressure for kafka source

2021-09-26 Thread baizhendong (Jira)
baizhendong created SPARK-36857: --- Summary: structured streaming support backpressure for kafka source Key: SPARK-36857 URL: https://issues.apache.org/jira/browse/SPARK-36857 Project: Spark

[jira] [Commented] (SPARK-36853) Code failing on checkstyle

2021-09-26 Thread Abhinav Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420258#comment-17420258 ] Abhinav Kumar commented on SPARK-36853: --- This error in thrown in Windows in Maven installing

[jira] [Created] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

2021-09-26 Thread copperybean (Jira)
copperybean created SPARK-36856: --- Summary: Building by "./build/mvn" may be stuck on MacOS Key: SPARK-36856 URL: https://issues.apache.org/jira/browse/SPARK-36856 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36855) Uniformly execute the mergeContinuousShuffleBlockIdsIfNeeded method first

2021-09-26 Thread jinhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinhai updated SPARK-36855: --- Description: In the ShuffleBlockFetcherIterator.partitionBlocksByFetchMode method, both local and

[jira] [Updated] (SPARK-36855) Uniformly execute the mergeContinuousShuffleBlockIdsIfNeeded method first

2021-09-26 Thread jinhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinhai updated SPARK-36855: --- Description: In the ShuffleBlockFetcherIterator.partitionBlocksByFetchMode method, both local and

[jira] [Created] (SPARK-36855) Uniformly execute the mergeContinuousShuffleBlockIdsIfNeeded method first

2021-09-26 Thread jinhai (Jira)
jinhai created SPARK-36855: -- Summary: Uniformly execute the mergeContinuousShuffleBlockIdsIfNeeded method first Key: SPARK-36855 URL: https://issues.apache.org/jira/browse/SPARK-36855 Project: Spark

[jira] [Commented] (SPARK-36638) Generalize OptimizeSkewedJoin

2021-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420215#comment-17420215 ] Apache Spark commented on SPARK-36638: -- User 'zhengruifeng' has created a pull request for this