[jira] [Resolved] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34543. - Fix Version/s: 3.1.2 3.0.3 3.2.0 Resolution: Fixed

[jira] [Assigned] (SPARK-34550) Skip InSet null value during push filter to Hive metastore

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34550: Assignee: Apache Spark > Skip InSet null value during push filter to Hive metastore >

[jira] [Assigned] (SPARK-34550) Skip InSet null value during push filter to Hive metastore

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34550: Assignee: (was: Apache Spark) > Skip InSet null value during push filter to Hive

[jira] [Commented] (SPARK-34550) Skip InSet null value during push filter to Hive metastore

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291434#comment-17291434 ] Apache Spark commented on SPARK-34550: -- User 'ulysses-you' has created a pull request for this

[jira] [Created] (SPARK-34550) Skip InSet null value during push filter to Hive metastore

2021-02-25 Thread ulysses you (Jira)
ulysses you created SPARK-34550: --- Summary: Skip InSet null value during push filter to Hive metastore Key: SPARK-34550 URL: https://issues.apache.org/jira/browse/SPARK-34550 Project: Spark

[jira] [Assigned] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34549: Assignee: L. C. Hsieh (was: Apache Spark) > Upgrade aws kinesis to 1.14.0 and java sdk

[jira] [Assigned] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34549: Assignee: Apache Spark (was: L. C. Hsieh) > Upgrade aws kinesis to 1.14.0 and java sdk

[jira] [Commented] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291410#comment-17291410 ] Apache Spark commented on SPARK-34549: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291409#comment-17291409 ] Apache Spark commented on SPARK-34549: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

2021-02-25 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34549: --- Summary: Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844 Key: SPARK-34549 URL: https://issues.apache.org/jira/browse/SPARK-34549 Project: Spark Issue

[jira] [Comment Edited] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291378#comment-17291378 ] zhengruifeng edited comment on SPARK-34448 at 2/26/21, 4:58 AM:

[jira] [Comment Edited] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291378#comment-17291378 ] zhengruifeng edited comment on SPARK-34448 at 2/26/21, 4:56 AM:

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291384#comment-17291384 ] zhengruifeng commented on SPARK-34448: -- My test code and log is here > Binary logistic regression

[jira] [Comment Edited] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291384#comment-17291384 ] zhengruifeng edited comment on SPARK-34448 at 2/26/21, 4:41 AM: My test

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291383#comment-17291383 ] Apache Spark commented on SPARK-34448: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34448: Assignee: (was: Apache Spark) > Binary logistic regression incorrectly computes the

[jira] [Assigned] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34448: Assignee: Apache Spark > Binary logistic regression incorrectly computes the intercept

[jira] [Comment Edited] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291378#comment-17291378 ] zhengruifeng edited comment on SPARK-34448 at 2/26/21, 4:33 AM:

[jira] [Comment Edited] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291378#comment-17291378 ] zhengruifeng edited comment on SPARK-34448 at 2/26/21, 4:30 AM:

[jira] [Comment Edited] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291378#comment-17291378 ] zhengruifeng edited comment on SPARK-34448 at 2/26/21, 4:29 AM:

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291378#comment-17291378 ] zhengruifeng commented on SPARK-34448: -- [~srowen] [~weichenxu123]  [~ykerzhner] My findings until

[jira] [Comment Edited] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290927#comment-17290927 ] Yikun Jiang edited comment on SPARK-34539 at 2/26/21, 4:07 AM: --- And some

[jira] [Assigned] (SPARK-34548) Remove unnecessary children from Union under Distince and Deduplicate

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34548: Assignee: L. C. Hsieh (was: Apache Spark) > Remove unnecessary children from Union

[jira] [Assigned] (SPARK-34548) Remove unnecessary children from Union under Distince and Deduplicate

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34548: Assignee: Apache Spark (was: L. C. Hsieh) > Remove unnecessary children from Union

[jira] [Commented] (SPARK-34548) Remove unnecessary children from Union under Distince and Deduplicate

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291359#comment-17291359 ] Apache Spark commented on SPARK-34548: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-34548) Remove unnecessary children from Union under Distince and Deduplicate

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291360#comment-17291360 ] Apache Spark commented on SPARK-34548: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-34548) Remove unnecessary children from Union under Distince and Deduplicate

2021-02-25 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34548: --- Summary: Remove unnecessary children from Union under Distince and Deduplicate Key: SPARK-34548 URL: https://issues.apache.org/jira/browse/SPARK-34548 Project: Spark

[jira] [Assigned] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32617: Assignee: Apache Spark > Upgrade kubernetes client version to support latest minikube

[jira] [Assigned] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32617: Assignee: (was: Apache Spark) > Upgrade kubernetes client version to support latest

[jira] [Commented] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291326#comment-17291326 ] Dongjoon Hyun commented on SPARK-32617: --- BTW, the issue title is wrong. K8s IT works with all the

[jira] [Commented] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291325#comment-17291325 ] Dongjoon Hyun commented on SPARK-32617: --- The commit is reverted because it breaks IT when

[jira] [Updated] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32617: -- Fix Version/s: (was: 3.2.0) > Upgrade kubernetes client version to support latest

[jira] [Reopened] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-32617: --- Assignee: (was: Attila Zsolt Piros) > Upgrade kubernetes client version to support

[jira] [Updated] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2021-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34541: - Fix Version/s: (was: 3.0.0) > Fixed an issue where data could not be cleaned up when

[jira] [Commented] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291321#comment-17291321 ] Apache Spark commented on SPARK-32617: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

2021-02-25 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291311#comment-17291311 ] Guillaume Martres commented on SPARK-34507: --- > I think scala-2.13 profile should overrdie this

[jira] [Updated] (SPARK-34436) DPP support LIKE ANY/ALL

2021-02-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34436: Issue Type: Bug (was: Improvement) > DPP support LIKE ANY/ALL > > >

[jira] [Resolved] (SPARK-34535) Cleanup unused symbol in Orc related code

2021-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34535. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31644

[jira] [Assigned] (SPARK-34535) Cleanup unused symbol in Orc related code

2021-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34535: Assignee: Yang Jie > Cleanup unused symbol in Orc related code >

[jira] [Assigned] (SPARK-34547) Resolve using child metadata attributes as fallback

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34547: Assignee: (was: Apache Spark) > Resolve using child metadata attributes as fallback

[jira] [Commented] (SPARK-34547) Resolve using child metadata attributes as fallback

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291307#comment-17291307 ] Apache Spark commented on SPARK-34547: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34547) Resolve using child metadata attributes as fallback

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34547: Assignee: Apache Spark > Resolve using child metadata attributes as fallback >

[jira] [Created] (SPARK-34547) Resolve using child metadata attributes as fallback

2021-02-25 Thread Karen Feng (Jira)
Karen Feng created SPARK-34547: -- Summary: Resolve using child metadata attributes as fallback Key: SPARK-34547 URL: https://issues.apache.org/jira/browse/SPARK-34547 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34547) Resolve using child metadata attributes as fallback

2021-02-25 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291303#comment-17291303 ] Karen Feng commented on SPARK-34547: I'm working on this. > Resolve using child metadata attributes

[jira] [Resolved] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34507. --- Resolution: Not A Problem > Spark artefacts built against Scala 2.13 incorrectly depend on

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291300#comment-17291300 ] Dongjoon Hyun commented on SPARK-34507: --- I'll resolved for now as `Not A Problem`. Please feel

[jira] [Closed] (SPARK-34098) HadoopVersionInfoSuite faild when maven test in Scala 2.13

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-34098. - > HadoopVersionInfoSuite faild when maven test in Scala 2.13 >

[jira] [Resolved] (SPARK-34098) HadoopVersionInfoSuite faild when maven test in Scala 2.13

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34098. --- Resolution: Not A Problem > HadoopVersionInfoSuite faild when maven test in Scala 2.13 >

[jira] [Commented] (SPARK-34098) HadoopVersionInfoSuite faild when maven test in Scala 2.13

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291299#comment-17291299 ] Dongjoon Hyun commented on SPARK-34098: --- Thank you for reporting and analyzing, [~LuciferYang].

[jira] [Closed] (SPARK-34258) Upgrade Scala to avoid Scala's bug about illegal cyclic reference

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-34258. - > Upgrade Scala to avoid Scala's bug about illegal cyclic reference >

[jira] [Resolved] (SPARK-34258) Upgrade Scala to avoid Scala's bug about illegal cyclic reference

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34258. --- Resolution: Duplicate This is fixed by SPARK-34505 via upgrading to Scala 2.13.5. - 

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291295#comment-17291295 ] Dongjoon Hyun commented on SPARK-34507: --- Hi, [~smarter]. When Apache Spark 2.4 publishes both

[jira] [Assigned] (SPARK-34505) Upgrade Scala to 2.13.5

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34505: - Assignee: Dongjoon Hyun > Upgrade Scala to 2.13.5 > --- > >

[jira] [Resolved] (SPARK-34505) Upgrade Scala to 2.13.5

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34505. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31620

[jira] [Commented] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291221#comment-17291221 ] Apache Spark commented on SPARK-33832: -- User 'ekoifman' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34474) Remove unnecessary Union under Distinct like operators

2021-02-25 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34474. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31595

[jira] [Commented] (SPARK-34545) PySpark Python UDF return inconsistent results when applying 2 UDFs with different return type to 2 columns together

2021-02-25 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291164#comment-17291164 ] Sanket Reddy commented on SPARK-34545: -- cc [~hyukjin.kwon] > PySpark Python UDF return

[jira] [Updated] (SPARK-34545) PySpark Python UDF return inconsistent results when applying 2 UDFs with different return type to 2 columns together

2021-02-25 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-34545: Summary: PySpark Python UDF return inconsistent results when applying 2 UDFs with different

[jira] [Updated] (SPARK-30228) Update zstd-jni to 1.4.4-3

2021-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30228: -- Fix Version/s: 2.4.8 > Update zstd-jni to 1.4.4-3 > -- > >

[jira] [Commented] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291120#comment-17291120 ] Apache Spark commented on SPARK-34546: -- User 'imback82' has created a pull request for this issue:

[jira] [Commented] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291123#comment-17291123 ] Apache Spark commented on SPARK-34546: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34546: Assignee: Apache Spark > AlterViewAs.query should be analyzed during the analysis phase

[jira] [Assigned] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34546: Assignee: (was: Apache Spark) > AlterViewAs.query should be analyzed during the

[jira] [Created] (SPARK-34546) AlterViewAs.query should be analyzed during the analysis phase

2021-02-25 Thread Terry Kim (Jira)
Terry Kim created SPARK-34546: - Summary: AlterViewAs.query should be analyzed during the analysis phase Key: SPARK-34546 URL: https://issues.apache.org/jira/browse/SPARK-34546 Project: Spark

[jira] [Updated] (SPARK-34545) PySpark Python UDF return inconsistent results when applying UDFs to 2 columns together

2021-02-25 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-34545: Description: Python UDF returns inconsistent results between evaluating 2 columns together and

[jira] [Created] (SPARK-34545) PySpark Python UDF return inconsistent results when applying UDFs to 2 columns together

2021-02-25 Thread Baohe Zhang (Jira)
Baohe Zhang created SPARK-34545: --- Summary: PySpark Python UDF return inconsistent results when applying UDFs to 2 columns together Key: SPARK-34545 URL: https://issues.apache.org/jira/browse/SPARK-34545

[jira] [Updated] (SPARK-34545) PySpark Python UDF return inconsistent results when applying UDFs to 2 columns together

2021-02-25 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-34545: Priority: Critical (was: Major) > PySpark Python UDF return inconsistent results when applying

[jira] [Updated] (SPARK-34545) PySpark Python UDF return inconsistent results when applying UDFs to 2 columns together

2021-02-25 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-34545: Component/s: SQL > PySpark Python UDF return inconsistent results when applying UDFs to 2 >

[jira] [Updated] (SPARK-34545) PySpark Python UDF return inconsistent results when applying UDFs to 2 columns together

2021-02-25 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-34545: Description: Python UDF returns inconsistent results between evaluating 2 columns together and

[jira] [Commented] (SPARK-34092) support filtering by task status in REST API call for a specific stage

2021-02-25 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291067#comment-17291067 ] Ron Hu commented on SPARK-34092: We clarified the need for query parameter taskStatus for a specific

[jira] [Updated] (SPARK-34092) support filtering by task status in REST API call for a specific stage

2021-02-25 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-34092: --- Description: When we want to get a specific stage's detail info with task information, it will return all

[jira] [Commented] (SPARK-34544) pyspark toPandas() should return pd.DataFrame

2021-02-25 Thread Daniel Himmelstein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291040#comment-17291040 ] Daniel Himmelstein commented on SPARK-34544: SPARK-34540 is an example. 

[jira] [Commented] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291034#comment-17291034 ] Apache Spark commented on SPARK-34543: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291033#comment-17291033 ] Apache Spark commented on SPARK-34543: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34543: Assignee: Maxim Gekk (was: Apache Spark) > Respect case sensitivity in V1 ALTER TABLE

[jira] [Assigned] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34543: Assignee: Apache Spark (was: Maxim Gekk) > Respect case sensitivity in V1 ALTER TABLE

[jira] [Created] (SPARK-34544) pyspark toPandas() should return pd.DataFrame

2021-02-25 Thread Rafal Wojdyla (Jira)
Rafal Wojdyla created SPARK-34544: - Summary: pyspark toPandas() should return pd.DataFrame Key: SPARK-34544 URL: https://issues.apache.org/jira/browse/SPARK-34544 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34152) CreateViewStatement.child should be a real child

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291005#comment-17291005 ] Apache Spark commented on SPARK-34152: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34543: --- Fix Version/s: (was: 3.0.2) (was: 2.4.8) (was:

[jira] [Updated] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34543: --- Affects Version/s: (was: 3.0.1) (was: 3.1.0)

[jira] [Updated] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34543: --- Description: SHOW PARTITIONS is case sensitive, and doesn't respect the SQL config

[jira] [Created] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34543: -- Summary: Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION Key: SPARK-34543 URL: https://issues.apache.org/jira/browse/SPARK-34543 Project: Spark Issue

[jira] [Assigned] (SPARK-34542) Upgrade Parquet to 1.12.0

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34542: Assignee: Apache Spark > Upgrade Parquet to 1.12.0 > - > >

[jira] [Assigned] (SPARK-34542) Upgrade Parquet to 1.12.0

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34542: Assignee: (was: Apache Spark) > Upgrade Parquet to 1.12.0 >

[jira] [Commented] (SPARK-34542) Upgrade Parquet to 1.12.0

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290982#comment-17290982 ] Apache Spark commented on SPARK-34542: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-34542) Upgrade Parquet to 1.12.0

2021-02-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34542: --- Summary: Upgrade Parquet to 1.12.0 Key: SPARK-34542 URL: https://issues.apache.org/jira/browse/SPARK-34542 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290934#comment-17290934 ] Apache Spark commented on SPARK-34541: -- User 'yikf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34541: Assignee: Apache Spark > Fixed an issue where data could not be cleaned up when

[jira] [Assigned] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34541: Assignee: (was: Apache Spark) > Fixed an issue where data could not be cleaned up

[jira] [Commented] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290927#comment-17290927 ] Yikun Jiang commented on SPARK-34539: - And some Zinc description on spark site should also be

[jira] [Commented] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290923#comment-17290923 ] Yikun Jiang commented on SPARK-34539: - [~srowen] Thanks for the reminder, I change the "Type" to

[jira] [Updated] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-34539: Issue Type: Improvement (was: Bug) > Zinc standalone server is useless after scala-maven-plugin

[jira] [Commented] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290913#comment-17290913 ] Sean R. Owen commented on SPARK-34539: -- Is this a "bug"? what problem does it cause? builds seem to

[jira] [Created] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2021-02-25 Thread yikf (Jira)
yikf created SPARK-34541: Summary: Fixed an issue where data could not be cleaned up when unregisterShuffle Key: SPARK-34541 URL: https://issues.apache.org/jira/browse/SPARK-34541 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-33537) Hive Metastore filter pushdown improvement

2021-02-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33537: Comment: was deleted (was: User 'ulysses-you' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34539: Assignee: Apache Spark > Zinc standalone server is useless after scala-maven-plugin 4.x

[jira] [Commented] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290896#comment-17290896 ] Apache Spark commented on SPARK-34539: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290895#comment-17290895 ] Apache Spark commented on SPARK-34539: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34539: Assignee: (was: Apache Spark) > Zinc standalone server is useless after

[jira] [Updated] (SPARK-34539) Zinc standalone server is useless after scala-maven-plugin 4.x

2021-02-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-34539: Attachment: [SPARK-34539] Zinc standalone server is useless after scala-maven-plugin 4.x.pdf >

  1   2   >