[jira] [Resolved] (SPARK-29831) Scan Hive partitioned table should not dramatically increase data parallelism

[ https://issues.apache.org/jira/browse/SPARK-29831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-29831. - Resolution: Won't Fix > Scan Hive partitioned table should not dramatically increase data

[jira] [Commented] (SPARK-27721) spark ./build/mvn test failed on aarch64

[ https://issues.apache.org/jira/browse/SPARK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979938#comment-16979938 ] huangtianhua commented on SPARK-27721: -- Will add a profile to switch to use leveldbjni base on the

[jira] [Commented] (SPARK-29900) make relation lookup behavior consistent within Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979936#comment-16979936 ] Terry Kim commented on SPARK-29900: --- Thanks for the clarification [~cloud_fan]! I am aiming to send

[jira] [Commented] (SPARK-29900) make relation lookup behavior consistent within Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979927#comment-16979927 ] Wenchen Fan commented on SPARK-29900: - Temp view is special. It's per session. All the single-part

[jira] [Commented] (SPARK-29966) Add version method in TableCatalog to avoid load table twice

[ https://issues.apache.org/jira/browse/SPARK-29966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979926#comment-16979926 ] Terry Kim commented on SPARK-29966: --- Sure. You meant to change the implementation to look up once

[jira] [Updated] (SPARK-27721) spark ./build/mvn test failed on aarch64

[ https://issues.apache.org/jira/browse/SPARK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangtianhua updated SPARK-27721: - Issue Type: Improvement (was: Question) > spark ./build/mvn test failed on aarch64 >

[jira] [Reopened] (SPARK-27721) spark ./build/mvn test failed on aarch64

[ https://issues.apache.org/jira/browse/SPARK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangtianhua reopened SPARK-27721: -- Unfortunately, the repository [https://github.com/fusesource/leveldbjni] is unmaintaining after

[jira] [Commented] (SPARK-29966) Add version method in TableCatalog to avoid load table twice

[ https://issues.apache.org/jira/browse/SPARK-29966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979911#comment-16979911 ] Wenchen Fan commented on SPARK-29966: - Forgot to mention that I also -1 on changing the public API

[jira] [Comment Edited] (SPARK-29900) make relation lookup behavior consistent within Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979762#comment-16979762 ] Terry Kim edited comment on SPARK-29900 at 11/22/19 6:28 AM: - [~cloud_fan],

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979888#comment-16979888 ] zhang liming commented on SPARK-29995: -- Ok,thanks for your reply. > Structured Streaming file-sink

[jira] [Issue Comment Deleted] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang liming updated SPARK-29995: - Comment: was deleted (was: 好的，谢谢你的回复) > Structured Streaming file-sink log grow indefinitely >

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979886#comment-16979886 ] zhang liming commented on SPARK-29995: -- 好的，谢谢你的回复 > Structured Streaming file-sink log grow

[jira] [Created] (SPARK-29996) Add v2 command exec check in adaptive

ulysses you created SPARK-29996: --- Summary: Add v2 command exec check in adaptive Key: SPARK-29996 URL: https://issues.apache.org/jira/browse/SPARK-29996 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979870#comment-16979870 ] Jungtaek Lim commented on SPARK-29995: -- Btw, SPARK-27188 is the approach to solve this issue what I

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979869#comment-16979869 ] Jungtaek Lim commented on SPARK-29995: -- Removing myself in Shepherd - that's mostly used for SPIP

[jira] [Commented] (SPARK-29226) Upgrade jackson-databind to 2.9.10 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979868#comment-16979868 ] Lars Francke commented on SPARK-29226: -- Thanks for the quick follow-up. I did not create a Jira

[jira] [Updated] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29995: - Shepherd: (was: Jungtaek Lim) > Structured Streaming file-sink log grow indefinitely >

[jira] [Resolved] (SPARK-29962) Avoid changing merge join to broadcast join if one side is non-shuffle and the other side can be broadcast

[ https://issues.apache.org/jira/browse/SPARK-29962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-29962. - Resolution: Invalid > Avoid changing merge join to broadcast join if one side is non-shuffle

[jira] [Updated] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang liming updated SPARK-29995: - Description: When i use structured streaming parquet sink, I've noticed that the File-Sink-Log

[jira] [Updated] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang liming updated SPARK-29995: - Attachment: file.png > Structured Streaming file-sink log grow indefinitely >

[jira] [Updated] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang liming updated SPARK-29995: - Attachment: task.png > Structured Streaming file-sink log grow indefinitely >

[jira] [Updated] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang liming updated SPARK-29995: - Description: When i use structured streaming parquet sink, I've noticed that the File-Sink-Log

[jira] [Created] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

zhang liming created SPARK-29995: Summary: Structured Streaming file-sink log grow indefinitely Key: SPARK-29995 URL: https://issues.apache.org/jira/browse/SPARK-29995 Project: Spark Issue

[jira] [Created] (SPARK-29994) Add WILDCARD task location

Wei Xue created SPARK-29994: --- Summary: Add WILDCARD task location Key: SPARK-29994 URL: https://issues.apache.org/jira/browse/SPARK-29994 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-29993) Avoid continuous warn log in get record and offset from Kafka

wenxuanguan created SPARK-29993: --- Summary: Avoid continuous warn log in get record and offset from Kafka Key: SPARK-29993 URL: https://issues.apache.org/jira/browse/SPARK-29993 Project: Spark

[jira] [Assigned] (SPARK-29248) Pass in number of partitions to BuildWriter

[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29248: --- Assignee: Ximo Guanter > Pass in number of partitions to BuildWriter >

[jira] [Commented] (SPARK-29992) Make access to getActive public

[ https://issues.apache.org/jira/browse/SPARK-29992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979794#comment-16979794 ] Nishkam Ravi commented on SPARK-29992: -- [https://github.com/apache/spark/pull/26631] > Make access

[jira] [Created] (SPARK-29992) Make access to getActive public

Nishkam Ravi created SPARK-29992: Summary: Make access to getActive public Key: SPARK-29992 URL: https://issues.apache.org/jira/browse/SPARK-29992 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-29900) make relation lookup behavior consistent within Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979762#comment-16979762 ] Terry Kim edited comment on SPARK-29900 at 11/22/19 2:35 AM: - [~cloud_fan],

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979784#comment-16979784 ] WuZeyi commented on SPARK-29553: I also try the cmd "export OPENBLAS_NUM_THREADS=1", but it doesn't

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979781#comment-16979781 ] WuZeyi commented on SPARK-29553: [~srowen] I set it in the spark/conf/spark-env.sh which machine my

[jira] [Comment Edited] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979781#comment-16979781 ] WuZeyi edited comment on SPARK-29553 at 11/22/19 2:29 AM: -- [~srowen] I set it

[jira] [Comment Edited] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979775#comment-16979775 ] WuZeyi edited comment on SPARK-29553 at 11/22/19 2:18 AM: -- [~srowen]  But if I

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979778#comment-16979778 ] Sean R. Owen commented on SPARK-29553: -- You're not getting what I'm saying. You set this entry in

[jira] [Resolved] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29553. -- Resolution: Not A Problem > This problemis about using native BLAS to improvement ML/MLLIB

[jira] [Comment Edited] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979775#comment-16979775 ] WuZeyi edited comment on SPARK-29553 at 11/22/19 2:10 AM: -- But if I set it with

[jira] [Comment Edited] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979775#comment-16979775 ] WuZeyi edited comment on SPARK-29553 at 11/22/19 2:10 AM: -- [~srowen]  But if I

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979775#comment-16979775 ] WuZeyi commented on SPARK-29553: But if I set it with spark.env, it doesn't take effact on executors.If

[jira] [Comment Edited] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979775#comment-16979775 ] WuZeyi edited comment on SPARK-29553 at 11/22/19 2:09 AM: -- But if I set it with

[jira] [Resolved] (SPARK-29975) introduce --CONFIG_DIM directive

[ https://issues.apache.org/jira/browse/SPARK-29975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29975. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26612

[jira] [Commented] (SPARK-29900) make relation lookup behavior consistent within Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979762#comment-16979762 ] Terry Kim commented on SPARK-29900: --- [~cloud_fan], what's the expected behavior for v2 catalogs? Will

[jira] [Comment Edited] (SPARK-29226) Upgrade jackson-databind to 2.9.10 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979706#comment-16979706 ] Dongjoon Hyun edited comment on SPARK-29226 at 11/21/19 11:51 PM: --

[jira] [Commented] (SPARK-29226) Upgrade jackson-databind to 2.9.10 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979707#comment-16979707 ] Dongjoon Hyun commented on SPARK-29226: --- Also, SPARK-29483 already bumps Jackson to 2.10.0. >

[jira] [Commented] (SPARK-29226) Upgrade jackson-databind to 2.9.10 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979706#comment-16979706 ] Dongjoon Hyun commented on SPARK-29226: --- Thank you for reporting, [~larsfrancke]. I'll follow up

[jira] [Commented] (SPARK-29966) Add version method in TableCatalog to avoid load table twice

[ https://issues.apache.org/jira/browse/SPARK-29966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979698#comment-16979698 ] Terry Kim commented on SPARK-29966: --- I agree with [~rdblue] that this should be handled in the

[jira] [Commented] (SPARK-29226) Upgrade jackson-databind to 2.9.10 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979697#comment-16979697 ] Lars Francke commented on SPARK-29226: -- This causes the following exception for me:   {code:java}

[jira] [Created] (SPARK-29991) Support `hive-1.2/2.3` in PR Builder

Dongjoon Hyun created SPARK-29991: - Summary: Support `hive-1.2/2.3` in PR Builder Key: SPARK-29991 URL: https://issues.apache.org/jira/browse/SPARK-29991 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-29988) Adjust Jenkins jobs for `hive-1.2/2.3` combination

[ https://issues.apache.org/jira/browse/SPARK-29988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-29988: --- Assignee: Shane Knapp > Adjust Jenkins jobs for `hive-1.2/2.3` combination >

[jira] [Created] (SPARK-29990) Pandas UDF including numpy sort operation not working with multi-dimensional array column

Dean Wyatte created SPARK-29990: --- Summary: Pandas UDF including numpy sort operation not working with multi-dimensional array column Key: SPARK-29990 URL: https://issues.apache.org/jira/browse/SPARK-29990

[jira] [Commented] (SPARK-29558) ResolveTables and ResolveRelations should be order-insensitive

[ https://issues.apache.org/jira/browse/SPARK-29558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979455#comment-16979455 ] Ryan Blue commented on SPARK-29558: --- Thanks for fixing this, [~cloud_fan]! > ResolveTables and

[jira] [Resolved] (SPARK-29558) ResolveTables and ResolveRelations should be order-insensitive

[ https://issues.apache.org/jira/browse/SPARK-29558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue resolved SPARK-29558. --- Fix Version/s: 3.0.0 Resolution: Fixed > ResolveTables and ResolveRelations should be

[jira] [Created] (SPARK-29989) Update release-script for `hive-1.2/2.3` combination

Dongjoon Hyun created SPARK-29989: - Summary: Update release-script for `hive-1.2/2.3` combination Key: SPARK-29989 URL: https://issues.apache.org/jira/browse/SPARK-29989 Project: Spark Issue

[jira] [Updated] (SPARK-29981) Add `hive-1.2` and `hive-2.3` profiles

[ https://issues.apache.org/jira/browse/SPARK-29981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29981: -- Target Version/s: 3.0.0 > Add `hive-1.2` and `hive-2.3` profiles >

[jira] [Updated] (SPARK-29988) Adjust Jenkins jobs for `hive-1.2/2.3` combination

[ https://issues.apache.org/jira/browse/SPARK-29988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29988: -- Summary: Adjust Jenkins jobs for `hive-1.2/2.3` combination (was: Adjust Jenkins jobs for

[jira] [Updated] (SPARK-29988) Adjust Jenkins jobs for `hive-1.2/2.3` combination

[ https://issues.apache.org/jira/browse/SPARK-29988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29988: -- Target Version/s: 3.0.0 > Adjust Jenkins jobs for `hive-1.2/2.3` combination >

[jira] [Created] (SPARK-29988) Adjust Jenkins jobs for the new `hive-1.2/2.3` combination

Dongjoon Hyun created SPARK-29988: - Summary: Adjust Jenkins jobs for the new `hive-1.2/2.3` combination Key: SPARK-29988 URL: https://issues.apache.org/jira/browse/SPARK-29988 Project: Spark

[jira] [Commented] (SPARK-29966) Add version method in TableCatalog to avoid load table twice

[ https://issues.apache.org/jira/browse/SPARK-29966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979419#comment-16979419 ] Ryan Blue commented on SPARK-29966: --- As I said on the PR, I'm -1 on changing a public extension API to

[jira] [Resolved] (SPARK-29248) Pass in number of partitions to BuildWriter

[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29248. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26591

[jira] [Commented] (SPARK-29900) make relation lookup behavior consistent within Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979395#comment-16979395 ] Terry Kim commented on SPARK-29900: --- [~dongjoon] 'global temp view' can be referred only by the

[jira] [Resolved] (SPARK-29977) Remove newMutableProjection/newOrdering/newNaturalAscendingOrdering from SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-29977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29977. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26615

[jira] [Assigned] (SPARK-29977) Remove newMutableProjection/newOrdering/newNaturalAscendingOrdering from SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-29977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29977: --- Assignee: Takeshi Yamamuro > Remove

[jira] [Commented] (SPARK-29966) Add version method in TableCatalog to avoid load table twice

[ https://issues.apache.org/jira/browse/SPARK-29966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979312#comment-16979312 ] Wenchen Fan commented on SPARK-29966: - I do agree that this is a perf regression in Spark 3.0. Now

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979241#comment-16979241 ] Sean R. Owen commented on SPARK-29553: -- This is really an environment variable that the cluster env

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979236#comment-16979236 ] Izek Greenfield commented on SPARK-8981: [~srowen] I created pull request for that. > Set

[jira] [Created] (SPARK-29987) Add CatalogTable cache in SessionCatalog to improve performance

ulysses you created SPARK-29987: --- Summary: Add CatalogTable cache in SessionCatalog to improve performance Key: SPARK-29987 URL: https://issues.apache.org/jira/browse/SPARK-29987 Project: Spark

[jira] [Created] (SPARK-29986) Introduce java like string trim to UTF8String

Kent Yao created SPARK-29986: Summary: Introduce java like string trim to UTF8String Key: SPARK-29986 URL: https://issues.apache.org/jira/browse/SPARK-29986 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29874) Optimize Dataset.isEmpty()

[ https://issues.apache.org/jira/browse/SPARK-29874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29874. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26500

[jira] [Assigned] (SPARK-29874) Optimize Dataset.isEmpty()

[ https://issues.apache.org/jira/browse/SPARK-29874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29874: --- Assignee: angerszhu > Optimize Dataset.isEmpty() > -- > >

[jira] [Resolved] (SPARK-29960) MulticlassClassificationEvaluator support hammingLoss

[ https://issues.apache.org/jira/browse/SPARK-29960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-29960. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26597

[jira] [Assigned] (SPARK-29960) MulticlassClassificationEvaluator support hammingLoss

[ https://issues.apache.org/jira/browse/SPARK-29960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-29960: Assignee: zhengruifeng > MulticlassClassificationEvaluator support hammingLoss >

[jira] [Updated] (SPARK-29942) Impl Complement Naive Bayes Classifier

[ https://issues.apache.org/jira/browse/SPARK-29942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-29942: - Fix Version/s: (was: 3.1.0) 3.0.0 > Impl Complement Naive Bayes

[jira] [Assigned] (SPARK-29942) Impl Complement Naive Bayes Classifier

[ https://issues.apache.org/jira/browse/SPARK-29942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-29942: Assignee: zhengruifeng > Impl Complement Naive Bayes Classifier >

[jira] [Resolved] (SPARK-29942) Impl Complement Naive Bayes Classifier

[ https://issues.apache.org/jira/browse/SPARK-29942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-29942. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 26575

[jira] [Commented] (SPARK-29985) Spark integrated Hive ---cannot read database and table in hive

[ https://issues.apache.org/jira/browse/SPARK-29985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979122#comment-16979122 ] lv haiyang commented on SPARK-29985: I have another way,although could find all database in

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979116#comment-16979116 ] WuZeyi commented on SPARK-29553: [~srowen] Yes,you are right. This isn't a bug.The processes run 

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979114#comment-16979114 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp], If you feel sparkR testing is good with a new job

[jira] [Updated] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo updated SPARK-29106: Attachment: SparkR-and-pyspark36-testing.txt > Add jenkins arm test for spark >

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979050#comment-16979050 ] zhao bo edited comment on SPARK-29106 at 11/21/19 9:08 AM: --- Hi [~shaneknapp],

[jira] [Updated] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WuZeyi updated SPARK-29553: --- Attachment: image-2019-11-21-17-08-15-797.png > This problemis about using native BLAS to improvement

[jira] [Comment Edited] (SPARK-29985) Spark integrated Hive ---cannot read database and table in hive

[ https://issues.apache.org/jira/browse/SPARK-29985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979105#comment-16979105 ] lv haiyang edited comment on SPARK-29985 at 11/21/19 9:05 AM: -- the Spark

[jira] [Comment Edited] (SPARK-29985) Spark integrated Hive ---cannot read database and table in hive

[ https://issues.apache.org/jira/browse/SPARK-29985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979105#comment-16979105 ] lv haiyang edited comment on SPARK-29985 at 11/21/19 9:04 AM: -- the Spark

[jira] [Commented] (SPARK-29985) Spark integrated Hive ---cannot read database and table in hive

[ https://issues.apache.org/jira/browse/SPARK-29985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979105#comment-16979105 ] lv haiyang commented on SPARK-29985: the Spark version 2.3.2 and Hive version 3.1.0 # From the

[jira] [Created] (SPARK-29985) Spark integrated Hive ---cannot read database and table in hive

lv haiyang created SPARK-29985: -- Summary: Spark integrated Hive ---cannot read database and table in hive Key: SPARK-29985 URL: https://issues.apache.org/jira/browse/SPARK-29985 Project: Spark

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979050#comment-16979050 ] zhao bo edited comment on SPARK-29106 at 11/21/19 8:39 AM: --- Hi [~shaneknapp],

[jira] [Commented] (SPARK-29984) Add built-in Array Functions: array_ndims

[ https://issues.apache.org/jira/browse/SPARK-29984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979062#comment-16979062 ] jiaan.geng commented on SPARK-29984: I'm working on. > Add built-in Array Functions: array_ndims >

[jira] [Created] (SPARK-29984) Add built-in Array Functions: array_ndims

jiaan.geng created SPARK-29984: -- Summary: Add built-in Array Functions: array_ndims Key: SPARK-29984 URL: https://issues.apache.org/jira/browse/SPARK-29984 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-29984) Add built-in Array Functions: array_ndims

[ https://issues.apache.org/jira/browse/SPARK-29984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29984: --- Description: |{{array_ndims}}{{(}}{{anyarray}}{{)}}|{{int}}|returns the number of dimensions of

[jira] [Resolved] (SPARK-29982) Add built-in Array Functions: array_append

[ https://issues.apache.org/jira/browse/SPARK-29982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-29982. Resolution: Duplicate > Add built-in Array Functions: array_append >