[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982232#comment-16982232 ] huangtianhua commented on SPARK-29106: -- [~shaneknapp]，I modified the script /tmp/hu

[jira] [Commented] (SPARK-30040) DROP FUNCTION should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-30040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982215#comment-16982215 ] Pablo Langa Blanco commented on SPARK-30040: I'm working on this > DROP FUN

[jira] [Created] (SPARK-30040) DROP FUNCTION should look up catalog/table like v2 commands

Pablo Langa Blanco created SPARK-30040: -- Summary: DROP FUNCTION should look up catalog/table like v2 commands Key: SPARK-30040 URL: https://issues.apache.org/jira/browse/SPARK-30040 Project: Spar

[jira] [Commented] (SPARK-30039) CREATE FUNCTION should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-30039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982214#comment-16982214 ] Pablo Langa Blanco commented on SPARK-30039: I am working on this > CREATE

[jira] [Created] (SPARK-30039) CREATE FUNCTION should look up catalog/table like v2 commands

Pablo Langa Blanco created SPARK-30039: -- Summary: CREATE FUNCTION should look up catalog/table like v2 commands Key: SPARK-30039 URL: https://issues.apache.org/jira/browse/SPARK-30039 Project: S

[jira] [Commented] (SPARK-30038) DESCRIBE FUNCTION should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-30038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982213#comment-16982213 ] Pablo Langa Blanco commented on SPARK-30038: I am working on this > DESCRIB

[jira] [Created] (SPARK-30038) DESCRIBE FUNCTION should look up catalog/table like v2 commands

Pablo Langa Blanco created SPARK-30038: -- Summary: DESCRIBE FUNCTION should look up catalog/table like v2 commands Key: SPARK-30038 URL: https://issues.apache.org/jira/browse/SPARK-30038 Project:

[jira] [Updated] (SPARK-30037) Customize krb5.conf to test Kafka delegation token with MiniKDC

[ https://issues.apache.org/jira/browse/SPARK-30037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30037: Description: We need to improvement Kafka delegation token with MiniKDC to support test KafkaDele

[jira] [Updated] (SPARK-30037) Customize krb5.conf to test Kafka delegation token with MiniKDC

[ https://issues.apache.org/jira/browse/SPARK-30037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30037: Summary: Customize krb5.conf to test Kafka delegation token with MiniKDC (was: Better way to test

[jira] [Commented] (SPARK-30037) Better way to test Kafka delegation token with MiniKDC

[ https://issues.apache.org/jira/browse/SPARK-30037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982154#comment-16982154 ] Yuming Wang commented on SPARK-30037: - cc [~gsomogyi] > Better way to test Kafka de

[jira] [Updated] (SPARK-30037) Better way to test Kafka delegation token with MiniKDC

[ https://issues.apache.org/jira/browse/SPARK-30037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30037: Description: We need to improvement Kafka delegation token with MiniKDC to support test this test

[jira] [Created] (SPARK-30037) Better way to test Kafka delegation token with MiniKDC

Yuming Wang created SPARK-30037: --- Summary: Better way to test Kafka delegation token with MiniKDC Key: SPARK-30037 URL: https://issues.apache.org/jira/browse/SPARK-30037 Project: Spark Issue Ty

[jira] [Created] (SPARK-30036) REPARTITION hint dose not work with order by

Jackey Lee created SPARK-30036: -- Summary: REPARTITION hint dose not work with order by Key: SPARK-30036 URL: https://issues.apache.org/jira/browse/SPARK-30036 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29194) JDK11 QA

[ https://issues.apache.org/jira/browse/SPARK-29194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29194: -- Target Version/s: 3.0.0 > JDK11 QA > > > Key: SPARK-29194 >

[jira] [Resolved] (SPARK-29979) Add basic/reserved property key constants in Table and SupportsNamespaces

[ https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29979. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26617 [https://gith

[jira] [Assigned] (SPARK-29979) Add basic/reserved property key constants in Table and SupportsNamespaces

[ https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29979: --- Assignee: Hu Fuwang > Add basic/reserved property key constants in Table and SupportsNamesp

[jira] [Created] (SPARK-30035) Upgrade to Apache Commons Lang 3.9

Dongjoon Hyun created SPARK-30035: - Summary: Upgrade to Apache Commons Lang 3.9 Key: SPARK-30035 URL: https://issues.apache.org/jira/browse/SPARK-30035 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-30032) Upgrade to ORC 1.5.8

[ https://issues.apache.org/jira/browse/SPARK-30032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30032. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26669 [https://

[jira] [Assigned] (SPARK-30032) Upgrade to ORC 1.5.8

[ https://issues.apache.org/jira/browse/SPARK-30032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30032: - Assignee: Dongjoon Hyun > Upgrade to ORC 1.5.8 > > >

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982078#comment-16982078 ] huangtianhua commented on SPARK-29106: -- [~shaneknapp], the arm jobs are failed, I t

[jira] [Commented] (SPARK-30014) for non-default catalog, namespace name is always needed in a query?

[ https://issues.apache.org/jira/browse/SPARK-30014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982059#comment-16982059 ] xufei commented on SPARK-30014: --- And I've done some basic investigation, looks like the '_

[jira] [Commented] (SPARK-30014) for non-default catalog, namespace name is always needed in a query?

[ https://issues.apache.org/jira/browse/SPARK-30014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982056#comment-16982056 ] xufei commented on SPARK-30014: --- Hi, [~Konjac], you can reproduce the error using the test

[jira] [Updated] (SPARK-30014) for non-default catalog, namespace name is always needed in a query?

[ https://issues.apache.org/jira/browse/SPARK-30014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xufei updated SPARK-30014: -- Attachment: DataSourceV2ExplainSuite.scala > for non-default catalog, namespace name is always needed in a que

[jira] [Commented] (SPARK-29967) KMeans support instance weighting

[ https://issues.apache.org/jira/browse/SPARK-29967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982021#comment-16982021 ] Huaxin Gao commented on SPARK-29967: I will work on this.  > KMeans support instanc

[jira] [Updated] (SPARK-30034) Use Apache Hive 2.3 dependency by default

[ https://issues.apache.org/jira/browse/SPARK-30034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30034: -- Priority: Blocker (was: Major) > Use Apache Hive 2.3 dependency by default >

[jira] [Updated] (SPARK-30034) Use Apache Hive 2.3 dependency by default

[ https://issues.apache.org/jira/browse/SPARK-30034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30034: -- Target Version/s: 3.0.0 > Use Apache Hive 2.3 dependency by default >

[jira] [Updated] (SPARK-30015) Move hive-storage-api dependency from `hive-2.3` to `sql/core`

[ https://issues.apache.org/jira/browse/SPARK-30015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30015: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Move hive-storage-api d

[jira] [Updated] (SPARK-29988) Adjust Jenkins jobs for `hive-1.2/2.3` combination

[ https://issues.apache.org/jira/browse/SPARK-29988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29988: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Adjust Jenkins jobs for

[jira] [Updated] (SPARK-29991) Support `hive-1.2/2.3` in PR Builder

[ https://issues.apache.org/jira/browse/SPARK-29991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29991: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Support `hive-1.2/2.3`

[jira] [Updated] (SPARK-29989) Update release-script for `hive-1.2/2.3` combination

[ https://issues.apache.org/jira/browse/SPARK-29989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29989: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Update release-script f

[jira] [Updated] (SPARK-30007) Publish snapshot/release with `-Phive-2.3` only

[ https://issues.apache.org/jira/browse/SPARK-30007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30007: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Publish snapshot/releas

[jira] [Updated] (SPARK-30031) Remove `hive-2.3` profile from `sql/hive` module

[ https://issues.apache.org/jira/browse/SPARK-30031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30031: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Remove `hive-2.3` profi

[jira] [Updated] (SPARK-30005) Update `test-dependencies.sh` to check `hive-1.2/2.3` profile

[ https://issues.apache.org/jira/browse/SPARK-30005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30005: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Update `test-dependenci

[jira] [Updated] (SPARK-29981) Add `hive-1.2` and `hive-2.3` profiles

[ https://issues.apache.org/jira/browse/SPARK-29981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29981: -- Parent: SPARK-30034 Issue Type: Sub-task (was: Improvement) > Add `hive-1.2` and `hiv

[jira] [Created] (SPARK-30034) Use Apache Hive 2.3 dependency by default

Dongjoon Hyun created SPARK-30034: - Summary: Use Apache Hive 2.3 dependency by default Key: SPARK-30034 URL: https://issues.apache.org/jira/browse/SPARK-30034 Project: Spark Issue Type: Umbre

[jira] [Commented] (SPARK-30033) Use Spark plugin support to manage shuffle plugin lifecycle

[ https://issues.apache.org/jira/browse/SPARK-30033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981997#comment-16981997 ] Marcelo Masiero Vanzin commented on SPARK-30033: [~mcheah] [~yifeih] I

[jira] [Created] (SPARK-30033) Use Spark plugin support to manage shuffle plugin lifecycle

Marcelo Masiero Vanzin created SPARK-30033: -- Summary: Use Spark plugin support to manage shuffle plugin lifecycle Key: SPARK-30033 URL: https://issues.apache.org/jira/browse/SPARK-30033 Proje

[jira] [Created] (SPARK-30032) Upgrade to ORC 1.5.8

Dongjoon Hyun created SPARK-30032: - Summary: Upgrade to ORC 1.5.8 Key: SPARK-30032 URL: https://issues.apache.org/jira/browse/SPARK-30032 Project: Spark Issue Type: Improvement Comp

[jira] [Commented] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-30029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981975#comment-16981975 ] Dongjoon Hyun commented on SPARK-30029: --- Thank you for confirming. Also SPARK-3003

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails with Maven -rf :spark-core_2.12

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30028: -- Affects Version/s: (was: 3.1.0) 3.0.0 > Spark Catalyst build fails

[jira] [Updated] (SPARK-30031) Remove `hive-2.3` profile from `sql/hive` module

[ https://issues.apache.org/jira/browse/SPARK-30031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30031: -- Summary: Remove `hive-2.3` profile from `sql/hive` module (was: Remove `hive-2.3` profile fro

[jira] [Assigned] (SPARK-30031) Remove `hive-2.3` profile from `sql/hive/pom.xml`

[ https://issues.apache.org/jira/browse/SPARK-30031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30031: - Assignee: Dongjoon Hyun > Remove `hive-2.3` profile from `sql/hive/pom.xml` > -

[jira] [Resolved] (SPARK-30031) Remove `hive-2.3` profile from `sql/hive/pom.xml`

[ https://issues.apache.org/jira/browse/SPARK-30031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30031. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26668 [https://

[jira] [Resolved] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25923. --- Resolution: Fixed After monitoring some PRS, this seems to be resolved from CRAN side. > Sp

[jira] [Comment Edited] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981910#comment-16981910 ] Dongjoon Hyun edited comment on SPARK-25923 at 11/25/19 9:34 PM: -

[jira] [Updated] (SPARK-30030) Use RegexChecker instead of TokenChecker to check `org.apache.commons.lang.`

[ https://issues.apache.org/jira/browse/SPARK-30030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30030: -- Affects Version/s: 2.4.4 > Use RegexChecker instead of TokenChecker to check `org.apache.commo

[jira] [Updated] (SPARK-30030) Use RegexChecker instead of TokenChecker to check `org.apache.commons.lang.`

[ https://issues.apache.org/jira/browse/SPARK-30030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30030: -- Fix Version/s: 2.4.5 > Use RegexChecker instead of TokenChecker to check `org.apache.commons.l

[jira] [Created] (SPARK-30031) Remove `hive-2.3` profile from `sql/hive/pom.xml`

Dongjoon Hyun created SPARK-30031: - Summary: Remove `hive-2.3` profile from `sql/hive/pom.xml` Key: SPARK-30031 URL: https://issues.apache.org/jira/browse/SPARK-30031 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-30030) Use RegexChecker instead of TokenChecker to check `regex`

[ https://issues.apache.org/jira/browse/SPARK-30030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30030. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 2 [https://

[jira] [Updated] (SPARK-30030) Use RegexChecker instead of TokenChecker to check `org.apache.commons.lang.`

[ https://issues.apache.org/jira/browse/SPARK-30030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30030: -- Summary: Use RegexChecker instead of TokenChecker to check `org.apache.commons.lang.` (was: U

[jira] [Assigned] (SPARK-30030) Use RegexChecker instead of TokenChecker to check `regex`

[ https://issues.apache.org/jira/browse/SPARK-30030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30030: - Assignee: Dongjoon Hyun > Use RegexChecker instead of TokenChecker to check `regex` > -

[jira] [Created] (SPARK-30030) Use RegexChecker instead of TokenChecker to check `regex`

Dongjoon Hyun created SPARK-30030: - Summary: Use RegexChecker instead of TokenChecker to check `regex` Key: SPARK-30030 URL: https://issues.apache.org/jira/browse/SPARK-30030 Project: Spark I

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails with Maven -rf :spark-core_2.12

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30028: Affects Version/s: (was: 2.4.4) 3.1.0 Priority: Min

[jira] [Commented] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-30029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981833#comment-16981833 ] Douglas Colkitt commented on SPARK-30029: - Thanks, using the Hive 2.3 profile re

[jira] [Updated] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-30029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30029: Affects Version/s: (was: 2.4.4) 3.1.0 > Build fails at Spark Co

[jira] [Commented] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-30029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981812#comment-16981812 ] Dongjoon Hyun commented on SPARK-30029: --- If you are facing `hive` module failure,

[jira] [Commented] (SPARK-30028) Spark Catalyst build fails with Maven -rf :spark-core_2.12

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981810#comment-16981810 ] Dongjoon Hyun commented on SPARK-30028: --- Hi, [~dcolkitt]. I'm wondering why you se

[jira] [Resolved] (SPARK-30015) Move hive-storage-api dependency from `hive-2.3` to `sql/core`

[ https://issues.apache.org/jira/browse/SPARK-30015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30015. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26658 [https://

[jira] [Assigned] (SPARK-30015) Move hive-storage-api dependency from `hive-2.3` to `sql/core`

[ https://issues.apache.org/jira/browse/SPARK-30015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30015: - Assignee: Dongjoon Hyun > Move hive-storage-api dependency from `hive-2.3` to `sql/core

[jira] [Commented] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-30029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981805#comment-16981805 ] Dongjoon Hyun commented on SPARK-30029: --- 1. Both `PropertiesCloneBenchmark.scala`

[jira] [Closed] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-30029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30029. - > Build fails at Spark Core with -Phadoop-3.2 > --- > >

[jira] [Resolved] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-30029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30029. --- Resolution: Duplicate This is not `2.4.4`. For `master`, this duplicate SPARK-30015 > Build

[jira] [Updated] (SPARK-29971) Multiple possible buffer leaks in TransportFrameDecoder and TransportCipher

[ https://issues.apache.org/jira/browse/SPARK-29971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin updated SPARK-29971: --- Fix Version/s: 2.4.5 > Multiple possible buffer leaks in TransportFrameDecod

[jira] [Assigned] (SPARK-26260) Task Summary Metrics for Stage Page: Efficient implementation for SHS when using disk store.

[ https://issues.apache.org/jira/browse/SPARK-26260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-26260: -- Assignee: shahid > Task Summary Metrics for Stage Page: Efficient imp

[jira] [Resolved] (SPARK-26260) Task Summary Metrics for Stage Page: Efficient implementation for SHS when using disk store.

[ https://issues.apache.org/jira/browse/SPARK-26260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-26260. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Created] (SPARK-30029) Build fails at Spark Core with -Phadoop-3.2

Douglas Colkitt created SPARK-30029: --- Summary: Build fails at Spark Core with -Phadoop-3.2 Key: SPARK-30029 URL: https://issues.apache.org/jira/browse/SPARK-30029 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails with Maven -rf :spark-core_2.12

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30028: Description: Building from latest source with the following command:  {code:java} ./build/

[jira] [Commented] (SPARK-30028) Spark Catalyst build fails - trimAll() not a member of UTF8String

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981723#comment-16981723 ] Douglas Colkitt commented on SPARK-30028: - Actually, this does _not_ fail with a

[jira] [Commented] (SPARK-24261) Spark cannot read renamed managed Hive table

[ https://issues.apache.org/jira/browse/SPARK-24261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981712#comment-16981712 ] Nithin commented on SPARK-24261: Could you please specify why this issue is marked resol

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails - trimAll() not a member of UTF8String

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30028: Environment: Building with OpenJDK-11, Scala 2.12.8 and Maven 3.6.2. Using Debian 10 with

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails - trimAll() not a member of UTF8String

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30028: Environment: Building with OpenJDK-11 and Scala 2.12.8. Using Debian 10 with kernel 4.19.0

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails - trimAll() not a member of UTF8String

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30028: Description: Building from latest source with the following command:  {code:java} ./build/

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails - trimAll() not a member of UTF8String

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30028: Summary: Spark Catalyst build fails - trimAll() not a member of UTF8String (was: Spark Ca

[jira] [Updated] (SPARK-30028) Spark Catalyst build fails - trimAll() not a member of UTF8String

[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Colkitt updated SPARK-30028: Description: Building from latest source with the following command:    {code:java} ./bui

[jira] [Created] (SPARK-30028) Spark Catalyst build fails

Douglas Colkitt created SPARK-30028: --- Summary: Spark Catalyst build fails Key: SPARK-30028 URL: https://issues.apache.org/jira/browse/SPARK-30028 Project: Spark Issue Type: Bug Co

[jira] [Resolved] (SPARK-29890) Unable to fill na with 0 with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29890. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26593 [https://gith

[jira] [Assigned] (SPARK-29890) Unable to fill na with 0 with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29890: --- Assignee: Terry Kim > Unable to fill na with 0 with duplicate columns > ---

[jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981661#comment-16981661 ] L. C. Hsieh commented on SPARK-25923: - Should be fixed now. > SparkR UT Failure (ch

[jira] [Resolved] (SPARK-29415) Stage Level Sched: Add base ResourceProfile and Request classes

[ https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-29415. --- Fix Version/s: 3.0.0 Resolution: Fixed > Stage Level Sched: Add base ResourceProfile

[jira] [Commented] (SPARK-30027) Support codegen for filter exprs in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-30027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981525#comment-16981525 ] Takeshi Yamamuro commented on SPARK-30027: -- I will do this when SPARK-27986 fin

[jira] [Created] (SPARK-30027) Support codegen for filter exprs in HashAggregateExec

Takeshi Yamamuro created SPARK-30027: Summary: Support codegen for filter exprs in HashAggregateExec Key: SPARK-30027 URL: https://issues.apache.org/jira/browse/SPARK-30027 Project: Spark

[jira] [Created] (SPARK-30026) Support all whitespaces as delimiter for inside a interval value

Kent Yao created SPARK-30026: Summary: Support all whitespaces as delimiter for inside a interval value Key: SPARK-30026 URL: https://issues.apache.org/jira/browse/SPARK-30026 Project: Spark Iss

[jira] [Created] (SPARK-30025) Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

Yuanjian Li created SPARK-30025: --- Summary: Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used Key: SPARK-30025 URL: https://issues.apache.org/jira/browse/SPARK-30025

[jira] [Updated] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

[ https://issues.apache.org/jira/browse/SPARK-30023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShivaKumar SS updated SPARK-30023: -- Labels: dataframe (was: ) > Spark partitionby saves as columnName={value} | Can it be only co

[jira] [Updated] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

[ https://issues.apache.org/jira/browse/SPARK-30023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShivaKumar SS updated SPARK-30023: -- Description: I am using scala and spark. This is using Dataframe and in dataframe i have a co

[jira] [Created] (SPARK-30024) Support subdirectories when accessing partitioned Parquet Hive table

Michael Lotkowski created SPARK-30024: - Summary: Support subdirectories when accessing partitioned Parquet Hive table Key: SPARK-30024 URL: https://issues.apache.org/jira/browse/SPARK-30024 Projec

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981461#comment-16981461 ] Maksym F edited comment on SPARK-18105 at 11/25/19 11:27 AM: -

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981461#comment-16981461 ] Maksym F commented on SPARK-18105: -- I was able to reproduce with the code as shown belo

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981442#comment-16981442 ] Ivan Dyptan edited comment on SPARK-18105 at 11/25/19 11:10 AM: --

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981442#comment-16981442 ] Ivan Dyptan edited comment on SPARK-18105 at 11/25/19 11:10 AM: --

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981442#comment-16981442 ] Ivan Dyptan commented on SPARK-18105: - You can recreate the error consistently by fo

[jira] [Commented] (SPARK-30014) for non-default catalog, namespace name is always needed in a query?

[ https://issues.apache.org/jira/browse/SPARK-30014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981416#comment-16981416 ] Kun commented on SPARK-30014: - Could you share the full scripts? > for non-default catalog,

[jira] [Comment Edited] (SPARK-30006) printSchema indeterministic output

[ https://issues.apache.org/jira/browse/SPARK-30006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981407#comment-16981407 ] Kun edited comment on SPARK-30006 at 11/25/19 9:45 AM: --- In the con

[jira] [Comment Edited] (SPARK-30006) printSchema indeterministic output

[ https://issues.apache.org/jira/browse/SPARK-30006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981407#comment-16981407 ] Kun edited comment on SPARK-30006 at 11/25/19 9:26 AM: --- In the con

[jira] [Commented] (SPARK-30006) printSchema indeterministic output

[ https://issues.apache.org/jira/browse/SPARK-30006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981407#comment-16981407 ] Kun commented on SPARK-30006: - In the constructor of *pyspark.sql.Row*, the fields order get

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981406#comment-16981406 ] Jungtaek Lim commented on SPARK-29995: -- The thing is, "exactly-once" on file stream

[jira] [Created] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

ShivaKumar SS created SPARK-30023: - Summary: Spark partitionby saves as columnName={value} | Can it be only columnvalue Key: SPARK-30023 URL: https://issues.apache.org/jira/browse/SPARK-30023 Project:

[jira] [Updated] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

[ https://issues.apache.org/jira/browse/SPARK-30023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShivaKumar SS updated SPARK-30023: -- Description: I am using scala and spark. This is using Dataframe and in dataframe i have a co

[jira] [Updated] (SPARK-30022) Supporting reading of Hive Virtual created from Presto

[ https://issues.apache.org/jira/browse/SPARK-30022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Ravi M V updated SPARK-30022: -- Priority: Major (was: Critical) > Supporting reading of Hive Virtual created from Presto > --

[jira] [Updated] (SPARK-30022) Supporting reading of Hive Virtual created from Presto

[ https://issues.apache.org/jira/browse/SPARK-30022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Ravi M V updated SPARK-30022: -- Description: In Apache Spark, I found that views are resolved using the VIEW_EXPANDED_TEXT in

  1   2   >