[jira] [Resolved] (SPARK-31588) merge small files may need more common setting

[ https://issues.apache.org/jira/browse/SPARK-31588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31588. -- Resolution: Won't Fix > merge small files may need more common setting >

[jira] [Commented] (SPARK-31686) Return of String instead of array in function get_json_object

[ https://issues.apache.org/jira/browse/SPARK-31686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105939#comment-17105939 ] daile commented on SPARK-31686: --- [~bruneltouopi] looks like it was specifically removed {code:java} val

[jira] [Updated] (SPARK-31695) BigDecimal setScale is not working in Spark UDF

[ https://issues.apache.org/jira/browse/SPARK-31695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saravanan Raju updated SPARK-31695: --- Description: I was trying to convert json column to map. I tried udf for converting json to

[jira] [Created] (SPARK-31695) BigDecimal setScale is not working in Spark UDF

Saravanan Raju created SPARK-31695: -- Summary: BigDecimal setScale is not working in Spark UDF Key: SPARK-31695 URL: https://issues.apache.org/jira/browse/SPARK-31695 Project: Spark Issue

[jira] [Commented] (SPARK-31640) Support SHOW PARTITIONS for DataSource V2 tables

[ https://issues.apache.org/jira/browse/SPARK-31640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105885#comment-17105885 ] Jackey Lee commented on SPARK-31640: Hi [~younggyuchun] [~brkyvz], I have add this issue on Hive

[jira] [Updated] (SPARK-31694) Add SupportsPartitions Catalog APIs on DataSourceV2

[ https://issues.apache.org/jira/browse/SPARK-31694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jackey Lee updated SPARK-31694: --- Summary: Add SupportsPartitions Catalog APIs on DataSourceV2 (was: Add SupportsPartitions on

[jira] [Created] (SPARK-31694) Add SupportsPartitions on DataSourceV2

Jackey Lee created SPARK-31694: -- Summary: Add SupportsPartitions on DataSourceV2 Key: SPARK-31694 URL: https://issues.apache.org/jira/browse/SPARK-31694 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105840#comment-17105840 ] Dongjoon Hyun commented on SPARK-31693: --- Thank you for taking a look at this~ > Investigate

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105815#comment-17105815 ] Shane Knapp commented on SPARK-31693: - weird. nothing has changed on our end and i'm going to have

[jira] [Commented] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105814#comment-17105814 ] Apache Spark commented on SPARK-30098: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-31136) Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-31136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105812#comment-17105812 ] Apache Spark commented on SPARK-31136: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105813#comment-17105813 ] Apache Spark commented on SPARK-30098: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-31136) Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-31136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105811#comment-17105811 ] Apache Spark commented on SPARK-31136: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Updated] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31693: -- Description: Given the series of failures in Spark packaging Jenkins job, it seems that

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105807#comment-17105807 ] Dongjoon Hyun commented on SPARK-31693: --- Hi, [~shaneknapp]. How do you think the above? cc

[jira] [Updated] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31693: -- Description: Given the series of failures in Spark packaging Jenkins job, it seems that

[jira] [Created] (SPARK-31693) Investigate AmpLab Jenkins server network issue

Dongjoon Hyun created SPARK-31693: - Summary: Investigate AmpLab Jenkins server network issue Key: SPARK-31693 URL: https://issues.apache.org/jira/browse/SPARK-31693 Project: Spark Issue

[jira] [Assigned] (SPARK-31692) Hadoop confs passed via spark config are not set in URLStream Handler Factory

[ https://issues.apache.org/jira/browse/SPARK-31692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31692: Assignee: (was: Apache Spark) > Hadoop confs passed via spark config are not set in

[jira] [Commented] (SPARK-31692) Hadoop confs passed via spark config are not set in URLStream Handler Factory

[ https://issues.apache.org/jira/browse/SPARK-31692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105788#comment-17105788 ] Apache Spark commented on SPARK-31692: -- User 'karuppayya' has created a pull request for this

[jira] [Assigned] (SPARK-31692) Hadoop confs passed via spark config are not set in URLStream Handler Factory

[ https://issues.apache.org/jira/browse/SPARK-31692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31692: Assignee: Apache Spark > Hadoop confs passed via spark config are not set in URLStream

[jira] [Created] (SPARK-31692) Hadoop confs passed via spark config are not set in URLStream Handler Factory

Karuppayya created SPARK-31692: -- Summary: Hadoop confs passed via spark config are not set in URLStream Handler Factory Key: SPARK-31692 URL: https://issues.apache.org/jira/browse/SPARK-31692 Project:

[jira] [Resolved] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-31691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31691. --- Fix Version/s: 3.0.0 2.4.6 Assignee: Dongjoon Hyun

[jira] [Commented] (SPARK-30654) Update Docs Bootstrap to 4.4.1

[ https://issues.apache.org/jira/browse/SPARK-30654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105746#comment-17105746 ] Apache Spark commented on SPARK-30654: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-30654) Update Docs Bootstrap to 4.4.1

[ https://issues.apache.org/jira/browse/SPARK-30654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105744#comment-17105744 ] Apache Spark commented on SPARK-30654: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-31691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31691: Assignee: Apache Spark > release-build.sh should ignore a fallback output from

[jira] [Assigned] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-31691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31691: Assignee: (was: Apache Spark) > release-build.sh should ignore a fallback output

[jira] [Commented] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-31691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105737#comment-17105737 ] Apache Spark commented on SPARK-31691: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-31691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105736#comment-17105736 ] Apache Spark commented on SPARK-31691: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-31691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31691: -- Description: SPARK-28963 prints Falling back to archive.apache.org to download Maven in

[jira] [Updated] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-31691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31691: -- Affects Version/s: 2.4.5 > release-build.sh should ignore a fallback output from `build/mvn`

[jira] [Created] (SPARK-31691) release-build.sh should ignore a fallback output from `build/mvn`

Dongjoon Hyun created SPARK-31691: - Summary: release-build.sh should ignore a fallback output from `build/mvn` Key: SPARK-31691 URL: https://issues.apache.org/jira/browse/SPARK-31691 Project: Spark

[jira] [Updated] (SPARK-31687) Use GitHub instead of GitBox in release script

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31687: -- Summary: Use GitHub instead of GitBox in release script (was: Use github instead of gitbox

[jira] [Resolved] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31687. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28513

[jira] [Assigned] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31687: - Assignee: Dongjoon Hyun > Use github instead of gitbox in Spark Packaging Jenkins jobs

[jira] [Updated] (SPARK-31690) Backport pyspark Interaction to Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-31690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Giovagnoli updated SPARK-31690: Priority: Minor (was: Trivial) > Backport pyspark Interaction to Spark 2.4.x >

[jira] [Updated] (SPARK-31690) Backport pyspark Interaction to Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-31690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Giovagnoli updated SPARK-31690: Fix Version/s: (was: 2.4.7) (was: 2.4.6) > Backport pyspark

[jira] [Created] (SPARK-31690) Backport pyspark Interaction to Spark 2.4.x

Luca Giovagnoli created SPARK-31690: --- Summary: Backport pyspark Interaction to Spark 2.4.x Key: SPARK-31690 URL: https://issues.apache.org/jira/browse/SPARK-31690 Project: Spark Issue

[jira] [Assigned] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31687: Assignee: Apache Spark > Use github instead of gitbox in Spark Packaging Jenkins jobs >

[jira] [Commented] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105686#comment-17105686 ] Apache Spark commented on SPARK-31687: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31687: Assignee: (was: Apache Spark) > Use github instead of gitbox in Spark Packaging

[jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105684#comment-17105684 ] Dongjoon Hyun commented on SPARK-25557: --- I'm just not working on this, [~omalley]. :) > ORC

[jira] [Assigned] (SPARK-27217) Nested schema pruning doesn't work for aggregation e.g. `sum`.

[ https://issues.apache.org/jira/browse/SPARK-27217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27217: Assignee: Apache Spark > Nested schema pruning doesn't work for aggregation e.g. `sum`.

[jira] [Assigned] (SPARK-27217) Nested schema pruning doesn't work for aggregation e.g. `sum`.

[ https://issues.apache.org/jira/browse/SPARK-27217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27217: Assignee: (was: Apache Spark) > Nested schema pruning doesn't work for aggregation

[jira] [Comment Edited] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105680#comment-17105680 ] DB Tsai edited comment on SPARK-25557 at 5/12/20, 6:57 PM: --- [~omalley] No

[jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105680#comment-17105680 ] DB Tsai commented on SPARK-25557: - [~omalley] No missing part on ORC side. We already have the

[jira] [Commented] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105658#comment-17105658 ] Dongjoon Hyun commented on SPARK-31687: --- After tracing Patrick's repo, I found that the root cause

[jira] [Commented] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105655#comment-17105655 ] Dongjoon Hyun commented on SPARK-31687: --- Oh. Got it. > Use github instead of gitbox in Spark

[jira] [Commented] (SPARK-31688) Refactor pagination framework for spark web UI pages

[ https://issues.apache.org/jira/browse/SPARK-31688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105650#comment-17105650 ] Apache Spark commented on SPARK-31688: -- User 'iRakson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31688) Refactor pagination framework for spark web UI pages

[ https://issues.apache.org/jira/browse/SPARK-31688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31688: Assignee: Apache Spark > Refactor pagination framework for spark web UI pages >

[jira] [Assigned] (SPARK-31688) Refactor pagination framework for spark web UI pages

[ https://issues.apache.org/jira/browse/SPARK-31688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31688: Assignee: (was: Apache Spark) > Refactor pagination framework for spark web UI pages

[jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105640#comment-17105640 ] Owen O'Malley commented on SPARK-25557: --- Are there missing pieces on the ORC side, [~dongjoon]? >

[jira] [Created] (SPARK-31689) ShuffleBlockFetchIterator keeps localBlocks in its memory even though it never uses it

Chandni Singh created SPARK-31689: - Summary: ShuffleBlockFetchIterator keeps localBlocks in its memory even though it never uses it Key: SPARK-31689 URL: https://issues.apache.org/jira/browse/SPARK-31689

[jira] [Created] (SPARK-31688) Refactor pagination framework for spark web UI pages

Rakesh Raushan created SPARK-31688: -- Summary: Refactor pagination framework for spark web UI pages Key: SPARK-31688 URL: https://issues.apache.org/jira/browse/SPARK-31688 Project: Spark

[jira] [Commented] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105596#comment-17105596 ] Shane Knapp commented on SPARK-31687: - actually, it looks to be code in [~pwendell]'s github repo:

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105592#comment-17105592 ] Dongjoon Hyun commented on SPARK-31679: --- AFAIK, both successful build and failure build have the

[jira] [Comment Edited] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105592#comment-17105592 ] Dongjoon Hyun edited comment on SPARK-31679 at 5/12/20, 4:45 PM: - AFAIK,

[jira] [Commented] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105576#comment-17105576 ] Dongjoon Hyun commented on SPARK-31687: --- The code itself seems to be AmbLab script code which

[jira] [Commented] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105570#comment-17105570 ] Shane Knapp commented on SPARK-31687: - did something change that i was unaware of? > Use github

[jira] [Updated] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31687: -- Description: Currently, Spark Packaing jobs are broken. - 

[jira] [Commented] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-31687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105566#comment-17105566 ] Dongjoon Hyun commented on SPARK-31687: --- Hi, [~shaneknapp]. Could you take a look at this please?

[jira] [Created] (SPARK-31687) Use github instead of gitbox in Spark Packaging Jenkins jobs

Dongjoon Hyun created SPARK-31687: - Summary: Use github instead of gitbox in Spark Packaging Jenkins jobs Key: SPARK-31687 URL: https://issues.apache.org/jira/browse/SPARK-31687 Project: Spark

[jira] [Assigned] (SPARK-31387) HiveThriftServer2Listener update methods fail with unknown operation/session id

[ https://issues.apache.org/jira/browse/SPARK-31387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-31387: --- Assignee: Ali Smesseim (was: Ali Afroozeh) > HiveThriftServer2Listener update methods fail with

[jira] [Resolved] (SPARK-31387) HiveThriftServer2Listener update methods fail with unknown operation/session id

[ https://issues.apache.org/jira/browse/SPARK-31387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31387. - Fix Version/s: 3.0.0 Assignee: Ali Afroozeh Resolution: Fixed >

[jira] [Updated] (SPARK-31610) Expose hashFuncVersion property in HashingTF

[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-31610: -- Issue Type: Improvement (was: Bug) > Expose hashFuncVersion property in HashingTF >

[jira] [Updated] (SPARK-31610) Expose hashFuncVersion property in HashingTF

[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-31610: -- Priority: Major (was: Critical) > Expose hashFuncVersion property in HashingTF >

[jira] [Updated] (SPARK-31610) Expose hashFuncVersion property in HashingTF

[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-31610: -- Description: Expose hashFuncVersion property in HashingTF Some third-party library such as

[jira] [Assigned] (SPARK-31610) Expose hashFunc property in HashingTF

[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-31610: - Assignee: Weichen Xu > Expose hashFunc property in HashingTF >

[jira] [Resolved] (SPARK-31668) Saving and loading HashingTF leads to hash function changed

[ https://issues.apache.org/jira/browse/SPARK-31668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-31668. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28413

[jira] [Updated] (SPARK-31610) Expose hashFuncVersion property in HashingTF

[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-31610: -- Summary: Expose hashFuncVersion property in HashingTF (was: Expose hashFunc property in

[jira] [Resolved] (SPARK-31610) Expose hashFunc property in HashingTF

[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-31610. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28413

[jira] [Commented] (SPARK-31588) merge small files may need more common setting

[ https://issues.apache.org/jira/browse/SPARK-31588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105530#comment-17105530 ] philipse commented on SPARK-31588: -- Thanks Hyukjin for your advice , i will reconsider it.

[jira] [Created] (SPARK-31686) Return of String instead of array in function get_json_object

Touopi Touopi created SPARK-31686: - Summary: Return of String instead of array in function get_json_object Key: SPARK-31686 URL: https://issues.apache.org/jira/browse/SPARK-31686 Project: Spark

[jira] [Assigned] (SPARK-31680) Support Java 8 datetime types by Random data generator

[ https://issues.apache.org/jira/browse/SPARK-31680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31680: --- Assignee: Maxim Gekk > Support Java 8 datetime types by Random data generator >

[jira] [Resolved] (SPARK-31680) Support Java 8 datetime types by Random data generator

[ https://issues.apache.org/jira/browse/SPARK-31680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31680. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28502

[jira] [Resolved] (SPARK-31678) PrintStackTrace for Spark SQL CLI when error occurs

[ https://issues.apache.org/jira/browse/SPARK-31678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31678. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28499

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105436#comment-17105436 ] Gabor Somogyi commented on SPARK-31679: --- Ah, as I see only the successful build have artifacts for

[jira] [Assigned] (SPARK-31678) PrintStackTrace for Spark SQL CLI when error occurs

[ https://issues.apache.org/jira/browse/SPARK-31678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31678: --- Assignee: Kent Yao > PrintStackTrace for Spark SQL CLI when error occurs >

[jira] [Commented] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105431#comment-17105431 ] Gary Liu commented on SPARK-30741: -- Can anyone look at this issue please? > The data returned from SAS

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105407#comment-17105407 ] Sean R. Owen commented on SPARK-31679: -- They get removed after a certain period of time; if it's

[jira] [Commented] (SPARK-31430) Bug in the approximate quantile computation.

[ https://issues.apache.org/jira/browse/SPARK-31430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105363#comment-17105363 ] Karim Magomedov commented on SPARK-31430: - I'd like to work on this issue > Bug in the

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105309#comment-17105309 ] Rajeev Kumar commented on SPARK-31685: -- Another ticket is open for similar issue.

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105307#comment-17105307 ] Rajeev Kumar commented on SPARK-31685: -- I did some testing. I found one issue in 

[jira] [Created] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

Rajeev Kumar created SPARK-31685: Summary: Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue Key: SPARK-31685 URL: https://issues.apache.org/jira/browse/SPARK-31685

[jira] [Resolved] (SPARK-30828) Improve insertInto behaviour

[ https://issues.apache.org/jira/browse/SPARK-30828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30828. -- Resolution: Won't Fix > Improve insertInto behaviour > >

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105237#comment-17105237 ] Gabor Somogyi commented on SPARK-31679: --- As I see there are no artifacts for previous jenkins

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105236#comment-17105236 ] Gabor Somogyi commented on SPARK-31679: --- Hmmm, I've taken a look at the log and found only 2 type

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105214#comment-17105214 ] Gabor Somogyi commented on SPARK-31679: --- I've tried to reproduce the issue where the following

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105207#comment-17105207 ] Gabor Somogyi commented on SPARK-31679: --- I've made the intended modification in the following

[jira] [Assigned] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31684: Assignee: (was: Apache Spark) > Overwrite partition failed with 'WRONG FS' when the

[jira] [Assigned] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31684: Assignee: Apache Spark > Overwrite partition failed with 'WRONG FS' when the target

[jira] [Commented] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105142#comment-17105142 ] Apache Spark commented on SPARK-31684: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31684: - Description: With https://issues.apache.org/jira/browse/SPARK-18107, we will disable the underlying

[jira] [Created] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

Kent Yao created SPARK-31684: Summary: Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table Key: SPARK-31684 URL: