[jira] [Created] (SPARK-27980) Add built-in Ordered-Set Aggregate Functions: percentile_cont

Yuming Wang created SPARK-27980: --- Summary: Add built-in Ordered-Set Aggregate Functions: percentile_cont Key: SPARK-27980 URL: https://issues.apache.org/jira/browse/SPARK-27980 Project: Spark

[jira] [Assigned] (SPARK-27979) Remove deprecated `--force` option in `build/mvn` and `run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-27979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27979: Assignee: Apache Spark > Remove deprecated `--force` option in `build/mvn` and

[jira] [Assigned] (SPARK-27979) Remove deprecated `--force` option in `build/mvn` and `run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-27979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27979: Assignee: (was: Apache Spark) > Remove deprecated `--force` option in `build/mvn`

[jira] [Updated] (SPARK-27979) Remove deprecated `--force` option in `build/mvn` and `run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-27979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27979: -- Summary: Remove deprecated `--force` option in `build/mvn` and `run-tests.py` (was: Remove

[jira] [Updated] (SPARK-27979) Remove deprecated `--force` option in `build/mvn`

[ https://issues.apache.org/jira/browse/SPARK-27979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27979: -- Description: Since 2.0.0, SPARK-14867 deprecated `--force` option and ignores it. This issue

[jira] [Created] (SPARK-27979) Remove deprecated `--force` option in `build/mvn`

Dongjoon Hyun created SPARK-27979: - Summary: Remove deprecated `--force` option in `build/mvn` Key: SPARK-27979 URL: https://issues.apache.org/jira/browse/SPARK-27979 Project: Spark Issue

[jira] [Created] (SPARK-27978) Add built-in Aggregate Functions: string_agg

Yuming Wang created SPARK-27978: --- Summary: Add built-in Aggregate Functions: string_agg Key: SPARK-27978 URL: https://issues.apache.org/jira/browse/SPARK-27978 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-27966) input_file_name empty when listing files in parallel

[ https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859067#comment-16859067 ] Hyukjin Kwon edited comment on SPARK-27966 at 6/8/19 1:22 AM: -- It doesn't

[jira] [Commented] (SPARK-27966) input_file_name empty when listing files in parallel

[ https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859067#comment-16859067 ] Hyukjin Kwon commented on SPARK-27966: -- It doesn't have to be a perfect reproducer. It's kind of

[jira] [Resolved] (SPARK-27970) Support Hive 3.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-27970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27970. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Support Hive 3.0

[jira] [Commented] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859001#comment-16859001 ] Dhruve Ashar commented on SPARK-27937: -- The exception that we started encountering is while spark

[jira] [Comment Edited] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859001#comment-16859001 ] Dhruve Ashar edited comment on SPARK-27937 at 6/7/19 9:27 PM: -- The

[jira] [Resolved] (SPARK-27870) Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

[ https://issues.apache.org/jira/browse/SPARK-27870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27870. - Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 3.0.0 > Flush each batch for

[jira] [Assigned] (SPARK-27823) Add an abstraction layer for accelerator resource handling to avoid manipulating raw confs

[ https://issues.apache.org/jira/browse/SPARK-27823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-27823: - Assignee: Thomas Graves > Add an abstraction layer for accelerator resource handling

[jira] [Assigned] (SPARK-27823) Add an abstraction layer for accelerator resource handling to avoid manipulating raw confs

[ https://issues.apache.org/jira/browse/SPARK-27823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27823: Assignee: Apache Spark > Add an abstraction layer for accelerator resource handling to

[jira] [Assigned] (SPARK-27823) Add an abstraction layer for accelerator resource handling to avoid manipulating raw confs

[ https://issues.apache.org/jira/browse/SPARK-27823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27823: Assignee: (was: Apache Spark) > Add an abstraction layer for accelerator resource

[jira] [Comment Edited] (SPARK-27966) input_file_name empty when listing files in parallel

[ https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858739#comment-16858739 ] Christian Homberg edited comment on SPARK-27966 at 6/7/19 3:32 PM: ---

[jira] [Commented] (SPARK-27966) input_file_name empty when listing files in parallel

[ https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858739#comment-16858739 ] Christian Homberg commented on SPARK-27966: --- I'm afraid I can't. For one thing I can't share

[jira] [Resolved] (SPARK-27932) Update jackson versions on 2.4.x and 2.3.x branches

[ https://issues.apache.org/jira/browse/SPARK-27932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Dettinger resolved SPARK-27932. Resolution: Won't Fix Right, I didn't get that possible fixes/workarounds were already

[jira] [Commented] (SPARK-27932) Update jackson versions on 2.4.x and 2.3.x branches

[ https://issues.apache.org/jira/browse/SPARK-27932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858630#comment-16858630 ] Sean Owen commented on SPARK-27932: --- I don't see how you can update to 2.7.x and not get the behavior

[jira] [Commented] (SPARK-27932) Update jackson versions on 2.4.x and 2.3.x branches

[ https://issues.apache.org/jira/browse/SPARK-27932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858624#comment-16858624 ] Alex Dettinger commented on SPARK-27932: [~srowen] stated in [a somewhat related

[jira] [Assigned] (SPARK-27973) Streaming sample DirectKafkaWordCount should mention GroupId in usage

[ https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27973: - Assignee: Yuexin Zhang > Streaming sample DirectKafkaWordCount should mention GroupId in usage

[jira] [Resolved] (SPARK-27973) Streaming sample DirectKafkaWordCount should mention GroupId in usage

[ https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27973. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24819

[jira] [Updated] (SPARK-27973) Streaming sample DirectKafkaWordCount should mention GroupId in usage

[ https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27973: -- Priority: Trivial (was: Minor) (This is too trivial for a JIRA; the description and fix are all but

[jira] [Created] (SPARK-27977) MicroBatchWriter should use StreamWriter for human-friendly textual representation (toString)

Jacek Laskowski created SPARK-27977: --- Summary: MicroBatchWriter should use StreamWriter for human-friendly textual representation (toString) Key: SPARK-27977 URL:

[jira] [Created] (SPARK-27976) Add built-in Array Functions: array_append

Yuming Wang created SPARK-27976: --- Summary: Add built-in Array Functions: array_append Key: SPARK-27976 URL: https://issues.apache.org/jira/browse/SPARK-27976 Project: Spark Issue Type:

[jira] [Created] (SPARK-27975) ConsoleSink should display alias and options for streaming progress

Jacek Laskowski created SPARK-27975: --- Summary: ConsoleSink should display alias and options for streaming progress Key: SPARK-27975 URL: https://issues.apache.org/jira/browse/SPARK-27975 Project:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858430#comment-16858430 ] Edwin Biemond commented on SPARK-27927: --- just doing a spark-submit on the same host ( same pod)

[jira] [Commented] (SPARK-27785) Introduce .joinWith() overloads for typed inner joins of 3 or more tables

[ https://issues.apache.org/jira/browse/SPARK-27785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858402#comment-16858402 ] Hyukjin Kwon commented on SPARK-27785: -- To me, I don't have much information about how common this

[jira] [Resolved] (SPARK-27965) Add extractors for logical transforms

[ https://issues.apache.org/jira/browse/SPARK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27965. - Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 3.0.0 > Add extractors for logical

[jira] [Created] (SPARK-27974) Add built-in Aggregate Function: array_agg

Yuming Wang created SPARK-27974: --- Summary: Add built-in Aggregate Function: array_agg Key: SPARK-27974 URL: https://issues.apache.org/jira/browse/SPARK-27974 Project: Spark Issue Type: