[jira] [Updated] (SPARK-26060) Track SparkConf entries and make SET command reject such entries.

2020-01-27 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26060: - Labels: release-notes (was: ) > Track SparkConf entries and make SET command reject such

[jira] [Updated] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

2020-01-27 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-19287: - Docs Text: JavaPairRDD/JavaPairDStream.flatMapValues() now requires a FlatMapFunction as an

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-01-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024909#comment-17024909 ] Kousuke Saruta commented on SPARK-29292: [~srowen] Are you already working on this? > Fix

[jira] [Commented] (SPARK-26295) [K8S] serviceAccountName is not set in client mode

2020-01-27 Thread Mathew Wicks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024838#comment-17024838 ] Mathew Wicks commented on SPARK-26295: -- I am still encountering this issue on 2.4.4, (and given

[jira] [Commented] (SPARK-28360) The serviceAccountName configuration item does not take effect in client mode.

2020-01-27 Thread Mathew Wicks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024835#comment-17024835 ] Mathew Wicks commented on SPARK-28360: -- This issue was also reported for 2.4, but has not been

[jira] [Comment Edited] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently

2020-01-27 Thread Denys Tyshetskyy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024811#comment-17024811 ] Denys Tyshetskyy edited comment on SPARK-23829 at 1/28/20 1:56 AM: --- Hi

[jira] [Comment Edited] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently

2020-01-27 Thread Denys Tyshetskyy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024811#comment-17024811 ] Denys Tyshetskyy edited comment on SPARK-23829 at 1/28/20 1:53 AM: --- Hi

[jira] [Commented] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently

2020-01-27 Thread Denys Tyshetskyy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024811#comment-17024811 ] Denys Tyshetskyy commented on SPARK-23829: -- Hi [~gsomogyi], I am experiencing the same issue

[jira] [Created] (SPARK-30656) Support the "minPartitions" option in Kafka batch source and streaming source v1

2020-01-27 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-30656: Summary: Support the "minPartitions" option in Kafka batch source and streaming source v1 Key: SPARK-30656 URL: https://issues.apache.org/jira/browse/SPARK-30656

[jira] [Created] (SPARK-30655) Update WebUI Bootstrap to 4.4.1

2020-01-27 Thread Dale Clarke (Jira)
Dale Clarke created SPARK-30655: --- Summary: Update WebUI Bootstrap to 4.4.1 Key: SPARK-30655 URL: https://issues.apache.org/jira/browse/SPARK-30655 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30654) Update Docs Bootstrap to 4.4.1

2020-01-27 Thread Dale Clarke (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dale Clarke updated SPARK-30654: Summary: Update Docs Bootstrap to 4.4.1 (was: Update Bootstrap to 4.4.1) > Update Docs Bootstrap

[jira] [Commented] (SPARK-30654) Update Bootstrap to 4.4.1

2020-01-27 Thread Dale Clarke (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024630#comment-17024630 ] Dale Clarke commented on SPARK-30654: - GitHub Pull Request -

[jira] [Created] (SPARK-30654) Update Bootstrap to 4.4.1

2020-01-27 Thread Dale Clarke (Jira)
Dale Clarke created SPARK-30654: --- Summary: Update Bootstrap to 4.4.1 Key: SPARK-30654 URL: https://issues.apache.org/jira/browse/SPARK-30654 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-30633) Codegen fails when xxHash seed is not an integer

2020-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30633: - Assignee: Patrick Cording > Codegen fails when xxHash seed is not an integer >

[jira] [Resolved] (SPARK-30625) Add `escapeChar` parameter to the `like` function

2020-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30625. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27355

[jira] [Assigned] (SPARK-30625) Add `escapeChar` parameter to the `like` function

2020-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30625: - Assignee: Maxim Gekk > Add `escapeChar` parameter to the `like` function >

[jira] [Resolved] (SPARK-30633) Codegen fails when xxHash seed is not an integer

2020-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30633. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-30653) EOL character enforcement for java/scala/xml/py/R files

2020-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30653. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27365

[jira] [Assigned] (SPARK-30653) EOL character enforcement for java/scala/xml/py/R files

2020-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30653: - Assignee: Jungtaek Lim > EOL character enforcement for java/scala/xml/py/R files >

[jira] [Updated] (SPARK-30653) EOL character enforcement for java/scala/xml/py/R files

2020-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30653: -- Reporter: Jungtaek Lim (was: Dongjoon Hyun) > EOL character enforcement for

[jira] [Created] (SPARK-30653) EOL character enforcement for java/scala/xml/py/R files

2020-01-27 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-30653: - Summary: EOL character enforcement for java/scala/xml/py/R files Key: SPARK-30653 URL: https://issues.apache.org/jira/browse/SPARK-30653 Project: Spark

[jira] [Resolved] (SPARK-30652) EXPLAIN EXTENDED does not show detail information for aggregate operators

2020-01-27 Thread Xin Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu resolved SPARK-30652. Resolution: Duplicate > EXPLAIN EXTENDED does not show detail information for aggregate operators >

[jira] [Created] (SPARK-30652) EXPLAIN EXTENDED does not show detail information for aggregate operators

2020-01-27 Thread Xin Wu (Jira)
Xin Wu created SPARK-30652: -- Summary: EXPLAIN EXTENDED does not show detail information for aggregate operators Key: SPARK-30652 URL: https://issues.apache.org/jira/browse/SPARK-30652 Project: Spark

[jira] [Created] (SPARK-30651) EXPLAIN EXTENDED does not show detail information for aggregate operators

2020-01-27 Thread Xin Wu (Jira)
Xin Wu created SPARK-30651: -- Summary: EXPLAIN EXTENDED does not show detail information for aggregate operators Key: SPARK-30651 URL: https://issues.apache.org/jira/browse/SPARK-30651 Project: Spark

[jira] [Resolved] (SPARK-30588) Document CLUSTER BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30588. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27297

[jira] [Assigned] (SPARK-30588) Document CLUSTER BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30588: Assignee: Dilip Biswal > Document CLUSTER BY Clause of SELECT statement in SQL

[jira] [Resolved] (SPARK-30589) Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30589. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27298

[jira] [Updated] (SPARK-30589) Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30589: - Priority: Minor (was: Major) > Document DISTRIBUTE BY Clause of SELECT statement in SQL

[jira] [Assigned] (SPARK-30589) Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30589: Assignee: Dilip Biswal > Document DISTRIBUTE BY Clause of SELECT statement in SQL

[jira] [Resolved] (SPARK-30581) Document SORT BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30581. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27289

[jira] [Updated] (SPARK-30581) Document SORT BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30581: - Priority: Minor (was: Major) > Document SORT BY Clause of SELECT statement in SQL Reference. >

[jira] [Assigned] (SPARK-30581) Document SORT BY Clause of SELECT statement in SQL Reference.

2020-01-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30581: Assignee: Dilip Biswal > Document SORT BY Clause of SELECT statement in SQL Reference. >

[jira] [Created] (SPARK-30650) The parquet file written by spark often incurs corrupted footer and hence not readable

2020-01-27 Thread DILIP KUMAR MOHAPATRO (Jira)
DILIP KUMAR MOHAPATRO created SPARK-30650: - Summary: The parquet file written by spark often incurs corrupted footer and hence not readable Key: SPARK-30650 URL:

[jira] [Updated] (SPARK-30649) Azure Spark read : ContentMD5 header is missing in the response

2020-01-27 Thread Nilesh Patil (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nilesh Patil updated SPARK-30649: - Flags: Important > Azure Spark read : ContentMD5 header is missing in the response >

[jira] [Created] (SPARK-30649) Azure Spark read : ContentMD5 header is missing in the response

2020-01-27 Thread Nilesh Patil (Jira)
Nilesh Patil created SPARK-30649: Summary: Azure Spark read : ContentMD5 header is missing in the response Key: SPARK-30649 URL: https://issues.apache.org/jira/browse/SPARK-30649 Project: Spark

[jira] [Created] (SPARK-30648) Support filters pushdown in JSON datasource

2020-01-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30648: -- Summary: Support filters pushdown in JSON datasource Key: SPARK-30648 URL: https://issues.apache.org/jira/browse/SPARK-30648 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30647) When creating a custom datasource File NotFoundExpection happens

2020-01-27 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024242#comment-17024242 ] Jorge Machado commented on SPARK-30647: --- I found a way to overcome this. I just replace %20 with "