[jira] [Assigned] (SPARK-31746) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31746: Assignee: Hyukjin Kwon > Flaky Test: LocalityPlacementStrategySuite.handle large number o

[jira] [Resolved] (SPARK-31746) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31746. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28566 [https://gi

[jira] [Resolved] (SPARK-31399) Closure cleaner broken in Scala 2.12

2020-05-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31399. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28463 [https://gith

[jira] [Comment Edited] (SPARK-28588) Build a SQL reference doc

2020-05-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109894#comment-17109894 ] Takeshi Yamamuro edited comment on SPARK-28588 at 5/18/20, 5:32 AM: --

[jira] [Updated] (SPARK-31747) Support for multiple null values when reading CSV data

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31747: - Issue Type: Improvement (was: Story) > Support for multiple null values when reading CSV data >

[jira] [Commented] (SPARK-28588) Build a SQL reference doc

2020-05-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109894#comment-17109894 ] Takeshi Yamamuro commented on SPARK-28588: -- Thanks, [~huaxingao] [~dkbiswal] !

[jira] [Updated] (SPARK-31747) Support for multiple null values when reading CSV data

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31747: - Affects Version/s: 3.0.0 2.4.5 > Support for multiple null values when re

[jira] [Commented] (SPARK-17878) Support for multiple null values when reading CSV data

2020-05-17 Thread K Jaya Shankar Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109893#comment-17109893 ] K Jaya Shankar Reddy commented on SPARK-17878: -- Okay. Created this -> https

[jira] [Comment Edited] (SPARK-17878) Support for multiple null values when reading CSV data

2020-05-17 Thread K Jaya Shankar Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109893#comment-17109893 ] K Jaya Shankar Reddy edited comment on SPARK-17878 at 5/18/20, 5:28 AM: --

[jira] [Assigned] (SPARK-28588) Build a SQL reference doc

2020-05-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reassigned SPARK-28588: Assignee: Huaxin Gao > Build a SQL reference doc > - > >

[jira] [Updated] (SPARK-31404) file source backward compatibility after calendar switch

2020-05-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31404: Attachment: Switch to Java 8 time API in Spark 3.0.pdf > file source backward compatibility after

[jira] [Updated] (SPARK-31408) Build Spark’s own datetime pattern definition

2020-05-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31408: Attachment: Switch to Java 8 time API in Spark 3.0.pdf > Build Spark’s own datetime pattern defini

[jira] [Assigned] (SPARK-31740) Use github URL instead of a broken link

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31740: - Assignee: William Hyun > Use github URL instead of a broken link > ---

[jira] [Resolved] (SPARK-31740) Use github URL instead of a broken link

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31740. --- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by pul

[jira] [Updated] (SPARK-31747) Support for multiple null values when reading CSV data

2020-05-17 Thread K Jaya Shankar Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] K Jaya Shankar Reddy updated SPARK-31747: - Description: There are CSV files out there with multiple values that are suppose

[jira] [Created] (SPARK-31747) Support for multiple null values when reading CSV data

2020-05-17 Thread K Jaya Shankar Reddy (Jira)
K Jaya Shankar Reddy created SPARK-31747: Summary: Support for multiple null values when reading CSV data Key: SPARK-31747 URL: https://issues.apache.org/jira/browse/SPARK-31747 Project: Spark

[jira] [Resolved] (SPARK-31727) Inconsistent error messages of casting timestamp to int

2020-05-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31727. - Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed > Inconsistent error

[jira] [Assigned] (SPARK-31743) Add spark_info metric into PrometheusResource

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31743: - Assignee: Dongjoon Hyun > Add spark_info metric into PrometheusResource > -

[jira] [Resolved] (SPARK-31743) Add spark_info metric into PrometheusResource

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31743. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28563 [https://

[jira] [Assigned] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31742: - Assignee: Hyukjin Kwon > Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do

[jira] [Resolved] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31742. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28562 [https://

[jira] [Resolved] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31744. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28564 [https://

[jira] [Assigned] (SPARK-31746) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31746: Assignee: (was: Apache Spark) > Flaky Test: LocalityPlacementStrategySuite.handle lar

[jira] [Assigned] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31744: - Assignee: Hyukjin Kwon > Remove Hive dependency in AppVeyor build temporarily > ---

[jira] [Assigned] (SPARK-31746) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31746: Assignee: Apache Spark > Flaky Test: LocalityPlacementStrategySuite.handle large number o

[jira] [Commented] (SPARK-31746) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109829#comment-17109829 ] Apache Spark commented on SPARK-31746: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-31102) spark-sql fails to parse when contains comment

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109811#comment-17109811 ] Apache Spark commented on SPARK-31102: -- User 'javierivanov' has created a pull requ

[jira] [Commented] (SPARK-31102) spark-sql fails to parse when contains comment

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109810#comment-17109810 ] Apache Spark commented on SPARK-31102: -- User 'javierivanov' has created a pull requ

[jira] [Created] (SPARK-31746) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2020-05-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31746: Summary: Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) Key: SPARK-31746 URL: https://issues.apache.org/jira/browse/SPARK-317

[jira] [Resolved] (SPARK-28588) Build a SQL reference doc

2020-05-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28588. -- Fix Version/s: 3.0.0 Resolution: Done Looks like this is done for 3.0 > Build a SQL re

[jira] [Resolved] (SPARK-28965) Document workings of CBO

2020-05-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28965. -- Resolution: Won't Fix > Document workings of CBO > > >

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109796#comment-17109796 ] Hyukjin Kwon commented on SPARK-31693: -- Gentle ping [~shaneknapp], seems this is bl

[jira] [Commented] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109734#comment-17109734 ] Apache Spark commented on SPARK-31744: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109733#comment-17109733 ] Apache Spark commented on SPARK-31744: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31744: Assignee: (was: Apache Spark) > Remove Hive dependency in AppVeyor build temporarily

[jira] [Assigned] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31744: Assignee: Apache Spark > Remove Hive dependency in AppVeyor build temporarily > -

[jira] [Created] (SPARK-31745) Enable Hive related test cases of SparkR in AppVeyor

2020-05-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31745: Summary: Enable Hive related test cases of SparkR in AppVeyor Key: SPARK-31745 URL: https://issues.apache.org/jira/browse/SPARK-31745 Project: Spark Issue Ty

[jira] [Updated] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31744: - Component/s: (was: Build) Tests > Remove Hive dependency in AppVeyor build

[jira] [Created] (SPARK-31744) Remove Hive dependency in AppVeyor build temporarily

2020-05-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31744: Summary: Remove Hive dependency in AppVeyor build temporarily Key: SPARK-31744 URL: https://issues.apache.org/jira/browse/SPARK-31744 Project: Spark Issue Ty

[jira] [Comment Edited] (SPARK-17878) Support for multiple null values when reading CSV data

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109724#comment-17109724 ] Hyukjin Kwon edited comment on SPARK-17878 at 5/18/20, 1:20 AM: --

[jira] [Commented] (SPARK-17878) Support for multiple null values when reading CSV data

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109724#comment-17109724 ] Hyukjin Kwon commented on SPARK-17878: -- No, it's not fixed. It was closed because i

[jira] [Assigned] (SPARK-31743) Add spark_info metric into PrometheusResource

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31743: Assignee: (was: Apache Spark) > Add spark_info metric into PrometheusResource > -

[jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109717#comment-17109717 ] Hyukjin Kwon commented on SPARK-28358: -- I took a look related issue to this. Seems

[jira] [Assigned] (SPARK-31743) Add spark_info metric into PrometheusResource

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31743: Assignee: Apache Spark > Add spark_info metric into PrometheusResource >

[jira] [Commented] (SPARK-31743) Add spark_info metric into PrometheusResource

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109718#comment-17109718 ] Apache Spark commented on SPARK-31743: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-31743) Add spark_info metric into PrometheusResource

2020-05-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-31743: - Summary: Add spark_info metric into PrometheusResource Key: SPARK-31743 URL: https://issues.apache.org/jira/browse/SPARK-31743 Project: Spark Issue Type: S

[jira] [Resolved] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31683. --- Fix Version/s: 3.0.0 Assignee: Dongjoon Hyun Resolution: Fixed This is resol

[jira] [Updated] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31742: - Affects Version/s: 3.0.0 > Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fa

[jira] [Commented] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109714#comment-17109714 ] Apache Spark commented on SPARK-31742: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31742: Assignee: (was: Apache Spark) > Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-

[jira] [Commented] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109713#comment-17109713 ] Apache Spark commented on SPARK-31742: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31742: Assignee: Apache Spark > Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do n

[jira] [Updated] (SPARK-31742) Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31742: - Summary: Flaky tests: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user

[jira] [Created] (SPARK-31742) HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials

2020-05-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31742: Summary: HadoopDelegationTokenManagerSuite.SPARK-29082: do not fail if current user does not have credentials Key: SPARK-31742 URL: https://issues.apache.org/jira/browse/SPARK-317

[jira] [Updated] (SPARK-31741) Flaky test: pyspark.sql.dataframe.DataFrame.intersectAll

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31741: - Affects Version/s: (was: 3.0.0) 3.1.0 > Flaky test: pyspark.sql.dataf

[jira] [Updated] (SPARK-31741) Flaky test: pyspark.sql.dataframe.DataFrame.intersectAll

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31741: - Component/s: Tests > Flaky test: pyspark.sql.dataframe.DataFrame.intersectAll >

[jira] [Updated] (SPARK-31732) Disable some flaky tests temporarily

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31732: - Description: https://issues.apache.org/jira/browse/SPARK-31722 https://issues.apache.org/jira/br

[jira] [Updated] (SPARK-31741) Flaky test: pyspark.sql.dataframe.DataFrame.intersectAll

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31741: - Description: https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7-hive-2.

[jira] [Updated] (SPARK-31732) Disable some flaky tests temporarily

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31732: - Description: https://issues.apache.org/jira/browse/SPARK-31722 https://issues.apache.org/jira/br

[jira] [Created] (SPARK-31741) Flaky test: pyspark.sql.dataframe.DataFrame.intersectAll

2020-05-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31741: Summary: Flaky test: pyspark.sql.dataframe.DataFrame.intersectAll Key: SPARK-31741 URL: https://issues.apache.org/jira/browse/SPARK-31741 Project: Spark Issu

[jira] [Updated] (SPARK-31741) Flaky test: pyspark.sql.dataframe.DataFrame.intersectAll

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31741: - Description: https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7-hive-2.

[jira] [Updated] (SPARK-31728) Flaky test: org.apache.spark.streaming.StreamingContextSuite

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31728: - Summary: Flaky test: org.apache.spark.streaming.StreamingContextSuite (was: flaky test: org.apa

[jira] [Updated] (SPARK-31723) Flaky test: org.apache.spark.deploy.history.HistoryServerSuite

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31723: - Summary: Flaky test: org.apache.spark.deploy.history.HistoryServerSuite (was: flaky test: org.a

[jira] [Updated] (SPARK-31730) Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31730: - Summary: Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite (was: flaky test: org.a

[jira] [Updated] (SPARK-31731) Flaky test: org.apache.spark.sql.kafka010.KafkaMicroBatchV1SourceSuite

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31731: - Summary: Flaky test: org.apache.spark.sql.kafka010.KafkaMicroBatchV1SourceSuite (was: flaky tes

[jira] [Updated] (SPARK-31729) Flaky test: org.apache.spark.sql.kafka010.KafkaRelationSuiteV2

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31729: - Summary: Flaky test: org.apache.spark.sql.kafka010.KafkaRelationSuiteV2 (was: flaky test: org.a

[jira] [Updated] (SPARK-31722) Flaky test: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31722: - Summary: Flaky test: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite (was: flaky tes

[jira] [Updated] (SPARK-31732) Disable some flaky tests temporarily

2020-05-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31732: - Summary: Disable some flaky tests temporarily (was: disable some flaky test) > Disable some fl

[jira] [Commented] (SPARK-31740) Use github URL instead of a broken link

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109710#comment-17109710 ] Apache Spark commented on SPARK-31740: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-31740) Use github URL instead of a broken link

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31740: Assignee: (was: Apache Spark) > Use github URL instead of a broken link > --

[jira] [Assigned] (SPARK-31740) Use github URL instead of a broken link

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31740: Assignee: Apache Spark > Use github URL instead of a broken link > -

[jira] [Commented] (SPARK-31740) Use github URL instead of a broken link

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109709#comment-17109709 ] Apache Spark commented on SPARK-31740: -- User 'williamhyun' has created a pull reque

[jira] [Created] (SPARK-31740) Use github URL instead of a broken link

2020-05-17 Thread William Hyun (Jira)
William Hyun created SPARK-31740: Summary: Use github URL instead of a broken link Key: SPARK-31740 URL: https://issues.apache.org/jira/browse/SPARK-31740 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-31366) Document aggregation in the sql reference doc

2020-05-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31366. -- Resolution: Won't Fix > Document aggregation in the sql reference doc > --

[jira] [Updated] (SPARK-27217) Nested schema pruning doesn't work for aggregation e.g. `sum`.

2020-05-17 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-27217: Affects Version/s: (was: 3.0.0) 3.1.0 > Nested schema pruning doesn't w

[jira] [Commented] (SPARK-27217) Nested schema pruning doesn't work for aggregation e.g. `sum`.

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109672#comment-17109672 ] Apache Spark commented on SPARK-27217: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-27217) Nested schema pruning doesn't work for aggregation e.g. `sum`.

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109669#comment-17109669 ] Apache Spark commented on SPARK-27217: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-31739) Docstring syntax issues prevent proper compilation of documentation

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31739: Assignee: Apache Spark > Docstring syntax issues prevent proper compilation of documentat

[jira] [Commented] (SPARK-31739) Docstring syntax issues prevent proper compilation of documentation

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109636#comment-17109636 ] Apache Spark commented on SPARK-31739: -- User 'DavidToneian' has created a pull requ

[jira] [Assigned] (SPARK-31739) Docstring syntax issues prevent proper compilation of documentation

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31739: Assignee: (was: Apache Spark) > Docstring syntax issues prevent proper compilation of

[jira] [Commented] (SPARK-31739) Docstring syntax issues prevent proper compilation of documentation

2020-05-17 Thread David Toneian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109634#comment-17109634 ] David Toneian commented on SPARK-31739: --- Proposed a fix in [PR #28559|https://gith

[jira] [Created] (SPARK-31739) Docstring syntax issues prevent proper compilation of documentation

2020-05-17 Thread David Toneian (Jira)
David Toneian created SPARK-31739: - Summary: Docstring syntax issues prevent proper compilation of documentation Key: SPARK-31739 URL: https://issues.apache.org/jira/browse/SPARK-31739 Project: Spark

[jira] [Assigned] (SPARK-31738) Describe 'L' and 'M' month pattern letters

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31738: Assignee: Apache Spark > Describe 'L' and 'M' month pattern letters > ---

[jira] [Assigned] (SPARK-31738) Describe 'L' and 'M' month pattern letters

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31738: Assignee: Apache Spark > Describe 'L' and 'M' month pattern letters > ---

[jira] [Commented] (SPARK-31738) Describe 'L' and 'M' month pattern letters

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109609#comment-17109609 ] Apache Spark commented on SPARK-31738: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-31738) Describe 'L' and 'M' month pattern letters

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31738: Assignee: (was: Apache Spark) > Describe 'L' and 'M' month pattern letters >

[jira] [Created] (SPARK-31738) Describe 'L' and 'M' month pattern letters

2020-05-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31738: -- Summary: Describe 'L' and 'M' month pattern letters Key: SPARK-31738 URL: https://issues.apache.org/jira/browse/SPARK-31738 Project: Spark Issue Type: Documentat

[jira] [Updated] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31655: -- Fix Version/s: (was: 3.1.0) 2.4.7 3.0.0 > Upgrade sn

[jira] [Updated] (SPARK-27471) Reorganize public v2 catalog API

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27471: Fix Version/s: 3.0.0 > Reorganize public v2 catalog API > > >

[jira] [Updated] (SPARK-27886) Add Apache Spark project to https://python3statement.org/

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27886: Fix Version/s: 3.0.0 > Add Apache Spark project to https://python3statement.org/ > ---

[jira] [Updated] (SPARK-28413) sizeInByte is Not updated for parquet datasource on Next Insert.

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28413: Fix Version/s: 3.0.0 > sizeInByte is Not updated for parquet datasource on Next Insert. >

[jira] [Updated] (SPARK-28426) Metadata Handling in Thrift Server

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28426: Fix Version/s: 3.0.0 > Metadata Handling in Thrift Server > -- > >

[jira] [Updated] (SPARK-27885) Announce deprecation of Python 2 support

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27885: Fix Version/s: 3.0.0 > Announce deprecation of Python 2 support >

[jira] [Updated] (SPARK-31201) add an individual config for skewed partition threshold

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31201: Fix Version/s: 3.0.0 > add an individual config for skewed partition threshold > -

[jira] [Updated] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27763: Fix Version/s: 3.0.0 > Port test cases from PostgreSQL to Spark SQL >

[jira] [Updated] (SPARK-18486) Access of SparkUI after task completion

2020-05-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18486: Component/s: (was: Optimizer) > Access of SparkUI after task completion >

[jira] [Resolved] (SPARK-30273) Add melt() function

2020-05-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30273. -- Resolution: Won't Fix > Add melt() function > --- > > Key: SPA

[jira] [Assigned] (SPARK-31737) SparkSQL can't recognize the modified length of Hive varchar

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31737: Assignee: (was: Apache Spark) > SparkSQL can't recognize the modified length of Hive

[jira] [Commented] (SPARK-31737) SparkSQL can't recognize the modified length of Hive varchar

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109526#comment-17109526 ] Apache Spark commented on SPARK-31737: -- User 'KaiZhang956' has created a pull reque

[jira] [Assigned] (SPARK-31737) SparkSQL can't recognize the modified length of Hive varchar

2020-05-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31737: Assignee: Apache Spark > SparkSQL can't recognize the modified length of Hive varchar > -

  1   2   >