[jira] [Assigned] (SPARK-31185) implement VarianceThresholdSelector

2020-03-21 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-31185: Assignee: Huaxin Gao > implement VarianceThresholdSelector >

[jira] [Resolved] (SPARK-31185) implement VarianceThresholdSelector

2020-03-21 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31185. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27954

[jira] [Created] (SPARK-31214) Upgrade Janino to 3.1.2

2020-03-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-31214: - Summary: Upgrade Janino to 3.1.2 Key: SPARK-31214 URL: https://issues.apache.org/jira/browse/SPARK-31214 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-31101) Upgrade Janino to 3.0.16

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31101: - Assignee: Jungtaek Lim > Upgrade Janino to 3.0.16 > > >

[jira] [Resolved] (SPARK-31101) Upgrade Janino to 3.0.16

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31101. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27932

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Description: We got some report on failure on user's query which Janino throws error on

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Summary: Upgrade Janino to 3.0.16 (was: Upgrade Janino to 3.1.1) > Upgrade Janino to 3.0.16

[jira] [Assigned] (SPARK-30541) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30541: - Assignee: Gabor Somogyi > Flaky test:

[jira] [Resolved] (SPARK-30541) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30541. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27877

[jira] [Created] (SPARK-31213) Arrange the configuration of Spark SQL

2020-03-21 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31213: -- Summary: Arrange the configuration of Spark SQL Key: SPARK-31213 URL: https://issues.apache.org/jira/browse/SPARK-31213 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-31184) Support getTablesByType API of Hive Client

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31184. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27952

[jira] [Assigned] (SPARK-31184) Support getTablesByType API of Hive Client

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31184: - Assignee: Xin Wu > Support getTablesByType API of Hive Client >

[jira] [Updated] (SPARK-31209) Not compatible with new version of scalatest (3.1.0 and above)

2020-03-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31209: Affects Version/s: (was: 2.4.5) 3.1.0 > Not compatible with new

[jira] [Updated] (SPARK-30494) Duplicates cached RDD when create or replace an existing view

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30494: -- Affects Version/s: 2.0.2 2.1.3 > Duplicates cached RDD when create or

[jira] [Updated] (SPARK-30494) Duplicates cached RDD when create or replace an existing view

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30494: -- Description: We can reproduce by below commands: {code} beeline> create or replace temporary

[jira] [Updated] (SPARK-30494) Duplicates cached RDD when create or replace an existing view

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30494: -- Affects Version/s: 2.2.3 > Duplicates cached RDD when create or replace an existing view >

[jira] [Updated] (SPARK-30494) Duplicates cached RDD when create or replace an existing view

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30494: -- Affects Version/s: 2.3.4 > Duplicates cached RDD when create or replace an existing view >

[jira] [Updated] (SPARK-30494) Duplicates cached RDD when create or replace an existing view

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30494: -- Affects Version/s: 2.4.5 > Duplicates cached RDD when create or replace an existing view >

[jira] [Commented] (SPARK-30494) Duplicates cached RDD when create or replace an existing view

2020-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064093#comment-17064093 ] Dongjoon Hyun commented on SPARK-30494: --- Hi, [~cltlfcjin]. How about older versions, 2.3.4 and

[jira] [Commented] (SPARK-31212) Failure of casting the '1000-02-29' string to the date type

2020-03-21 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064017#comment-17064017 ] Maxim Gekk commented on SPARK-31212: The isLeapYear() function in 2.4 assumes Proleptic Gregorian

[jira] [Created] (SPARK-31212) Failure of casting the '1000-02-29' string to the date type

2020-03-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31212: -- Summary: Failure of casting the '1000-02-29' string to the date type Key: SPARK-31212 URL: https://issues.apache.org/jira/browse/SPARK-31212 Project: Spark

[jira] [Updated] (SPARK-31199) Separate connection timeout and idle timeout for netty

2020-03-21 Thread runnings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runnings updated SPARK-31199: - Description: io.connectionTimeout only used for connection timeout for connection setup while

[jira] [Commented] (SPARK-27097) Avoid embedding platform-dependent offsets literally in whole-stage generated code

2020-03-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063909#comment-17063909 ] angerszhu commented on SPARK-27097: --- [~irashid] to be honest, I meet this problem these days.  

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063851#comment-17063851 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 11:33 AM: --- At

[jira] [Commented] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063851#comment-17063851 ] jiaan.geng commented on SPARK-31210: At finally, I guess your problem resolved by

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063849#comment-17063849 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 10:40 AM: --- The

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063830#comment-17063830 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 10:40 AM: ---

[jira] [Commented] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063849#comment-17063849 ] jiaan.geng commented on SPARK-31210: The content of /home/test/test_table_like.json show below:

[jira] [Created] (SPARK-31211) Failure on loading 1000-02-29 from parquet saved by Spark 2.4.5

2020-03-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31211: -- Summary: Failure on loading 1000-02-29 from parquet saved by Spark 2.4.5 Key: SPARK-31211 URL: https://issues.apache.org/jira/browse/SPARK-31211 Project: Spark

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063743#comment-17063743 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 10:10 AM: ---

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063830#comment-17063830 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 10:10 AM: ---

[jira] [Updated] (SPARK-31199) Separate connection timeout and idle timeout for netty

2020-03-21 Thread runnings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runnings updated SPARK-31199: - Description: io.connectionTimeout only used for connection timeout for connection setup while

[jira] [Updated] (SPARK-31199) Separate connection timeout and idle timeout for netty

2020-03-21 Thread runnings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runnings updated SPARK-31199: - Summary: Separate connection timeout and idle timeout for netty (was: Separate connection timeout and

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063744#comment-17063744 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 9:56 AM: -- {code:java}

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063743#comment-17063743 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 9:56 AM: -- {code:java}

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063742#comment-17063742 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 9:56 AM: -- {code:java}

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063830#comment-17063830 ] jiaan.geng edited comment on SPARK-31210 at 3/21/20, 9:56 AM: -- {code:java}

[jira] [Commented] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063831#comment-17063831 ] jiaan.geng commented on SPARK-31210: I cannot reproduce it. Could you paste detail info for it? >

[jira] [Commented] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063830#comment-17063830 ] jiaan.geng commented on SPARK-31210: scala> spark.sql("select * from xsql.test_table_like2 where

[jira] [Comment Edited] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread Mingli Rui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063792#comment-17063792 ] Mingli Rui edited comment on SPARK-31210 at 3/21/20, 6:29 AM: -- In the

[jira] [Commented] (SPARK-31210) An issue for Spark SQL LIKE-with-ESCAPE clause

2020-03-21 Thread Mingli Rui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063792#comment-17063792 ] Mingli Rui commented on SPARK-31210: In the repro, the DataFrame is accessing an external database