[jira] [Commented] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

2020-02-05 Thread Mahima Khatri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031318#comment-17031318 ] Mahima Khatri commented on SPARK-27298: --- @Sunita ,We tested the bug with

[jira] [Updated] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

2020-02-05 Thread Mahima Khatri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahima Khatri updated SPARK-27298: -- Attachment: Linux-spark-2.4.4_result.txt Linux-spark-2.3.0_result.txt >

[jira] [Commented] (SPARK-30595) Unable to create local temp dir on spark on k8s mode, with defaults.

2020-02-05 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031309#comment-17031309 ] Prashant Sharma commented on SPARK-30595: - Resolving this as not a problem, as this was a

[jira] [Resolved] (SPARK-30595) Unable to create local temp dir on spark on k8s mode, with defaults.

2020-02-05 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-30595. - Resolution: Not A Problem > Unable to create local temp dir on spark on k8s mode, with

[jira] [Resolved] (SPARK-30612) can't resolve qualified column name with v2 tables

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30612. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27391

[jira] [Assigned] (SPARK-30612) can't resolve qualified column name with v2 tables

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30612: --- Assignee: Terry Kim > can't resolve qualified column name with v2 tables >

[jira] [Resolved] (SPARK-30729) Eagerly filter out zombie TaskSetManager before offering resources

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30729. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27455

[jira] [Assigned] (SPARK-30729) Eagerly filter out zombie TaskSetManager before offering resources

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30729: --- Assignee: wuyi > Eagerly filter out zombie TaskSetManager before offering resources >

[jira] [Commented] (SPARK-30711) 64KB JVM bytecode limit - janino.InternalCompilerException

2020-02-05 Thread Kazuaki Ishizaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031276#comment-17031276 ] Kazuaki Ishizaki commented on SPARK-30711: -- Now, I am looking at this with master branch at

[jira] [Updated] (SPARK-30746) support envFrom configMapRef

2020-02-05 Thread Viktor Bogdanov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viktor Bogdanov updated SPARK-30746: Description: Add a configuration parameter to add environment variables to executor and

[jira] [Created] (SPARK-30746) support envFrom configMapRef

2020-02-05 Thread Viktor Bogdanov (Jira)
Viktor Bogdanov created SPARK-30746: --- Summary: support envFrom configMapRef Key: SPARK-30746 URL: https://issues.apache.org/jira/browse/SPARK-30746 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-27262) Add explicit UTF-8 Encoding to DESCRIPTION

2020-02-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27262. -- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-30737) Reenable to generate Rd files

2020-02-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30737. -- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-30745) Spark streaming, kafka broker error, "Failed to get records for spark-executor- .... after polling for 512"

2020-02-05 Thread Harneet K (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harneet K updated SPARK-30745: -- Description: We have a spark streaming application reading data from Kafka. Data size: 15 Million

[jira] [Created] (SPARK-30745) Spark streaming, kafka broker error, "Failed to get records for spark-executor- .... after polling for 512"

2020-02-05 Thread Harneet K (Jira)
Harneet K created SPARK-30745: - Summary: Spark streaming, kafka broker error, "Failed to get records for spark-executor- after polling for 512" Key: SPARK-30745 URL:

[jira] [Created] (SPARK-30744) Optimize AnalyzePartitionCommand by calculating location sizes in parallel

2020-02-05 Thread wuyi (Jira)
wuyi created SPARK-30744: Summary: Optimize AnalyzePartitionCommand by calculating location sizes in parallel Key: SPARK-30744 URL: https://issues.apache.org/jira/browse/SPARK-30744 Project: Spark

[jira] [Comment Edited] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

2020-02-05 Thread Mark Sirek (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879735#comment-16879735 ] Mark Sirek edited comment on SPARK-28067 at 2/6/20 1:08 AM: I tried the test

[jira] [Resolved] (SPARK-30743) Use JRE instead of JDK in K8S integration test

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30743. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27469

[jira] [Assigned] (SPARK-30743) Use JRE instead of JDK in K8S integration test

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30743: - Assignee: Dongjoon Hyun > Use JRE instead of JDK in K8S integration test >

[jira] [Created] (SPARK-30743) Use JRE instead of JDK in K8S integration test

2020-02-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-30743: - Summary: Use JRE instead of JDK in K8S integration test Key: SPARK-30743 URL: https://issues.apache.org/jira/browse/SPARK-30743 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Tomohiro Tanaka (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031099#comment-17031099 ] Tomohiro Tanaka commented on SPARK-30735: - Hello, [~dongjoon]! Thanks for your checking this

[jira] [Commented] (SPARK-30122) Allow setting serviceAccountName for executor pods

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031085#comment-17031085 ] Dongjoon Hyun commented on SPARK-30122: --- Thank YOU, [~ayudovin]. > Allow setting

[jira] [Assigned] (SPARK-30122) Allow setting serviceAccountName for executor pods

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30122: - Assignee: Artsiom Yudovin > Allow setting serviceAccountName for executor pods >

[jira] [Commented] (SPARK-30122) Allow setting serviceAccountName for executor pods

2020-02-05 Thread Artsiom Yudovin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031084#comment-17031084 ] Artsiom Yudovin commented on SPARK-30122: - (y) > Allow setting serviceAccountName for executor

[jira] [Updated] (SPARK-30122) Allow setting serviceAccountName for executor pods

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30122: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Allow setting

[jira] [Resolved] (SPARK-30122) Allow setting serviceAccountName for executor pods

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30122. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27034

[jira] [Created] (SPARK-30742) Resource discovery should protect against user returing empty string for address

2020-02-05 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-30742: - Summary: Resource discovery should protect against user returing empty string for address Key: SPARK-30742 URL: https://issues.apache.org/jira/browse/SPARK-30742

[jira] [Comment Edited] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031065#comment-17031065 ] Dongjoon Hyun edited comment on SPARK-30735 at 2/5/20 9:49 PM: --- Hi,

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30735: -- Fix Version/s: (was: 3.1.0) (was: 3.0.0) > Improving writing

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30735: -- Flags: (was: Important) > Improving writing performance by adding repartition based on

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30735: -- Affects Version/s: (was: 2.4.4) (was: 2.4.3)

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30735: -- Component/s: (was: Spark Core) SQL > Improving writing performance by

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30735: -- Target Version/s: (was: 3.0.0, 3.1.0) > Improving writing performance by adding repartition

[jira] [Commented] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031065#comment-17031065 ] Dongjoon Hyun commented on SPARK-30735: --- Hi, [~tom_tanaka]. Thank you for filing a JIRA and making

[jira] [Assigned] (SPARK-30721) fix DataFrameAggregateSuite when enabling AQE

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30721: - Assignee: Wenchen Fan > fix DataFrameAggregateSuite when enabling AQE >

[jira] [Resolved] (SPARK-30721) fix DataFrameAggregateSuite when enabling AQE

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30721. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27451

[jira] [Commented] (SPARK-28880) ANSI SQL: Bracketed comments

2020-02-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030974#comment-17030974 ] Xiao Li commented on SPARK-28880: -

[jira] [Commented] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

2020-02-05 Thread Sunitha Kambhampati (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030968#comment-17030968 ] Sunitha Kambhampati commented on SPARK-27298: - If you get a chance to repro the issue again,

[jira] [Commented] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

2020-02-05 Thread Sunitha Kambhampati (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030961#comment-17030961 ] Sunitha Kambhampati commented on SPARK-27298: - I tried on linux as well with the spark

[jira] [Updated] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

2020-02-05 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-30741: - Attachment: SparkBug.png > The data returned from SAS using JDBC reader contains column label >

[jira] [Resolved] (SPARK-30738) Use specific image version in "Launcher client dependencies" test

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30738. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27465

[jira] [Created] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

2020-02-05 Thread Gary Liu (Jira)
Gary Liu created SPARK-30741: Summary: The data returned from SAS using JDBC reader contains column label Key: SPARK-30741 URL: https://issues.apache.org/jira/browse/SPARK-30741 Project: Spark

[jira] [Updated] (SPARK-30740) months_between wrong calculation

2020-02-05 Thread nhufas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nhufas updated SPARK-30740: --- Description: months_between not calculating right for February example   {{select }} {{ 

[jira] [Created] (SPARK-30740) months_between wrong calculation

2020-02-05 Thread nhufas (Jira)
nhufas created SPARK-30740: -- Summary: months_between wrong calculation Key: SPARK-30740 URL: https://issues.apache.org/jira/browse/SPARK-30740 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-20384) supporting value classes over primitives in DataSets

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20384: -- Affects Version/s: (was: 2.1.0) 3.1.0 > supporting value classes

[jira] [Updated] (SPARK-30523) Collapse back to back aggregations into a single aggregate to reduce the number of shuffles

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30523: -- Component/s: (was: Optimizer) SQL > Collapse back to back aggregations

[jira] [Updated] (SPARK-30523) Collapse back to back aggregations into a single aggregate to reduce the number of shuffles

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30523: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Collapse back to back

[jira] [Updated] (SPARK-20384) supporting value classes over primitives in DataSets

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20384: -- Component/s: (was: Optimizer) > supporting value classes over primitives in DataSets >

[jira] [Updated] (SPARK-28478) Optimizer rule to remove unnecessary explicit null checks for null-intolerant expressions (e.g. if(x is null, x, f(x)))

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28478: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Optimizer rule to remove

[jira] [Resolved] (SPARK-30636) Unable to add packages on spark-packages.org

2020-02-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30636. - Fix Version/s: 3.0.0 Assignee: Cheng Lian (was: Burak Yavuz) Resolution: Fixed >

[jira] [Updated] (SPARK-28478) Optimizer rule to remove unnecessary explicit null checks for null-intolerant expressions (e.g. if(x is null, x, f(x)))

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28478: -- Component/s: (was: Optimizer) > Optimizer rule to remove unnecessary explicit null checks

[jira] [Created] (SPARK-30739) unable to turn off Hadoop's trash feature

2020-02-05 Thread Ohad Raviv (Jira)
Ohad Raviv created SPARK-30739: -- Summary: unable to turn off Hadoop's trash feature Key: SPARK-30739 URL: https://issues.apache.org/jira/browse/SPARK-30739 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

2020-02-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030742#comment-17030742 ] Maxim Gekk commented on SPARK-30730: [~srowen] Since Spark 2.2, CAST uses the session time zone. In

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

2020-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030723#comment-17030723 ] Sean R. Owen commented on SPARK-30730: -- Is it a regression? just asking if it means it must be in

[jira] [Commented] (SPARK-30686) Spark 2.4.4 metrics endpoint throwing error

2020-02-05 Thread Behroz Sikander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030653#comment-17030653 ] Behroz Sikander commented on SPARK-30686: - I have pinged. I hope someone can help with the

[jira] [Updated] (SPARK-30722) Document type hints in pandas UDF

2020-02-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30722: - Target Version/s: 3.0.0 > Document type hints in pandas UDF > -

[jira] [Assigned] (SPARK-30738) Use specific image version in "Launcher client dependencies" test

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30738: - Target Version/s: 3.0.0 Assignee: Dongjoon Hyun > Use specific image

[jira] [Resolved] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30668. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27441

[jira] [Assigned] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30668: --- Assignee: Maxim Gekk > to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using

[jira] [Updated] (SPARK-30738) Use specific image version in "Launcher client dependencies" test

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30738: -- Summary: Use specific image version in "Launcher client dependencies" test (was: Fix

[jira] [Updated] (SPARK-30738) Fix "Launcher client dependencies" test

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30738: -- Summary: Fix "Launcher client dependencies" test (was: Fix flaky "Launcher client

[jira] [Assigned] (SPARK-30506) Document general file source options

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30506: --- Assignee: wuyi > Document general file source options >

[jira] [Resolved] (SPARK-30506) Document general file source options

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30506. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27302

[jira] [Created] (SPARK-30738) Fix flaky "Launcher client dependencies" test

2020-02-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-30738: - Summary: Fix flaky "Launcher client dependencies" test Key: SPARK-30738 URL: https://issues.apache.org/jira/browse/SPARK-30738 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-30715) Upgrade fabric8 to 4.7.1 to support K8s 1.17

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30715: - Assignee: Onur Satici > Upgrade fabric8 to 4.7.1 to support K8s 1.17 >

[jira] [Resolved] (SPARK-30715) Upgrade fabric8 to 4.7.1 to support K8s 1.17

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30715. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27443

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

2020-02-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030472#comment-17030472 ] Maxim Gekk commented on SPARK-30730: [~cloud_fan] [~srowen] [~hyukjin.kwon] Please, have a look at

[jira] [Assigned] (SPARK-30594) Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30594: --- Assignee: wuyi > Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

[jira] [Resolved] (SPARK-30594) Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

2020-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30594. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27306

[jira] [Commented] (SPARK-20964) Make some keywords reserved along with the ANSI/SQL standard

2020-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030440#comment-17030440 ] Dongjoon Hyun commented on SPARK-20964: --- Thanks! > Make some keywords reserved along with the