[jira] [Commented] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2020-06-18 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139930#comment-17139930 ] Jeff Evans commented on SPARK-26494: The pull request was closed as stale. Can someone please

[jira] [Comment Edited] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-29 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119931#comment-17119931 ] Jeff Evans edited comment on SPARK-31779 at 5/29/20, 9:01 PM: -- Thanks,

[jira] [Commented] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-29 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119931#comment-17119931 ] Jeff Evans commented on SPARK-31779: Thanks, using {{arrays_zip}} (along with an extra {{cast}} to

[jira] [Commented] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-28 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119200#comment-17119200 ] Jeff Evans commented on SPARK-31779: I disagree. An entire new array has been introduced into the

[jira] [Comment Edited] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-28 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119200#comment-17119200 ] Jeff Evans edited comment on SPARK-31779 at 5/29/20, 1:53 AM: -- I disagree.

[jira] [Created] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-20 Thread Jeff Evans (Jira)
Jeff Evans created SPARK-31779: -- Summary: Redefining struct inside array incorrectly wraps child fields in array Key: SPARK-31779 URL: https://issues.apache.org/jira/browse/SPARK-31779 Project: Spark

[jira] [Commented] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

2020-01-24 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023019#comment-17023019 ] Jeff Evans commented on SPARK-19248: I'm not a Spark maintainer, so can't answer definitively.

[jira] [Comment Edited] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

2020-01-23 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans edited comment on SPARK-19248 at 1/23/20 8:06 PM: - After some

[jira] [Comment Edited] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

2020-01-23 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans edited comment on SPARK-19248 at 1/23/20 7:53 PM: - After some

[jira] [Comment Edited] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

2020-01-23 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans edited comment on SPARK-19248 at 1/23/20 7:53 PM: - After some

[jira] [Commented] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

2020-01-23 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans commented on SPARK-19248: After some debugging, I figured out what's going on here. The

[jira] [Created] (SPARK-30489) Make build delete pyspark.zip file properly

2020-01-10 Thread Jeff Evans (Jira)
Jeff Evans created SPARK-30489: -- Summary: Make build delete pyspark.zip file properly Key: SPARK-30489 URL: https://issues.apache.org/jira/browse/SPARK-30489 Project: Spark Issue Type:

[jira] [Updated] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2020-01-10 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-26494: --- Summary: Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type (was: 【spark sql】Use spark to read

[jira] [Commented] (SPARK-26494) 【spark sql】Use spark to read oracle TIMESTAMP(6) WITH LOCAL TIME ZONE type can't be found,

2020-01-10 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013093#comment-17013093 ] Jeff Evans commented on SPARK-26494: To be clear, this type represents an instant in time. From

[jira] [Commented] (SPARK-26739) Standardized Join Types for DataFrames

2020-01-08 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011019#comment-17011019 ] Jeff Evans commented on SPARK-26739: [~maropu], I have an active PR for this, which is just awaiting

[jira] [Updated] (SPARK-30256) Allow SparkLauncher to sudo before executing spark-submit

2019-12-13 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-30256: --- Description: It would be useful if {{org.apache.spark.launcher.SparkLauncher}} allowed for a "sudo

[jira] [Created] (SPARK-30256) Allow SparkLauncher to sudo before executing spark-submit

2019-12-13 Thread Jeff Evans (Jira)
Jeff Evans created SPARK-30256: -- Summary: Allow SparkLauncher to sudo before executing spark-submit Key: SPARK-30256 URL: https://issues.apache.org/jira/browse/SPARK-30256 Project: Spark Issue

[jira] [Updated] (SPARK-24540) Support for multiple character delimiter in Spark CSV read

2019-10-04 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-24540: --- Summary: Support for multiple character delimiter in Spark CSV read (was: Support for multiple

[jira] [Commented] (SPARK-24540) Support for multiple delimiter in Spark CSV read

2019-10-04 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944783#comment-16944783 ] Jeff Evans commented on SPARK-24540: I created a pull request to support this (which was linked

[jira] [Commented] (SPARK-27903) Improve parser error message for mismatched parentheses in expressions

2019-10-03 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944041#comment-16944041 ] Jeff Evans commented on SPARK-27903: I've been spending some time playing around with the grammar,

[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

2019-09-30 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941363#comment-16941363 ] Jeff Evans commented on SPARK-24077: Is this still relevant, given SPARK-20383 is done? > Issue a

[jira] [Commented] (SPARK-25153) Improve error messages for columns with dots/periods

2019-09-16 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930896#comment-16930896 ] Jeff Evans commented on SPARK-25153: Opened a pull request for this (see link added by the bot).

[jira] [Updated] (SPARK-29070) Make SparkLauncher log full spark-submit command line

2019-09-16 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-29070: --- Description: {{org.apache.spark.launcher.SparkLauncher}} wraps a {{ProcessBuilder}}, and builds up

[jira] [Updated] (SPARK-29070) Make SparkLauncher log full spark-submit command line

2019-09-16 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-29070: --- Summary: Make SparkLauncher log full spark-submit command line (was: Allow SparkLauncher to return

[jira] [Updated] (SPARK-29070) Allow SparkLauncher to return full spark-submit command line

2019-09-12 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-29070: --- Priority: Minor (was: Major) > Allow SparkLauncher to return full spark-submit command line >

[jira] [Created] (SPARK-29070) Allow SparkLauncher to return full spark-submit command line

2019-09-12 Thread Jeff Evans (Jira)
Jeff Evans created SPARK-29070: -- Summary: Allow SparkLauncher to return full spark-submit command line Key: SPARK-29070 URL: https://issues.apache.org/jira/browse/SPARK-29070 Project: Spark