[jira] [Commented] (SPARK-32799) Make unionByName optionally fill missing columns with nulls in SparkR

2020-09-06 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191388#comment-17191388 ] Michael Chirico commented on SPARK-32799: - OK I will comment here if I start working on it (or

[jira] [Commented] (SPARK-32799) Make unionByName optionally fill missing columns with nulls in SparkR

2020-09-06 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191308#comment-17191308 ] Michael Chirico commented on SPARK-32799: - Hey [~hyukjin.kwon] thanks for reaching out. Do you

[jira] [Commented] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

2020-07-10 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155512#comment-17155512 ] Michael Chirico commented on SPARK-31918: - Hey folks, I just saw SparkR was removed from CRAN, I

[jira] [Commented] (SPARK-26199) Long expressions cause mutate to fail

2020-04-28 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094232#comment-17094232 ] Michael Chirico commented on SPARK-26199: - Just saw this.

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-28 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094200#comment-17094200 ] Michael Chirico commented on SPARK-31517: - The issue is the use of deparse() in mutate;

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-28 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094193#comment-17094193 ] Michael Chirico commented on SPARK-31517: - Separating the window to its own step works: window

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-27 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094172#comment-17094172 ] Michael Chirico commented on SPARK-31517: - > Error in ns[[i]] : subscript out of bounds This

[jira] [Created] (SPARK-31581) paste0 is always better than paste(sep="")

2020-04-27 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-31581: --- Summary: paste0 is always better than paste(sep="") Key: SPARK-31581 URL: https://issues.apache.org/jira/browse/SPARK-31581 Project: Spark Issue Type:

[jira] [Created] (SPARK-31578) Internal checkSchemaInArrow is inefficient

2020-04-27 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-31578: --- Summary: Internal checkSchemaInArrow is inefficient Key: SPARK-31578 URL: https://issues.apache.org/jira/browse/SPARK-31578 Project: Spark Issue Type:

[jira] [Created] (SPARK-31573) Use fixed=TRUE where possible for internal efficiency

2020-04-27 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-31573: --- Summary: Use fixed=TRUE where possible for internal efficiency Key: SPARK-31573 URL: https://issues.apache.org/jira/browse/SPARK-31573 Project: Spark

[jira] [Created] (SPARK-31571) don't use stop(paste to build R errors

2020-04-27 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-31571: --- Summary: don't use stop(paste to build R errors Key: SPARK-31571 URL: https://issues.apache.org/jira/browse/SPARK-31571 Project: Spark Issue Type:

[jira] [Created] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

2020-04-26 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-31570: --- Summary: gapply and dapply docs should be more aligned, possibly combined Key: SPARK-31570 URL: https://issues.apache.org/jira/browse/SPARK-31570 Project:

[jira] [Created] (SPARK-31568) R: gapply documentation could be clearer about what the func argument is

2020-04-26 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-31568: --- Summary: R: gapply documentation could be clearer about what the func argument is Key: SPARK-31568 URL: https://issues.apache.org/jira/browse/SPARK-31568

[jira] [Created] (SPARK-31186) toPandas fails on simple query (collect() works)

2020-03-18 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-31186: --- Summary: toPandas fails on simple query (collect() works) Key: SPARK-31186 URL: https://issues.apache.org/jira/browse/SPARK-31186 Project: Spark Issue

[jira] [Commented] (SPARK-30250) SparkQL div is undocumented

2019-12-13 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996209#comment-16996209 ] Michael Chirico commented on SPARK-30250: - Doubly great news! Thanks > SparkQL div is

[jira] [Commented] (SPARK-30250) SparkQL div is undocumented

2019-12-12 Thread Michael Chirico (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995421#comment-16995421 ] Michael Chirico commented on SPARK-30250: - If I'm not mistaken, the definition is here. However,

[jira] [Created] (SPARK-30250) SparkQL div is undocumented

2019-12-12 Thread Michael Chirico (Jira)
Michael Chirico created SPARK-30250: --- Summary: SparkQL div is undocumented Key: SPARK-30250 URL: https://issues.apache.org/jira/browse/SPARK-30250 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-28070) writeType and writeObject in SparkR should be handled by S3 methods

2019-06-16 Thread Michael Chirico (JIRA)
Michael Chirico created SPARK-28070: --- Summary: writeType and writeObject in SparkR should be handled by S3 methods Key: SPARK-28070 URL: https://issues.apache.org/jira/browse/SPARK-28070 Project:

[jira] [Commented] (SPARK-28040) sql() fails to process output of glue::glue_data()

2019-06-14 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864043#comment-16864043 ] Michael Chirico commented on SPARK-28040: - glue_data returns class('glue','character') object

[jira] [Created] (SPARK-28040) sql() fails to process output of glue::glue_data()

2019-06-13 Thread Michael Chirico (JIRA)
Michael Chirico created SPARK-28040: --- Summary: sql() fails to process output of glue::glue_data() Key: SPARK-28040 URL: https://issues.apache.org/jira/browse/SPARK-28040 Project: Spark

[jira] [Commented] (SPARK-27335) cannot collect() from Correlation.corr

2019-05-12 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838241#comment-16838241 ] Michael Chirico commented on SPARK-27335: - Also came across this in another context on Spark

[jira] [Updated] (SPARK-27507) get_json_object fails somewhat arbitrarily on long input

2019-04-18 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-27507: Description: Some long JSON objects are parsed incorrectly by {{get_json_object}}. The

[jira] [Updated] (SPARK-27507) get_json_object fails somewhat arbitrarily on long input

2019-04-18 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-27507: Attachment: Screen Shot 2019-04-18 at 7.13.02 PM.png > get_json_object fails somewhat

[jira] [Updated] (SPARK-27507) get_json_object fails somewhat arbitrarily on long input

2019-04-18 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-27507: Description: Some long JSON objects are parsed incorrectly by {{get_json_object}}. The

[jira] [Created] (SPARK-27507) get_json_object fails somewhat arbitrarily on long input

2019-04-18 Thread Michael Chirico (JIRA)
Michael Chirico created SPARK-27507: --- Summary: get_json_object fails somewhat arbitrarily on long input Key: SPARK-27507 URL: https://issues.apache.org/jira/browse/SPARK-27507 Project: Spark

[jira] [Commented] (SPARK-26910) Re-release SparkR to CRAN

2019-04-07 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811930#comment-16811930 ] Michael Chirico commented on SPARK-26910: - awesome! thanks and congrats :) > Re-release SparkR

[jira] [Commented] (SPARK-27262) Add explicit UTF-8 Encoding to DESCRIPTION

2019-03-23 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799891#comment-16799891 ] Michael Chirico commented on SPARK-27262: - This was my original PR (tagging w my Jira ID) > Add

[jira] [Created] (SPARK-26910) Re-release SparkR to CRAN

2019-02-18 Thread Michael Chirico (JIRA)
Michael Chirico created SPARK-26910: --- Summary: Re-release SparkR to CRAN Key: SPARK-26910 URL: https://issues.apache.org/jira/browse/SPARK-26910 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2018-12-10 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716350#comment-16716350 ] Michael Chirico commented on SPARK-14948: - This issue comes up a _lot_ in non-trivial ETLs. I

[jira] [Updated] (SPARK-26331) Allow SQL UDF registration to recognize default function values from Scala

2018-12-10 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-26331: Description: {code:java} As described here:{code}

[jira] [Updated] (SPARK-26331) Allow SQL UDF registration to recognize default function values from Scala

2018-12-10 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-26331: Description: As described here: [https://stackoverflow.com/q/53702727/3576984] I have a

[jira] [Updated] (SPARK-26331) Allow SQL UDF registration to recognize default function values from Scala

2018-12-10 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-26331: Description: {code:java} de placeholder {code} As described here:

[jira] [Updated] (SPARK-26331) Allow SQL UDF registration to recognize default function values from Scala

2018-12-10 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-26331: Description: {code:java} As described here:{code}

[jira] [Updated] (SPARK-26331) Allow SQL UDF registration to recognize default function values from Scala

2018-12-10 Thread Michael Chirico (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chirico updated SPARK-26331: Description: {code:java} As described here:{code}

[jira] [Created] (SPARK-26331) Allow SQL UDF registration to recognize default function values from Scala

2018-12-10 Thread Michael Chirico (JIRA)
Michael Chirico created SPARK-26331: --- Summary: Allow SQL UDF registration to recognize default function values from Scala Key: SPARK-26331 URL: https://issues.apache.org/jira/browse/SPARK-26331