[jira] [Resolved] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R.

2018-09-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-25117. -- Resolution: Fixed Assignee: Dilip Biswal > Add EXEPT ALL and INTERSECT ALL support in

[jira] [Updated] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R.

2018-09-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25117: - Fix Version/s: 2.4.0 > Add EXEPT ALL and INTERSECT ALL support in R. >

[jira] [Resolved] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

2018-09-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-25007. -- Resolution: Fixed Fix Version/s: 2.4.0 > Add array_intersect / array_except

[jira] [Assigned] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR

2018-09-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-25007: Assignee: Huaxin Gao > Add array_intersect / array_except /array_union / array_shuffle

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-08-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599380#comment-16599380 ] Felix Cheung commented on SPARK-24434: -- .. and let's make sure any discussion are summarized and

[jira] [Assigned] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles)

2018-08-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-25275: Assignee: Erik Erlandson > require memberhip in wheel to run 'su' (in dockerfiles) >

[jira] [Assigned] (SPARK-24433) Add Spark R support

2018-08-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-24433: Assignee: Ilan Filonenko > Add Spark R support > --- > >

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-08-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598300#comment-16598300 ] Felix Cheung commented on SPARK-24434: -- so [~onursatici] is there a reason you open a PR even

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-08-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598297#comment-16598297 ] Felix Cheung commented on SPARK-24434: -- [~skonto] - hi what's happening? Henry is right, with

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582009#comment-16582009 ] Felix Cheung commented on SPARK-24918: -- I'd tend to agree with opt in - too many mistakes with

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569109#comment-16569109 ] Felix Cheung commented on SPARK-24924: --   I tend to agree that we shouldn't "magically" remap

[jira] [Commented] (SPARK-23683) FileCommitProtocol.instantiate to require 3-arg constructor for dynamic partition overwrite

2018-07-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558009#comment-16558009 ] Felix Cheung commented on SPARK-23683: -- should this be ported back to branch 2.3 ? we ran into this

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2018-07-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541191#comment-16541191 ] Felix Cheung commented on SPARK-20202: -- How like will there be a hive release? HIVE-16391 is still

[jira] [Commented] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work.

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539627#comment-16539627 ] Felix Cheung commented on SPARK-24781: -- [~jerryshao] > Using a reference from Dataset in

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539622#comment-16539622 ] Felix Cheung commented on SPARK-14220: -- this shouldn't block 2.3.2 right? > Build and test Spark

[jira] [Assigned] (SPARK-23461) vignettes should include model predictions for some ML models

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-23461: Assignee: Huaxin Gao > vignettes should include model predictions for some ML models >

[jira] [Resolved] (SPARK-23461) vignettes should include model predictions for some ML models

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23461. -- Resolution: Fixed Fix Version/s: 2.4.0 > vignettes should include model predictions

[jira] [Resolved] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23529. -- Resolution: Fixed Assignee: Andrew Korzhuev (was: Anirudh Ramanathan) Fix

[jira] [Commented] (SPARK-24674) Spark on Kubernetes BLAS performance

2018-07-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535983#comment-16535983 ] Felix Cheung commented on SPARK-24674: -- kinda - there has been discussions on whether alpine is

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-07-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535345#comment-16535345 ] Felix Cheung commented on SPARK-24152: -- I'm pretty sure it's a problem on the server side though

[jira] [Resolved] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24535. -- Resolution: Fixed Fix Version/s: 2.4.0 2.3.2 Target

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534502#comment-16534502 ] Felix Cheung commented on SPARK-24535: -- [~shivaram] I've merged it, but it could be great if you

[jira] [Comment Edited] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530963#comment-16530963 ] Felix Cheung edited comment on SPARK-24535 at 7/3/18 7:50 AM: -- ok, I

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Summary: Fix java version parsing in SparkR on Windows (was: Fix java version parsing in

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR

2018-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530963#comment-16530963 ] Felix Cheung commented on SPARK-24535: -- ok, I submitted a modified package to win-builder, and was

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR

2018-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Target Version/s: 2.3.2 > Fix java version parsing in SparkR >

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR

2018-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Priority: Blocker (was: Major) > Fix java version parsing in SparkR >

[jira] [Assigned] (SPARK-24535) Fix java version parsing in SparkR

2018-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-24535: Assignee: Felix Cheung > Fix java version parsing in SparkR >

[jira] [Created] (SPARK-24572) "eager execution" for R shell, IDE

2018-06-16 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24572: Summary: "eager execution" for R shell, IDE Key: SPARK-24572 URL: https://issues.apache.org/jira/browse/SPARK-24572 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

2018-06-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513416#comment-16513416 ] Felix Cheung commented on SPARK-23435: -- sorry, I did try but couldn't get it to work, but something

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR

2018-06-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513372#comment-16513372 ] Felix Cheung commented on SPARK-24535: -- is this only failing on windows? I wonder if this is

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513363#comment-16513363 ] Felix Cheung commented on SPARK-24359: -- [~shivaram] sure - do you mean 2.3.1.1 though? 2.4.0

[jira] [Commented] (SPARK-13184) Support minPartitions parameter for JSON and CSV datasources as options

2018-06-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507476#comment-16507476 ] Felix Cheung commented on SPARK-13184: -- what's the next step? > Support minPartitions parameter

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM: -- Thanks

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM: -- Thanks

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung commented on SPARK-24359: -- Thanks Joseph - correct one possibility is to branch 2.4.0

[jira] [Resolved] (SPARK-24403) reuse r worker

2018-06-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24403. -- Resolution: Duplicate > reuse r worker > -- > > Key: SPARK-24403

[jira] [Closed] (SPARK-24403) reuse r worker

2018-06-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung closed SPARK-24403. > reuse r worker > -- > > Key: SPARK-24403 > URL:

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500634#comment-16500634 ] Felix Cheung commented on SPARK-24359: -- +1 on the `spark-website` model for faster iterations. This

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-06-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499528#comment-16499528 ] Felix Cheung commented on SPARK-23206: -- [~irashid] sorry I thought I had replied - on our end,

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498901#comment-16498901 ] Felix Cheung commented on SPARK-24434: -- I see. Why not then pass along the pod template as a

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498225#comment-16498225 ] Felix Cheung commented on SPARK-24434: -- java properties is basically the "standard" in spark, I'm

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2018-06-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498213#comment-16498213 ] Felix Cheung commented on SPARK-20202: -- Prefer newer Hive also > Remove references to

[jira] [Resolved] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

2018-05-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24326. -- Resolution: Fixed Assignee: Stavros Kontopoulos Fix Version/s: 2.4.0 > Add

[jira] [Resolved] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24331. -- Resolution: Fixed Fix Version/s: 2.4.0 Target Version/s: 2.4.0 > Add

[jira] [Assigned] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-24331: Assignee: Marek Novotny > Add arrays_overlap / array_repeat / map_entries >

[jira] [Comment Edited] (SPARK-24403) reuse r worker

2018-05-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494707#comment-16494707 ] Felix Cheung edited comment on SPARK-24403 at 5/30/18 5:38 AM: --- Reuse

[jira] [Commented] (SPARK-23650) Slow SparkR udf (dapply)

2018-05-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494708#comment-16494708 ] Felix Cheung commented on SPARK-23650: -- sorry, I really don't have time/resource to investigate

[jira] [Commented] (SPARK-24403) reuse r worker

2018-05-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494707#comment-16494707 ] Felix Cheung commented on SPARK-24403: -- Reuse worker (daemon process) is actually supported and the

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492341#comment-16492341 ] Felix Cheung edited comment on SPARK-24359 at 5/28/18 7:10 AM: --- re

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492341#comment-16492341 ] Felix Cheung commented on SPARK-24359: -- re repo/release/version - again to be clear, what Shivaram

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491908#comment-16491908 ] Felix Cheung commented on SPARK-23435: -- Work was stopped for a while. Hopefully I can come by in a

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491867#comment-16491867 ] Felix Cheung edited comment on SPARK-24359 at 5/27/18 3:24 AM: --- # are the

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491867#comment-16491867 ] Felix Cheung commented on SPARK-24359: -- # are the set_input_col / set_output_col methods going to

[jira] [Commented] (SPARK-24356) Duplicate strings in File.path managed by FileSegmentManagedBuffer

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491788#comment-16491788 ] Felix Cheung commented on SPARK-24356: -- Interesting. we will definitely look into this. Is the plan

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488512#comment-16488512 ] Felix Cheung edited comment on SPARK-24359 at 5/24/18 6:34 AM: --- re this  *

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488512#comment-16488512 ] Felix Cheung commented on SPARK-24359: -- re this  * This also leads to the question of how the

[jira] [Commented] (SPARK-22055) Port release scripts

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486728#comment-16486728 ] Felix Cheung commented on SPARK-22055: -- interesting - I'd definitely be happy to help. do you have

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486719#comment-16486719 ] Felix Cheung edited comment on SPARK-24359 at 5/23/18 5:21 AM: --- # could you

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486719#comment-16486719 ] Felix Cheung edited comment on SPARK-24359 at 5/23/18 5:18 AM: --- # could you

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486719#comment-16486719 ] Felix Cheung commented on SPARK-24359: -- # could you include design doc as google doc - it will be

[jira] [Commented] (SPARK-23455) Default Params in ML should be saved separately

2018-05-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476747#comment-16476747 ] Felix Cheung commented on SPARK-23455: -- does this affect R? > Default Params in ML should be saved

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475202#comment-16475202 ] Felix Cheung commented on SPARK-23780: -- [~vanzin] - FYI - if we have another RC this can be pulled

[jira] [Resolved] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23780. -- Resolution: Fixed Fix Version/s: (was: 2.3.1) > Failed to use googleVis library

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Fix Version/s: 2.3.2 > Failed to use googleVis library with new SparkR >

[jira] [Assigned] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-23780: Assignee: Felix Cheung > Failed to use googleVis library with new SparkR >

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Fix Version/s: 2.4.0 2.3.1 > Failed to use googleVis library with new SparkR

[jira] [Commented] (SPARK-24265) lintr checks not failing PR build

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473651#comment-16473651 ] Felix Cheung commented on SPARK-24265: -- example:

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Affects Version/s: 2.3.0 > Failed to use googleVis library with new SparkR >

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Labels: regression (was: regresion) > Failed to use googleVis library with new SparkR >

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Labels: regresion (was: ) > Failed to use googleVis library with new SparkR >

[jira] [Created] (SPARK-24265) lintr checks not failing PR build

2018-05-13 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24265: Summary: lintr checks not failing PR build Key: SPARK-24265 URL: https://issues.apache.org/jira/browse/SPARK-24265 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Description: testing with openjdk, noticed that it breaks because the version string is

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Description: testing with openjdk, noticed that it breaks because the version string is

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Priority: Blocker (was: Major) > SparkR java check breaks on openjdk >

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Affects Version/s: (was: 2.3.0) 2.3.1 > SparkR java check breaks on

[jira] [Created] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24263: Summary: SparkR java check breaks on openjdk Key: SPARK-24263 URL: https://issues.apache.org/jira/browse/SPARK-24263 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-23206) Additional Memory Tuning Metrics

2018-05-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470777#comment-16470777 ] Felix Cheung edited comment on SPARK-23206 at 5/10/18 5:20 PM: --- yes, for us

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-05-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470777#comment-16470777 ] Felix Cheung commented on SPARK-23206: -- yes, for use network and disk IO stats. We have been

[jira] [Created] (SPARK-24207) PrefixSpan: R API

2018-05-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24207: Summary: PrefixSpan: R API Key: SPARK-24207 URL: https://issues.apache.org/jira/browse/SPARK-24207 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466920#comment-16466920 ] Felix Cheung commented on SPARK-23780: -- I suppose if you load googleVis first and then SparkR it

[jira] [Updated] (SPARK-24195) sc.addFile for local:/ path is broken

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24195: - Description: In changing SPARK-6300

[jira] [Updated] (SPARK-24195) sc.addFile for local:/ path is broken

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24195: - Affects Version/s: 1.3.1 1.4.1 1.5.2

[jira] [Created] (SPARK-24195) sc.addFile for local:/ path is broken

2018-05-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24195: Summary: sc.addFile for local:/ path is broken Key: SPARK-24195 URL: https://issues.apache.org/jira/browse/SPARK-24195 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465433#comment-16465433 ] Felix Cheung commented on SPARK-23291: -- I don't disagree the behavior issue. (ah, so someone did run

[jira] [Comment Edited] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung edited comment on SPARK-23291 at 5/6/18 10:38 PM: --- actually,

[jira] [Comment Edited] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung edited comment on SPARK-23291 at 5/6/18 10:35 PM: --- actually,

[jira] [Commented] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung commented on SPARK-23291: -- actually, I'm not sure we should backport this to a x.x.1

[jira] [Comment Edited] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung edited comment on SPARK-23291 at 5/6/18 10:34 PM: --- actually,

[jira] [Comment Edited] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461983#comment-16461983 ] Felix Cheung edited comment on SPARK-24152 at 5/3/18 6:29 AM: -- ok good. in

[jira] [Updated] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24152: - Summary: SparkR CRAN feasibility check server problem (was: Flaky Test: SparkR) > SparkR CRAN

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461993#comment-16461993 ] Felix Cheung commented on SPARK-24152: -- (I updated the bug title - it's not really flaky..) >

[jira] [Comment Edited] (SPARK-24152) Flaky Test: SparkR

2018-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461983#comment-16461983 ] Felix Cheung edited comment on SPARK-24152 at 5/3/18 6:26 AM: -- ok good. in

[jira] [Comment Edited] (SPARK-24152) Flaky Test: SparkR

2018-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461983#comment-16461983 ] Felix Cheung edited comment on SPARK-24152 at 5/3/18 6:26 AM: -- ok good. in

[jira] [Commented] (SPARK-24152) Flaky Test: SparkR

2018-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461983#comment-16461983 ] Felix Cheung commented on SPARK-24152: -- ok good. in the event this reoccurs persistently, option

[jira] [Commented] (SPARK-24152) Flaky Test: SparkR

2018-05-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461974#comment-16461974 ] Felix Cheung commented on SPARK-24152: -- Is this still a problem? > Flaky Test: SparkR >

[jira] [Commented] (SPARK-23954) Converting spark dataframe containing int64 fields to R dataframes leads to impredictable errors.

2018-04-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457390#comment-16457390 ] Felix Cheung commented on SPARK-23954: -- yap, please see discussion in SPARK-12360 in particular >

[jira] [Commented] (SPARK-23285) Allow spark.executor.cores to be fractional

2018-04-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425206#comment-16425206 ] Felix Cheung commented on SPARK-23285: -- fixed in 2.3, updating. > Allow spark.executor.cores to be

[jira] [Updated] (SPARK-23285) Allow spark.executor.cores to be fractional

2018-04-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23285: - Fix Version/s: 2.4.0 > Allow spark.executor.cores to be fractional >

[jira] [Comment Edited] (SPARK-23285) Allow spark.executor.cores to be fractional

2018-04-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425206#comment-16425206 ] Felix Cheung edited comment on SPARK-23285 at 4/4/18 8:53 AM: -- fixed in 2.4,

<    1   2   3   4   5   6   7   8   9   10   >