[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574137#comment-15574137 ] Felix Cheung commented on SPARK-17781: -- Hmm.. I'm not quite sure what it is just yet - not seeing

[jira] [Commented] (SPARK-17865) R API for global temp view

2016-10-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564534#comment-15564534 ] Felix Cheung commented on SPARK-17865: -- I can take this. > R API for global temp view >

[jira] [Commented] (SPARK-17865) R API for global temp view

2016-10-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564558#comment-15564558 ] Felix Cheung commented on SPARK-17865: -- I haven't kept up on SharedState before this but it looks to

[jira] [Resolved] (SPARK-17790) Support for parallelizing R data.frame larger than 2GB

2016-10-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-17790. -- Resolution: Fixed Assignee: Hossein Falaki Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569325#comment-15569325 ] Felix Cheung commented on SPARK-17781: -- Thanks for the investigation. This might seem like a R

[jira] [Commented] (SPARK-17865) R API for global temp view

2016-10-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578639#comment-15578639 ] Felix Cheung commented on SPARK-17865: -- I see. So then we could either omit the support for global

[jira] [Commented] (SPARK-18618) SparkR model predict should support type as a argument

2016-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704698#comment-15704698 ] Felix Cheung commented on SPARK-18618: -- Sounds like a good idea. Does the existing types in

[jira] [Commented] (SPARK-18332) SparkR 2.1 QA: Programming guide, migration guide, vignettes updates

2016-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732796#comment-15732796 ] Felix Cheung commented on SPARK-18332: -- Would you have time to do this [~wangmiao1981]? Particularly

[jira] [Commented] (SPARK-18330) SparkR 2.1 QA: Update user guide for new features & APIs

2016-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732827#comment-15732827 ] Felix Cheung commented on SPARK-18330: -- Yanbo has already updated the programming guide with for

[jira] [Commented] (SPARK-18332) SparkR 2.1 QA: Programming guide, migration guide, vignettes updates

2016-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733608#comment-15733608 ] Felix Cheung commented on SPARK-18332: -- Agreed. This piece is in need of updates, urgently ;) >

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736790#comment-15736790 ] Felix Cheung commented on SPARK-15799: -- That certainly would be the option. Typically when

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737022#comment-15737022 ] Felix Cheung commented on SPARK-18788: -- I looked and didn't see that on DataFrame? I'm not sure what

[jira] [Comment Edited] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736790#comment-15736790 ] Felix Cheung edited comment on SPARK-15799 at 12/10/16 12:23 AM: - That

[jira] [Updated] (SPARK-18349) Update R API documentation on ml model summary

2016-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18349: - Fix Version/s: 2.1.1 > Update R API documentation on ml model summary >

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734403#comment-15734403 ] Felix Cheung commented on SPARK-18788: -- In SparkR we don't officially support RDD - In which way

[jira] [Assigned] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-18810: Assignee: Felix Cheung > SparkR install.spark does not work for RCs, snapshots >

[jira] [Resolved] (SPARK-18349) Update R API documentation on ml model summary

2016-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18349. -- Resolution: Fixed Assignee: Miao Wang Target Version/s: 2.1.1 > Update R

[jira] [Updated] (SPARK-18348) Improve tree ensemble model summary

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18348: - Target Version/s: 2.2.0 > Improve tree ensemble model summary >

[jira] [Updated] (SPARK-18570) Consider supporting other R formula operators

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18570: - Target Version/s: 2.2.0 > Consider supporting other R formula operators >

[jira] [Updated] (SPARK-18569) Support R formula arithmetic

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18569: - Affects Version/s: 2.2.0 > Support R formula arithmetic > - > >

[jira] [Updated] (SPARK-18569) Support R formula arithmetic

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18569: - Affects Version/s: (was: 2.2.0) Target Version/s: 2.2.0 > Support R formula arithmetic

[jira] [Created] (SPARK-18828) Refactor SparkR build and test scripts

2016-12-11 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-18828: Summary: Refactor SparkR build and test scripts Key: SPARK-18828 URL: https://issues.apache.org/jira/browse/SPARK-18828 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18570) Consider supporting other R formula operators

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18570: - Priority: Minor (was: Major) > Consider supporting other R formula operators >

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2016-12-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744415#comment-15744415 ] Felix Cheung commented on SPARK-18823: -- How important it is to support df[[myname]] <- c(1:nrow(df))

[jira] [Commented] (SPARK-4591) Algorithm/model parity for spark.ml (Scala)

2016-12-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744481#comment-15744481 ] Felix Cheung commented on SPARK-4591: - Is SVM part of this? > Algorithm/model parity for spark.ml

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2016-12-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747410#comment-15747410 ] Felix Cheung commented on SPARK-18825: -- I will see what I can do... > Eliminate duplicate links in

[jira] [Commented] (SPARK-18849) Vignettes final checks for Spark 2.1

2016-12-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747412#comment-15747412 ] Felix Cheung commented on SPARK-18849: -- probably would be good to check for warning or error in

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2016-12-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747429#comment-15747429 ] Felix Cheung commented on SPARK-18823: -- For #2, I do agree it could get messy, but I was thinking

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2016-12-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747433#comment-15747433 ] Felix Cheung commented on SPARK-18823: -- We will address both of your suggestions. As for x$y <-

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753048#comment-15753048 ] Felix Cheung commented on SPARK-18817: -- Tested this just now, I still see spark-warehouse when

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753064#comment-15753064 ] Felix Cheung commented on SPARK-18817: -- Actually, I'm not seeing derby.log or metastore_db in the

[jira] [Comment Edited] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753041#comment-15753041 ] Felix Cheung edited comment on SPARK-18817 at 12/16/16 1:03 AM: we could,

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753032#comment-15753032 ] Felix Cheung commented on SPARK-18862: -- FYI I reorg the vignettes based on what's discussed here.

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753040#comment-15753040 ] Felix Cheung commented on SPARK-18817: -- we could, but we did ship 2.0 with it enabled by default

[jira] [Issue Comment Deleted] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18817: - Comment: was deleted (was: we could, but we did ship 2.0 with it enabled by default though.

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753041#comment-15753041 ] Felix Cheung commented on SPARK-18817: -- we could, but we did ship 2.0 with it enabled by default

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753462#comment-15753462 ] Felix Cheung commented on SPARK-18817: -- I ran more of this but wasn't seeinng derby.log or

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753414#comment-15753414 ] Felix Cheung commented on SPARK-18817: -- It looks like javax.jdo.option.ConnectionURL can also be set

[jira] [Reopened] (SPARK-17838) Strict type checking for arguments with a better messages across APIs.

2016-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reopened SPARK-17838: -- Assignee: (was: Hyukjin Kwon) Re-open as per discussion in PR. > Strict type checking

[jira] [Commented] (SPARK-18849) Vignettes final checks for Spark 2.1

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749696#comment-15749696 ] Felix Cheung commented on SPARK-18849: -- working on this... > Vignettes final checks for Spark 2.1 >

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749559#comment-15749559 ] Felix Cheung commented on SPARK-18862: -- AFAIK, R package has a constrain that it has to be a flat

[jira] [Comment Edited] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749559#comment-15749559 ] Felix Cheung edited comment on SPARK-18862 at 12/14/16 9:37 PM: AFAIK, R

[jira] [Commented] (SPARK-7839) Augment build environment to support native libraries with SparkR

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749626#comment-15749626 ] Felix Cheung commented on SPARK-7839: - This could be behavior that we turn on for R package

[jira] [Comment Edited] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749559#comment-15749559 ] Felix Cheung edited comment on SPARK-18862 at 12/14/16 9:38 PM: AFAIK, R

[jira] [Updated] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18817: - Priority: Critical (was: Major) > Ensure nothing is written outside R's tempdir() by default >

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749617#comment-15749617 ] Felix Cheung commented on SPARK-18817: -- this could block R package release > Ensure nothing is

[jira] [Commented] (SPARK-18849) Vignettes final checks for Spark 2.1

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749591#comment-15749591 ] Felix Cheung commented on SPARK-18849: -- I could take this [~mengxr] as soon as

[jira] [Resolved] (SPARK-18865) SparkR vignettes MLP and LDA updates

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18865. -- Resolution: Fixed Assignee: Miao Wang Target Version/s: 2.1.1, 2.2.0 >

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750614#comment-15750614 ] Felix Cheung commented on SPARK-18862: -- ah :) Would we end up having mllib-gmm.R, mllib-als.R and so

[jira] [Commented] (SPARK-18862) Split SparkR mllib.R into multiple files

2016-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750929#comment-15750929 ] Felix Cheung commented on SPARK-18862: -- Right I think if there are families that span multiple

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15757998#comment-15757998 ] Felix Cheung commented on SPARK-18817: -- Aside from changing the existing shipped behavior, there are

[jira] [Comment Edited] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15757998#comment-15757998 ] Felix Cheung edited comment on SPARK-18817 at 12/18/16 2:04 AM: Aside

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15758005#comment-15758005 ] Felix Cheung commented on SPARK-18817: -- And as a side note, I feel like spark-warehouse,

[jira] [Commented] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740184#comment-15740184 ] Felix Cheung commented on SPARK-18813: -- I added a couple of JIRAs for R that can be found with [this

[jira] [Commented] (SPARK-18822) Support ML Pipeline in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740181#comment-15740181 ] Felix Cheung commented on SPARK-18822: -- I'll take a shot at this. > Support ML Pipeline in SparkR >

[jira] [Created] (SPARK-18822) Support ML Pipeline in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-18822: Summary: Support ML Pipeline in SparkR Key: SPARK-18822 URL: https://issues.apache.org/jira/browse/SPARK-18822 Project: Spark Issue Type: New Feature

[jira] [Comment Edited] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740184#comment-15740184 ] Felix Cheung edited comment on SPARK-18813 at 12/11/16 7:11 PM: I added a

[jira] [Updated] (SPARK-18822) Support ML Pipeline in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18822: - Description: >From Joseph Bradley: " Supporting Pipelines and advanced use cases: There really

[jira] [Updated] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-15767: - Shepherd: Felix Cheung > Decision Tree Regression wrapper in SparkR >

[jira] [Updated] (SPARK-18822) Support ML Pipeline in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18822: - Shepherd: Felix Cheung > Support ML Pipeline in SparkR > - > >

[jira] [Updated] (SPARK-18821) Bisecting k-means wrapper in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18821: - Shepherd: Felix Cheung > Bisecting k-means wrapper in SparkR >

[jira] [Commented] (SPARK-18332) SparkR 2.1 QA: Programming guide, migration guide, vignettes updates

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740172#comment-15740172 ] Felix Cheung commented on SPARK-18332: -- [~josephkb] they are because of the {code}@aliases{code}

[jira] [Created] (SPARK-18821) Bisecting k-means wrapper in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-18821: Summary: Bisecting k-means wrapper in SparkR Key: SPARK-18821 URL: https://issues.apache.org/jira/browse/SPARK-18821 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740185#comment-15740185 ] Felix Cheung commented on SPARK-15581: -- re: Pipeline in R - certainly. opened

[jira] [Updated] (SPARK-18822) Support ML Pipeline in SparkR

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18822: - Description: >From Joseph Bradley: " Supporting Pipelines and advanced use cases: There really

[jira] [Commented] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15740216#comment-15740216 ] Felix Cheung commented on SPARK-18813: -- This is great, Joseph. Thanks for putting down the framework

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736217#comment-15736217 ] Felix Cheung commented on SPARK-18810: -- For RC, it actually expects to have a subdirectory

[jira] [Comment Edited] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736217#comment-15736217 ] Felix Cheung edited comment on SPARK-18810 at 12/9/16 8:06 PM: --- For RC, it

[jira] [Created] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-18807: Summary: Should suppress output print for calls to JVM methods with void return values Key: SPARK-18807 URL: https://issues.apache.org/jira/browse/SPARK-18807

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736161#comment-15736161 ] Felix Cheung commented on SPARK-18810: -- I've found the same issue while testing as well, and was

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736230#comment-15736230 ] Felix Cheung commented on SPARK-18810: -- Also to expand on the earlier note above, I think the main

[jira] [Updated] (SPARK-19133) SparkR glm Gamma family results in error

2017-01-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19133: - Affects Version/s: 2.0.0 Target Version/s: 2.0.3, 2.1.1, 2.2.0 (was: 2.2.0) Fix

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2017-01-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820389#comment-15820389 ] Felix Cheung commented on SPARK-18823: -- Yap. I'll start on this shortly. > Assignation by column

[jira] [Resolved] (SPARK-19133) SparkR glm Gamma family results in error

2017-01-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19133. -- Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0 > SparkR glm

[jira] [Commented] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

2016-12-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717723#comment-15717723 ] Felix Cheung commented on SPARK-17822: -- >From what [~josephkb] observed and described, I suspect

[jira] [Commented] (SPARK-18349) Update R API documentation on ml model summary

2016-12-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717726#comment-15717726 ] Felix Cheung commented on SPARK-18349: -- [~wangmiao1981]Please do, thanks! Since we have some

[jira] [Commented] (SPARK-18643) SparkR hangs when installed as a package without SPARK_HOME set

2016-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707669#comment-15707669 ] Felix Cheung commented on SPARK-18643: -- Related PR: https://github.com/apache/spark/pull/15888 >

[jira] [Created] (SPARK-18643) SparkR hangs when installed as a package without SPARK_HOME set

2016-11-29 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-18643: Summary: SparkR hangs when installed as a package without SPARK_HOME set Key: SPARK-18643 URL: https://issues.apache.org/jira/browse/SPARK-18643 Project: Spark

[jira] [Updated] (SPARK-18643) SparkR hangs when installed as a package without SPARK_HOME set

2016-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18643: - Description: 1) Install SparkR from source package, ie. R CMD INSTALL SparkR_2.1.0.tar.gz 2)

[jira] [Commented] (SPARK-18643) SparkR hangs at session start when installed as a package without SPARK_HOME set

2016-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707704#comment-15707704 ] Felix Cheung commented on SPARK-18643: -- A workaround is to start as sparkR.session(master="local") -

[jira] [Updated] (SPARK-18643) SparkR hangs at session start when installed as a package without SPARK_HOME set

2016-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18643: - Description: 1) Install SparkR from source package, ie. R CMD INSTALL SparkR_2.1.0.tar.gz 2)

[jira] [Updated] (SPARK-18643) SparkR hangs when installed as a package without SPARK_HOME set

2016-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18643: - Description: 1) Install SparkR from source package, ie. R CMD INSTALL SparkR_2.1.0.tar.gz 2)

[jira] [Updated] (SPARK-18643) SparkR hangs at session start when installed as a package without SPARK_HOME set

2016-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18643: - Summary: SparkR hangs at session start when installed as a package without SPARK_HOME set (was:

[jira] [Updated] (SPARK-19133) SparkR glm Gamma family results in error

2017-01-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19133: - Summary: SparkR glm Gamma family results in error (was: glm Gamma family results in error) >

[jira] [Commented] (SPARK-12757) Use reference counting to prevent blocks from being evicted during reads

2016-12-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786726#comment-15786726 ] Felix Cheung commented on SPARK-12757: -- ping. Still seeing a lot of these messages on Spark 2.1. Is

[jira] [Updated] (SPARK-19133) glm Gamma family results in error

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19133: - Description: > glm(y~1,family=Gamma, data = dy) 17/01/09 06:10:47 ERROR RBackendHandler: fit on

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810250#comment-15810250 ] Felix Cheung commented on SPARK-18570: -- Hi - the code is here:

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810634#comment-15810634 ] Felix Cheung commented on SPARK-18823: -- I think to Shivaram, this is a bit tricky since we are

[jira] [Created] (SPARK-19130) SparkR should support setting and adding new column with singular value implicitly

2017-01-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19130: Summary: SparkR should support setting and adding new column with singular value implicitly Key: SPARK-19130 URL: https://issues.apache.org/jira/browse/SPARK-19130

[jira] [Commented] (SPARK-18011) SparkR serialize "NA" throws exception

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810660#comment-15810660 ] Felix Cheung commented on SPARK-18011: -- [~wangmiao1981]do you remember this one? I thought at one

[jira] [Commented] (SPARK-14692) Error While Setting the path for R front end

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810754#comment-15810754 ] Felix Cheung commented on SPARK-14692: -- closing. let us know if this is still an issue. thanks >

[jira] [Resolved] (SPARK-14692) Error While Setting the path for R front end

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-14692. -- Resolution: Cannot Reproduce Assignee: Felix Cheung > Error While Setting the path for R

[jira] [Commented] (SPARK-15237) SparkR corr function documentation

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810760#comment-15810760 ] Felix Cheung commented on SPARK-15237: -- I think this is better now? Shall we resolve this JIRA? >

[jira] [Created] (SPARK-19133) glm Gamma family results in error

2017-01-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19133: Summary: glm Gamma family results in error Key: SPARK-19133 URL: https://issues.apache.org/jira/browse/SPARK-19133 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19126. -- Resolution: Fixed Assignee: Bill Chambers Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

2016-12-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763165#comment-15763165 ] Felix Cheung commented on SPARK-18924: -- Thank you for bring this up. JVM<->Java performance has been

[jira] [Created] (SPARK-18958) SparkR should support toJSON on DataFrame

2016-12-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-18958: Summary: SparkR should support toJSON on DataFrame Key: SPARK-18958 URL: https://issues.apache.org/jira/browse/SPARK-18958 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2016-12-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15759368#comment-15759368 ] Felix Cheung commented on SPARK-18817: -- testing fix, will open a PR shortly. > Ensure nothing is

[jira] [Commented] (SPARK-10523) SparkR formula syntax to turn strings/factors into numerics

2016-12-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768165#comment-15768165 ] Felix Cheung commented on SPARK-10523: -- [~cantdutchthis]I'm curious, do you know why all your

[jira] [Resolved] (SPARK-18958) SparkR should support toJSON on DataFrame

2016-12-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18958. -- Resolution: Fixed Target Version/s: 2.2.0 > SparkR should support toJSON on

<    1   2   3   4   5   6   7   8   9   10   >