[jira] [Commented] (SPARK-11167) Incorrect type resolution on heterogeneous data structures

2015-10-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981398#comment-14981398 ] Felix Cheung commented on SPARK-11167: -- Another error from PR 8984 I can have this

[jira] [Commented] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14987964#comment-14987964 ] Felix Cheung commented on SPARK-11263: -- [~shivaram] what should we do with this? Sho

[jira] [Commented] (SPARK-11492) Ignore commented code warnings in SparkR

2015-11-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988949#comment-14988949 ] Felix Cheung commented on SPARK-11492: -- please see SPARK-11263 > Ignore commented c

[jira] [Commented] (SPARK-11468) Add R API for stddev/variance

2015-11-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990180#comment-14990180 ] Felix Cheung commented on SPARK-11468: -- I'd like to take this if no one has started

[jira] [Created] (SPARK-11567) Add Python API for corr in agg

2015-11-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11567: Summary: Add Python API for corr in agg Key: SPARK-11567 URL: https://issues.apache.org/jira/browse/SPARK-11567 Project: Spark Issue Type: Task Affects V

[jira] [Updated] (SPARK-11567) Add Python API for corr aggregate function

2015-11-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11567: - Summary: Add Python API for corr aggregate function (was: Add Python API for corr in agg) > Add

[jira] [Commented] (SPARK-11339) Document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995810#comment-14995810 ] Felix Cheung commented on SPARK-11339: -- [~sunrui] [~shivaram] Is this the list? {co

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997750#comment-14997750 ] Felix Cheung commented on SPARK-11587: -- [~shivaram] here's the list SPARK-11339 (whi

[jira] [Created] (SPARK-11715) Support corr for Column Aggregration

2015-11-12 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11715: Summary: Support corr for Column Aggregration Key: SPARK-11715 URL: https://issues.apache.org/jira/browse/SPARK-11715 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11715) R support corr for Column Aggregration

2015-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11715: - Summary: R support corr for Column Aggregration (was: Support corr for Column Aggregration) > R

[jira] [Commented] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003301#comment-15003301 ] Felix Cheung commented on SPARK-11698: -- Should we ignore message? Doesn't that mean

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003548#comment-15003548 ] Felix Cheung commented on SPARK-10863: -- [~olarayej] I"m a little confused - I though

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004442#comment-15004442 ] Felix Cheung commented on SPARK-10863: -- I understand but I think this is problematic

[jira] [Updated] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

2015-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11756: - Component/s: SparkR > SparkR can not output help information for SparkR:::summary correctly > ---

[jira] [Commented] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

2015-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007481#comment-15007481 ] Felix Cheung commented on SPARK-11756: -- [~yanboliang] Could you please clarify what

[jira] [Updated] (SPARK-11755) SparkR can not output help information for SparkR:::predict

2015-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11755: - Component/s: SparkR > SparkR can not output help information for SparkR:::predict > -

[jira] [Commented] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

2015-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007792#comment-15007792 ] Felix Cheung commented on SPARK-11756: -- Fix use of aliases and changes uses of @rdna

[jira] [Created] (SPARK-11800) Broken link to Spark in Dynamic Form doc

2015-11-17 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11800: Summary: Broken link to Spark in Dynamic Form doc Key: SPARK-11800 URL: https://issues.apache.org/jira/browse/SPARK-11800 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-11800) Broken link to Spark in Dynamic Form doc

2015-11-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung closed SPARK-11800. Resolution: Invalid > Broken link to Spark in Dynamic Form doc > --

[jira] [Updated] (SPARK-11800) Broken link

2015-11-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11800: - Description: (was: https://zeppelin.incubator.apache.org/docs/manual/dynamicform.html)

[jira] [Updated] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11339: - Summary: Fix and document the list of functions in R base package that are masked by functions wi

[jira] [Created] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11886: Summary: R function name conflicts with base or stats package ones Key: SPARK-11886 URL: https://issues.apache.org/jira/browse/SPARK-11886 Project: Spark Iss

[jira] [Updated] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11886: - Description: See https://github.com/apache/spark/pull/9785 Currently these are masked: stats::co

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15022787#comment-15022787 ] Felix Cheung commented on SPARK-11886: -- We could also create a generic function to r

[jira] [Created] (SPARK-11984) Typos in GroupedData Pivot doc in Scala and Python

2015-11-25 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11984: Summary: Typos in GroupedData Pivot doc in Scala and Python Key: SPARK-11984 URL: https://issues.apache.org/jira/browse/SPARK-11984 Project: Spark Issue Type

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030229#comment-15030229 ] Felix Cheung commented on SPARK-11886: -- SPARK-12025 renamed several functions that a

[jira] [Created] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12029: Summary: Improve column functions signature, param check, tests, fix doc and add examples Key: SPARK-12029 URL: https://issues.apache.org/jira/browse/SPARK-12029 Proj

[jira] [Updated] (SPARK-12019) SparkR.init have wrong example

2015-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12019: - Component/s: SparkR > SparkR.init have wrong example > -- > >

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032810#comment-15032810 ] Felix Cheung commented on SPARK-11886: -- I see this if I load dplyr after SparkR {co

[jira] [Created] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12071: Summary: Programming guide should explain NULL in JVM translate to NA in R Key: SPARK-12071 URL: https://issues.apache.org/jira/browse/SPARK-12071 Project: Spark

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033227#comment-15033227 ] Felix Cheung commented on SPARK-12071: -- See PR https://github.com/apache/spark/comm

[jira] [Comment Edited] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033227#comment-15033227 ] Felix Cheung edited comment on SPARK-12071 at 12/1/15 7:07 AM:

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034700#comment-15034700 ] Felix Cheung commented on SPARK-11886: -- {code} > library(dplyr) > library(SparkR, l

[jira] [Commented] (SPARK-10894) Add 'drop' support for DataFrame's subset function

2015-12-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035090#comment-15035090 ] Felix Cheung commented on SPARK-10894: -- These seem like orthogonal things. I don't k

[jira] [Updated] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12071: - Labels: releasenotes (was: ) > Programming guide should explain NULL in JVM translate to NA in R

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12019: - Summary: SparkR.init does not support character vector for sparkJars and sparkPackages (was: Spa

[jira] [Commented] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037221#comment-15037221 ] Felix Cheung commented on SPARK-12019: -- per PR comment, we are going to update the c

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037249#comment-15037249 ] Felix Cheung commented on SPARK-12071: -- Also see discussion in https://github.com/ap

[jira] [Created] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12116: Summary: Document workaround when method conflicts with another R package, like dplyr Key: SPARK-12116 URL: https://issues.apache.org/jira/browse/SPARK-12116 Project:

[jira] [Updated] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12116: - Description: See https://issues.apache.org/jira/browse/SPARK-11886 > Document workaround when met

[jira] [Comment Edited] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037251#comment-15037251 ] Felix Cheung edited comment on SPARK-11886 at 12/3/15 4:51 AM:

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037251#comment-15037251 ] Felix Cheung commented on SPARK-11886: -- Created SPARK-12116 for dplyr conflicts > R

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12019: - Affects Version/s: 1.4.0 1.4.1 > SparkR.init does not support character ve

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

2015-12-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042103#comment-15042103 ] Felix Cheung commented on SPARK-12144: -- +1 [~shivaram] The style {code} read.format

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2015-12-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12148: - Component/s: SparkR > SparkR: rename DataFrame to SparkDataFrame > --

[jira] [Created] (SPARK-12168) Need test for masked function

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12168: Summary: Need test for masked function Key: SPARK-12168 URL: https://issues.apache.org/jira/browse/SPARK-12168 Project: Spark Issue Type: Bug Compo

[jira] [Updated] (SPARK-12168) Need test for masked function

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12168: - Description: Currently it is hard to know if a function in base or stats packages are masked whe

[jira] [Updated] (SPARK-12168) Need test for conflicted function in R

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12168: - Summary: Need test for conflicted function in R (was: Need test for masked function) > Need tes

[jira] [Created] (SPARK-12172) Remove SparkR internal RDD APIs

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12172: Summary: Remove SparkR internal RDD APIs Key: SPARK-12172 URL: https://issues.apache.org/jira/browse/SPARK-12172 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12173) Consider supporting DataSet API in SparkR

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12173: Summary: Consider supporting DataSet API in SparkR Key: SPARK-12173 URL: https://issues.apache.org/jira/browse/SPARK-12173 Project: Spark Issue Type: Sub-tas

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044390#comment-15044390 ] Felix Cheung commented on SPARK-12169: -- Great thanks for opening this. I think we sh

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044394#comment-15044394 ] Felix Cheung commented on SPARK-12169: -- For those who's reading - we shouldn't open

[jira] [Updated] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12172: - Summary: Consider removing SparkR internal RDD APIs (was: Remove SparkR internal RDD APIs) > Co

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046369#comment-15046369 ] Felix Cheung commented on SPARK-12172: -- Sure. What are the uses for RDD stuff you ha

[jira] [Commented] (SPARK-12224) R support for JDBC source

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047868#comment-15047868 ] Felix Cheung commented on SPARK-12224: -- I'm working on this. > R support for JDBC s

[jira] [Created] (SPARK-12224) R support for JDBC source

2015-12-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12224: Summary: R support for JDBC source Key: SPARK-12224 URL: https://issues.apache.org/jira/browse/SPARK-12224 Project: Spark Issue Type: Bug Component

[jira] [Created] (SPARK-12232) Consider exporting in R read.table

2015-12-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12232: Summary: Consider exporting in R read.table Key: SPARK-12232 URL: https://issues.apache.org/jira/browse/SPARK-12232 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12232: - Summary: Consider exporting read.table in R (was: Consider exporting in R read.table) > Conside

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048039#comment-15048039 ] Felix Cheung commented on SPARK-12232: -- WIP here: https://github.com/felixcheung/sp

[jira] [Comment Edited] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048039#comment-15048039 ] Felix Cheung edited comment on SPARK-12232 at 12/9/15 5:22 AM:

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048195#comment-15048195 ] Felix Cheung commented on SPARK-12232: -- right, but then table() is confusing as well

[jira] [Commented] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048204#comment-15048204 ] Felix Cheung commented on SPARK-12235: -- Is this related to https://issues.apache.org

[jira] [Commented] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049217#comment-15049217 ] Felix Cheung commented on SPARK-12235: -- Please see https://github.com/apache/spark/p

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049743#comment-15049743 ] Felix Cheung commented on SPARK-12232: -- table() is not on DataFrame, it's with SQLCo

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050104#comment-15050104 ] Felix Cheung commented on SPARK-12071: -- Release note: http://spark.apache.org/releas

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054003#comment-15054003 ] Felix Cheung commented on SPARK-12232: -- agreed, `sqlTableToDF` would make sense. >

[jira] [Updated] (SPARK-12232) Create new R API for read.table to avoid conflict

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12232: - Summary: Create new R API for read.table to avoid conflict (was: Consider exporting read.table i

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056994#comment-15056994 ] Felix Cheung commented on SPARK-12327: -- yea, I think these are overactive checks in

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056995#comment-15056995 ] Felix Cheung commented on SPARK-12327: -- "# void -> NULL" is another example - they a

[jira] [Comment Edited] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056995#comment-15056995 ] Felix Cheung edited comment on SPARK-12327 at 12/14/15 11:51 PM: --

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057364#comment-15057364 ] Felix Cheung commented on SPARK-12327: -- In fact [~yu_ishikawa] did open a PR for a s

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057368#comment-15057368 ] Felix Cheung commented on SPARK-11255: -- Is this test error caused by this? https://

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059510#comment-15059510 ] Felix Cheung commented on SPARK-12327: -- re: PR to lintr: https://github.com/jimheste

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.2

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059515#comment-15059515 ] Felix Cheung commented on SPARK-11255: -- [~joshrosen] was there a specific change in

[jira] [Commented] (SPARK-10312) Enhance SerDe to handle atomic vector

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059537#comment-15059537 ] Felix Cheung commented on SPARK-10312: -- I think method implementation could easily h

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059550#comment-15059550 ] Felix Cheung commented on SPARK-12172: -- That's a great point. [~shivaram] should ht

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065207#comment-15065207 ] Felix Cheung commented on SPARK-12360: -- +1 string. How would parse error (eg. should

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067575#comment-15067575 ] Felix Cheung commented on SPARK-12327: -- https://github.com/apache/spark/pull/10408

[jira] [Created] (SPARK-12515) Minor clarification on DataFrameReader.jdbc doc

2015-12-23 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12515: Summary: Minor clarification on DataFrameReader.jdbc doc Key: SPARK-12515 URL: https://issues.apache.org/jira/browse/SPARK-12515 Project: Spark Issue Type: B

[jira] [Created] (SPARK-12534) Document missing command line options to Spark properties mapping

2015-12-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12534: Summary: Document missing command line options to Spark properties mapping Key: SPARK-12534 URL: https://issues.apache.org/jira/browse/SPARK-12534 Project: Spark

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081686#comment-15081686 ] Felix Cheung commented on SPARK-12609: -- Shouldn't we have a "in-progress" update pin

[jira] [Commented] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081903#comment-15081903 ] Felix Cheung commented on SPARK-12625: -- Is this the complete set of API to be remove

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083506#comment-15083506 ] Felix Cheung commented on SPARK-12609: -- It looks like the timeout to socketConnectio

[jira] [Commented] (SPARK-11139) Make SparkContext.stop() exception-safe

2016-01-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085172#comment-15085172 ] Felix Cheung commented on SPARK-11139: -- it looks like this might have been resolved

[jira] [Created] (SPARK-12699) R driver process should start in a clean state

2016-01-07 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12699: Summary: R driver process should start in a clean state Key: SPARK-12699 URL: https://issues.apache.org/jira/browse/SPARK-12699 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-5162) Python yarn-cluster mode

2016-01-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-5162: Description: Running pyspark in yarn is currently limited to ‘yarn-client’ mode. It would be great

[jira] [Updated] (SPARK-5162) Python yarn-cluster mode

2016-01-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-5162: Description: 2Running pyspark in yarn is currently limited to ‘yarn-client’ mode. It would be great

[jira] [Created] (SPARK-12862) Jenkins does not run R tests

2016-01-17 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12862: Summary: Jenkins does not run R tests Key: SPARK-12862 URL: https://issues.apache.org/jira/browse/SPARK-12862 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-12862) Jenkins does not run R tests

2016-01-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103633#comment-15103633 ] Felix Cheung commented on SPARK-12862: -- mail thread: http://apache-spark-developers

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103856#comment-15103856 ] Felix Cheung commented on SPARK-12790: -- is this simply removing the code path with `

[jira] [Commented] (SPARK-12343) Remove YARN Client / ClientArguments

2016-01-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103915#comment-15103915 ] Felix Cheung commented on SPARK-12343: -- Should deploy/Client be separately removed t

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108138#comment-15108138 ] Felix Cheung commented on SPARK-12790: -- I have made the changes but running tests, I

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108140#comment-15108140 ] Felix Cheung commented on SPARK-12790: -- FsHistoryProviderSuite, which I did change,

[jira] [Commented] (SPARK-3374) Spark on Yarn remove deprecated configs for 2.0

2016-01-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110053#comment-15110053 ] Felix Cheung commented on SPARK-3374: - +1 esp on config handling. SPARK-12343 gets mes

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110299#comment-15110299 ] Felix Cheung commented on SPARK-6817: - Thanks for putting together on the doc [~sunrui

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116645#comment-15116645 ] Felix Cheung commented on SPARK-12984: -- You should specify 'source' - otherwise it d

[jira] [Commented] (SPARK-12344) Remove env-based configurations

2016-02-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127794#comment-15127794 ] Felix Cheung commented on SPARK-12344: -- I think we should remove `SPARK_YARN_USER_EN

[jira] [Commented] (SPARK-12846) Follow up SPARK-12707, Update documentation and other related code

2016-02-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149343#comment-15149343 ] Felix Cheung commented on SPARK-12846: -- actually I was referring to how Jenkins/test

[jira] [Commented] (SPARK-12846) Follow up SPARK-12707, Update documentation and other related code

2016-02-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149349#comment-15149349 ] Felix Cheung commented on SPARK-12846: -- changes to fix Jenkins was in PR https://git

[jira] [Commented] (SPARK-12224) R support for JDBC source

2016-02-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151298#comment-15151298 ] Felix Cheung commented on SPARK-12224: -- [~shivaram] could you please review the PR c

<    3   4   5   6   7   8   9   10   11   12   >