[jira] [Commented] (SPARK-21805) disable R vignettes code on Windows

2017-08-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138097#comment-16138097 ] Felix Cheung commented on SPARK-21805: -- https://github.com/apache/spark/pull/19016 > disabl

[jira] [Commented] (SPARK-12157) Support numpy types as return values of Python UDFs

2017-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137028#comment-16137028 ] Felix Cheung commented on SPARK-12157: -- seems like we have a couple of issues here. I ran

[jira] [Commented] (SPARK-21801) SparkR unit test randomly fail on trees

2017-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136445#comment-16136445 ] Felix Cheung commented on SPARK-21801: -- https://github.com/apache/spark/pull/19018 > SparkR u

[jira] [Created] (SPARK-21805) disable R vignettes code on Windows

2017-08-22 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21805: Summary: disable R vignettes code on Windows Key: SPARK-21805 URL: https://issues.apache.org/jira/browse/SPARK-21805 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-21584) Update R method for summary to call new implementation

2017-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21584. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > Updat

[jira] [Commented] (SPARK-21801) SparkR unit test randomly fail on trees

2017-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136370#comment-16136370 ] Felix Cheung commented on SPARK-21801: -- I've seen it a couple of times. Looking at the test now i

Changing parallelism on BucketingSink

2017-08-21 Thread Felix Cheung
Hi, I'm implementing a custom sink. The job is reading a DataStream into this custom sink. I'd like to be able to maximize the parallelism to use all available slots in the cluster, but to write to a smaller sets of files in the final output. When I implement this sink with

[jira] [Created] (FLINK-7482) StringWriter to support compression

2017-08-20 Thread Felix Cheung (JIRA)
Felix Cheung created FLINK-7482: --- Summary: StringWriter to support compression Key: FLINK-7482 URL: https://issues.apache.org/jira/browse/FLINK-7482 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7482) StringWriter to support compression

2017-08-20 Thread Felix Cheung (JIRA)
Felix Cheung created FLINK-7482: --- Summary: StringWriter to support compression Key: FLINK-7482 URL: https://issues.apache.org/jira/browse/FLINK-7482 Project: Flink Issue Type: Bug

Re: R arrow dependency on Rcpp?

2017-08-11 Thread Felix Cheung
iday, August 11, 2017 1:04 PM Subject: Re: R arrow dependency on Rcpp? To: Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> Cc: <dev@arrow.apache.org<mailto:dev@arrow.apache.org>> hi Felix, Thanks for this context. From > If the goal is to

Re: R arrow dependency on Rcpp?

2017-08-11 Thread Felix Cheung
Friday, August 11, 2017 7:29:29 AM To: dev@arrow.apache.org Cc: Felix Cheung Subject: Re: R arrow dependency on Rcpp? It seems that using Rcpp is fine because an R library for Arrow is an optional component of the project, but will await more opinions on LEGAL-324. + Felix Cheung -- I wonder if you

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-08-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121866#comment-16121866 ] Felix Cheung commented on SPARK-21693: -- splitting test matrix is also possible, I worry though since

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-08-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121860#comment-16121860 ] Felix Cheung commented on SPARK-21693: -- we could certainly simplify the classification set

Re: Welcoming Hyukjin Kwon and Sameer Agarwal as committers

2017-08-07 Thread Felix Cheung
Congrats!! From: Kevin Kim (Sangwoo) Sent: Monday, August 7, 2017 7:30:01 PM To: Hyukjin Kwon; dev Cc: Bryan Cutler; Mridul Muralidharan; Matei Zaharia; Holden Karau Subject: Re: Welcoming Hyukjin Kwon and Sameer Agarwal as committers Thanks

[jira] [Resolved] (SPARK-21622) Support Offset in SparkR

2017-08-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21622. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-21622) Support Offset in SparkR

2017-08-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16115951#comment-16115951 ] Felix Cheung commented on SPARK-21622: -- https://github.com/apache/spark/pull/18831 > Support Off

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2017-08-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113974#comment-16113974 ] Felix Cheung commented on SPARK-15799: -- we submitted 2.2.0 release to CRAN and got some comment

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-08-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113145#comment-16113145 ] Felix Cheung commented on SPARK-21367: -- still seeing it Warning messages: 1: In check_dep_version

[jira] [Assigned] (SPARK-21584) Update R method for summary to call new implementation

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21584: Assignee: Andrew Ray > Update R method for summary to call new implementat

[jira] [Commented] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111483#comment-16111483 ] Felix Cheung commented on SPARK-21616: -- SPARK-21584 > SparkR 2.3.0 migration guide, release n

[jira] [Commented] (SPARK-21584) Update R method for summary to call new implementation

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111485#comment-16111485 ] Felix Cheung commented on SPARK-21584: -- https://github.com/apache/spark/pull/18786 > Updat

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Fix Version/s: (was: 2.2.0) > SparkR 2.3.0 migration guide, release n

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Description: >From looking at changes since 2.2.0, this/these should be documen

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Affects Version/s: (was: 2.2.0) 2.3.0 > SparkR 2.3.0 migration gu

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Summary: SparkR 2.3.0 migration guide, release note (was: CLONE - SparkR 2.2.0 migration guide

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-08-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Target Version/s: 2.3.0 (was: 2.2.0, 2.3.0) > SparkR 2.3.0 migration guide, release n

[jira] [Created] (SPARK-21616) CLONE - SparkR 2.2.0 migration guide, release note

2017-08-02 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21616: Summary: CLONE - SparkR 2.2.0 migration guide, release note Key: SPARK-21616 URL: https://issues.apache.org/jira/browse/SPARK-21616 Project: Spark Issue

[jira] [Resolved] (SPARK-21381) SparkR: pass on setHandleInvalid for classification algorithms

2017-07-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21381. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.3.0 Target

[jira] [Commented] (SPARK-18226) SparkR displaying vector columns in incorrect way

2017-07-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094277#comment-16094277 ] Felix Cheung commented on SPARK-18226: -- I agree, usability is poor, though I think if you subset

[jira] [Commented] (SPARK-18226) SparkR displaying vector columns in incorrect way

2017-07-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093466#comment-16093466 ] Felix Cheung commented on SPARK-18226: -- if you collect on what's returned by predict(), you should

[jira] [Commented] (SPARK-21450) List of NA is flattened inside a SparkR struct type

2017-07-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091132#comment-16091132 ] Felix Cheung commented on SPARK-21450: -- [~hyukjin.kwon] If you follow the code in test_sparkSQL.R

Re: R package in Apache projects

2017-07-12 Thread Felix Cheung
Thanks Qiang. To clarify, Spark or SparkR does not depend on Rcpp. And SparkR is part of the Spark source and binary release. On Wed, Jul 12, 2017 at 1:31 PM Qiang Kou wrote: > Hi, > > I am sending this email for how to handle R package in an Apache project. > Any opinions

Re: R package in Apache projects

2017-07-12 Thread Felix Cheung
Thanks Qiang. To clarify, Spark or SparkR does not depend on Rcpp. And SparkR is part of the Spark source and binary release. On Wed, Jul 12, 2017 at 1:31 PM Qiang Kou wrote: > Hi, > > I am sending this email for how to handle R package in an Apache project. > Any opinions

Re: With 2.2.0 PySpark is now available for pip install from PyPI :)

2017-07-12 Thread Felix Cheung
Awesome! Congrats!! From: holden.ka...@gmail.com on behalf of Holden Karau Sent: Wednesday, July 12, 2017 12:26:00 PM To: user@spark.apache.org Subject: With 2.2.0 PySpark is now available for pip install from PyPI

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082692#comment-16082692 ] Felix Cheung commented on SPARK-21367: -- *SOMETIMES*? :) > R older version of Roxygen2 on Jenk

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081720#comment-16081720 ] Felix Cheung edited comment on SPARK-21367 at 7/11/17 6:28 AM: --- I'm

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081744#comment-16081744 ] Felix Cheung commented on SPARK-21367: -- I think I found the first error, it's one build before

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081720#comment-16081720 ] Felix Cheung edited comment on SPARK-21367 at 7/11/17 6:33 AM: --- I'm

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081744#comment-16081744 ] Felix Cheung edited comment on SPARK-21367 at 7/11/17 6:26 AM: --- I think I

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081744#comment-16081744 ] Felix Cheung edited comment on SPARK-21367 at 7/11/17 6:26 AM: --- I think I

[jira] [Issue Comment Deleted] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21367: - Comment: was deleted (was: it looks like instead of 5.x, the older 4.0 is being loaded? First

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081720#comment-16081720 ] Felix Cheung edited comment on SPARK-21367 at 7/11/17 6:06 AM: --- I'm

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081723#comment-16081723 ] Felix Cheung commented on SPARK-21367: -- And I'm pretty sure we should build with Roxygen2 5.0.1

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081720#comment-16081720 ] Felix Cheung edited comment on SPARK-21367 at 7/11/17 6:02 AM: --- I'm

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081720#comment-16081720 ] Felix Cheung commented on SPARK-21367: -- I'm not sure exactly why yet, but comparing the working

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081712#comment-16081712 ] Felix Cheung commented on SPARK-21367: -- it looks like instead of 5.x, the older 4.0 is being loaded

[jira] [Updated] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21367: - Description: Getting this message from a recent build. https://amplab.cs.berkeley.edu/jenkins

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080728#comment-16080728 ] Felix Cheung edited comment on SPARK-21367 at 7/10/17 5:45 PM

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080728#comment-16080728 ] Felix Cheung commented on SPARK-21367: -- @shane knapp could you check? thanks! > R older vers

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080728#comment-16080728 ] Felix Cheung edited comment on SPARK-21367 at 7/10/17 5:44 PM: --- ~shane

[jira] [Created] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21367: Summary: R older version of Roxygen2 on Jenkins Key: SPARK-21367 URL: https://issues.apache.org/jira/browse/SPARK-21367 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-21266) Support schema a DDL-formatted string in dapply/gapply/from_json

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21266. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079325#comment-16079325 ] Felix Cheung commented on SPARK-19568: -- separate from CRAN task > Must include class/met

[jira] [Updated] (SPARK-19568) Must include class/method documentation for CRAN check

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19568: - Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-15799) > Must include cl

[jira] [Updated] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21290: - Target Version/s: 2.3.0 > R document Programmatically Specifying the Schema in SQL gu

[jira] [Commented] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079323#comment-16079323 ] Felix Cheung commented on SPARK-21290: -- with some changes to schema string support on the way, let's

[jira] [Resolved] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21093. -- Resolution: Fixed Fix Version/s: 2.3.0 > Multiple gapply execution occasionally fai

[jira] [Assigned] (SPARK-20456) Add examples for functions collection for pyspark

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-20456: Assignee: Michael Patterson > Add examples for functions collection for pysp

[jira] [Resolved] (SPARK-20456) Add examples for functions collection for pyspark

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20456. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > Add examp

[jira] [Resolved] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-07-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20307. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.3.0 Target

Re: ZeroMQ licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
ul 7, 2017 at 1:54 AM, Greg Stein <gst...@gmail.com> wrote: > > > If it is optional at compile-time, then a header file is very allowable. > As > > long as MXNet can be compiled without ZeroMQ on the box, then I see no > > issue at all. > > > > On Thu, Jul 6, 2017 at

Re: Rcpp licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
.org<mailto:dev@mxnet.incubator.apache.org>> Really thank you for the info. Can you tell us a little more on how Spark handles the R package? The building of R package is skipped when releasing, right? Best wishes, KK On Fri, Jul 7, 2017 at 7:41 AM, Felix Cheung <felixcheun...@ho

Re: Rcpp licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
es, our case is very similar with Spark. > > The Spark R package includes "R.h" and "Rinternals.h", which are both LGPL > ( > https://github.com/apache/spark/blob/master/R/pkg/src- > native/string_hash_code.c#L24-L25 > ). > > Best wishes, >

Re: ZeroMQ licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
box, then I see no > issue at all. > > On Thu, Jul 6, 2017 at 3:51 PM, Felix Cheung <felixche...@apache.org> > wrote: > > > Isn't the release binaries going to contain bits from zeromq because of > > #include though? > > > > That header file is still going

Re: Rcpp licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
project.org/doc/manuals/r-release/R-exts. html#Package-Dependencies). (3) Many R packages who use Rcpp to communicate with C++ have been released under Apache License, like feather (https://github.com/wesm/ feather/blob/master/R/DESCRIPTION). Best, Qiang Kou On Thu, Jul 6, 2017 at 1:20 AM, Feli

Re: ZeroMQ licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
Isn't the release binaries going to contain bits from zeromq because of #include though? That header file is still going to be LGPL 3.0 licensed right? On Thu, Jul 6, 2017 at 12:45 PM John D. Ament wrote: > Mu, > > So what happens when ZeroMQ is not available, do you

Re: ZeroMQ licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
Isn't the release binaries going to contain bits from zeromq because of #include though? That header file is still going to be LGPL 3.0 licensed right? On Thu, Jul 6, 2017 at 12:45 PM John D. Ament wrote: > Mu, > > So what happens when ZeroMQ is not available, do you

Rcpp licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
On a related note, Rcpp, used extensively in the R package, is GPLv2/GPLv3 licensed. I'm not aware of any other R package available that supports R<->C++. https://www.apache.org/legal/resolved.html#category-x https://cran.r-project.org/web/packages/Rcpp/index.html _

Re: [VOTE] Apache Spark 2.2.0 (RC6)

2017-07-05 Thread Felix Cheung
+1 (non binding) Tested R, R package on Ubuntu and Windows, CRAN checks, manual tests with steaming & udf. _ From: Denny Lee > Sent: Monday, July 3, 2017 9:30 PM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC6) To:

[jira] [Assigned] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21293: Assignee: Felix Cheung > R document update structured stream

[jira] [Commented] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072771#comment-16072771 ] Felix Cheung commented on SPARK-21293: -- and remove `(experimental).` from R guide > R docum

[jira] [Closed] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung closed SPARK-21294. > R document Decision Tree in ML guide > > >

[jira] [Resolved] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21294. -- Resolution: Cannot Reproduce it's in master > R document Decision Tree in ML gu

[jira] [Updated] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21290: - Issue Type: Documentation (was: Bug) > R document Programmatically Specifying the Schema in

[jira] [Updated] (SPARK-21291) R bucketBy partitionBy API

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21291: - Issue Type: Improvement (was: Bug) > R bucketBy partitionBy

[jira] [Updated] (SPARK-21292) R document Catalog function metadata refresh

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21292: - Issue Type: Documentation (was: Bug) > R document Catalog function metadata refr

[jira] [Updated] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21293: - Issue Type: Documentation (was: Bug) > R document update structured stream

[jira] [Created] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21294: Summary: R document Decision Tree in ML guide Key: SPARK-21294 URL: https://issues.apache.org/jira/browse/SPARK-21294 Project: Spark Issue Type

[jira] [Updated] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21294: - Description: 2.3.0 release Decision tree was: 2.3.0 release Decision tree classifier >

[jira] [Created] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21293: Summary: R document update structured streaming Key: SPARK-21293 URL: https://issues.apache.org/jira/browse/SPARK-21293 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-21292) R document Catalog function metadata refresh

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21292: Summary: R document Catalog function metadata refresh Key: SPARK-21292 URL: https://issues.apache.org/jira/browse/SPARK-21292 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-21292) R document Catalog function metadata refresh

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21292: Assignee: Felix Cheung > R document Catalog function metadata refr

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072743#comment-16072743 ] Felix Cheung commented on SPARK-21291: -- and update the SQL programming guide > R bucke

[jira] [Created] (SPARK-21291) R bucketBy partitionBy API

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21291: Summary: R bucketBy partitionBy API Key: SPARK-21291 URL: https://issues.apache.org/jira/browse/SPARK-21291 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21290: Summary: R document Programmatically Specifying the Schema in SQL guide Key: SPARK-21290 URL: https://issues.apache.org/jira/browse/SPARK-21290 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21208: - Comment: was deleted (was: User 'HyukjinKwon' has created a pull request for this issue: https

[jira] [Comment Edited] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067637#comment-16067637 ] Felix Cheung edited comment on SPARK-21093 at 6/29/17 3:12 AM

[jira] [Reopened] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reopened SPARK-21093: -- this was reverted. > Multiple gapply execution occasionally failed in Spa

[jira] [Assigned] (SPARK-21224) Support a DDL-formatted string as schema in reading for R

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21224: Assignee: Hyukjin Kwon > Support a DDL-formatted string as schema in reading fo

[jira] [Commented] (SPARK-21224) Support a DDL-formatted string as schema in reading for R

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067608#comment-16067608 ] Felix Cheung commented on SPARK-21224: -- let's add this to from_json, gapply, dapply too

[jira] [Commented] (SPARK-21232) New built-in SQL function - Data_Type

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065972#comment-16065972 ] Felix Cheung commented on SPARK-21232: -- I don't see this in Scala - are you proposing we add

[jira] [Commented] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062399#comment-16062399 ] Felix Cheung commented on SPARK-21093: -- since this is a very core change to SparkR, we agree

[jira] [Resolved] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21093. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

2017-06-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062396#comment-16062396 ] Felix Cheung commented on SPARK-21208: -- +1 > Ability to "setLocalProperty" from

[jira] [Resolved] (SPARK-21149) Add job description API for R

2017-06-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21149. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-06-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061159#comment-16061159 ] Felix Cheung commented on SPARK-20307: -- Not much update as far as I know. Would you like

Re: New committer: Park Hoon

2017-06-22 Thread Felix Cheung
Congrats! From: astros...@gmail.com on behalf of Hyung Sung Shim Sent: Thursday, June 22, 2017 9:10:12 AM To: dev Subject: Re: New committer: Park Hoon Congratulations!!! 2017-06-22 20:56 GMT+09:00 Jeff Zhang

[jira] [Resolved] (SPARK-20906) Constrained Logistic Regression for SparkR

2017-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20906. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.3.0 Target

[jira] [Resolved] (SPARK-20917) SparkR supports string encoding consistent with R

2017-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20917. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

Re: Contributing to Apache Zeppelin

2017-06-21 Thread Felix Cheung
Hi welcome! Please feel free to open JIRA and add a comment that you are working on it - there is no need to wait to have the JIRA assigned to you to start. _ From: Marco Tagliabue > Sent:

<    8   9   10   11   12   13   14   15   16   17   >