Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json

2018-08-13 Thread Felix Cheung
Perhaps one concern is users having characters in note name that are invalid for file name/file path? From: Mohit Jaggi Sent: Sunday, August 12, 2018 6:02 PM To: us...@zeppelin.apache.org Cc: dev Subject: Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln

Re: [R] discuss: removing lint-r checks for old branches

2018-08-11 Thread Felix Cheung
SGTM for old branches. I recall we need to upgrade to newer lintr since it is missing some tests. Also these seems like real test failures? Are these only happening in 2.1 and 2.2? From: shane knapp Sent: Friday, August 10, 2018 4:04 PM To: Sean Owen Cc:

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569109#comment-16569109 ] Felix Cheung commented on SPARK-24924: --   I tend to agree that we shouldn't "magically&q

[jira] [Commented] (SPARK-23683) FileCommitProtocol.instantiate to require 3-arg constructor for dynamic partition overwrite

2018-07-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558009#comment-16558009 ] Felix Cheung commented on SPARK-23683: -- should this be ported back to branch 2.3 ? we ran

Re: Cleaning Spark releases from mirrors, and the flakiness of HiveExternalCatalogVersionsSuite

2018-07-19 Thread Felix Cheung
+1 this has been problematic. Also, this list needs to be updated every time we make a new release? Plus can we cache them on Jenkins, maybe we can avoid downloading the same thing from Apache archive every test run. From: Marco Gaido Sent: Monday, July 16,

Re: [VOTE] SPIP: Standardize SQL logical plans

2018-07-18 Thread Felix Cheung
+1 From: Bruce Robbins Sent: Wednesday, July 18, 2018 3:02 PM To: Ryan Blue Cc: Spark Dev List Subject: Re: [VOTE] SPIP: Standardize SQL logical plans +1 (non-binding) On Tue, Jul 17, 2018 at 10:59 AM, Ryan Blue mailto:b...@apache.org>> wrote: Hi everyone,

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2018-07-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541191#comment-16541191 ] Felix Cheung commented on SPARK-20202: -- How like will there be a hive release? HIVE-16391 is still

[jira] [Commented] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work.

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539627#comment-16539627 ] Felix Cheung commented on SPARK-24781: -- [~jerryshao] > Using a reference from Dataset in Fil

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539622#comment-16539622 ] Felix Cheung commented on SPARK-14220: -- this shouldn't block 2.3.2 right? > Build and test Sp

[jira] [Assigned] (SPARK-23461) vignettes should include model predictions for some ML models

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-23461: Assignee: Huaxin Gao > vignettes should include model predictions for some ML mod

[jira] [Resolved] (SPARK-23461) vignettes should include model predictions for some ML models

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23461. -- Resolution: Fixed Fix Version/s: 2.4.0 > vignettes should include model predicti

[jira] [Resolved] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

2018-07-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23529. -- Resolution: Fixed Assignee: Andrew Korzhuev (was: Anirudh Ramanathan) Fix

Re: [CRAN-pretest-archived] CRAN submission SparkR 2.2.2

2018-07-09 Thread Felix Cheung
I recall this might be a problem running Spark on java 9 From: Shivaram Venkataraman Sent: Monday, July 9, 2018 2:17 PM To: dev; Felix Cheung; Tom Graves Subject: Fwd: [CRAN-pretest-archived] CRAN submission SparkR 2.2.2 The upcoming 2.2.2 release was submitted

[jira] [Commented] (SPARK-24674) Spark on Kubernetes BLAS performance

2018-07-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535983#comment-16535983 ] Felix Cheung commented on SPARK-24674: -- kinda - there has been discussions on whether alpine

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-07-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535345#comment-16535345 ] Felix Cheung commented on SPARK-24152: -- I'm pretty sure it's a problem on the server side though

[jira] [Resolved] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24535. -- Resolution: Fixed Fix Version/s: 2.4.0 2.3.2 Target

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534502#comment-16534502 ] Felix Cheung commented on SPARK-24535: -- [~shivaram] I've merged it, but it could be great if you

[jira] [Comment Edited] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530963#comment-16530963 ] Felix Cheung edited comment on SPARK-24535 at 7/3/18 7:50 AM: -- ok, I

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR on Windows

2018-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Summary: Fix java version parsing in SparkR on Windows (was: Fix java version parsing

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR

2018-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530963#comment-16530963 ] Felix Cheung commented on SPARK-24535: -- ok, I submitted a modified package to win-builder

Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

2018-06-29 Thread Felix Cheung
Hmm... this is built automatically from the git tag when the release is official. We will need to investigate.. From: Krishna Pandey Sent: Thursday, June 28, 2018 3:26:46 PM To: dev@zeppelin.apache.org Subject: Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR

2018-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Target Version/s: 2.3.2 > Fix java version parsing in Spa

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR

2018-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Priority: Blocker (was: Major) > Fix java version parsing in Spa

[jira] [Assigned] (SPARK-24535) Fix java version parsing in SparkR

2018-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-24535: Assignee: Felix Cheung > Fix java version parsing in Spa

Re: [VOTE] Spark 2.1.3 (RC2)

2018-06-28 Thread Felix Cheung
If I recall we stop releasing Hadoop 2.3 or 2.4 in newer releases (2.2+?) - that might be why they are not the release script. From: Marcelo Vanzin Sent: Thursday, June 28, 2018 11:12:45 AM To: Sean Owen Cc: Marcelo Vanzin; dev Subject: Re: [VOTE] Spark 2.1.3

Re: [VOTE] Spark 2.1.3 (RC2)

2018-06-28 Thread Felix Cheung
Exactly... From: Marcelo Vanzin Sent: Thursday, June 28, 2018 9:16:08 AM To: Tom Graves Cc: Felix Cheung; dev Subject: Re: [VOTE] Spark 2.1.3 (RC2) Yeah, we should be more careful with that in general. Like we state that "Spark runs on Java 8+"... O

Re: Time for 2.3.2?

2018-06-28 Thread Felix Cheung
Yap will do From: Marcelo Vanzin Sent: Thursday, June 28, 2018 9:04:41 AM To: Felix Cheung Cc: Spark dev list Subject: Re: Time for 2.3.2? Could you mark that bug as blocker and set the target version, in that case? On Thu, Jun 28, 2018 at 8:46 AM, Felix Cheung

Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

2018-06-28 Thread Felix Cheung
Congrats and thanks for putting together the release From: Miquel Angel Andreu Febrer Sent: Wednesday, June 27, 2018 11:02:20 PM To: dev@zeppelin.apache.org Cc: us...@zeppelin.apache.org Subject: Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released Great news, It has

Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

2018-06-28 Thread Felix Cheung
Congrats and thanks for putting together the release From: Miquel Angel Andreu Febrer Sent: Wednesday, June 27, 2018 11:02:20 PM To: d...@zeppelin.apache.org Cc: users@zeppelin.apache.org Subject: Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released Great news, It has

Re: Time for 2.3.2?

2018-06-28 Thread Felix Cheung
+1 I’d like to fix SPARK-24535 first though From: Stavros Kontopoulos Sent: Thursday, June 28, 2018 3:50:34 AM To: Marco Gaido Cc: Takeshi Yamamuro; Xingbo Jiang; Wenchen Fan; Spark dev list; Saisai Shao; van...@cloudera.com.invalid Subject: Re: Time for 2.3.2?

Re: [VOTE] Spark 2.1.3 (RC2)

2018-06-28 Thread Felix Cheung
.nabble.com/VOTE-Spark-2-1-2-RC2-tt22540.html#a22555 Since it isn’t a regression I’d say +1 from me. From: Tom Graves Sent: Thursday, June 28, 2018 6:56:16 AM To: Marcelo Vanzin; Felix Cheung Cc: dev Subject: Re: [VOTE] Spark 2.1.3 (RC2) If this is just supporting

Re: [VOTE] Spark 2.1.3 (RC2)

2018-06-27 Thread Felix Cheung
Yes, this is broken with newer version of R. We check explicitly for warning for the R check which should fail the test run. From: Marcelo Vanzin Sent: Wednesday, June 27, 2018 6:55 PM To: Felix Cheung Cc: Marcelo Vanzin; Tom Graves; dev Subject: Re: [VOTE

Re: [VOTE] Spark 2.1.3 (RC2)

2018-06-27 Thread Felix Cheung
(I don’t want to block the release(s) per se...) We need to backport SPARK-22281 (to branch-2.1 and branch-2.2) This is fixed in 2.3 back in Nov 2017 https://github.com/apache/spark/commit/2ca5aae47a25dc6bc9e333fb592025ff14824501#diff-e1e1d3d40573127e9ee0480caf1283d6 Perhaps we don't get

Re: Spark 2.3.1 not working on Java 10

2018-06-21 Thread Felix Cheung
I'm not sure we have completed support for Java 10 From: Rahul Agrawal Sent: Thursday, June 21, 2018 7:22:42 AM To: user@spark.apache.org Subject: Spark 2.3.1 not working on Java 10 Dear Team, I have installed Java 10, Scala 2.12.6 and spark 2.3.1 in my

[jira] [Created] (SPARK-24572) "eager execution" for R shell, IDE

2018-06-16 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24572: Summary: "eager execution" for R shell, IDE Key: SPARK-24572 URL: https://issues.apache.org/jira/browse/SPARK-24572 Project: Spark Issue

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

2018-06-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513416#comment-16513416 ] Felix Cheung commented on SPARK-23435: -- sorry, I did try but couldn't get it to work, but something

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR

2018-06-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513372#comment-16513372 ] Felix Cheung commented on SPARK-24535: -- is this only failing on windows? I wonder

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513363#comment-16513363 ] Felix Cheung commented on SPARK-24359: -- [~shivaram] sure - do you mean 2.3.1.1 though? 2.4.0

Re: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1

2018-06-12 Thread Felix Cheung
For #1 is system requirements not honored? For #2 it looks like Oracle JDK? From: Shivaram Venkataraman Sent: Tuesday, June 12, 2018 3:17:52 PM To: dev Cc: Felix Cheung Subject: Fwd: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1 Corresponding

[jira] [Commented] (SPARK-13184) Support minPartitions parameter for JSON and CSV datasources as options

2018-06-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507476#comment-16507476 ] Felix Cheung commented on SPARK-13184: -- what's the next step? > Support minPartitions parame

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM: -- Thanks

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM: -- Thanks

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung commented on SPARK-24359: -- Thanks Joseph - correct one possibility is to branch 2.4.0

Re: Scala 2.12 support

2018-06-07 Thread Felix Cheung
+1 Spoke to Dean as well and mentioned the problem with 2.11.12 https://github.com/scala/bug/issues/10913 _ From: Sean Owen Sent: Wednesday, June 6, 2018 12:23 PM Subject: Re: Scala 2.12 support To: Holden Karau Cc: Dean Wampler , Reynold Xin , dev If it means

Re: Time for 2.2.2 release

2018-06-07 Thread Felix Cheung
+1 and thanks! From: Tom Graves Sent: Wednesday, June 6, 2018 7:54:43 AM To: Dev Subject: Time for 2.2.2 release Hello all, I think its time for another 2.2 release. I took a look at Jira and I don't see anything explicitly targeted for 2.2.2 that is not yet

[jira] [Resolved] (SPARK-24403) reuse r worker

2018-06-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24403. -- Resolution: Duplicate > reuse r worker > -- > > Key:

[jira] [Closed] (SPARK-24403) reuse r worker

2018-06-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung closed SPARK-24403. > reuse r worker > -- > > Key: SPARK-24403 >

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500634#comment-16500634 ] Felix Cheung commented on SPARK-24359: -- +1 on the `spark-website` model for faster iterations

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-06-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499528#comment-16499528 ] Felix Cheung commented on SPARK-23206: -- [~irashid] sorry I thought I had replied - on our end

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498901#comment-16498901 ] Felix Cheung commented on SPARK-24434: -- I see. Why not then pass along the pod template as a (yaml

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498225#comment-16498225 ] Felix Cheung commented on SPARK-24434: -- java properties is basically the "standard" in

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2018-06-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498213#comment-16498213 ] Felix Cheung commented on SPARK-20202: -- Prefer newer Hive also > Remove references to org.sp

[jira] [Resolved] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

2018-05-31 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24326. -- Resolution: Fixed Assignee: Stavros Kontopoulos Fix Version/s: 2.4.0 >

Re: [VOTE] SPIP ML Pipelines in R

2018-05-31 Thread Felix Cheung
+1 With my concerns in the SPIP discussion. From: Hossein Sent: Wednesday, May 30, 2018 2:03:03 PM To: dev@spark.apache.org Subject: [VOTE] SPIP ML Pipelines in R Hi, I started discussion

Re: Revisiting Online serving of Spark models?

2018-05-30 Thread Felix Cheung
: Re: Revisiting Online serving of Spark models? To: Maximiliano Felice Cc: Felix Cheung , Holden Karau , Joseph Bradley , Leif Walsh , dev Would love to join but am in Seattle, thoughts on how to make this work? Regards Sent from my iPhone On May 29, 2018, at 10:35 AM, Maximiliano Felice

[jira] [Resolved] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24331. -- Resolution: Fixed Fix Version/s: 2.4.0 Target Version/s: 2.4.0 >

[jira] [Assigned] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-24331: Assignee: Marek Novotny > Add arrays_overlap / array_repeat / map_entr

[jira] [Comment Edited] (SPARK-24403) reuse r worker

2018-05-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494707#comment-16494707 ] Felix Cheung edited comment on SPARK-24403 at 5/30/18 5:38 AM: --- Reuse

[jira] [Commented] (SPARK-23650) Slow SparkR udf (dapply)

2018-05-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494708#comment-16494708 ] Felix Cheung commented on SPARK-23650: -- sorry, I really don't have time/resource to investigate

[jira] [Commented] (SPARK-24403) reuse r worker

2018-05-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494707#comment-16494707 ] Felix Cheung commented on SPARK-24403: -- Reuse worker (daemon process) is actually supported

Re: Revisiting Online serving of Spark models?

2018-05-29 Thread Felix Cheung
You had me at blue bottle! _ From: Holden Karau Sent: Tuesday, May 29, 2018 9:47 AM Subject: Re: Revisiting Online serving of Spark models? To: Felix Cheung Cc: Saikat Kanjilal , Maximiliano Felice , Joseph Bradley , Leif Walsh , dev I'm down for that, we could

Re: Revisiting Online serving of Spark models?

2018-05-29 Thread Felix Cheung
Bump. From: Felix Cheung Sent: Saturday, May 26, 2018 1:05:29 PM To: Saikat Kanjilal; Maximiliano Felice; Joseph Bradley Cc: Leif Walsh; Holden Karau; dev Subject: Re: Revisiting Online serving of Spark models? Hi! How about we meet the community and discuss

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492341#comment-16492341 ] Felix Cheung edited comment on SPARK-24359 at 5/28/18 7:10 AM: --- re repo

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492341#comment-16492341 ] Felix Cheung commented on SPARK-24359: -- re repo/release/version - again to be clear, what Shivaram

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491908#comment-16491908 ] Felix Cheung commented on SPARK-23435: -- Work was stopped for a while. Hopefully I can come

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491867#comment-16491867 ] Felix Cheung edited comment on SPARK-24359 at 5/27/18 3:24 AM

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491867#comment-16491867 ] Felix Cheung commented on SPARK-24359: -- # are the set_input_col / set_output_col methods going

Re: Revisiting Online serving of Spark models?

2018-05-26 Thread Felix Cheung
2018 7:47:07 AM To: Maximiliano Felice Cc: Leif Walsh; Felix Cheung; Holden Karau; Joseph Bradley; dev Subject: Re: Revisiting Online serving of Spark models? I’m in the same exact boat as Maximiliano and have use cases as well for model serving and would love to join this discussion. Sent f

[jira] [Commented] (SPARK-24356) Duplicate strings in File.path managed by FileSegmentManagedBuffer

2018-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491788#comment-16491788 ] Felix Cheung commented on SPARK-24356: -- Interesting. we will definitely look into this. Is the plan

Re: SparkR was removed from CRAN on 2018-05-01

2018-05-25 Thread Felix Cheung
This is the fix https://github.com/apache/spark/commit/f27a035daf705766d3445e5c6a99867c11c552b0#diff-e1e1d3d40573127e9ee0480caf1283d6 I don't have the email though. From: Hossein Sent: Friday, May 25, 2018 10:58:42 AM To: dev@spark.apache.org

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488512#comment-16488512 ] Felix Cheung edited comment on SPARK-24359 at 5/24/18 6:34 AM: --- re

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488512#comment-16488512 ] Felix Cheung commented on SPARK-24359: -- re this  * This also leads to the question of how

[jira] [Commented] (SPARK-22055) Port release scripts

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486728#comment-16486728 ] Felix Cheung commented on SPARK-22055: -- interesting - I'd definitely be happy to help. do you have

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486719#comment-16486719 ] Felix Cheung edited comment on SPARK-24359 at 5/23/18 5:21 AM: --- # could you

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486719#comment-16486719 ] Felix Cheung edited comment on SPARK-24359 at 5/23/18 5:18 AM: --- # could you

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486719#comment-16486719 ] Felix Cheung commented on SPARK-24359: -- # could you include design doc as google doc

Re: Revisiting Online serving of Spark models?

2018-05-21 Thread Felix Cheung
+1 on meeting up! From: Holden Karau <hol...@pigscanfly.ca> Sent: Monday, May 21, 2018 2:52:20 PM To: Joseph Bradley Cc: Felix Cheung; dev Subject: Re: Revisiting Online serving of Spark models? (Oh also the write API has already been extended to take f

Re: Running lint-java during PR builds?

2018-05-21 Thread Felix Cheung
One concern is with the volume of test runs on Travis. In ASF projects Travis could get significantly backed up since - if I recall - all of ASF shares one queue. At the number of PRs Spark has this could be a big issue. From: Marcelo Vanzin

Re: Integrating ML/DL frameworks with Spark

2018-05-20 Thread Felix Cheung
Very cool. We would be very interested in this. What is the plan forward to make progress in each of the three areas? From: Bryan Cutler Sent: Monday, May 14, 2018 11:37:20 PM To: Xiangrui Meng Cc: Reynold Xin; dev Subject: Re: Integrating

Re: Revisiting Online serving of Spark models?

2018-05-20 Thread Felix Cheung
be interested in getting together to discuss/get some feedback? _ From: Felix Cheung <felixcheun...@hotmail.com> Sent: Thursday, May 10, 2018 10:10 AM Subject: Re: Revisiting Online serving of Spark models? To: Holden Karau <hol...@pigscanfly.ca>, Joseph

[jira] [Created] (ZEPPELIN-3469) Confusing behavior when running on Java 9

2018-05-17 Thread Felix Cheung (JIRA)
Felix Cheung created ZEPPELIN-3469: -- Summary: Confusing behavior when running on Java 9 Key: ZEPPELIN-3469 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3469 Project: Zeppelin Issue

[jira] [Created] (ZEPPELIN-3468) Undo paragraph change after find/replace erratic

2018-05-17 Thread Felix Cheung (JIRA)
Felix Cheung created ZEPPELIN-3468: -- Summary: Undo paragraph change after find/replace erratic Key: ZEPPELIN-3468 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3468 Project: Zeppelin

Re: [VOTE] Release Apache Zeppelin 0.8.0 (RC2)

2018-05-16 Thread Felix Cheung
Tested and some observations / issues: - We should remove *.md5 from dist.apache.org before publishing (on the other hand, .md5 is needed for maven / repository.apache.org) - also this doc page has hardcoded versions (to 0.7.0), might also need a few more updates

[jira] [Commented] (SPARK-23455) Default Params in ML should be saved separately

2018-05-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476747#comment-16476747 ] Felix Cheung commented on SPARK-23455: -- does this affect R? > Default Params in ML should be sa

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475202#comment-16475202 ] Felix Cheung commented on SPARK-23780: -- [~vanzin] - FYI - if we have another RC this can be pulled

[jira] [Resolved] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23780. -- Resolution: Fixed Fix Version/s: (was: 2.3.1) > Failed to use googleVis libr

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Fix Version/s: 2.3.2 > Failed to use googleVis library with new Spa

[jira] [Assigned] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-23780: Assignee: Felix Cheung > Failed to use googleVis library with new Spa

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Fix Version/s: 2.4.0 2.3.1 > Failed to use googleVis library with new Spa

[jira] [Commented] (SPARK-24265) lintr checks not failing PR build

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473651#comment-16473651 ] Felix Cheung commented on SPARK-24265: -- example: https://github.com/apache/spark/pull/21315/files

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Affects Version/s: 2.3.0 > Failed to use googleVis library with new Spa

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Labels: regression (was: regresion) > Failed to use googleVis library with new Spa

[jira] [Updated] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23780: - Labels: regresion (was: ) > Failed to use googleVis library with new Spa

[jira] [Created] (SPARK-24265) lintr checks not failing PR build

2018-05-13 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24265: Summary: lintr checks not failing PR build Key: SPARK-24265 URL: https://issues.apache.org/jira/browse/SPARK-24265 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Description: testing with openjdk, noticed that it breaks because the version string

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Description: testing with openjdk, noticed that it breaks because the version string

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Priority: Blocker (was: Major) > SparkR java check breaks on open

[jira] [Updated] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24263: - Affects Version/s: (was: 2.3.0) 2.3.1 > SparkR java check bre

[jira] [Created] (SPARK-24263) SparkR java check breaks on openjdk

2018-05-13 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24263: Summary: SparkR java check breaks on openjdk Key: SPARK-24263 URL: https://issues.apache.org/jira/browse/SPARK-24263 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-23206) Additional Memory Tuning Metrics

2018-05-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470777#comment-16470777 ] Felix Cheung edited comment on SPARK-23206 at 5/10/18 5:20 PM: --- yes, for us

<    2   3   4   5   6   7   8   9   10   11   >