[jira] [Commented] (SPARK-26910) Re-release SparkR to CRAN

2019-02-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771496#comment-16771496 ] Felix Cheung commented on SPARK-26910: -- 2.3.3 has been submitted to CRAN. we are currently waiting

[jira] [Commented] (SPARK-26910) Re-release SparkR to CRAN

2019-02-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771498#comment-16771498 ] Felix Cheung commented on SPARK-26910: -- once that works we should look into 2.4.1 > Re-rele

[jira] [Assigned] (SPARK-26910) Re-release SparkR to CRAN

2019-02-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-26910: Assignee: Felix Cheung > Re-release SparkR to C

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

2019-02-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771494#comment-16771494 ] Felix Cheung commented on SPARK-26858: -- If I understand, this is the case where Spark actually

Re: SparkR + binary type + how to get value

2019-02-17 Thread Felix Cheung
: Thijs Haarhuis Sent: Thursday, February 14, 2019 4:01 AM To: Felix Cheung; user@spark.apache.org Subject: Re: SparkR + binary type + how to get value Hi Felix, Sure.. I have the following code: printSchema(results) cat("\n\n\n") firstRow <- first(results

Re: [DISCUSS] Deprecate support for Spark 2.2.x and earlier version

2019-02-15 Thread Felix Cheung
+1 From: Jeff Zhang Sent: Thursday, February 14, 2019 10:28 PM To: users Subject: [DISCUSS] Deprecate support for Spark 2.2.x and earlier version Hi Folks, Spark 2.2.x will be EOL[1] from January of 2019. So I am considering to deprecate support for spark

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

2019-02-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767935#comment-16767935 ] Felix Cheung commented on SPARK-26855: -- possibly. sounds like there are more cases like

Re: SparkR + binary type + how to get value

2019-02-13 Thread Felix Cheung
Please share your code From: Thijs Haarhuis Sent: Wednesday, February 13, 2019 6:09 AM To: user@spark.apache.org Subject: SparkR + binary type + how to get value Hi all, Does anybody have any experience in accessing the data from a column which has a binary

Re: [VOTE] Accept Training into the Apache Incubator

2019-02-13 Thread Felix Cheung
+1 On Wed, Feb 13, 2019 at 7:23 AM Matt Sicker wrote: > +1 > > Would be interesting if this project includes training for developing > Apache projects in any way, or would that make more sense under ComDev > or some other project? > > On Wed, 13 Feb 2019 at 09:09, Dmitriy Pavlov wrote: > > > >

Re: Failing on deploying artifacts

2019-02-12 Thread Felix Cheung
Ah good. Is this documented as a step somewhere? (Just want to see if this needs to be clarified) From: Seunghyun Lee Sent: Tuesday, February 12, 2019 7:14 PM To: dev@pinot.apache.org Subject: Re: Failing on deploying artifacts This was because I haven't set

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

2019-02-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765759#comment-16765759 ] Felix Cheung commented on SPARK-26855: -- IMO we have two options: # document tests only pass after

Re: java.lang.IllegalArgumentException: Unsupported class file major version 55

2019-02-10 Thread Felix Cheung
And it might not work completely. Spark only officially supports JDK 8. I’m not sure if JDK 9 and + support is complete? From: Jungtaek Lim Sent: Thursday, February 7, 2019 5:22 AM To: Gabor Somogyi Cc: Hande, Ranjit Dilip (Ranjit); user@spark.apache.org

Re: Vectorized R gapply[Collect]() implementation

2019-02-10 Thread Felix Cheung
This is super awesome! From: Shivaram Venkataraman Sent: Saturday, February 9, 2019 8:33 AM To: Hyukjin Kwon Cc: dev; Felix Cheung; Bryan Cutler; Liang-Chi Hsieh; Shivaram Venkataraman Subject: Re: Vectorized R gapply[Collect]() implementation Those speedups

Re: Podlings not following ASF release policy

2019-02-10 Thread Felix Cheung
... so I think we need to provide an option here. No question that any unauthorized release is not allowed. But what about while voting for a release? It sounds like httpd has the same problem since some of these listed “releases” are failed vote attempts (and so not official releases) >From a

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-10 Thread Felix Cheung
Zhuge Sent: Saturday, February 9, 2019 6:25 PM To: Felix Cheung Cc: Takeshi Yamamuro; Spark dev list Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC2) Not me. I am running zulu8, maven, and hadoop-2.7. On Sat, Feb 9, 2019 at 5:42 PM Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: On

[jira] [Updated] (SPARK-26855) SparkSubmitSuite fails on a clean build

2019-02-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26855: - Description: SparkSubmitSuite "include an external JAR in SparkR" fails co

[jira] [Created] (SPARK-26855) SparkSubmitSuite fails on a clean build

2019-02-10 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-26855: Summary: SparkSubmitSuite fails on a clean build Key: SPARK-26855 URL: https://issues.apache.org/jira/browse/SPARK-26855 Project: Spark Issue Type: Bug

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-09 Thread Felix Cheung
-integration-tests` for the JDBC integration tests. I run these tests, and then I checked if they are passed. On Sat, Feb 9, 2019 at 5:26 PM Herman van Hovell mailto:her...@databricks.com>> wrote: I count 2 binding votes :)... Op vr 8 feb. 2019 om 22:36 schreef Felix Cheung mailto:feli

[jira] [Commented] (SPARK-26762) Arrow optimization for conversion from Spark DataFrame to R DataFrame

2019-02-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764092#comment-16764092 ] Felix Cheung commented on SPARK-26762: -- does this include head, take etc? > Arrow optimizat

[jira] [Comment Edited] (SPARK-26762) Arrow optimization for conversion from Spark DataFrame to R DataFrame

2019-02-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764092#comment-16764092 ] Felix Cheung edited comment on SPARK-26762 at 2/9/19 7:35 AM: -- does

Re: Podlings not following ASF release policy

2019-02-08 Thread Felix Cheung
I’d agree- it’s a “feature” of GitHub and I didn’t see a way to turn off “turning a git tag into a release” I see that there is a API to edit a release to say it is “pre-release” https://developer.github.com/v3/repos/releases/#edit-a-release IMO either way it should be ok because a) the tag is

Re: [DISCUSS] Change default executor log URLs for YARN

2019-02-08 Thread Felix Cheung
For this case I’d agree with Ryan. I haven’t followed this thread and the details of the change since it’s way too much for me to consume “in my free time” (which is 0 nowadays) but I’m pretty sure the existing behavior works for us and very likely we don’t want it to change because of some

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Felix Cheung
Nope, still only 1 binding vote ;) From: Mark Hamstra Sent: Friday, February 8, 2019 7:30 PM To: Marcelo Vanzin Cc: Takeshi Yamamuro; Spark dev list Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC2) There are 2. C'mon Marcelo, you can make it 3! On Fri, Feb

Re: [MENTORS] Unapproved releases

2019-02-08 Thread Felix Cheung
I think this happens automatically by GitHub when a git tag is pushed? From: kishore g Sent: Friday, February 8, 2019 3:34 PM To: dev@pinot.apache.org Subject: Re: [MENTORS] Unapproved releases Thanks Justin. I will take a look at it. Olivier, we might need

Re: Mentor sign-off due next Tuesday (February 12th)

2019-02-07 Thread Felix Cheung
Done as well. Also updated the note about committer. From: Olivier Lamy Sent: Wednesday, February 6, 2019 5:22 PM To: dev@pinot.apache.org Subject: Re: Mentor sign-off due next Tuesday (February 12th) done! On Thu, 7 Feb 2019 at 08:52, Seunghyun Lee wrote: >

ASF Release process

2019-02-06 Thread Felix Cheung
Sharing doc Chris has on the ASF release process http://plc4x.apache.org/developers/release.html Thanks Chris!

Re: Interest in release documentation?

2019-02-06 Thread Felix Cheung
Very cool. I am going to share this with another incubator project, I hope you don’t mind! From: Christofer Dutz Sent: Tuesday, February 5, 2019 5:02 AM To: dev@iotdb.apache.org Subject: Interest in release documentation? Hi all, I know this is early, but you

Re: Request for checking commits before creating a release candidate

2019-02-06 Thread Felix Cheung
For #1 LG generally. What happened to the whole chunk of Apache ones like Apache Commons Net? #2 LGTM On Tue, Feb 5, 2019 at 9:59 PM Seunghyun Lee wrote: > Hi Felix, > > Before we cut the release candidate, I have some remaining checks from you. > > 1. Can you double check on the update for

Re: Request to join iotdb mailing list

2019-02-04 Thread Felix Cheung
Please email dev-subscr...@iotdb.apache.org From: Jack Liu Sent: Monday, February 4, 2019 12:23 PM To: dev@iotdb.apache.org Subject: Request to join iotdb mailing list I Huaqing Liu, work in Microsoft and JinRui is my college, just start to play IoTDB. Hope to

Re: [DISCUSS] Upgrade built-in Hive to 2.3.4

2019-02-04 Thread Felix Cheung
Likely need a shim (which we should have anyway) because of namespace/import changes. I’m huge +1 on this. From: Hyukjin Kwon Sent: Monday, February 4, 2019 12:27 PM To: Xiao Li Cc: Sean Owen; Felix Cheung; Ryan Blue; Marcelo Vanzin; Yuming Wang; dev Subject

[jira] [Assigned] (SPARK-26603) Update minikube backend in K8s integration tests

2019-02-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-26603: Assignee: Stavros Kontopoulos > Update minikube backend in K8s integration te

[jira] [Resolved] (SPARK-26603) Update minikube backend in K8s integration tests

2019-02-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26603. -- Resolution: Fixed Fix Version/s: 3.0.0 > Update minikube backend in K8s integrat

Re: Can we blacklist the mails from GitBox for dev mailing list?

2019-02-02 Thread Felix Cheung
This hasn’t changed, I think. Seunghyun, you can open a JIRA on INFRA to request that. From: Seunghyun Lee Sent: Wednesday, January 30, 2019 10:25 PM To: Daniel Gruno Cc: us...@infra.apache.org; dev@pinot.apache.org Subject: Re: Can we blacklist the mails from

Re: [DISCUSS] Upgrade built-in Hive to 2.3.4

2019-02-01 Thread Felix Cheung
What’s the update and next step on this? We have real users getting blocked by this issue. From: Xiao Li Sent: Wednesday, January 16, 2019 9:37 AM To: Ryan Blue Cc: Marcelo Vanzin; Hyukjin Kwon; Sean Owen; Felix Cheung; Yuming Wang; dev Subject: Re: [DISCUSS

Re: incubator wiki - Please provide write access to incubator PMC report wiki for Pinot

2019-02-01 Thread Felix Cheung
Thanks Justin! On Thu, Jan 31, 2019 at 8:23 PM Justin Mclean wrote: > Hi, > > > Could someone please add user *sbeeram* > > Done. > > Thanks, > Justin > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >

incubator wiki - Please provide write access to incubator PMC report wiki for Pinot

2019-01-31 Thread Felix Cheung
Could someone please add user *sbeeram* On Thu, Jan 31, 2019 at 8:06 AM Felix Cheung wrote: > (A little strange as I didn’t see this thread before, so I’m trying to > send it) > > > On Thu, Jan 31, 2019 at 8:02 AM Sunitha Beeram > wrote: > >> +Felix >>

Re: [IP CLEARANCE] Apache Arrow Rust DataFusion

2019-01-31 Thread Felix Cheung
+1 (Checked IP clearance) On Thu, Jan 31, 2019 at 12:57 PM Wes McKinney wrote: > Apache Arrow is receiving a donation of "DataFusion" a Rust library > that computes analytical queries on Arrow columnar memory. It is > intended to work together with the Arrow Rust library [1]. > > Please vote

Re: Please provide write access to incubator PMC report wiki for Pinot

2019-01-31 Thread Felix Cheung
(A little strange as I didn’t see this thread before, so I’m trying to send it) On Thu, Jan 31, 2019 at 8:02 AM Sunitha Beeram wrote: > +Felix > > > > *From: *Sunitha Beeram > *Date: *Wednesday, January 30, 2019 at 2:37 PM > *To: *"general@incubator.apache.org" > *Cc:

Re: Unapproved releases

2019-01-30 Thread Felix Cheung
> *Sent:* Wednesday, January 30, 2019 9:55:50 AM > > *To:* dev@pinot.apache.org > *Cc:* kisho...@apache.org; Felix Cheung; Subbu Subramaniam > *Subject:* Re: Unapproved releases > > We will be deleting all old releases/tags using the "git push --delete > origin &qu

Re: Unapproved releases

2019-01-29 Thread Felix Cheung
t page. Would it be > possible to get an exception only for the latest one until we make our > first release (expected end of this quarter)? > > Yes, we do plan to go to branch-based releases, much easier to manage > without stopping checkin to the trunk. > > -Subbu >

Re: Unapproved releases

2019-01-29 Thread Felix Cheung
Hi Subbu How are these releases made and what are they useful for? Generally, it’s not good to have unofficial unvoted releases, and having these visible links on GitHub can be confusing. To me the biggest concern is github doesn’t give you a way to note these are unofficial and unsupported

Re: Missing SparkR in CRAN

2019-01-24 Thread Felix Cheung
Yes it was discussed on dev@. We are waiting for 2.3.3 to release to resubmit. On Thu, Jan 24, 2019 at 5:33 AM Hyukjin Kwon wrote: > Hi all, > > I happened to find SparkR is missing in CRAN. See > https://cran.r-project.org/web/packages/SparkR/index.html > > I remember I saw some threads about

Re: Requesting a review for updating license & notice information

2019-01-23 Thread Felix Cheung
Actually I’m going to retract the whole thing I said. Seems like it should carry it under license for: https://github.com/apache/spark/commit/bf4199e261c3c8dd2970e2a154c97b46fb339f02 From: Felix Cheung Sent: Wednesday, January 23, 2019 9:20 PM To: dev

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

2019-01-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750751#comment-16750751 ] Felix Cheung commented on SPARK-24615: -- We are interested to know as well.   [~mengxr] touched

Re: Requesting a review for updating license & notice information

2019-01-23 Thread Felix Cheung
related libaries. > > Best, > Seunghyun > > On Fri, Jan 18, 2019 at 9:53 PM Felix Cheung > wrote: > > > Thanks for doing that and sending this note. > > > > I will help check today. > > > > > > > > >

Re: I have trained a ML model, now what?

2019-01-23 Thread Felix Cheung
Please comment in the JIRA/SPIP if you are interested! We can see the community support for a proposal like this. From: Pola Yao Sent: Wednesday, January 23, 2019 8:01 AM To: Riccardo Ferrari Cc: Felix Cheung; User Subject: Re: I have trained a ML model, now

[jira] [Commented] (SPARK-26679) Deconflict spark.executor.pyspark.memory and spark.python.worker.memory

2019-01-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750696#comment-16750696 ] Felix Cheung commented on SPARK-26679: -- I find the fraction configs very confusing

Re: [VOTE] Release Apache Zeppelin 0.8.1 (RC1)

2019-01-22 Thread Felix Cheung
Thanks Jeff. I just tried to reach the rc1 tarball and realized its gone ;) From: Jeff Zhang Sent: Tuesday, January 22, 2019 6:17 PM To: users; dev Subject: Re: [VOTE] Release Apache Zeppelin 0.8.1 (RC1) The vote is passed with 10 +1 ( 4 binding +1), Thanks

Re: I have trained a ML model, now what?

2019-01-22 Thread Felix Cheung
About deployment/serving SPIP https://issues.apache.org/jira/browse/SPARK-26247 From: Riccardo Ferrari Sent: Tuesday, January 22, 2019 8:07 AM To: User Subject: I have trained a ML model, now what? Hi list! I am writing here to here about your experience on

Re: Make proactive check for closure serializability optional?

2019-01-21 Thread Felix Cheung
Agreed on the pros / cons, esp driver could be the data science notebook. Is it worthwhile making it configurable? From: Sean Owen Sent: Monday, January 21, 2019 10:42 AM To: Reynold Xin Cc: dev Subject: Re: Make proactive check for closure serializability

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-20 Thread Felix Cheung
+1 My focus is on R (sorry couldn’t cross validate what’s Sean is seeing) tested: reviewed doc R package test win-builder, r-hub Tarball/package signature From: Takeshi Yamamuro Sent: Thursday, January 17, 2019 6:49 PM To: Spark dev list Subject: [VOTE]

Re: [DISCUSS] Identifiers with multi-catalog support

2019-01-20 Thread Felix Cheung
+1 I like Ryan last mail. Thank you for putting it clearly (should be a spec/SPIP!) I agree and understand the need for 3 part id. However I don’t think we should make assumption that it must be or can only be as long as 3 parts. Once the catalog is identified (ie. The first part), the catalog

[jira] [Assigned] (SPARK-26642) Add --num-executors option to spark-submit for Spark on K8S

2019-01-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-26642: Assignee: Luca Canali > Add --num-executors option to spark-submit for Spark on

[jira] [Resolved] (SPARK-26642) Add --num-executors option to spark-submit for Spark on K8S

2019-01-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26642. -- Resolution: Fixed Fix Version/s: 3.0.0 > Add --num-executors option to spark-sub

Re: Persist Dataframe to HDFS considering HDFS Block Size.

2019-01-19 Thread Felix Cheung
You can call coalesce to combine partitions.. From: Shivam Sharma <28shivamsha...@gmail.com> Sent: Saturday, January 19, 2019 7:43 AM To: user@spark.apache.org Subject: Persist Dataframe to HDFS considering HDFS Block Size. Hi All, I wanted to persist dataframe

Re: Spark on Yarn, is it possible to manually blacklist nodes before running spark job?

2019-01-19 Thread Felix Cheung
From: Li Gao Sent: Saturday, January 19, 2019 8:43 AM To: Felix Cheung Cc: Serega Sheypak; user Subject: Re: Spark on Yarn, is it possible to manually blacklist nodes before running spark job? on yarn it is impossible afaik. on kubernetes you can use taints

Re: Requesting a review for updating license & notice information

2019-01-18 Thread Felix Cheung
Thanks for doing that and sending this note. I will help check today. From: Seunghyun Lee Sent: Friday, January 18, 2019 3:42 PM To: dev@pinot.apache.org Subject: Requesting a review for updating license & notice information Hi Mentors, I have recently

Re: Original Marvin-AI Website Redirection

2019-01-18 Thread Felix Cheung
https://www.marvin-ai.org/ Does not load for me... From: Daniel Takabayashi Sent: Friday, January 18, 2019 6:29 PM To: dev@marvin.apache.org Subject: Re: Original Marvin-AI Website Redirection Problem solved, cold you check if is working? thanks, Taka Em

Re: Spark on Yarn, is it possible to manually blacklist nodes before running spark job?

2019-01-18 Thread Felix Cheung
Not as far as I recall... From: Serega Sheypak Sent: Friday, January 18, 2019 3:21 PM To: user Subject: Spark on Yarn, is it possible to manually blacklist nodes before running spark job? Hi, is there any possibility to tell Scheduler to blacklist specific

Re: [Discuss] 0.8.1 Release

2019-01-15 Thread Felix Cheung
+1 thanks! From: Jeff Zhang Sent: Tuesday, January 15, 2019 5:39 PM To: users Subject: Re: [Discuss] 0.8.1 Release Hi Folks, I will start the 0.8.1 release since there's no concerns on this. Jeff Zhang mailto:zjf...@gmail.com>> 于2019年1月14日周一 下午8:50写道: Hi

Re: [DISCUSS] Upgrade built-in Hive to 2.3.4

2019-01-15 Thread Felix Cheung
of it) from the spark core project.. From: Xiao Li Sent: Tuesday, January 15, 2019 10:03 AM To: Felix Cheung Cc: rb...@netflix.com; Yuming Wang; dev Subject: Re: [DISCUSS] Upgrade built-in Hive to 2.3.4 Let me take my words back. To read/write a table, Spark users do

Re: [DISCUSS] Upgrade built-in Hive to 2.3.4

2019-01-15 Thread Felix Cheung
And we are super 100% dependent on Hive... From: Ryan Blue Sent: Tuesday, January 15, 2019 9:53 AM To: Xiao Li Cc: Yuming Wang; dev Subject: Re: [DISCUSS] Upgrade built-in Hive to 2.3.4 How do we know that most Spark users are not using Hive? I wouldn't be

Re: [DISCUSS] Upgrade built-in Hive to 2.3.4

2019-01-15 Thread Felix Cheung
Resolving https://issues.apache.org/jira/browse/HIVE-16391 means to keep Spark on Hive 1.2? I’m not sure that is reducing dependency on Hive - Hive is still there and it’s a very old Hive. IMO it is increasing the risk the longer we keep on this. (And it’s been years) Looking at the two PR.

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742845#comment-16742845 ] Felix Cheung commented on SPARK-26565: -- ok AFAIK the first `cannot stat` is from this line

Re: [VOTE] Accept Hudi into the Apache Incubator

2019-01-14 Thread Felix Cheung
+1 On Mon, Jan 14, 2019 at 3:20 AM Suneel Marthi wrote: > +1 > > Sent from my iPhone > > > On Jan 13, 2019, at 5:34 PM, Thomas Weise wrote: > > > > Hi all, > > > > Following the discussion of the Hudi proposal in [1], this is a vote > > on accepting Hudi into the Apache Incubator, > > per the

Re: Clean out https://dist.apache.org/repos/dist/dev/spark/ ?

2019-01-13 Thread Felix Cheung
13, 2019 5:45 AM To: Felix Cheung Cc: Dongjoon Hyun; dev Subject: Re: Clean out https://dist.apache.org/repos/dist/dev/spark/ ? Will do. Er, maybe add Shane here too -- should we disable this docs job? are these docs used, and is there much value in nightly snapshots of the whole site? On Sat, Jan

[jira] [Updated] (SPARK-26120) Fix a streaming query leak in Structured Streaming R tests

2019-01-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26120: - Fix Version/s: 2.3.3 > Fix a streaming query leak in Structured Streaming R te

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741453#comment-16741453 ] Felix Cheung commented on SPARK-26565: -- Yeah, my point wasn’t to allow access to unsigned release

Re: Clean out https://dist.apache.org/repos/dist/dev/spark/ ?

2019-01-12 Thread Felix Cheung
These get “published” by doc nightly build from riselab Jenkins... From: Dongjoon Hyun Sent: Saturday, January 12, 2019 4:32 PM To: Sean Owen Cc: dev Subject: Re: Clean out https://dist.apache.org/repos/dist/dev/spark/ ? +1 for removing old docs there. It seems

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

2019-01-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Fix Version/s: 2.3.3 > SparkR tests failed on CRAN on Java

[jira] [Updated] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

2019-01-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26010: - Fix Version/s: 2.3.3 > SparkR vignette fails on CRAN on Java

Re: spark2.4 arrow enabled true,error log not returned

2019-01-12 Thread Felix Cheung
Do you mean you run the same code on yarn and standalone? Can you check if they are running the same python versions? From: Bryan Cutler Sent: Thursday, January 10, 2019 5:29 PM To: libinsong1...@gmail.com Cc: zlist Spark Subject: Re: spark2.4 arrow enabled

Re: [NOTICE] Mandatory migration of git repositories to gitbox.apache.org

2019-01-06 Thread Felix Cheung
in the past. On Sun, Jan 6, 2019 at 8:09 PM Felix Cheung wrote: > > Hi there - any more vote/comment? > > > > From: Luciano Resende > Sent: Friday, January 4, 2019 5:44 AM > To: dev@crail.apache.org > Subject: Re: [NOTICE] Mandatory mi

Re: Spark Packaging Jenkins

2019-01-06 Thread Felix Cheung
Awesome Shane! From: shane knapp Sent: Sunday, January 6, 2019 11:38 AM To: Felix Cheung Cc: Dongjoon Hyun; Wenchen Fan; dev Subject: Re: Spark Packaging Jenkins noted. i like the idea of building (but not signing) the release and will update the job(s

Re: Spark Packaging Jenkins

2019-01-06 Thread Felix Cheung
https://spark.apache.org/release-process.html Look for do-release-docker.sh script From: Felix Cheung Sent: Sunday, January 6, 2019 11:17 AM To: Dongjoon Hyun; Wenchen Fan Cc: dev; shane knapp Subject: Re: Spark Packaging Jenkins The release process doc should

Re: Spark Packaging Jenkins

2019-01-06 Thread Felix Cheung
The release process doc should have been updated on this - as mentioned we do not use Jenkins for release signing (take this offline if further discussion is needed) The release build on Jenkins can still be useful for pre-validating the release build process (without actually signing it)

Re: Apache Spark 2.2.3 ?

2019-01-02 Thread Felix Cheung
+1 on 2.2.3 of course From: Dongjoon Hyun Sent: Wednesday, January 2, 2019 12:21 PM To: Saisai Shao Cc: Xiao Li; Felix Cheung; Sean Owen; dev Subject: Re: Apache Spark 2.2.3 ? Thank you for swift feedbacks and Happy New Year. :) For 2.2.3 release on next week

Re: Apache Spark 2.2.3 ?

2019-01-01 Thread Felix Cheung
Speaking of, it’s been 3 months since 2.3.2... (Sept 2018) And 2 months since 2.4.0 (Nov 2018) - does the community feel 2.4 branch is stabilizing? From: Sean Owen Sent: Tuesday, January 1, 2019 8:30 PM To: Dongjoon Hyun Cc: dev Subject: Re: Apache Spark 2.2.3

Re: Podling Report Reminder - January 2019

2018-12-28 Thread Felix Cheung
@pinot.apache.org Subject: Re: Podling Report Reminder - January 2019 Thanks Felix. I have updated the podling page. Please take a look and let me know if there is anything else needed. -Subbu From: Felix Cheung Sent: Thursday, December 27, 2018 12:12 PM To: dev

Pinot website and DOAP

2018-12-28 Thread Felix Cheung
Hello, I’ve opened a PR to update some trademark references on the website https://github.com/apache/incubator-pinot-site/pull/4 Also open JIRA on link back https://issues.apache.org/jira/browse/PINOT-2 And JIRA on DOAP https://issues.apache.org/jira/browse/PINOT-3 Regards

Re: Podling Report Reminder - January 2019

2018-12-27 Thread Felix Cheung
Another reminder since we are less than one week away from the deadline. From: Felix Cheung Sent: Friday, December 21, 2018 8:07 PM To: dev@pinot.apache.org; g.kish...@gmail.com Subject: Re: Podling Report Reminder - January 2019 Hi - quick reminder please see

Re: Podling Report Reminder - January 2019

2018-12-21 Thread Felix Cheung
Hi - quick reminder please see below. Report is due Wed January 02 -- Podling reports due by end of day Best to kick off discussions soon. Happy holidays! From: jmcl...@apache.org Sent: Friday, December 21, 2018 4:47 PM To: d...@pinot.incubator.apache.org

Re: Requested gitbox migration

2018-12-19 Thread Felix Cheung
Thanks! From: Jongyoul Lee Sent: Wednesday, December 19, 2018 6:09:50 PM To: dev Subject: Requested gitbox migration Please check the link below: https://issues.apache.org/jira/browse/INFRA-17477 JL -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: [DISCUSS] Make interpreters' repository

2018-12-14 Thread Felix Cheung
c 14, 2018 at 12:03 PM Jeff Zhang wrote: > >> Agree with Felix, this is what I also concern in my last email. @Jongyoul >> Lee Could you explain more about how separate repo >> help here ? Thanks >> >> >> Felix Cheung 于2018年12月14日周五 上午11:00写道: >

Re: [DISCUSS] Fwd: [NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

2018-12-14 Thread Felix Cheung
relocation of Apache git repositories on git-wip-us.apache.org +1 for earlier. On Tue, 11 Dec 2018 at 22:46, Felix Cheung wrote: > Yes that’s all it takes to migrate. > > (And committers to setup gitbox link) > > Any more thoughts from the community? > > > ___

Re: [DISCUSS] Moving to gitbox

2018-12-14 Thread Felix Cheung
it. On Fri, Dec 14, 2018 at 12:14 PM Felix Cheung wrote: > Hi Jongyoul - is this the same as the earlier thread? > > > > From: Jongyoul Lee > Sent: Tuesday, December 11, 2018 6:28 PM > To: dev > Subject: [DISCUSS] Moving to gitbox > >

Re: [DISCUSS] Moving to gitbox

2018-12-13 Thread Felix Cheung
Hi Jongyoul - is this the same as the earlier thread? From: Jongyoul Lee Sent: Tuesday, December 11, 2018 6:28 PM To: dev Subject: [DISCUSS] Moving to gitbox Hi, devs, I'd like to make a consensus to move our repository from git-wip to gitbox. Please give

Re: [DISCUSS] Make interpreters' repository

2018-12-13 Thread Felix Cheung
In my opinion, definitely a clean interface will be very useful and having a better way to test is good. But sounds to me like these should be possible without a code repo separation? The downside of separate repo (I assume still under ASF) is the spreading the attention of committers and

Re: [DISCUSS] Fwd: [NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

2018-12-11 Thread Felix Cheung
ve any special reason not to move there. > > > > +1 for earlier > > > > On Mon, Dec 10, 2018 at 3:56 AM Felix Cheung > > wrote: > > > > > Hi community, > > > > > > The move to gitbox is coming. This does not affect Contributors - > m

Re: [DISCUSS] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

2018-12-10 Thread Felix Cheung
+1 On Mon, Dec 10, 2018 at 12:56 PM Roy Lenferink wrote: > Hi all, > > The Apache Incubator is still having a repository on git-wip-us as well > [1]. > > Does anyone have a problem with moving over the incubator repository to > gitbox voluntarily? > This means integrated access and easy PRs

Re: Questions about building the website of IoTDB Project

2018-12-09 Thread Felix Cheung
Looks good! Thanks for the mock ups. On your homepage, references to Hadoop and Spark should be Apache Hadoop and Apache Spark, because of trademarks - and it might be good to link to their project pages. From: Stefanie Zhao Sent: Friday, December 7, 2018

Re: Incubator Podling Report (Due 5th December)

2018-12-05 Thread Felix Cheung
& PPMC - ? contributor growth If dev@ is ok with this summary I can also write this into the wiki page as the project report. From: Felix Cheung Sent: Monday, December 3, 2018 9:58 AM To: dev@pinot.apache.org; kishore g; dev@pinot.apache.org; jmcl...@apache

Re: draft podling report

2018-12-05 Thread Felix Cheung
Great! I’ve added myself preemptively to the wiki and signed off the Crail report. Could one you please add me on whimsy, if it makes sense, as mentor. Thanks From: Luciano Resende Sent: Tuesday, December 4, 2018 2:01 PM To: dev@crail.apache.org Subject: Re:

Incubator Wiki write access

2018-12-04 Thread Felix Cheung
It might have lost my earlier account. My username is FelixCheung Thanks

Re: [VOTE] Apache Crail 1.1-incubating (rc8)

2018-12-03 Thread Felix Cheung
at 12:29 AM Jonas Pfefferle wrote: > Hi Felix > > > On Fri, 30 Nov 2018 15:43:45 -0800 > Felix Cheung wrote: > > +1 (binding) > > > > a few comments below, checked: > > filename > > signature & hash > > DISCLAIMER, LICENSE, NOTICE > >

Re: Incubator Podling Report (Due 5th December)

2018-12-03 Thread Felix Cheung
Process info here https://incubator.apache.org/guides/ppmc.html#podling_status_reports It’s a wiki page https://wiki.apache.org/incubator/December2018 From: Subbu Subramaniam Sent: Monday, December 3, 2018 9:39 AM To: kishore g; dev@pinot.apache.org;

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

2018-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Description: This ticket tracks an SPIP to improve model load time and model serving

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

2018-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Target Version/s: 3.0.0 (was: 2.1.0) > SPIP - ML Model Extension for no-Spark MLLib Onl

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

2018-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Fix Version/s: (was: 2.1.0) > SPIP - ML Model Extension for no-Spark MLLib Online Serv

Podling website

2018-12-02 Thread Felix Cheung
Hi, Want to see if there is any effort on building the incubator website. I’ve checked github issue and mail archives.

<    1   2   3   4   5   6   7   8   9   10   >