Re: Podling reports due Wednesday

2019-06-10 Thread Felix Cheung
I don’t mind taking on as a mentor for Spot but it seems the volume of interaction (commits, dev@) has gone down significantly in the last 6-9 months? On Mon, Jun 10, 2019 at 3:21 PM Justin Mclean wrote: > Hi, > > Currently we’re missing only one sign off and that is for: > Spot > > Which, I

Re: Spark SQL in R?

2019-06-08 Thread Felix Cheung
I don’t think you should get a hive-xml from the internet. It should have connection information about a running hive metastore - if you don’t have a hive metastore service as you are running locally (from a laptop?) then you don’t really need it. You can get spark to work with it’s own.

Re: sparksql in sparkR?

2019-06-07 Thread Felix Cheung
This seem to be more a question of spark-sql shell? I may suggest you change the email title to get more attention. From: ya Sent: Wednesday, June 5, 2019 11:48:17 PM To: user@spark.apache.org Subject: sparksql in sparkR? Dear list, I am trying to use sparksql

Re: Missing podling logos

2019-06-05 Thread Felix Cheung
; On Mon, Jun 3, 2019 at 11:04 PM Felix Cheung > wrote: > >> http://www.apache.org/logos/ >> >> >> From: Subbu Subramaniam >> Sent: Monday, June 3, 2019 9:00 AM >> To: dev@pinot.apache.org >> Subject: Re: Missing po

Re: Missing podling logos

2019-06-04 Thread Felix Cheung
://pinot.incubator.apache.org/ thanks -Subbu From: Felix Cheung Sent: Sunday, June 2, 2019 11:51 AM To: dev@pinot.apache.org Subject: Fwd: Missing podling logos Quick reminder... -- Forwarded message - From: Justin Mclean Date: Sat, Jun 1, 2019 at 7:37 PM

Fwd: Missing podling logos

2019-06-02 Thread Felix Cheung
Quick reminder... -- Forwarded message - From: Justin Mclean Date: Sat, Jun 1, 2019 at 7:37 PM Subject: Re: Missing podling logos To: Hi, It’s good to see some podling have added their logos, but we’re still missing a few. Missing logo are: amaterasu annotator batchee brpc

Re: podling report June

2019-06-01 Thread Felix Cheung
About me - yes, it was discussed on list and I wasn’t able to change the roster myself at the time. From: Justin Mclean Sent: Thursday, May 30, 2019 8:00 PM To: dev@crail.apache.org Subject: Re: podling report June Hi, Thanks for submitting the report early

Re: Should python-2 be supported in Spark 3.0?

2019-05-31 Thread Felix Cheung
. From: shane knapp Sent: Friday, May 31, 2019 7:38:10 PM To: Denny Lee Cc: Holden Karau; Bryan Cutler; Erik Erlandson; Felix Cheung; Mark Hamstra; Matei Zaharia; Reynold Xin; Sean Owen; Wenchen Fen; Xiangrui Meng; dev; user Subject: Re: Should python-2 be supported in Spark 3.0? +1000

Re: Should python-2 be supported in Spark 3.0?

2019-05-31 Thread Felix Cheung
. From: shane knapp Sent: Friday, May 31, 2019 7:38:10 PM To: Denny Lee Cc: Holden Karau; Bryan Cutler; Erik Erlandson; Felix Cheung; Mark Hamstra; Matei Zaharia; Reynold Xin; Sean Owen; Wenchen Fen; Xiangrui Meng; dev; user Subject: Re: Should python-2 be supported in Spark 3.0? +1000

Re: Zeppelin log files in windows

2019-05-31 Thread Felix Cheung
Thanks for the report! Other projects have testing setup on the like of AppVeyor. We would greatly appreciate any contribution in this area to fix the issue and enable continuous testing coverage! From: Jeff Zhang Sent: Tuesday, May 28, 2019 6:26:43 AM To:

Re: Should python-2 be supported in Spark 3.0?

2019-05-30 Thread Felix Cheung
We don’t usually reference a future release on website > Spark website and state that Python 2 is deprecated in Spark 3.0 I suspect people will then ask when is Spark 3.0 coming out then. Might need to provide some clarity on that. From: Reynold Xin Sent:

Re: Should python-2 be supported in Spark 3.0?

2019-05-30 Thread Felix Cheung
We don’t usually reference a future release on website > Spark website and state that Python 2 is deprecated in Spark 3.0 I suspect people will then ask when is Spark 3.0 coming out then. Might need to provide some clarity on that. From: Reynold Xin Sent:

Re: [VOTE][SPARK-27396] SPIP: Public APIs for extended Columnar Processing Support

2019-05-27 Thread Felix Cheung
+1 I’d prefer to see more of the end goal and how that could be achieved (such as ETL or SPARK-24579). However given the rounds and months of discussions we have come down to just the public API. If the community thinks a new set of public API is maintainable, I don’t see any problem with

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2019-05-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838188#comment-16838188 ] Felix Cheung commented on SPARK-21367: -- great thx! > R older version of Roxygen2 on Jenk

[jira] [Commented] (SPARK-27684) Reduce ScalaUDF conversion overheads for primitives

2019-05-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838187#comment-16838187 ] Felix Cheung commented on SPARK-27684: -- definitely could be interesting.. > Reduce Scala

Fwd: Missing podling logos

2019-05-12 Thread Felix Cheung
Please add the project logo! -- Forwarded message - From: Justin Mclean Date: Sat, May 11, 2019 at 9:47 PM Subject: Re: Missing podling logos To: CC: Hi, My second list for the logos [1] had a few errors as it assumed .svg files existed for all projects. Try this one

Re: Static partitioning in partitionBy()

2019-05-07 Thread Felix Cheung
You could df.filter(col(“c”) = “c1”).write().partitionBy(“c”).save It could get some data skew problem but might work for you From: Burak Yavuz Sent: Tuesday, May 7, 2019 9:35:10 AM To: Shubham Chaurasia Cc: dev; u...@spark.apache.org Subject: Re: Static

Re: Static partitioning in partitionBy()

2019-05-07 Thread Felix Cheung
You could df.filter(col(“c”) = “c1”).write().partitionBy(“c”).save It could get some data skew problem but might work for you From: Burak Yavuz Sent: Tuesday, May 7, 2019 9:35:10 AM To: Shubham Chaurasia Cc: dev; user@spark.apache.org Subject: Re: Static

Re: [VOTE] Release Apache Spark 2.4.3

2019-05-05 Thread Felix Cheung
I ran basic tests on R, r-hub etc. LGTM. +1 (limited - I didn’t get to run other usual tests) From: Sean Owen Sent: Wednesday, May 1, 2019 2:21 PM To: Xiao Li Cc: dev@spark.apache.org Subject: Re: [VOTE] Release Apache Spark 2.4.3 +1 from me. There is little

Re: [VOTE] Release Apache Spark 2.4.2

2019-05-01 Thread Felix Cheung
Just my 2c If there is a known security issue, we should fix it rather waiting for if it actually could be might be affecting Spark to be found by a black hat, or worse. I don’t think any of us want to see Spark in the news for this reason. From: Sean Owen

Re: [VOTE] Release Apache Spark 2.4.2

2019-04-21 Thread Felix Cheung
+1 R tests, package tests on r-hub. Manually check commits under R, doc etc From: Sean Owen Sent: Saturday, April 20, 2019 11:27 AM To: Wenchen Fan Cc: Spark dev list Subject: Re: [VOTE] Release Apache Spark 2.4.2 +1 from me too. It seems like there is

Re: Spark 2.4.2

2019-04-18 Thread Felix Cheung
Re shading - same argument I’ve made earlier today in a PR... (Context- in many cases Spark has light or indirect dependencies but bringing them into the process breaks users code easily) From: Michael Heuer Sent: Thursday, April 18, 2019 6:41 AM To: Reynold

Re: ApacheCon NA 2019 Call For Proposal and help promoting Spark project

2019-04-14 Thread Felix Cheung
And a plug for the Graph Processing track - A discussion of comparison talk between the various Spark options (GraphX, GraphFrames, CAPS), or the ongoing work with SPARK-25994 Property Graphs, Cypher Queries, and Algorithms Would be great! From: Felix Cheung

Re: Dataset schema incompatibility bug when reading column partitioned data

2019-04-13 Thread Felix Cheung
I kinda agree it is confusing when a parameter is not used... From: Ryan Blue Sent: Thursday, April 11, 2019 11:07:25 AM To: Bruce Robbins Cc: Dávid Szakállas; Spark Dev List Subject: Re: Dataset schema incompatibility bug when reading column partitioned data

ApacheCon NA 2019 Call For Proposal and help promoting Spark project

2019-04-13 Thread Felix Cheung
Hi Spark community! As you know ApacheCon NA 2019 is coming this Sept and it’s CFP is now open! This is an important milestone as we celebrate 20 years of ASF. We have tracks like Big Data and Machine Learning among many others. Please submit your talks/thoughts/challenges/learnings here:

ApacheCon NA 2019 Call For Proposal and help promoting Spark project

2019-04-13 Thread Felix Cheung
Hi Spark community! As you know ApacheCon NA 2019 is coming this Sept and it’s CFP is now open! This is an important milestone as we celebrate 20 years of ASF. We have tracks like Big Data and Machine Learning among many others. Please submit your talks/thoughts/challenges/learnings here:

[jira] [Updated] (SPARK-21805) disable R vignettes code on Windows

2019-04-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21805: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > disable R vignettes c

[jira] [Updated] (SPARK-22344) Prevent R CMD check from using /tmp

2019-04-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22344: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > Prevent R CMD check from us

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR on Windows

2019-04-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > Fix java version pars

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

2019-04-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > SparkR tests failed on C

[jira] [Updated] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

2019-04-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26010: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > SparkR vignette fails on C

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2019-04-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811654#comment-16811654 ] Felix Cheung commented on SPARK-15799: -- more fixed for this (did not open JIRA) [https

[jira] [Resolved] (SPARK-26910) Re-release SparkR to CRAN

2019-04-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26910. -- Resolution: Fixed Fix Version/s: 2.4.1 2.4.1. released [https://cran.r-project.org/web

[jira] [Commented] (SPARK-27389) pyspark test failures w/ "UnknownTimeZoneError: 'US/Pacific-New'"

2019-04-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811461#comment-16811461 ] Felix Cheung commented on SPARK-27389: -- maybe a new JDK changes TimeZone? > pyspark test failu

[jira] [Closed] (LIVY-584) python build needs configparser

2019-04-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung closed LIVY-584. - Resolution: Duplicate > python build needs configpar

[jira] [Created] (LIVY-584) python build needs configparser

2019-04-03 Thread Felix Cheung (JIRA)
Felix Cheung created LIVY-584: - Summary: python build needs configparser Key: LIVY-584 URL: https://issues.apache.org/jira/browse/LIVY-584 Project: Livy Issue Type: Bug Affects Versions

[jira] [Created] (LIVY-583) python build needs configparser

2019-04-03 Thread Felix Cheung (JIRA)
Felix Cheung created LIVY-583: - Summary: python build needs configparser Key: LIVY-583 URL: https://issues.apache.org/jira/browse/LIVY-583 Project: Livy Issue Type: Bug Affects Versions

[jira] [Created] (LIVY-582) python test_create_new_session_without_default_config test fails consistently

2019-04-03 Thread Felix Cheung (JIRA)
Felix Cheung created LIVY-582: - Summary: python test_create_new_session_without_default_config test fails consistently Key: LIVY-582 URL: https://issues.apache.org/jira/browse/LIVY-582 Project: Livy

[jira] [Commented] (LIVY-580) Python 3 fails unicode test written for Python 2

2019-04-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808998#comment-16808998 ] Felix Cheung commented on LIVY-580: --- thx > Python 3 fails unicode test written for Pytho

Re: IoTDB supports distributed version

2019-03-31 Thread Felix Cheung
! Julian Am 31.03.19, 20:25 schrieb "Felix Cheung" : I, on the other hand, would be very interested in the strong consistency option. (Very cool discussion!) From: Julian Feinauer Sent: Thursday, March 28, 2019 1:10 AM To: dev@iotdb.apache.org S

Re: Submitting code

2019-03-31 Thread Felix Cheung
suggested. Fork the repo, then share access. Open PR to merge bigger complete chunk when ready. This has been done many times in other projects. From: Xun Liu Sent: Sunday, March 31, 2019 8:12 AM To: Jongyoul Lee Cc: Felix Cheung; H GHOSH; Jeff Zhang; Morkovkin, Basil

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-29 Thread Felix Cheung
/server/ui/static/css/bootstrap.min.css On Thu, Mar 28, 2019 at 4:05 PM Marcelo Vanzin wrote: > On Thu, Mar 28, 2019 at 3:57 PM Felix Cheung > wrote: > > > I have LANG=“en_US.UTF-8” > > I tried a couple of things finally it passed when I use virtualenv - my > > python is Py

Re: Upgrading minimal PyArrow version to 0.12.x [SPARK-27276]

2019-03-29 Thread Felix Cheung
To: Bryan Cutler Cc: Felix Cheung; Hyukjin Kwon; dev Subject: Re: Upgrading minimal PyArrow version to 0.12.x [SPARK-27276] i'm not opposed to 3.6 at all. On Fri, Mar 29, 2019 at 4:16 PM Bryan Cutler mailto:cutl...@gmail.com>> wrote: PyArrow dropping Python 3.4 was mainly due to support goin

Re: [k8s][jenkins] spark dev tool docs now have k8s+minikube instructions!

2019-03-29 Thread Felix Cheung
Definitely the part on the PR. Thanks! From: shane knapp Sent: Thursday, March 28, 2019 11:19 AM To: dev; Stavros Kontopoulos Subject: [k8s][jenkins] spark dev tool docs now have k8s+minikube instructions! https://spark.apache.org/developer-tools.html search

Re: [VOTE] Release Apache Spark 2.4.1 (RC9)

2019-03-29 Thread Felix Cheung
+1 build source R tests R package CRAN check locally, r-hub From: d_t...@apple.com on behalf of DB Tsai Sent: Wednesday, March 27, 2019 11:31 AM To: dev Subject: [VOTE] Release Apache Spark 2.4.1 (RC9) Please vote on releasing the following candidate as Apache

Re: [VOTE] Release Apache Spark 2.4.1 (RC9)

2019-03-29 Thread Felix Cheung
(I think the .invalid is added by the list server) Personally I’d rather everyone just +1 or -1, and shouldn’t add binding or not. It’s really the responsibility of the RM to confirm if a vote is binding. Mistakes have been made otherwise. From: Marcelo Vanzin

Re: Upgrading minimal PyArrow version to 0.12.x [SPARK-27276]

2019-03-28 Thread Felix Cheung
3.4 is end of life but 3.5 is not. From your link we expect to release Python 3.5.8 around September 2019. From: shane knapp Sent: Thursday, March 28, 2019 7:54 PM To: Hyukjin Kwon Cc: Bryan Cutler; dev; Felix Cheung Subject: Re: Upgrading minimal PyArrow

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-28 Thread Felix Cheung
t be the > > problem. > > > It may be the test is expecting the output of child processes (in this > > case > > > the python interpreter) to be UTF-8. > > > > > > > > If that is the case, then the test case ought to be fixed... > > &g

Re: spark.submit.deployMode: cluster

2019-03-28 Thread Felix Cheung
If anyone wants to improve docs please create a PR. lol But seriously you might want to explore other projects that manage job submission on top of spark instead of rolling your own with spark-submit. From: Pat Ferrel Sent: Tuesday, March 26, 2019 2:38 PM

Re: Upgrading minimal PyArrow version to 0.12.x [SPARK-27276]

2019-03-28 Thread Felix Cheung
Shane is also correct in that newer versions of pyarrow have stopped support for Python 3.4, so we should probably have Jenkins test against 2.7 and 3.5. On Mon, Mar 25, 2019 at 9:44 PM Reynold Xin mailto:r...@databricks.com>> wrote: +1 on doing this in 3.0. On Mon, Mar 25, 2019 at 9:31 PM,

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-28 Thread Felix Cheung
I see, thanks. Perhaps the way I unzip the src zip file then. Is it a better approach to unpack it? On Thu, Mar 28, 2019 at 2:03 AM sebb wrote: > On Thu, 28 Mar 2019 at 05:25, Felix Cheung wrote: > > > This test is consistently failing when I build, any idea what’s wrong in &g

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-27 Thread Felix Cheung
This test is consistently failing when I build, any idea what’s wrong in my setup? - should print unicode correctly *** FAILED *** (101 milliseconds) ExecuteSuccess(JObject(List((text/plain,JString(☺) did not equal ExecuteSuccess(JObject(List((text/plain,JString(☺)

Re: Upgrading minimal PyArrow version to 0.12.x [SPARK-27276]

2019-03-25 Thread Felix Cheung
I’m +1 if 3.0 From: Sean Owen Sent: Monday, March 25, 2019 6:48 PM To: Hyukjin Kwon Cc: dev; Bryan Cutler; Takuya UESHIN; shane knapp Subject: Re: Upgrading minimal PyArrow version to 0.12.x [SPARK-27276] I don't know a lot about Arrow here, but seems

Re: Edit access to apache wiki

2019-03-24 Thread Felix Cheung
It happens again so I’m pretty sure certain email is filtering this as spam. Neha, please give your account name (register there https://wiki.apache.org/ first) so you can be added. Also as discussed Pinot is not required to report April. -- > *From:* Neha Pawar

Re: Spark - Hadoop custom filesystem service loading

2019-03-23 Thread Felix Cheung
Hmm thanks. Do you have a proposed solution? From: Jhon Anderson Cardenas Diaz Sent: Monday, March 18, 2019 1:24 PM To: user Subject: Spark - Hadoop custom filesystem service loading Hi everyone, On spark 2.2.0, if you wanted to create a custom file system

Re: [VOTE] Release Apache Spark 2.4.1 (RC8)

2019-03-20 Thread Felix Cheung
Reposting for shane here [SPARK-27178] https://github.com/apache/spark/commit/342e91fdfa4e6ce5cc3a0da085d1fe723184021b Is problematic too and it’s not in the rc8 cut https://github.com/apache/spark/commits/branch-2.4 (Personally I don’t want to delay 2.4.1 either..)

Re: [discuss] Zeppelin support workflow

2019-03-16 Thread Felix Cheung
I like it! From: Jongyoul Lee Sent: Monday, March 11, 2019 9:05:03 PM To: dev Subject: Re: [discuss] Zeppelin support workflow Thanks for the sharing this kind of discussion. I'm interested in it. Will see it. On Mon, Mar 11, 2019 at 10:43 AM Xun Liu wrote:

Re: [VOTE] Accept DataSketches into the Apache Incubator

2019-03-15 Thread Felix Cheung
+1 (binding) On Fri, Mar 15, 2019 at 6:19 AM Jean-Baptiste Onofré wrote: > +1 (binding) > > Regards > JB > > On 14/03/2019 22:23, Kenneth Knowles wrote: > > Hi all, > > > > We've discussed the proposal for the DataSketches project in [1] and [2]. > > The > > proposal itself has been put on the

[jira] [Commented] (SPARK-26910) Re-release SparkR to CRAN

2019-03-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792120#comment-16792120 ] Felix Cheung commented on SPARK-26910: -- 2.3.3 failed. we are waiting for 2.4.1 to be released >

Season of Docs 2019

2019-03-13 Thread Felix Cheung
https://developers.google.com/season-of-docs/ Sounds like a good idea? Google announces the inaugural year of Season of Docs, a Google program that fosters collaboration between open source projects and technical writers. Season of Docs is similar to Summer of Code, but with a focus on open

Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th

2019-03-12 Thread Felix Cheung
See the Machine Learning track! We’re delighted to announce that the Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th! As the official conference series of the ASF, ApacheCon North America will feature over a dozen Apache project summits.

Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th

2019-03-12 Thread Felix Cheung
See the Big Data track! We’re delighted to announce that the Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th! As the official conference series of the ASF, ApacheCon North America will feature over a dozen Apache project summits, including

Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th

2019-03-12 Thread Felix Cheung
See the Big Data track or the Machine Learning track! We’re delighted to announce that the Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th! As the official conference series of the ASF, ApacheCon North America will feature over a dozen Apache

Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th

2019-03-12 Thread Felix Cheung
See the Big Data track or the Machine Learning track! We’re delighted to announce that the Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th! As the official conference series of the ASF, ApacheCon North America will feature over a dozen Apache

Re: Zeppelin in GSOC 2019

2019-03-10 Thread Felix Cheung
Hi Xun, Thanks for your work - could you change the title of the email, I think you will get more attention to your ask to review the design. From: Xun Liu Sent: Sunday, March 10, 2019 12:03 AM To: Jongyoul Lee; m...@apache.org; Jeff Zhang; Vasiliy Morkovkin

Re: Do we have a plan to release the first normal version of IoTDB this month?

2019-03-08 Thread Felix Cheung
Sounds great! From: Xiangdong Huang Sent: Friday, March 8, 2019 12:16:18 AM To: dev@iotdb.apache.org Subject: Re: Do we have a plan to release the first normal version of IoTDB this month? That's Great! A binary release version is really needed! And, if so, at

Re: [VOTE] Release Apache Spark 2.4.1 (RC2)

2019-03-07 Thread Felix Cheung
There is SPARK-26604 we are looking into From: Saisai Shao Sent: Wednesday, March 6, 2019 6:05 PM To: shane knapp Cc: Stavros Kontopoulos; Sean Owen; DB Tsai; Spark dev list; d_t...@apple.com Subject: Re: [VOTE] Release Apache Spark 2.4.1 (RC2) Do we have other

[jira] [Commented] (SPARK-26604) Register channel for stream request

2019-03-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786397#comment-16786397 ] Felix Cheung commented on SPARK-26604: -- could we backport this to branch-2.4? > Register chan

[jira] [Comment Edited] (SPARK-26918) All .md should have ASF license header

2019-03-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784109#comment-16784109 ] Felix Cheung edited comment on SPARK-26918 at 3/5/19 5:47 AM: -- [~rmsm

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

2019-03-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784109#comment-16784109 ] Felix Cheung commented on SPARK-26918: -- [~rmsm...@gmail.com] - you don't need to checkout a tag

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-03 Thread Felix Cheung
To: Xiangrui Meng Cc: Felix Cheung; Xingbo Jiang; Yinan Li; dev; Weichen Xu; Marco Gaido Subject: Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling I think treating SPIPs as this high-level takes away much of the point of VOTEing on them. I'm not sure that's even what Reynold is suggesting elsewhere

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-03 Thread Felix Cheung
this. From: Sean Owen Sent: Sunday, March 3, 2019 8:15 AM To: Felix Cheung Cc: Xingbo Jiang; Yinan Li; dev; Weichen Xu; Marco Gaido Subject: Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling I'm for this in general, at least a +0. I do think this has

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-02 Thread Felix Cheung
I’m very hesitant with this. I don’t want to vote -1, because I personally think it’s important to do, but I’d like to see more discussion points addressed and not voting completely on the spirit of it. First, SPIP doesn’t match the format of SPIP proposed and agreed on. (Maybe this is a

[jira] [Created] (ZEPPELIN-4026) Doc should warn about anonymous access

2019-03-02 Thread Felix Cheung (JIRA)
Felix Cheung created ZEPPELIN-4026: -- Summary: Doc should warn about anonymous access Key: ZEPPELIN-4026 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4026 Project: Zeppelin Issue Type

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

2019-03-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782565#comment-16782565 ] Felix Cheung commented on SPARK-26918: -- [~srowen] what do you think? > All .md should have

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

2019-03-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782564#comment-16782564 ] Felix Cheung commented on SPARK-26918: -- I'm for doing this (Reopen this issue) Also [~rmsm

Re: SPIP: Accelerator-aware Scheduling

2019-03-02 Thread Felix Cheung
+1 on mesos - what Sean says From: Andrew Melo Sent: Friday, March 1, 2019 9:19 AM To: Xingbo Jiang Cc: Sean Owen; Xiangrui Meng; dev Subject: Re: SPIP: Accelerator-aware Scheduling Hi, On Fri, Mar 1, 2019 at 9:48 AM Xingbo Jiang wrote: > > Hi Sean, > > To

Re: [VOTE] Release Apache Pinot (incubating) 0.1.0 RC0

2019-03-02 Thread Felix Cheung
+1 (binding) Carrying my vote from dev@ checked license headers compiled from source, ran tests, demo checked name includes incubating checked DISCLAIMER, LICENSE and NOTICE checked signature and hashes checked no unexpected binary files On Thu, Feb 28, 2019 at 10:45 AM Seunghyun Lee wrote:

Re: Help with permissions to cwiki pages

2019-03-02 Thread Felix Cheung
I saw the other comment and the INFRA JIRA. My understanding would be that you would need to ensure the user has permission in the “space” first. On Fri, Mar 1, 2019 at 2:48 PM Felix Cheung wrote: > I missed the part about design doc > > My suggestion for that is to open JIRA

Re: Help with permissions to cwiki pages

2019-03-01 Thread Felix Cheung
I missed the part about design doc My suggestion for that is to open JIRA and link to pdf or google doc on that. On Fri, Mar 1, 2019 at 2:44 PM Felix Cheung wrote: > I’ve mentioned this on the pinot site PR. My suggestion is not to use wiki > for this. > > Use the sit

Re: Windows Supports

2019-02-28 Thread Felix Cheung
Ok but was the point about appveyer as CI. It’s not hard to setup. From: Jongyoul Lee Sent: Tuesday, February 26, 2019 11:12 PM To: users Subject: Re: Windows Supports @Felix What I meant was the case that running Zeppelin in the Windows environment natively

Re: [VOTE] Accept Apache TVM into the incubator

2019-02-28 Thread Felix Cheung
+1 (binding) On Wed, Feb 27, 2019 at 10:17 PM kellen sunderland < kellen.sunderl...@gmail.com> wrote: > +1 (non-binding) > > On Wed, Feb 27, 2019, 10:15 PM Furkan KAMACI > wrote: > > > +1 (binding) > > > > 28 Şub 2019 Per, saat 08:40 tarihinde Henry Saputra < > > henry.sapu...@gmail.com> > >

Re: Pinot Incubator PMC report for March 2019 has been updated

2019-02-25 Thread Felix Cheung
LG. Thx for putting this together. About “updated LICENSE/NOTICE” - wasn’t that in the last month ie the timeframe for the last report? From: Seunghyun Lee Sent: Monday, February 25, 2019 9:09 PM To: dev@pinot.apache.org Subject: Pinot Incubator PMC report for

Re: Windows Supports

2019-02-25 Thread Felix Cheung
Testing on windows can also be done as CI on appveyer. I don’t completely get your comment on .cmd file though. Are you suggesting we don’t support windows and users can “run on windows” by basically running Linux in a virtual environment? Docker is one and there is Linux on Windows

Re: Windows Supports

2019-02-25 Thread Felix Cheung
Testing on windows can also be done as CI on appveyer. I don’t completely get your comment on .cmd file though. Are you suggesting we don’t support windows and users can “run on windows” by basically running Linux in a virtual environment? Docker is one and there is Linux on Windows

Re: [DISCUSS][SQL][PySpark] Column name support for SQL functions

2019-02-24 Thread Felix Cheung
I hear three topics in this thread 1. I don’t think we should remove string. Column and string can both be “type safe”. And I would agree we don’t *need* to break API compatibility here. 2. Gaps in python API. Extending on #1, definitely we should be consistent and add string as param where it

Re: [VOTE] Accept Cava into the Apache Incubator

2019-02-24 Thread Felix Cheung
+1 On Sat, Feb 23, 2019 at 11:39 PM Vinayakumar B wrote: > +1 > > -Vinay > > > > On Fri, 22 Feb 2019, 7:22 am Huxing Zhang, wrote: > > > +1 (non-binding) > > > > On Thu, Feb 21, 2019 at 3:50 AM Antoine Toulme > > wrote: > > > > > > Hi everyone, > > > > > > we've discussed the proposal for the

[jira] [Comment Edited] (SPARK-26918) All .md should have ASF license header

2019-02-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776080#comment-16776080 ] Felix Cheung edited comment on SPARK-26918 at 2/24/19 12:36 AM: actually

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

2019-02-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776080#comment-16776080 ] Felix Cheung commented on SPARK-26918: -- actually, it does - it's a comment in ASF incubator

Re: [VOTE] Apache Pinot (incubating) 0.1.0 RC0

2019-02-22 Thread Felix Cheung
KEYS file while validating a release? > > Best, > Seunghyun > > On Fri, Feb 15, 2019 at 10:44 PM Felix Cheung > wrote: > >> +1 >> >> All checked out - please see note on key and wiki. >> Thanks for putting this together. >> >> Note - ideally, sig

Re: Spark-hive integration on HDInsight

2019-02-21 Thread Felix Cheung
You should check with HDInsight support From: Jay Singh Sent: Wednesday, February 20, 2019 11:43:23 PM To: User Subject: Spark-hive integration on HDInsight I am trying to integrate spark with hive on HDInsight spark cluster . I copied hive-site.xml in

Re: Questions about deleting branches on Apache Jenkins

2019-02-21 Thread Felix Cheung
Can you point to where you see these branches? Is it on asf Jenkins? From: yi xu Sent: Thursday, February 21, 2019 12:52 AM To: dev@iotdb.apache.org Subject: Questions about deleting branches on Apache Jenkins Hi, I’m curious about the branch detection of our

Re: [VOTE] Release Apache Spark 2.4.1 (RC2)

2019-02-21 Thread Felix Cheung
I merged the fix to 2.4. From: Felix Cheung Sent: Wednesday, February 20, 2019 9:34 PM To: DB Tsai; Spark dev list Cc: Cesar Delgado Subject: Re: [VOTE] Release Apache Spark 2.4.1 (RC2) Could you hold for a bit - I have one more fix to get

Re: [VOTE] Release Apache Spark 2.4.1 (RC2)

2019-02-20 Thread Felix Cheung
Could you hold for a bit - I have one more fix to get in From: d_t...@apple.com on behalf of DB Tsai Sent: Wednesday, February 20, 2019 12:25 PM To: Spark dev list Cc: Cesar Delgado Subject: Re: [VOTE] Release Apache Spark 2.4.1 (RC2) Okay. Let's fail rc2, and

Re: [VOTE] SPIP: Identifiers for multi-catalog Spark

2019-02-19 Thread Felix Cheung
+1 From: Ryan Blue Sent: Tuesday, February 19, 2019 9:34 AM To: Jamison Bennett Cc: dev Subject: Re: [VOTE] SPIP: Identifiers for multi-catalog Spark +1 On Tue, Feb 19, 2019 at 8:41 AM Jamison Bennett wrote: +1 (non-binding) Jamison Bennett Cloudera

Re: SparkR + binary type + how to get value

2019-02-19 Thread Felix Cheung
there: From: Thijs Haarhuis Sent: Tuesday, February 19, 2019 5:28 AM To: Felix Cheung; user@spark.apache.org Subject: Re: SparkR + binary type + how to get value Hi Felix, Thanks. I got it working now by using the unlist function. I have another question, maybe you can help me with, since I did

Re: Missing SparkR in CRAN

2019-02-19 Thread Felix Cheung
, Jan 25, 2019 at 1:41 AM Felix Cheung mailto:felixche...@apache.org>> wrote: Yes it was discussed on dev@. We are waiting for 2.3.3 to release to resubmit. On Thu, Jan 24, 2019 at 5:33 AM Hyukjin Kwon mailto:gurwls...@gmail.com>> wrote: Hi all, I happened to find SparkR is missing

[jira] [Created] (SPARK-26918) All .md should have ASF license header

2019-02-18 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-26918: Summary: All .md should have ASF license header Key: SPARK-26918 URL: https://issues.apache.org/jira/browse/SPARK-26918 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26918) All .md should have ASF license header

2019-02-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26918: - Description: per policy, all md files should have the header, like eg. [https

[jira] [Updated] (SPARK-26918) All .md should have ASF license header

2019-02-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26918: - Description: per policy, all md files should have the header, like eg. [https

<    1   2   3   4   5   6   7   8   9   10   >