Re: [PySpark] Revisiting PySpark type annotations

So IMO maintaining outside in a separate repo is going to be harder. That was why I asked. From: Maciej Szymkiewicz Sent: Tuesday, August 4, 2020 12:59 PM To: Sean Owen Cc: Felix Cheung; Hyukjin Kwon; Driesprong, Fokko; Holden Karau; Spark Dev List Subject: Re

Re: [VOTE] Release Apache Superset (incubating) version 0.37.0

(Carry my vote, as stated already) +1 On Tue, Aug 4, 2020 at 10:20 AM Ville Brofeldt wrote: > Hello IPMC, > > The Apache Superset (incubating) community has voted on and approved a > proposal to > release Apache Superset (incubating) version 0.37.0. > The voting thread can be found here: >

Re: [PySpark] Revisiting PySpark type annotations

What would be the reason for separate git repo? From: Hyukjin Kwon Sent: Monday, August 3, 2020 1:58:55 AM To: Maciej Szymkiewicz Cc: Driesprong, Fokko ; Holden Karau ; Spark Dev List Subject: Re: [PySpark] Revisiting PySpark type annotations Okay, seems like

Re: [VOTE] Release Apache Superset (incubating) 0.37.0 based on Superset 0.37.0rc4

+1 - incubating in name - signature and hash fine - DISCLAIMER is fine - LICENSE and NOTICE are fine - No unexpected binary files - All source files have ASF headers - compile from source Flask Frontend (While it seemed to work, I was getting 404 on assets, I didn’t look more into it)

Re: Podling Sedona Report Reminder - August 2020

And as a reminder the report is up https://cwiki.apache.org/confluence/display/INCUBATOR/August2020 Please review. From: jmcl...@apache.org Sent: Saturday, August 1, 2020 5:54:53 PM To: d...@sedona.incubator.apache.org Subject: Podling Sedona Report Reminder -

Re: YuniKorn web-site V2 now is up

- http://ratis.apache.org/ - https://livy.apache.org/ - http://flagon.apache.org/ This seems not a requirement. Please share your thoughts, thanks! On Sat, Aug 1, 2020 at 12:58 PM Felix Cheung wrote: > Reminder - branding is very important and since the website is public it > will

Re: YuniKorn web-site V2 now is up

11:17:45 PM To: dev@yunikorn.apache.org Cc: lamber...@apache.org Subject: Re: YuniKorn web-site V2 now is up Thanks Felix! We will be working on fixing the references in the next couple of days. On Thu, Jul 23, 2020 at 4:16 PM Felix Cheung wrote: > Looks great - please include the podl

Re: Podling Pinot Report Reminder - August 2020

Another reminder From: Felix Cheung Sent: Sunday, July 26, 2020 5:09:32 PM To: dev@pinot.apache.org ; d...@pinot.incubator.apache.org Subject: Re: Podling Pinot Report Reminder - August 2020 Reminder on the report. https://cwiki.apache.org/confluence/display

Re: Podling Age Report Reminder - August 2020

Any one could take a shot at the report? From: jmcl...@apache.org Sent: Thursday, July 23, 2020 1:22:06 AM To: d...@age.incubator.apache.org Subject: Podling Age Report Reminder - August 2020 Dear podling, This email was sent by an automated system on behalf

Re: Sedona project website template

Sounds good. You can request on https://selfserve.apache.org/ To create a repo for incubator-sedona-website.git From: Jia Yu Sent: Friday, July 31, 2020 4:37:15 PM To: dev@sedona.apache.org Subject: Sedona project website template Hi folks, We are creating a

Podling report for Sedona

Hi, We are due for the first report, I have taken a shot at the updates, under Sedona in https://cwiki.apache.org/confluence/display/INCUBATOR/August2020 Please review and edit. Felix

[jira] [Commented] (SPARK-20684) expose createOrReplaceGlobalTempView/createGlobalTempView and dropGlobalTempView in SparkR

[ https://issues.apache.org/jira/browse/SPARK-20684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166801#comment-17166801 ] Felix Cheung commented on SPARK-20684: -- [https://github.com/apache/spark/pull/17941#issuecomment

[jira] [Comment Edited] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166581#comment-17166581 ] Felix Cheung edited comment on SPARK-12172 at 7/29/20, 1:20 AM

[jira] [Comment Edited] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166581#comment-17166581 ] Felix Cheung edited comment on SPARK-12172 at 7/29/20, 1:19 AM

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166581#comment-17166581 ] Felix Cheung commented on SPARK-12172: -- These are methods (map etc) that were never public

Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2)

+1 From: Jeff Zhang Sent: Sunday, July 26, 2020 7:29:22 AM To: users Cc: dev Subject: Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2) +1 Tested spark interpreter tutorial, flink interpreter tutorial. Prabhjyot Singh mailto:prabhjyotsi...@gmail.com>>

Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2)

+1 From: Jeff Zhang Sent: Sunday, July 26, 2020 7:29:22 AM To: users Cc: dev Subject: Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2) +1 Tested spark interpreter tutorial, flink interpreter tutorial. Prabhjyot Singh mailto:prabhjyotsi...@gmail.com>>

[jira] [Closed] (WHIMSY-337) roster - LDAP sync issue

[ https://issues.apache.org/jira/browse/WHIMSY-337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung closed WHIMSY-337. --- Resolution: Fixed > roster - LDAP sync issue > > >

Re: Podling Pinot Report Reminder - August 2020

Reminder on the report. https://cwiki.apache.org/confluence/display/INCUBATOR/August2020 From: jmcl...@apache.org Sent: Thursday, July 23, 2020 1:21:50 AM To: d...@pinot.incubator.apache.org Subject: Podling Pinot Report Reminder - August 2020 Dear podling,

[jira] [Created] (WHIMSY-337) roster - LDAP sync issue

Felix Cheung created WHIMSY-337: --- Summary: roster - LDAP sync issue Key: WHIMSY-337 URL: https://issues.apache.org/jira/browse/WHIMSY-337 Project: Whimsy Issue Type: Bug Reporter

Re: Exposing Spark parallelized directory listing & non-locality listing in core

+1 From: Holden Karau Sent: Wednesday, July 22, 2020 10:49:49 AM To: Steve Loughran Cc: dev Subject: Re: Exposing Spark parallelized directory listing & non-locality listing in core Wonderful. To be clear the patch is more to start the discussion about how we

[RESULT] [VOTE] Accept Sedona into the Apache Incubator

Hi, With 6 binding +1 votes, and no -1, to vote to accept Sedona into the Apache Incubator CLOSED and the vote has PASSED. [6] +1 Binding votes: - Jean-Baptiste Onofre - Dave Fisher - Kevin Ratnasekera - Furkan KAMACI - Willem Jiang - Felix Cheung [ 0 ] +0 Binding votes [ 0 ] -1 Binding votes

Re: [VOTE] Accept Sedona into the Apache Incubator

+1 (binding) On Sat, Jul 18, 2020 at 6:19 AM Willem Jiang wrote: > +1 （binding) > > Willem Jiang > > Twitter: willemjiang > Weibo: 姜宁willem > > On Thu, Jul 16, 2020 at 11:49 AM Felix Cheung > wrote: > > > > Hi, > > > > As we discussed the S

[VOTE] Accept Sedona into the Apache Incubator

Hi, As we discussed the Sedona proposal [1], I would like to call for a vote to accept Sedona into the Apache Incubator. Sedona is a big geospatial data processing engine. The system provides an easy to use Scala, SQL, and Python APIs for spatial data scientists to manage, wrangle, and process

Re: Welcoming some new Apache Spark committers

Welcome! From: Nick Pentreath Sent: Tuesday, July 14, 2020 10:21:17 PM To: dev Cc: Dilip Biswal ; Jungtaek Lim ; huaxin gao Subject: Re: Welcoming some new Apache Spark committers Congratulations and welcome as Apache Spark committers! On Wed, 15 Jul 2020 at

Re: [DISCUSS] project proposal - Apache Sedona

ard to it! > > > > Jia Yu > > Ph.D. in Computer Science > > Arizona State University <http://www.asu.edu/> > > Reach me via: Homepage <http://jiayuasu.github.io/> | GitHub > <https://github.com/jiayuasu> > &

Re: [DISCUSS] project proposal - Apache Sedona

u are > interested. > > Best Regards, > Von Gosling > > > On Jul 9, 2020, at 9:12 PM, Felix Cheung wrote: > > > > Hi, > > > > We would like to propose Apache Sedona, currently known in its community > as > > GeoSpark, as a new project under the Apa

Re: [DISCUSS] project proposal - Apache Sedona

Noted below. I will leave others to add anything I’ve missed. On Mon, Jul 13, 2020 at 8:15 PM Justin Mclean wrote: > Hi, > > Currently PiPy is not an ASF supported platform and you may have some > difficulty in complying with ASF policies. Are you aware of the trademark, > branding and other

Re: [DISCUSS] project proposal - Apache Sedona

com/jiayuasu> > > On Sun, Jul 12, 2020 at 12:46 PM Dave Fisher >> wrote: >> >>> Hi - >>> >>> You note over 30 contributors to GeoSpark, but there are only 8 initial >>> committers. Has the move to the Apache Incubator been thoroughly discussed >&

Re: [DISCUSS] project proposal - Apache Sedona

Any questions or concerns? If not, I can kick off the VOTE thread shortly. On Thu, Jul 9, 2020 at 6:12 AM Felix Cheung wrote: > Hi, > > We would like to propose Apache Sedona, currently known in its community > as GeoSpark, as a new project under the Apache Incubator. > &g

[DISCUSS] project proposal - Apache Sedona

Hi, We would like to propose Apache Sedona, currently known in its community as GeoSpark, as a new project under the Apache Incubator. Sedona is a big geospatial data processing engine. The system provides an easy to use Scala, SQL, and Python APIs for spatial data scientists to manage, wrangle,

Re: Apache Spark 3.1 Feature Expectation (Dec. 2020)

I think pluggable storage in shuffle is essential for k8s GA From: Holden Karau Sent: Monday, June 29, 2020 9:33 AM To: Maxim Gekk Cc: Dongjoon Hyun; dev Subject: Re: Apache Spark 3.1 Feature Expectation (Dec. 2020) Should we also consider the shuffle service

Fwd: Announcing ApacheCon @Home 2020

-- Forwarded message - We are pleased to announce that ApacheCon @Home will be held online, September 29 through October 1. More event details are available at https://apachecon.com/acah2020 but there’s a few things that I want to highlight for you, the members. Yes, the CFP

Fwd: Announcing ApacheCon @Home 2020

-- Forwarded message - We are pleased to announce that ApacheCon @Home will be held online, September 29 through October 1. More event details are available at https://apachecon.com/acah2020 but there’s a few things that I want to highlight for you, the members. Yes, the CFP

Fwd: Announcing ApacheCon @Home 2020

-- Forwarded message - We are pleased to announce that ApacheCon @Home will be held online, September 29 through October 1. More event details are available at https://apachecon.com/acah2020 but there’s a few things that I want to highlight for you, the members. Yes, the CFP

Podling report

Hi! Any volunteer to draft the report? https://cwiki.apache.org/confluence/display/INCUBATOR/July2020

Re: [Announce] New Zeppelin Committer: Philipp Dallig

Congrats and welcome! From: Xun Liu Sent: Saturday, June 27, 2020 8:58:34 AM To: dev Cc: users ; philipp.dal...@gmail.com Subject: Re: [Announce] New Zeppelin Committer: Philipp Dallig That's great news! Welcome aboard Philipp! :-) On Sat, Jun 27, 2020 at

Re: [Announce] New Zeppelin Committer: Philipp Dallig

Congrats and welcome! From: Xun Liu Sent: Saturday, June 27, 2020 8:58:34 AM To: dev Cc: users ; philipp.dal...@gmail.com Subject: Re: [Announce] New Zeppelin Committer: Philipp Dallig That's great news! Welcome aboard Philipp! :-) On Sat, Jun 27, 2020 at

Re: [ANNOUNCE] Apache Spark 3.0.0

Congrats From: Jungtaek Lim Sent: Thursday, June 18, 2020 8:18:54 PM To: Hyukjin Kwon Cc: Mridul Muralidharan ; Reynold Xin ; dev ; user Subject: Re: [ANNOUNCE] Apache Spark 3.0.0 Great, thanks all for your efforts on the huge step forward! On Fri, Jun 19,

Re: [ANNOUNCE] Apache Spark 3.0.0

Congrats From: Jungtaek Lim Sent: Thursday, June 18, 2020 8:18:54 PM To: Hyukjin Kwon Cc: Mridul Muralidharan ; Reynold Xin ; dev ; user Subject: Re: [ANNOUNCE] Apache Spark 3.0.0 Great, thanks all for your efforts on the huge step forward! On Fri, Jun 19,

Re: About the binary files for source code release

rvice-headless.yaml > x zookeeper/templates/service.yaml > x zookeeper/templates/servicemonitors.yaml > x zookeeper/templates/statefulset.yaml > x zookeeper/.helmignore > x zookeeper/OWNERS > x zookeeper/README.md > > @Felix Cheung What are the recommended way to >

Re: [VOTE] Release Apache Pinot (incubating) 0.4.0 RC2

+1 But a couple of things to follow up: mailing list link at the bottom of the web site seems to be broken - binary files are in the source package ./kubernetes/helm/pinot-0.2.0.tgz ./kubernetes/helm/pinot/charts/zookeeper-2.1.3.tgz ./kubernetes/helm/presto-0.2.0.tgz - ASF license header is

Mentoring Superset

Hello, I spoke to Alan and wanted to offer my help to Apache Superset in the Incubator, and hope that I can help in its journey to graduation. I’m Committer and PMC member of Apache Spark, Zeppelin and I am currently mentoring Pinot and few other projects. Regards, Felix

Re: Crail draft podling report June 2020

Thanks - The wiki is now using the same credentials as your Apache account - have you tried that? From: bernard metzler Sent: Tuesday, June 2, 2020 2:04:00 AM To: dev@crail.apache.org Subject: Crail draft podling report June 2020 Please find below a draft

Re: Podling Pinot Report June 2020

I saw the report was posted but with a question- No, there isn’t a fixed email thread criteria for graduation. Graduation is about maturity of the community. From: jmcl...@apache.org Sent: Friday, May 22, 2020 9:53:41 PM To: d...@pinot.incubator.apache.org

Re: Podling Crail Report Reminder - June 2020

Reminder on the podling report From: jmcl...@apache.org Sent: Friday, May 22, 2020 9:53 PM To: d...@crail.incubator.apache.org Subject: Podling Crail Report Reminder - June 2020 Dear podling, This email was sent by an automated system on behalf of the Apache

Re: Teaclave Website

gt; Hi, > > Thanks for your effort on the website! I see that the ASF Sponsorship URL > is not right. So, I've created a PR for it. > > Kind Regards, > Furkan KAMACI > > > > On Sat, May 16, 2020 at 1:35 AM Felix Cheung > wrote: > > > This is great -

Re: Teaclave Website

This is great - you might want to add links to mail archive (dev@) and a page on the community (people) https://incubator.apache.org/guides/sites.html#creating_a_good_podling_site From: Mingshen Sun Sent: Thursday, May 14, 2020 5:55:35 PM To:

Re: [VOTE] Release Apache YuniKorn (Incubating) 0.8.0

+1 (binding) Carry over my vote On Wed, Apr 29, 2020 at 9:05 PM Weiwei Yang wrote: > Hello IPMC > > The Apache YuniKorn community has voted and approved the release Apache > YuniKorn (incubating) 0.8.0. We now kindly request the IPMC members review > and vote in this release. > > YuniKorn is a

Re: [VOTE] Project proposal - Apache AgensGraph Extension

+1 (binding) I can offer to mentor this project, if needed (have done graph and Postgres work in the past) On Wed, Apr 15, 2020 at 11:18 AM Kevin Ratnasekera wrote: > +1 ( binding ) > > Regards > Kevin > > On Wed, Apr 15, 2020 at 11:26 PM Dave Fisher wrote: > > > +1 (binding) > > > > > On

Reminder March Incubator report

Re: Mentors wanted for projects

Can we call out projects that might be at risk in some way (community growth, list traffic, low change count) It might help to bring attention to those needing help or should rather retire. On Wed, Feb 19, 2020 at 1:47 PM Justin Mclean wrote: > Hi, > > It generally seen that the right amount

Re: [ANNOUNCE] Apache Submarine 0.3.0 release!

Cool stuff! From: Wangda Tan Sent: Monday, February 10, 2020 9:07:07 PM To: users@submarine.apache.org Cc: d...@submarine.apache.org Subject: Re: [ANNOUNCE] Apache Submarine 0.3.0 release! Awesome! Thanks everybody for helping this release! Best, Wangda On

Re: [ANNOUNCE] Apache Submarine 0.3.0 release!

Cool stuff! From: Wangda Tan Sent: Monday, February 10, 2020 9:07:07 PM To: us...@submarine.apache.org Cc: dev@submarine.apache.org Subject: Re: [ANNOUNCE] Apache Submarine 0.3.0 release! Awesome! Thanks everybody for helping this release! Best, Wangda On

Re: [VOTE] Accept NLPCraft into Apache Incubator

+1 On Sun, Feb 9, 2020 at 1:58 PM Roman Shaposhnik wrote: > On Sun, Feb 9, 2020 at 1:54 PM Konstantin Boudnik wrote: > > > > Hello. > > > > As the discussion of NLPCraft proposal [1] has been wrapped up [2] I > would like > > to call a VOTE to accept this project into the Apache Incubator. > >

Re: More publicly documenting the options under spark.sql.*

I think it’s a good idea From: Hyukjin Kwon Sent: Wednesday, January 15, 2020 5:49:12 AM To: dev Cc: Sean Owen ; Nicholas Chammas Subject: Re: More publicly documenting the options under spark.sql.* Resending to the dev list for archive purpose: I think

Re: [VOTE] Accept YuniKorn into Apache Incubator

+1 (binding) On Fri, Jan 10, 2020 at 9:54 AM David Lyle wrote: > +1 (non-binding) > > -David... > > > On Fri, Jan 10, 2020 at 12:47 PM Vinod Kumar Vavilapalli < > vino...@apache.org> > wrote: > > > Hi, > > > > I'd like to call a vote on accepting YuniKorn into the Apache Incubator. > > > >

Re: Fail to use SparkR of 3.0 preview 2

Maybe it’s the reverse - the package is built to run in latest but not compatible with slightly older (3.5.2 was Dec 2018) From: Jeff Zhang Sent: Thursday, December 26, 2019 5:36:50 PM To: Felix Cheung Cc: user.spark Subject: Re: Fail to use SparkR of 3.0

Re: Fail to use SparkR of 3.0 preview 2

It looks like a change in the method signature in R base packages. Which version of R are you running on? From: Jeff Zhang Sent: Thursday, December 26, 2019 12:46:12 AM To: user.spark Subject: Fail to use SparkR of 3.0 preview 2 I tried SparkR of spark 3.0

Re: [VOTE] Apache Crail 1.2-incubating (rc2)

+1 binding Checked Name Disclaimer Signature License Header Compile from source On Thu, Dec 12, 2019 at 6:52 PM Justin Mclean wrote: > Hi, > > +1 (binding) > > I checked: > - incubating in name > - signatures and hashes good > - DISCLAIMER exists > - LICENSE is fine > - NOTICE has incorrect

Re: [VOTE] Apache Crail 1.2-incubating (rc2)

dist.apache.org is having some issue. Let me check back On Mon, Dec 16, 2019 at 11:57 PM Adrian Schuepbach < adrian.schuepb...@gribex.net> wrote: > Hi Felix > > Would you be available to vote on this Apache Crail release? > > Thanks > Adrian > > > > On 12/14/19 00:32, Adrian Schüpbach wrote: >

Re: [VOTE] Apache Crail 1.2-incubating (rc2)

I will look into later today. On Mon, Dec 16, 2019 at 11:57 PM Adrian Schuepbach < adrian.schuepb...@gribex.net> wrote: > Hi Felix > > Would you be available to vote on this Apache Crail release? > > Thanks > Adrian > > > > On 12/14/19 00:32, Adrian Schüpbach wrote: > > Dear all > > > > Thanks

Re: [DISCUSS] YuniKorn Proposal

ency manager, BSD 2-Clause License > > > > 2.8.2 Cryptography > > YuniKorn does not currently include any cryptography-related code. > > > > 2.9 Required Resources > > > > 2.9.1 Mailing lists: > > - priv...@yunikorn.incubator.apache.org (PMC list) > >

Re: Podling Crail Report Reminder - December 2019

Thanks. We could also report a release is ongoing. From: bernard metzler Sent: Monday, December 2, 2019 9:24:04 AM To: dev@crail.apache.org ; Felix Cheung Subject: Re: Podling Crail Report Reminder - December 2019 Hi Felix, Sure we will do. Just trying to get

Re: Podling Crail Report Reminder - December 2019

Hello- reminder on the report this week. Thanks! From: jmcl...@apache.org Sent: Saturday, November 30, 2019 3:49:40 PM To: d...@crail.incubator.apache.org Subject: Podling Crail Report Reminder - December 2019 Dear podling, This email was sent by an automated

Re: SparkR integration with Hive 3 spark-r

I think you will get more answer if you ask without SparkR. You question is independent on SparkR. Spark support for Hive 3.x (3.1.2) was added here https://github.com/apache/spark/commit/1b404b9b9928144e9f527ac7b1caa15f932c2649 You should be able to connect Spark to Hive metastore.

Re: Enabling fully disaggregated shuffle on Spark

; Christopher Crosbie ; Griselda Cuevas ; Holden Karau ; Mayank Ahuja ; Kalyan Sivakumar ; alfo...@fb.com ; Felix Cheung ; Matt Cheah ; Yifei Huang (PD) Subject: Re: Enabling fully disaggregated shuffle on Spark That sounds great! On Wed, Nov 20, 2019 at 9:02 AM John Zhuge mailto:jzh

Re: The Myth: the forked Hive 1.2.1 is stabler than XXX

Just to add - hive 1.2 fork is definitely not more stable. We know of a few critical bug fixes that we cherry picked into a fork of that fork to maintain ourselves. From: Dongjoon Hyun Sent: Wednesday, November 20, 2019 11:07:47 AM To: Sean Owen Cc: dev

Re: [VOTE] Release Apache Pinot (incubating) 0.2.0 RC0

+1 Built and ran tests. I’ve been trying to run some tools in the last few days for license header in file, so far the tools are not working out. Oh well. Btw, rat check doesn’t seem to cover all files in the project? On Mon, Nov 18, 2019 at 11:35 AM Subbu Subramaniam wrote: > Hi all, > >

Re: Use Hadoop-3.2 as a default Hadoop profile in 3.0.0?

1000% with Steve, the org.spark-project hive 1.2 will need a solution. It is old and rather buggy; and It’s been *years* I think we should decouple hive change from everything else if people are concerned? From: Steve Loughran Sent: Sunday, November 17, 2019

Re: Adding JIRA ID as the prefix for the test case name

this is about test description and not test file name right? if yes I don’t see a problem. From: Hyukjin Kwon Sent: Thursday, November 14, 2019 6:03:02 PM To: Shixiong(Ryan) Zhu Cc: dev ; Felix Cheung ; Shivaram Venkataraman Subject: Re: Adding JIRA ID

Re: [VOTE] Accept StreamPipes into the Apache Incubator

+1 Great project! On Thu, Nov 7, 2019 at 11:40 AM Christofer Dutz wrote: > A big +1 (binding) from me > > Chris > > Von: Julian Feinauer > Gesendet: Donnerstag, 7. November 2019 20:19:43 > An: general@incubator.apache.org > Betreff: Re: [VOTE] Accept

Re: Podling Pinot Report Reminder - November 2019

Hi, Reminder the report is due shortly. From: jmcl...@apache.org Sent: Sunday, October 20, 2019 5:27 AM To: d...@pinot.incubator.apache.org Subject: Podling Pinot Report Reminder - November 2019 Dear podling, This email was sent by an automated system on

Re: Intellij announce Big Data Tools – Integration with Zeppelin

Cool! From: Jeff Zhang Sent: Wednesday, October 16, 2019 6:52:02 AM To: users Subject: Intellij announce Big Data Tools – Integration with Zeppelin Here's the related details

[jira] [Updated] (SPARK-29042) Sampling-based RDD with unordered input should be INDETERMINATE

[ https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-29042: - Labels: correctness (was: ) > Sampling-based RDD with unordered input should be INDETERMIN

Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling

+1 From: Thomas graves Sent: Wednesday, September 4, 2019 7:24:26 AM To: dev Subject: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Hey everyone, I'd like to call for a vote on SPARK-27495 SPIP: Support Stage level

Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default

I’d prefer strict mode and fail fast (analysis check) Also I like what Alastair suggested about standard clarification. I think we can re-visit this proposal and restart the vote From: Ryan Blue Sent: Friday, September 6, 2019 5:28 PM To: Alastair Green Cc:

Re: maven 3.6.1 removed from apache maven repo

(Hmm, what is spark-...@apache.org?) From: Sean Owen Sent: Tuesday, September 3, 2019 11:58:30 AM To: Xiao Li Cc: Tom Graves ; spark-...@apache.org Subject: Re: maven 3.6.1 removed from apache maven repo It's because build/mvn only queries ASF mirrors, and

Re: Podling Report Reminder - September 2019

Hello - reminder again. The report is due in 2 days From: Felix Cheung Sent: Wednesday, August 28, 2019 12:07:53 PM To: dev@crail.apache.org Subject: Re: Podling Report Reminder - September 2019 Hi - reminder of the report due within a week

[jira] [Commented] (SPARK-27495) SPIP: Support Stage level resource configuration and scheduling

[ https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920479#comment-16920479 ] Felix Cheung commented on SPARK-27495: -- +1 on this.   I've reviewed this. A few questions

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920476#comment-16920476 ] Felix Cheung commented on SPARK-28594: -- Reviewed. looks reasonable to me. I can help shepherd

[jira] [Updated] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-28594: - Shepherd: Felix Cheung > Allow event logs for running streaming apps to be rolled o

Re: Design review of SPARK-28594

I did review it and solving this problem makes sense. I will comment in the JIRA. From: Jungtaek Lim Sent: Sunday, August 25, 2019 3:34:22 PM To: dev Subject: Design review of SPARK-28594 Hi devs, I have been working on designing SPARK-28594 [1] (though I've

Re: Zeppelin Studio Proposal

This is cool! From: CHALLA Sent: Wednesday, August 28, 2019 4:39:46 AM To: users@zeppelin.apache.org Subject: Re: Zeppelin Studio Proposal  great. On Wed, Aug 28, 2019 at 4:04 PM Ivan Shapovalov mailto:shapovalov.iva...@gmail.com>> wrote: Hey All, The idea

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

+1 Run tests, R tests, r-hub Debian, Ubuntu, mac, Windows From: Hyukjin Kwon Sent: Wednesday, August 28, 2019 9:14 PM To: Takeshi Yamamuro Cc: dev; Dongjoon Hyun Subject: Re: [VOTE] Release Apache Spark 2.4.4 (RC3) +1 (from the last blocker PR) 2019년 8월 29일

Re: JDK11 Support in Apache Spark

That’s great! From: ☼ R Nair Sent: Saturday, August 24, 2019 10:57:31 AM To: Dongjoon Hyun Cc: d...@spark.apache.org ; user @spark/'user @spark'/spark users/user@spark Subject: Re: JDK11 Support in Apache Spark Finally!!! Congrats On Sat, Aug 24, 2019, 11:11

Re: JDK11 Support in Apache Spark

That’s great! From: ☼ R Nair Sent: Saturday, August 24, 2019 10:57:31 AM To: Dongjoon Hyun Cc: dev@spark.apache.org ; user @spark/'user @spark'/spark users/user@spark Subject: Re: JDK11 Support in Apache Spark Finally!!! Congrats On Sat, Aug 24, 2019, 11:11

Re: [VOTE] Accept DolphinScheduler(was EasyScheduler) into Apache Incubator

+1 On Fri, Aug 23, 2019 at 8:11 AM ShaoFeng Shi wrote: > +1 (binding) > > I believe the DolphinScheduler project will bring value to ASF. The team is > very open and the community is already very active. Glad to see it to join > the incubator. > > Best regards, > > Shaofeng Shi 史少锋 > Apache

Re: [DISCUSS] IPMC votes on releases

option (D) combined with (E) And encourage mentors to vote on dev@ makes sense to me On Fri, Aug 9, 2019 at 3:24 PM Justin Mclean wrote: > Hi, > > > (D) will still require 2 more IPMC vote? > > (E) will be like (B) in that it will need mentors or other IPMC to vote > in > > podling dev@? > >

Re: [DISCUSS] IPMC votes on releases

(D) will still require 2 more IPMC vote? (E) will be like (B) in that it will need mentors or other IPMC to vote in podling dev@? On Thu, Aug 8, 2019 at 10:04 PM Justin Mclean wrote: > Hi, > > One of the incubator pain points is the double voting on releases first by > the podling and then by

Re: Fwd: Incubator report timeline August 2019

Subbu, A healthy community growth would be a big factor. May I suggest you to check out the Maturity model - please note it is a guideline not a checklist or rule https://community.apache.org/apache-way/apache-project-maturity-model.html From: Subbu

Re: Fwd: Incubator report timeline August 2019

Subbu, can you add a summary on community interaction numbers (dev@ threads, PRs)? From: Subbu Subramaniam Sent: Tuesday, August 6, 2019 8:30:49 PM To: dev@pinot.apache.org ; Verandah2 . Subject: Re: Fwd: Incubator report timeline August 2019 Hi Justin I had

Re: [MENTORS] IPMC Policy change work in progress disclaimer

+1 On Thu, Aug 1, 2019 at 11:17 PM Paul King wrote: > Kudos for progressing this idea. I really like it. It should allow > improvements from the perspective of both podlings and reviewers. > > Cheers, Paul. > > On Fri, Aug 2, 2019 at 12:25 PM Justin Mclean > wrote: > > > Hi, > > > > The work

Re: Incubator policy wording

I think rewording the termination spew could help as there has been feedback on incubator coming across as “unwelcoming” etc. Just my 2c On Wed, Jul 31, 2019 at 2:22 PM Justin Mclean wrote: > Hi, > > Thanks for the feedback. > > > 1. Should we move disclaimer and release up instead of being

Re: Incubator policy wording

Hi Justin, two thoughts 1. Should we move disclaimer and release up instead of being the last? Seems like good to be upfront with these 2. About “It MAY consider the termination of a Podling if violations are not corrected.“ Should we put a timeframe on the correction? It seems like violations

Re: [PySpark] [SparkR] Is it possible to invoke a PySpark function with a SparkR DataFrame?

Not currently in Spark. However, there are systems out there that can share DataFrame between languages on top of Spark - it’s not calling the python UDF directly but you can pass the DataFrame to python and then .map(UDF) that way. From: Fiske, Danny Sent:

Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API

+1 Glad to see the progress in this space - it’s been more than a year since the original discussion and effort started. From: Yinan Li Sent: Monday, June 17, 2019 7:14:42 PM To: rb...@netflix.com Cc: Dongjoon Hyun; Saisai Shao; Imran Rashid; Ilan Filonenko; bo

Re: [DISCUSS] Increasing minimum supported version of Pandas

How about pyArrow? From: Holden Karau Sent: Friday, June 14, 2019 11:06:15 AM To: Felix Cheung Cc: Bryan Cutler; Dongjoon Hyun; Hyukjin Kwon; dev; shane knapp Subject: Re: [DISCUSS] Increasing minimum supported version of Pandas Are there other Python

Re: [DISCUSS] Increasing minimum supported version of Pandas

So to be clear, min version check is 0.23 Jenkins test is 0.24 I’m ok with this. I hope someone will test 0.23 on releases though before we sign off? From: shane knapp Sent: Friday, June 14, 2019 10:23:56 AM To: Bryan Cutler Cc: Dongjoon Hyun; Holden Karau;

Re: Close PR right on Github page

Adrian, did you link your account? You should be able to close or merge PR once you have setup. https://gitbox.apache.org/setup/ From: Adrian Schüpbach Sent: Tuesday, June 11, 2019 2:41:54 PM To: dev@crail.apache.org Subject: Re: Close PR right on Github page

<    1   2   3   4   5   6   7   8   9   10   >