Re: Apache Spark git repo moved to gitbox.apache.org

The above instruction is different from what the website document: https://github.com/apache/spark-website/commit/92606b2e7849b9d743ef2a8176438142420a83e5#diff-17faa4bab13b7530a3e1b627bb798ad0 Some committers are using gitbox, but the others are following the website instruction and using github.

Re: [VOTE] [RESULT] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

++1 from me. On Wed, Feb 13, 2019 at 2:19 AM Xiangrui Meng wrote: > Hi all, > > The vote passed with the following +1s (* = binding) and no 0s/-1s: > > * Denny Lee > * Jules Damji > * Xiao Li* > * Dongjoon Hyun > * Mingjie Tang > * Yanbo Liang* > * Marco Gaido > * Joseph Bradley* > * Xiangrui

Re: building docker images for GPU

Just notice current spark task scheduling doesn't recognize any /device as constraints. What might happen as a result would be multiple tasks stuck on racing to acquire GPU/FPGA (you name it) Not sure if "multiple process"on one GPU works same as how CPU designed. If not, we should consider kinda

[VOTE] [RESULT] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

Hi all, The vote passed with the following +1s (* = binding) and no 0s/-1s: * Denny Lee * Jules Damji * Xiao Li* * Dongjoon Hyun * Mingjie Tang * Yanbo Liang* * Marco Gaido * Joseph Bradley* * Xiangrui Meng* Please watch SPARK-25994 and join future discussions there. Thanks! Best, Xiangrui

Re: [VOTE] [SPARK-25994] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

+1 from myself. The vote passed with the following +1s and no -1s: * Denny Lee * Jules Damji * Xiao Li* * Dongjoon Hyun * Mingjie Tang * Yanbo Liang* * Marco Gaido * Joseph Bradley* * Xiangrui Meng* I will send a result email soon. Please watch SPARK-25994 for future discussions. Thanks! Best,

Re: building docker images for GPU

I think I remember someone mentioning a thread about this on the PR discussion, and digging a bit I found this: http://apache-spark-developers-list.1001551.n3.nabble.com/Toward-an-quot-API-quot-for-spark-images-used-by-the-Kubernetes-back-end-td23622.html It started a discussion but I haven't

Re: Time to cut an Apache 2.4.1 release?

just filed a JIRA in https://issues.apache.org/jira/browse/SPARK-26862 ' this issue only happens in 2.4.0 but not in 2.3.2 anyone would help to look into that? On Tue, Feb 12, 2019 at 10:41 AM DB Tsai wrote: > Great. I'll prepare the release for voting. Thanks! > > DB Tsai | Siri Open

Re: Time to cut an Apache 2.4.1 release?

Great. I'll prepare the release for voting. Thanks! DB Tsai | Siri Open Source Technologies [not a contribution] |  Apple, Inc > On Feb 12, 2019, at 4:11 AM, Wenchen Fan wrote: > > +1 for 2.4.1 > > On Tue, Feb 12, 2019 at 7:55 PM Hyukjin Kwon wrote: > +1 for 2.4.1 > > 2019년 2월 12일 (화)

Re: Contribution

Hi Gabor, Ok, sure I will! Best regards, Valeria вт, 12 февр. 2019 г. в 17:00, Gabor Somogyi : > Hi Valeria, > > Welcome, ping me if you need review. > > BR, > G > > > On Tue, Feb 12, 2019 at 2:51 PM Valeria Vasylieva < > valeria.vasyli...@gmail.com> wrote: > >> Hi Gabor, >> >> Thank you for

Re: Contribution

Hi Valeria, Welcome, ping me if you need review. BR, G On Tue, Feb 12, 2019 at 2:51 PM Valeria Vasylieva < valeria.vasyli...@gmail.com> wrote: > Hi Gabor, > > Thank you for clarification! Will do it! > I am happy to join the community! > > Best Regards, > Valeria > > вт, 12 февр. 2019 г. в

Re: Contribution

Hi Gabor, Thank you for clarification! Will do it! I am happy to join the community! Best Regards, Valeria вт, 12 февр. 2019 г. в 16:32, Gabor Somogyi : > Hi Valeria, > > Glad to hear you would like to contribute! It will be assigned to you when > you create a PR. > Before you create it please

Re: Contribution

Hi Valeria, Glad to hear you would like to contribute! It will be assigned to you when you create a PR. Before you create it please read the following guide which describe the details: https://spark.apache.org/contributing.html BR, G On Tue, Feb 12, 2019 at 2:28 PM Valeria Vasylieva <

Contribution

Hi! My name is Valeria Vasylieva and I would like to help with the task: https://issues.apache.org/jira/browse/SPARK-20597 Please assign it to me, my JIRA account is: nimfadora ( https://issues.apache.org/jira/secure/ViewProfile.jspa?name=nimfadora) Thank you!

Re: Time to cut an Apache 2.4.1 release?

+1 for 2.4.1 On Tue, Feb 12, 2019 at 7:55 PM Hyukjin Kwon wrote: > +1 for 2.4.1 > > 2019년 2월 12일 (화) 오후 4:56, Dongjin Lee 님이 작성: > >> > SPARK-23539 is a non-trivial improvement, so probably would not be >> back-ported to 2.4.x. >> >> Got it. It seems reasonable. >> >> Committers: >> >> Please

Re: Time to cut an Apache 2.4.1 release?

+1 for 2.4.1 2019년 2월 12일 (화) 오후 4:56, Dongjin Lee 님이 작성: > > SPARK-23539 is a non-trivial improvement, so probably would not be > back-ported to 2.4.x. > > Got it. It seems reasonable. > > Committers: > > Please don't omit SPARK-23539 from 2.5.0. Kafka community needs this > feature. > >

Re: Tungsten Memory Consumer

Hello,     I am sorry about my first explanation, was not concrete. Well I will explain further about TaskMemoryManager. TaskMemoryManager manages the execution memory of each task application as follow:     1. MemoryConsumer is the entry for the Spark task to run. MemoryConsumer requests

Re: Time to cut an Apache 2.4.1 release?

> SPARK-23539 is a non-trivial improvement, so probably would not be back-ported to 2.4.x. Got it. It seems reasonable. Committers: Please don't omit SPARK-23539 from 2.5.0. Kafka community needs this feature. Thanks, Dongjin On Tue, Feb 12, 2019 at 1:50 PM Takeshi Yamamuro wrote: > +1,