Re: Why "Executor" have no NettyRpcEndpointRef?

http://apache-spark-developers-list.1001551.n3.nabble.com/Why-quot-Executor-quot-have-no-NettyRpcEndpointRef-td21432.html This is the origin question asked by yellowboy_ 2017-05-06 0:27

Re: PR permission to kick Jenkins?

alright. this kinda sucks. after looking at that PR, i found a bunch of comments by tom and marcelo on the morning of may 2nd. i grepped for that PR# in the jenkins logs and found things that made me REALLY SAD (as well as making me ask myself how this even works to begin with): INFO: Pull

Re: PR permission to kick Jenkins?

ok cool, thanks. i'll check the jenkins logs from then and see if i can find anything. no promises. :\ On Fri, May 5, 2017 at 1:10 PM, Marcelo Vanzin wrote: > I noticed it on this one (before I said "ok to test"): > https://github.com/apache/spark/pull/17658 > > My

Re: PR permission to kick Jenkins?

I noticed it on this one (before I said "ok to test"): https://github.com/apache/spark/pull/17658 My requests went through, Tom's seemed to be ignored. On Fri, May 5, 2017 at 1:06 PM, shane knapp wrote: > also, do we have any recent PRs where i can see this happening? it

Re: PR permission to kick Jenkins?

also, do we have any recent PRs where i can see this happening? it will make my log-diving a bit easier. On Fri, May 5, 2017 at 12:48 PM, shane knapp wrote: > tom: i checked and your username is still on the list. > > anyways, it's a pretty big list... i pulled a couple

Re: PR permission to kick Jenkins?

tom: i checked and your username is still on the list. anyways, it's a pretty big list... i pulled a couple of names out of it (including mine -- i can add myself back if needed), but i'd be down to have someone (rxin, maybe?) audit the list and pare it down. also, after checking out the code

Re: PR permission to kick Jenkins?

I suspect the list is getting too big for Jenkins to function well. It stopped working for me a while ago. On Fri, May 5, 2017 at 12:06 PM, Tom Graves wrote: > Does anyone know how to configure Jenkins to allow committers to tell it > to test prs? I used to have

PR permission to kick Jenkins?

Does  anyone know how to configure Jenkins to allow committers to tell it to test prs?  I used to have this access but lately it is either not working or only intermittently working. The commands like "ok to test", "test this please", etc.. Thanks,Tom

Re: [Spark Streaming] Dynamic Broadcast Variable Update

Thanks for the email. The process is to create a JIRA ticket and then post a design doc for discussion. You will of course need to update your code to work with the latest master branch, but you should wait oj that until the community has a chance to comment on the design. Cheers. On Fri, May

Re: Why "Executor" have no NettyRpcEndpointRef?

I don't understand what it is you're trying to reach at. Are you just trying to understand the RPC library? Or do you actually have a question? On Fri, May 5, 2017 at 3:33 AM, cane wrote: > Yes,that's the true process. > And i think client is initalized when NettyRpcRef

[Spark Streaming] Dynamic Broadcast Variable Update

Hi All, To support our Spark Streaming based anomaly detection tool, we have made a patch in Spark 1.6.2 to dynamically update broadcast variables. I'll first explain our use-case, which I believe should be common to several people using Spark Streaming applications. Broadcast variables are

Re: Why "Executor" have no NettyRpcEndpointRef?

Yes,that's the true process. And i think client is initalized when NettyRpcRef of executor is deserialized since NettyRpcEndpointRef#readObject is calling. Am i right? -- View this message in context:

Re: Why "Executor" have no NettyRpcEndpointRef?

After looking into code of branch-2.1. I found out Driver first handle executor connections by NettyRpcHandler. Once a connection arrive,driver's NettyRpcHandler will call receive,in which NettyRpcHandler#internalReceive will be called. And then NettyEnv#deserialize will be called,which will

Re: Why "Executor" have no NettyRpcEndpointRef?

Yes,i looked into branch 1.6.I will check out branch 2.1 -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Why-Executor-have-no-NettyRpcEndpointRef-tp21432p21505.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.