Re: Comprehensive Port Configuration reference?

2014-06-09 Thread Andrew Ash
/2014 05:18 PM Subject: Re: Comprehensive Port Configuration reference? -- Hmm, those do look like 4 listening ports to me. PID 3404 is an executor and PID 4762 is a worker? This is a standalone cluster? On Wed, May 28, 2014 at 8:22 AM, Jacob Eisinger *jeis

Re: Comprehensive Port Configuration reference?

2014-05-29 Thread Jacob Eisinger
@spark.apache.org Date: 05/28/2014 05:18 PM Subject:Re: Comprehensive Port Configuration reference? Hmm, those do look like 4 listening ports to me.  PID 3404 is an executor and PID 4762 is a worker?  This is a standalone cluster? On Wed, May 28, 2014 at 8:22 AM, Jacob Eisinger jeis

Re: Comprehensive Port Configuration reference?

2014-05-28 Thread Jacob Eisinger
are open. Is 57286 and 60235 not being used? Jacob Jacob D. Eisinger IBM Emerging Technologies jeis...@us.ibm.com - (512) 286-6075 From: Andrew Ash and...@andrewash.com To: user@spark.apache.org Date: 05/25/2014 06:25 PM Subject:Re: Comprehensive Port Configuration reference? Hi

Re: Comprehensive Port Configuration reference?

2014-05-25 Thread Andrew Ash
been interested in better understanding what ports are used where From: Andrew Ash and...@andrewash.com To: user@spark.apache.org Date: 05/23/2014 10:30 AM Subject: Re: Comprehensive Port Configuration reference? -- Hi everyone, I've also been interested

Re: Comprehensive Port Configuration reference?

2014-05-23 Thread Andrew Ash
Hi everyone, I've also been interested in better understanding what ports are used where and the direction the network connections go. I've observed a running cluster and read through code, and came up with the below documentation addition. https://github.com/apache/spark/pull/856 Scott and

Re: Comprehensive Port Configuration reference?

2014-05-11 Thread Mark Baker
On Tue, May 6, 2014 at 9:09 AM, Jacob Eisinger jeis...@us.ibm.com wrote: In a nut shell, Spark opens up a couple of well known ports. And,then the workers and the shell open up dynamic ports for each job. These dynamic ports make securing the Spark network difficult. Indeed. Judging by

Re: Comprehensive Port Configuration reference?

2014-05-06 Thread Jacob Eisinger
...@us.ibm.com - (512) 286-6075 From: Scott Clasen scott.cla...@gmail.com To: u...@spark.incubator.apache.org Date: 05/05/2014 11:39 AM Subject:Comprehensive Port Configuration reference? Is there somewhere documented how one would go about configuring every open port a spark

Comprehensive Port Configuration reference?

2014-05-05 Thread Scott Clasen
for BlockManager OutoutTracker FileServer WebUI Local port to get callbacks from mesos master.. What else? How do I configure all of these? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Comprehensive-Port-Configuration-reference-tp5384.html Sent from