Re: fishing for help!

note that with AWS, you can use Placement Groups and EC2 instances with Enhanced Networking to lower network latency and increase network

Re: fishing for help!

look for differences: packages versions, cpu/network/memory diff etc etc On 21 December 2015 at 14:53, Eran Witkon wrote: > Hi, > I know it is a wide question but can you think of reasons why a pyspark > job which runs on from server 1 using user 1 will run faster then

Re: fishing for help!

If you are running on Amazon, then it's always a crapshoot as well. M > On Dec 21, 2015, at 4:41 PM, Josh Rosen wrote: > > @Eran, are Server 1 and Server 2 both part of the same cluster / do they have > similar positions in the network topology w.r.t the Spark

Re: fishing for help!

@Eran, are Server 1 and Server 2 both part of the same cluster / do they have similar positions in the network topology w.r.t the Spark executors? If Server 1 had fast network access to the executors but Server 2 was across a WAN then I'd expect the job to run slower from Server 2 duet to the

Re: fishing for help!

I'll check it out. On Tue, 22 Dec 2015 at 00:30 Michal Klos wrote: > If you are running on Amazon, then it's always a crapshoot as well. > > M > > On Dec 21, 2015, at 4:41 PM, Josh Rosen wrote: > > @Eran, are Server 1 and Server 2 both part of

fishing for help!

Hi, I know it is a wide question but can you think of reasons why a pyspark job which runs on from server 1 using user 1 will run faster then the same job when running on server 2 with user 1 Eran

RE: fishing for help!

id.newber...@wandcorp.com> (P) 952.361.6200 From: Eran Witkon [mailto:eranwit...@gmail.com] Sent: Monday, December 21, 2015 6:54 AM To: user Subject: fishing for help! Hi, I know it is a wide question but can you think of reasons why a pyspark job which runs on from server 1 using user 1 wil