Re: Two spark applications listen on same port on same machine

2019-03-07 Thread Moein Hosseini
Two drivers can't be listening on port 4040 at the same time -- on the > same machine. The OS wouldn't allow it. Are they actually on different > machines or somehow different interfaces? or are you saying the reported > port is wrong? > > On Wed, Mar 6, 2019 at 12:23 PM Moein Hosseini

Two spark applications listen on same port on same machine

2019-03-06 Thread Moein Hosseini
and different application-id) but both of redirect to port number 4040 which is listen by second submitted job. I think it could be race condition in UI but found nothing in logs. Could you help me to investigate where should I look for reason? Best Regards Moein -- Moein Hosseini Data Engineer mobile

Re: [VOTE] [RESULT] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

2019-02-12 Thread Moein Hosseini
> * Joseph Bradley* > * Xiangrui Meng* > > Please watch SPARK-25994 and join future discussions there. Thanks! > > Best, > Xiangrui > -- Moein Hosseini Data Engineer mobile: +98 912 468 1859 <+98+912+468+1859> site: www.moein.xyz email: moein...@gmail.com [image:

Re: Feature request: split dataset based on condition

2019-02-02 Thread Moein Hosseini
ltiple times but it wouldn't be faster. What do you have in mind that's > different? > > On Sat, Feb 2, 2019 at 12:19 AM Moein Hosseini wrote: > >> I've seen many application need to split dataset to multiple datasets >> based on some conditions. As there is no method to do it in

Feature request: split dataset based on condition

2019-02-01 Thread Moein Hosseini
*partition* method of scala (of-course scala partition just split list into two list, but something more general can be more useful). If you think it can be helpful, I can create Jira issue and work on it to send PR. Best Regards Moein -- Moein Hosseini Data Engineer mobile: +98 912 468 1859 <

Why outdated third-parties exist on documentation?

2019-01-28 Thread Moein Hosseini
ickDB <https://github.com/sameeragarwal/blinkdb> has no commit over the last 5 years or ganglia <http://ganglia.info/> (monitoring tool) last release was in 2015. Is there any plan to use such old-school tools or we have remove them from documentation? -- Moein Hosseini Data Engineer mobil