Re: How to connect to spark remotely from java

2015-08-10 Thread Simon Elliston Ball
You don't connect to spark exactly. The spark client (running on your remote machine) submits jobs to the YARN cluster running on HDP. What you probably need is yarn-cluster or yarn-client with the yarn client configs as downloaded from the Ambari actions menu. Simon On 10 Aug 2015, at

How to connect to spark remotely from java

2015-08-10 Thread Zsombor Egyed
Hi! I want to know how can I connect to hortonworks spark from an other machine. So there is a HDP 2.2 and I want to connect to this, from remotely via java api. Do you have any suggestion? Thanks! Regards, -- *Egyed Zsombor * Junior Big Data Engineer Mobile: +36 70 320 65 81 |

Re: How to connect to spark remotely from java

2015-08-10 Thread Zsombor Egyed
Thank you for your respond! If I understand well I should get YARN cluster on server/HDP. I should start the yarn services, nodemanager, resourcemanager etc. and I also need to install a spark on my machine, write a java code, make a jar file, and submit it to the server? Am I right? On Mon,