Agreed with Mich The spark driver is the program that declares the transformations and actions on RDDs of data and submits such requests to the master.
*spark.driver.host :* Hostname or IP address for the driver to listen on. This is used for communicating with the executors and the standalone Master. hostname -f return FQDN add this to /etc/hosts file ( http://www.tldp.org/LDP/solrhe/Securing-Optimizing-Linux-RH-Edition-v1.3/chap9sec95.html ) *Doc:* http://spark.apache.org/docs/latest/configuration.html regards, Vaquar Kha On Sun, Jun 12, 2016 at 8:27 AM, Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > Hi, > > You basically want to use wired/Ethernet connections as opposed to > wireless? > > in Your Spark Web UI under environment table what do you get for " > spark.driver.host". > > Also can you cat /etc/hosts and send the output please and the output > from ifconfig -a > > HTH > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 12 June 2016 at 14:12, East Evil <super_big_h...@sina.com> wrote: > >> Hi, guys >> >> My question is about Spark Worker IP address. >> >> I have four nodes, four nodes have Wireless module and Ethernet module, >> so all nodes have two IP addresses. >> >> When I vist the webUI, information is always displayed in the Wireless >> IP address but my Spark computing cluster based on Ethernet. >> >> I have tried “ifconfig wlan0 down” and then “start-all.sh”, the Worker IP >> address become 127.0.0.1, and then I tried “ifconfig l0 down” and the >> Worker IP address become 127.0.1.1. >> >> What should I do to make IP use the IP address of the Ethernet instead of >> the address of the wireless? >> >> Thanks >> >> Jay >> >> >> >> Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for >> Windows 10 >> >> >> > > -- Regards, Vaquar Khan +91 830-851-1500
