Setting spark.executor.instances from Interpreter tab from UI simply does not take it . The setting is not shown in UI after reload/restart and its no where to be seen in the zeppelin installation directory.
$ find /home/zeppelin/incubator-zeppelin -type f -exec grep -H 'spark.executor.instances' {} \; [zeppelin@zeppelin-3529 incubator-zeppelin]$ On Sun, Aug 9, 2015 at 10:34 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> wrote: > WARNING: The following warnings have been detected with resource and/or > provider classes: > > WARNING: A HTTP GET method, public javax.ws.rs.core.Response > org.apache.zeppelin.rest.InterpreterRestApi.listInterpreter(java.lang.String), > should not consume any entity. > > Error: Could not find or load main class > =-Dspark.executor.instances=5Error: Could not find or load main class > =-Dspark.executor.instances=5 > > > How do i set spark tuning parameter > > 1) Number of executors > > 2) Memory for each executor > > 3) Spark settings > > On Sun, Aug 9, 2015 at 10:25 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> > wrote: > >> I wanted to increase the parallelsim and hence increased number of >> executors. I did >> http://goo.gl/Ww6Wpx >> and restart zeppelin server. >> >> I submitted load job and zeppelin.log shows >> >> >> Exception: >> >> ERROR [2015-08-09 10:24:41,530] ({Thread-25} >> RemoteInterpreterEventPoller.java[run]:63) - Can't get >> RemoteInterpreterEvent >> >> org.apache.zeppelin.interpreter.InterpreterException: >> org.apache.thrift.transport.TTransportException: java.net.ConnectException: >> Connection refused >> >> at >> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:53) >> >> at >> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37) >> >> at >> org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60) >> >> at >> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861) >> >> at >> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435) >> >> at >> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363) >> >> at >> org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:139) >> >> at >> org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller.run(RemoteInterpreterEventPoller.java:61) >> >> Caused by: org.apache.thrift.transport.TTransportException: >> java.net.ConnectException: Connection refused >> >> at org.apache.thrift.transport.TSocket.open(TSocket.java:185) >> >> at >> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51) >> >> ... 7 more >> >> Caused by: java.net.ConnectException: Connection refused >> >> at java.net.PlainSocketImpl.socketConnect(Native Method) >> >> at >> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) >> >> at >> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) >> >> at >> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) >> >> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) >> >> at java.net.Socket.connect(Socket.java:579) >> >> at org.apache.thrift.transport.TSocket.open(TSocket.java:180) >> >> ... 8 more >> >> -- >> Deepak >> >> > > > -- > Deepak > > -- Deepak