Setting spark.executor.instances from Interpreter tab from UI simply does
not take it .
The setting is not shown in UI after reload/restart and its no where to be
seen in the zeppelin installation directory.
$ find /home/zeppelin/incubator-zeppelin -type f -exec grep -H
'spark.executor.instances' {} \;
[zeppelin@zeppelin-3529 incubator-zeppelin]$
On Sun, Aug 9, 2015 at 10:34 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> wrote:
> WARNING: The following warnings have been detected with resource and/or
> provider classes:
>
> WARNING: A HTTP GET method, public javax.ws.rs.core.Response
> org.apache.zeppelin.rest.InterpreterRestApi.listInterpreter(java.lang.String),
> should not consume any entity.
>
> Error: Could not find or load main class
> =-Dspark.executor.instances=5Error: Could not find or load main class
> =-Dspark.executor.instances=5
>
>
> How do i set spark tuning parameter
>
> 1) Number of executors
>
> 2) Memory for each executor
>
> 3) Spark settings
>
> On Sun, Aug 9, 2015 at 10:25 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com>
> wrote:
>
>> I wanted to increase the parallelsim and hence increased number of
>> executors. I did
>> http://goo.gl/Ww6Wpx
>> and restart zeppelin server.
>>
>> I submitted load job and zeppelin.log shows
>>
>>
>> Exception:
>>
>> ERROR [2015-08-09 10:24:41,530] ({Thread-25}
>> RemoteInterpreterEventPoller.java[run]:63) - Can't get
>> RemoteInterpreterEvent
>>
>> org.apache.zeppelin.interpreter.InterpreterException:
>> org.apache.thrift.transport.TTransportException: java.net.ConnectException:
>> Connection refused
>>
>> at
>> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:53)
>>
>> at
>> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
>>
>> at
>> org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60)
>>
>> at
>> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
>>
>> at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
>>
>> at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
>>
>> at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:139)
>>
>> at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller.run(RemoteInterpreterEventPoller.java:61)
>>
>> Caused by: org.apache.thrift.transport.TTransportException:
>> java.net.ConnectException: Connection refused
>>
>> at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
>>
>> at
>> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
>>
>> ... 7 more
>>
>> Caused by: java.net.ConnectException: Connection refused
>>
>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>>
>> at
>> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
>>
>> at
>> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
>>
>> at
>> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>>
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>>
>> at java.net.Socket.connect(Socket.java:579)
>>
>> at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
>>
>> ... 8 more
>>
>> --
>> Deepak
>>
>>
>
>
> --
> Deepak
>
>
--
Deepak
