[jira] [Created] (ZEPPELIN-2281) If execution of paragrah is aborted then the previous results are cleared

[Sachin Janani (JIRA)]

Sachin Janani created ZEPPELIN-2281:
---

 Summary: If execution of paragrah is aborted then the previous 
results are cleared
 Key: ZEPPELIN-2281
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2281
 Project: Zeppelin
  Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Sachin Janani
Priority: Minor


If we about the execution of paragrah then the previous results are cleared but 
this was not the case with 0.6 version .The results were kept till the new 
results are produced



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

SnappyData announces new cloud service,iSight with Apache Zeppelin

[Sachin Janani]

Hi,

Today we are launching a service called the iSight cloud (iSight is short
for instant insights), which combines elements of the platform to allow
users to create notebooks where you can run queries on your data, and
visualize the results in near real time. iSight uses 3 core elements to
pull this together:

   - The use of Spark as a data unification layer to create samples on
   external datasets or streaming datasets that are plugged into SnappyData
   (via Kafka or any other Spark supported mechanism)
   - The SnappyData Synopsis Data Engine
    which accepts queries
   routed to it and returns results orders of magnitude faster, along with
   accurate error estimates, while optionally running the full query in the
   background.
   - Apache Zeppelin  (which is fast becoming
   the de-facto choice for anything notebook related), which uses its
   SnappyData interpreter to interface with the database and return results
   and render them on the notebook

You can use iSight to build out your own analytic dashboard using SQL
queries or the Spark API (and the examples we have provided show you how to
build fairly powerful dashboards using the Synopsis Data Engine)

iSight runs on AWS (and we are launching it on Azure shortly) and for a
limited time (our black Friday special I suppose), we are offering a free
trial  where we let you
play with the demo notebooks that we have included (so that you can check
out these claims for yourself and build your own notebooks), *on our
hardware in AWS*. Check it out and give us some feedback.

Thanks,

Disabling "run all paragraphs" button on notebook

[Sachin Janani]

Hi All,
I was finding a way or property to disable 'run all paragraphs' button on
notebook but didnt find any can someone please help me and let me know if
there is any way to disable that.

Regards,
Sachin Janani

Re: Blocking message pending 10000 for blocking while executing the paragraph

[Sachin Janani]

Sorry I forgot to add the stack trace:
ERROR [2016-09-22 03:57:45,567] ({Thread-482}
NotebookServer.java[broadcast]:320) - socket error
java.io.IOException: java.util.concurrent.TimeoutException: Idle timeout
expired: 30/30 ms
at
org.eclipse.jetty.util.SharedBlockingCallback$Blocker.block(SharedBlockingCallback.java:234)
at
org.eclipse.jetty.websocket.common.BlockingWriteCallback$WriteBlocker.block(BlockingWriteCallback.java:83)
at
org.eclipse.jetty.websocket.common.WebSocketRemoteEndpoint.blockingWrite(WebSocketRemoteEndpoint.java:107)
at
org.eclipse.jetty.websocket.common.WebSocketRemoteEndpoint.sendString(WebSocketRemoteEndpoint.java:387)
at
org.apache.zeppelin.socket.NotebookSocket.send(NotebookSocket.java:69)
at
org.apache.zeppelin.socket.NotebookServer.broadcast(NotebookServer.java:318)
at
org.apache.zeppelin.socket.NotebookServer.broadcastNote(NotebookServer.java:399)
at
org.apache.zeppelin.socket.NotebookServer$ParagraphListenerImpl.afterStatusChange(NotebookServer.java:1158)
at org.apache.zeppelin.scheduler.Job.setStatus(Job.java:150)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.afterStatusChange(RemoteScheduler.java:408)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:272)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.run(RemoteScheduler.java:211)
Caused by: java.util.concurrent.TimeoutException: Idle timeout expired:
30/30 ms
at
org.eclipse.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:161)
at org.eclipse.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

On Thu, Sep 22, 2016 at 9:35 AM, Sachin Janani <sjan...@snappydata.io>
wrote:

> Hi All,
> I was working on zeppelin and my zeppelin server was running for more than
> 24 hours.I am getting "Blocking message pending 1 for blocking " error
> intermittently when running the paragraph,but after waiting for some time
> these error disappears is this a known issue?
>
>
> Regards,
> Sachin Janani
>

Blocking message pending 10000 for blocking while executing the paragraph

[Sachin Janani]

Hi All,
I was working on zeppelin and my zeppelin server was running for more than
24 hours.I am getting "Blocking message pending 1 for blocking " error
intermittently when running the paragraph,but after waiting for some time
these error disappears is this a known issue?


Regards,
Sachin Janani

Re: Adding labels to axis on built in charts

[Sachin Janani]

Thanks Moon for reply.I have created a jira for this
https://issues.apache.org/jira/browse/ZEPPELIN-1441

Regards,
Sachin Janani

On Wed, Sep 14, 2016 at 10:07 PM, moon soo Lee <m...@apache.org> wrote:

> Currently, zeppelin doesn't have options to add lables on axis in it's
> built-in charts. Do you mind file an issue for the new feature?
>
> Thanks,
> moon
>
> On Wed, Sep 14, 2016 at 12:26 AM Sachin Janani <sjan...@snappydata.io>
> wrote:
>
> > Hi All,
> > I was exploring the charts in zeppelin to find out how we can add labels
> on
> > axis in charts but didnt found any.Is there any way we can add labels to
> > build in charts in zeppelin?
> >
> >
> > Regards,
> > Sachin Janani
> >
>

[jira] [Created] (ZEPPELIN-1441) Adding labels to axis on built in charts

[Sachin Janani (JIRA)]

Sachin Janani created ZEPPELIN-1441:
---

 Summary: Adding labels to axis on built in charts
 Key: ZEPPELIN-1441
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1441
 Project: Zeppelin
  Issue Type: New Feature
  Components: front-end, GUI
Affects Versions: 0.6.1
Reporter: Sachin Janani
 Fix For: 0.7.0


Currently there is no way in zeppelin where we can add labels to axis on build 
in charts.Charts will be more readable if we have labels on axis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Adding labels to axis on built in charts

[Sachin Janani]

Hi All,
I was exploring the charts in zeppelin to find out how we can add labels on
axis in charts but didnt found any.Is there any way we can add labels to
build in charts in zeppelin?


Regards,
Sachin Janani

Re: Issues in using Remote Interpreter

[Sachin Janani]

Hi Eric,Sourav,
I tried with latest HEAD and it seems to be broken but it works properly
with zeppelin 0.6.1.

On Mon, Sep 12, 2016 at 6:53 PM, Eric Charles  wrote:

> Another more classical way to achieve this is to start the remote
> interpreter via the shell command (example `./bin/interpreter.sh -p 3034 -d
> markdown`).
>
> When I configure the markdown interpreter to connect to localhost:3034, I
> receive an thrift exception (*). My thrift server and client are normally
> compatible.
> Anyone running remote interperter with latest HEAD?
>
>
>  INFO [2016-09-12 15:22:38,530] ({pool-2-thread-2}
> SchedulerFactory.java[jobFinished]:137) - Job
> paragraph_1423836981412_-1007008116 finished by scheduler
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter2A94M5J1Z1515
> 930344
> ERROR [2016-09-12 15:22:38,714] ({qtp2076287037-51}
> ResourcePoolUtils.java[getAllResourcesExcept]:64) - Negative length:
> -2147418111
> org.apache.thrift.TApplicationException: Negative length: -2147418111
> at
> org.apache.thrift.TApplicationException.read(TApplicationException.java:
> 111)
> at org.apache.thrift.TServiceClient.receiveBase(
> TServiceClient.java:71)
> at
> org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$
> Client.recv_resourcePoolGetAll(RemoteInterpreterService.java:486)
> at
> org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$
> Client.resourcePoolGetAll(RemoteInterpreterService.java:474)
> at
> org.apache.zeppelin.resource.ResourcePoolUtils.getAllResourcesExcept(
> ResourcePoolUtils.java:58)
> at
> org.apache.zeppelin.resource.ResourcePoolUtils.getAllResources(
> ResourcePoolUtils.java:36)
> at org.apache.zeppelin.helium.Helium.suggestApp(Helium.java:153)
> at org.apache.zeppelin.rest.HeliumRestApi.suggest(
> HeliumRestApi.java:74)
> at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:483)
> at
> org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(
> AbstractInvoker.java:180)
> at
> org.apache.cxf.service.invoker.AbstractInvoker.
> invoke(AbstractInvoker.java:96)
>
>
>
> On Fri, Aug 19, 2016 at 6:47 PM, Sourav Mazumder <
> sourav.mazumde...@gmail.com> wrote:
>
> > Hi,
> >
> > From the documentation it is not very clear how exactly the remote
> > interpreter works.
> >
> > Here is what I tried. But it didn't work. I am using zeppelin 0.6.1
> binary
> > and spark 2.0.
> >
> > 1. In a remote spark cluster
> > a)  I created a spark interpreter (copying from the default spark
> > interpreter) with master as Yarn-Client
> > b). I started the same in a notebook (ensuring that this interpreter is
> > enabled) using following code -
> > import org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer
> >
> > val interpreter = new RemoteInterpreterServer(51000)
> > interpreter.start()
> > c). When I go to the yarn application manager I can see this new
> > interpreter is running. Also the log file shows that the remote
> interpreter
> > has started in 51000 port
> >
> > 2. Next in a client machine (a mac laptop) I started Zeppelin.
> > a) I created a new Spark interpreter copying from existing one. There I
> > enabled the checkbox - Connect to Existing Process and provided host ip
> and
> > port.
> > b) I have kept the master as local
> > c) Now I selected this interpreter for Zeppelin Tutorial notebook and ran
> > the same.
> > d) The first paragraph with spark interpreter (Load Data in Table) worked
> > fine. Also I saw the log in the server shows that it is successfully
> > parsing the bank table.
> > e) But the next paragraph (%sql select age, count(1) value from bank
> where
> > age < 30 group by age order by age) gives error as follwos -
> >
> > Caused by: java.lang.ClassCastException: cannot assign instance of
> > scala.collection.immutable.List$SerializationProxy to field
> > org.apache.spark.rdd.RDD.org$apache$spark$rdd$RDD$$dependencies_ of type
> > scala.collection.Seq in instance of org.apache.spark.rdd.
> MapPartitionsRDD
> >
> > at
> > java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(
> > ObjectStreamClass.java:2089)
> >
> > at
> > java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)
> >
> > at
> > java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1999)
> >
> > at
> > java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
> >
> > at
> > java.io.ObjectInputStream.readOrdinaryObject(
> ObjectInputStream.java:1801)
> >
> > at
> > java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
> >
> > at
> > java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1993)
> >
> > at
> > java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
> >
> > at
> > 

Re: Unable to run spark in zeppelin

[Sachin Janani]

Hi Sachin,
Which version of zeppelin you are running? I think the issue is due to the
version mismatch between spark and scala.

Regards,
SJ

On Sat, Sep 3, 2016 at 2:52 PM, Sachin Jain  wrote:

> Sending this to dev mailing list sine my attempt to send on users mailing
> list failed with the following error.
>
> 
> Hi. This is the qmail-send program at apache.org.
> I'm afraid I wasn't able to deliver your message to the following
> addresses.
> This is a permanent error; I've given up. Sorry it didn't work out.
>
> :
> Must be sent from an @apache.org address or a subscriber address or an
> address in LDAP.
> 
>
> -Sachin
>
> -- Forwarded message --
> From: Sachin Jain 
> Date: Sat, Sep 3, 2016 at 2:43 PM
> Subject: Unable to run spark in zeppelin
> To: us...@zeppelin.apache.org
>
>
> Hi,
>
> I have done a fresh setup of Zeppelin and when I am trying to run spark
> code (with scala), I am getting following error in logs.
>
> Please find attached log file which contains error. I am also attaching my
> notebook screenshot and the interpreter binding just in case it is helpful.
>
> Use case: Till now, I run my code in spark shell but I want to move to
> notebook experience where I can save my code snippets and run them later.
>
>

Re: [VOTE] Apache Zeppelin release 0.6.1 (rc1)

[Sachin Janani]

Hi All,
Greetings' of the Day,
I was verifying this RC build and found that Progress bar and Running % is
not working as expected.Is this the known issue?

On Wed, Aug 10, 2016 at 7:41 AM, Jianfeng (Jeff) Zhang <
jzh...@hortonworks.com> wrote:

>
> Hi Mina,
>
> Can we also include ZEPPELIN-1175 in 0.6.1 ?  As 0.6.1 support spark 2.0
> which has a fix to distribute log4j.properties to executor, so it would
> make executor log unavailable too.
> Without the AM/Executor log, it is pretty hard to do diagnose.
>
> https://issues.apache.org/jira/browse/ZEPPELIN-1175
>
>
>
> Best Regard,
> Jeff Zhang
>
>
>
>
>
> On 8/10/16, 9:00 AM, "mina lee"  wrote:
>
> >Vinay, Andrey,
> >thanks for verification.
> >
> >It makes sense what you're saying.
> >I did include ZEPPELIN-1197
> > in branch-0.6 and
> we
> >will manage ZEPPELIN-1308
> > to be included
> soon.
> >I will wait for more feedback, and then proceed next vote for rc2 as soon
> >as possible.
> >
> >On Wed, Aug 10, 2016 at 7:48 AM, Andrey Gura  wrote:
> >
> >> Guys,
> >>
> >> 0.6.1 release will bring Ignite interpreter version older than 0.6.0
> >>due to
> >> ZEPPELIN-605 (1.5.0 instead of 1.6.0).
> >>
> >> It is wrong if new release will deprive users some possibilities in
> >>Ignite
> >> interpreter.
> >>
> >> I propose include ZEPPELIN-1308 into 0.6.1 version.
> >>
> >> Thanks!
> >>
> >>
> >> On Tue, Aug 9, 2016 at 8:18 PM, Vinay Shukla 
> >> wrote:
> >>
> >> > We should pull Zeppelin-1197 into 0.6.1. Without this pull request the
> >> user
> >> > experience in Zeppelin is inferior other notebooks.
> >> >
> >> > On Tue, Aug 9, 2016 at 12:38 PM, moon soo Lee 
> wrote:
> >> >
> >> > > Thanks Vinay for verifying RC.
> >> > >
> >> > > I think it is expected behavior not printing output without using
> >> print()
> >> > > in 0.6.1. Because
> >>https://issues.apache.org/jira/browse/ZEPPELIN-1197
> >> is
> >> > > resolved for 0.7.0 and patch is only available in master branch.
> >> > >
> >> > > Thanks,
> >> > > moon
> >> > >
> >> > > On Tue, Aug 9, 2016 at 8:21 AM Vinay Shukla 
> >> > wrote:
> >> > >
> >> > > > Sorry, sent the earlier email too soon.
> >> > > >
> >> > > > -1
> >> > > >
> >> > > > The below shows no output, looks like pyspark is broken.
> >> > > >
> >> > > > %pyspark
> >> > > > sys.version
> >> > > > sc.version
> >> > > > spark.version
> >> > > >
> >> > > >
> >> > > > %pyspark
> >> > > > sc.parallelize([1,2,3]).count()
> >> > > >
> >> > > > No output
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Tue, Aug 9, 2016 at 11:13 AM, Vinay Shukla
> >> >> >
> >> > > > wrote:
> >> > > >
> >> > > > > +1 (see point 5 below, existing issue, will file a tracking
> >>issue )
> >> > > > >
> >> > > > > 1. Downloaded zeppelin-0.6.1-bin-all.tgz
> >> > > > > 2. Installed on MacOSx Yosemite
> >> > > > > 3. Ran Zeppelin Tutorial successfully
> >> > > > > 4. Created a new note & validated spark 2.0 with sc.version &
> >> > > > spark.version
> >> > > > > 5. Searched for newly created note under a folder, exact name
> >> search
> >> > > > > works, wildcard name search fails.
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > > On Tue, Aug 9, 2016 at 10:40 AM, mina lee 
> >> > wrote:
> >> > > > >
> >> > > > >> Hi folks,
> >> > > > >>
> >> > > > >> I propose the following RC to be released for the Apache
> >>Zeppelin
> >> > > 0.6.1
> >> > > > >> release.
> >> > > > >>
> >> > > > >> The commit id is 09cd1f18bca04991610dce42de038c8d4c3c0a8d
> which
> >> is
> >> > > > >> corresponds
> >> > > > >> to the tag v0.6.1-rc1:
> >> > > > >> *https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=
> >> > > > >> commit;h=09cd1f18bca04991610dce42de038c8d4c3c0a8d
> >> > > > >>  >> > > > >> commit;h=09cd1f18bca04991610dce42de038c8d4c3c0a8d>*
> >> > > > >>
> >> > > > >> The release archives (tgz), signature, and checksums are here
> >> > > > >> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.
> >> 6.1-rc1/
> >> > > > >>
> >> > > > >> The release candidate consists of the following source
> >> distribution
> >> > > > >> archive
> >> > > > >> zeppelin-0.6.1.tgz
> >> > > > >>
> >> > > > >> In addition, the following supplementary binary distributions
> >>are
> >> > > > provided
> >> > > > >> for user convenience at the same location
> >> > > > >> zeppelin-0.6.1-bin-all.tgz
> >> > > > >> zeppelin-0.6.1-netinst-all.tgz
> >> > > > >>
> >> > > > >> The maven artifacts are here
> >> > > > >> https://repository.apache.org/content/repositories/
> >> > > > >> orgapachezeppelin-1014/org/apache/zeppelin/
> >> > > > >>
> >> > > > >> You can find the KEYS file here:
> >> > > > >> https://people.apache.org/keys/committer/minalee.asc
> >> > > > >>
> >> > > > >> 

Re: [VOTE] Apache Zeppelin release 0.6.1 (rc1)

[Sachin Janani]

Its working properly for Spark interpreter but not for JDBC

On Fri, Aug 12, 2016 at 9:42 AM, Sachin Janani <sjan...@snappydata.io>
wrote:

> Hi All,
> Greetings' of the Day,
> I was verifying this RC build and found that Progress bar and Running % is
> not working as expected.Is this the known issue?
>
> On Wed, Aug 10, 2016 at 7:41 AM, Jianfeng (Jeff) Zhang <
> jzh...@hortonworks.com> wrote:
>
>>
>> Hi Mina,
>>
>> Can we also include ZEPPELIN-1175 in 0.6.1 ?  As 0.6.1 support spark 2.0
>> which has a fix to distribute log4j.properties to executor, so it would
>> make executor log unavailable too.
>> Without the AM/Executor log, it is pretty hard to do diagnose.
>>
>> https://issues.apache.org/jira/browse/ZEPPELIN-1175
>>
>>
>>
>> Best Regard,
>> Jeff Zhang
>>
>>
>>
>>
>>
>> On 8/10/16, 9:00 AM, "mina lee" <mina...@apache.org> wrote:
>>
>> >Vinay, Andrey,
>> >thanks for verification.
>> >
>> >It makes sense what you're saying.
>> >I did include ZEPPELIN-1197
>> ><https://issues.apache.org/jira/browse/ZEPPELIN-1197> in branch-0.6 and
>> we
>> >will manage ZEPPELIN-1308
>> ><https://issues.apache.org/jira/browse/ZEPPELIN-1308> to be included
>> soon.
>> >I will wait for more feedback, and then proceed next vote for rc2 as soon
>> >as possible.
>> >
>> >On Wed, Aug 10, 2016 at 7:48 AM, Andrey Gura <ag...@gridgain.com> wrote:
>> >
>> >> Guys,
>> >>
>> >> 0.6.1 release will bring Ignite interpreter version older than 0.6.0
>> >>due to
>> >> ZEPPELIN-605 (1.5.0 instead of 1.6.0).
>> >>
>> >> It is wrong if new release will deprive users some possibilities in
>> >>Ignite
>> >> interpreter.
>> >>
>> >> I propose include ZEPPELIN-1308 into 0.6.1 version.
>> >>
>> >> Thanks!
>> >>
>> >>
>> >> On Tue, Aug 9, 2016 at 8:18 PM, Vinay Shukla <vinayshu...@gmail.com>
>> >> wrote:
>> >>
>> >> > We should pull Zeppelin-1197 into 0.6.1. Without this pull request
>> the
>> >> user
>> >> > experience in Zeppelin is inferior other notebooks.
>> >> >
>> >> > On Tue, Aug 9, 2016 at 12:38 PM, moon soo Lee <m...@apache.org>
>> wrote:
>> >> >
>> >> > > Thanks Vinay for verifying RC.
>> >> > >
>> >> > > I think it is expected behavior not printing output without using
>> >> print()
>> >> > > in 0.6.1. Because
>> >>https://issues.apache.org/jira/browse/ZEPPELIN-1197
>> >> is
>> >> > > resolved for 0.7.0 and patch is only available in master branch.
>> >> > >
>> >> > > Thanks,
>> >> > > moon
>> >> > >
>> >> > > On Tue, Aug 9, 2016 at 8:21 AM Vinay Shukla <vinayshu...@gmail.com
>> >
>> >> > wrote:
>> >> > >
>> >> > > > Sorry, sent the earlier email too soon.
>> >> > > >
>> >> > > > -1
>> >> > > >
>> >> > > > The below shows no output, looks like pyspark is broken.
>> >> > > >
>> >> > > > %pyspark
>> >> > > > sys.version
>> >> > > > sc.version
>> >> > > > spark.version
>> >> > > >
>> >> > > >
>> >> > > > %pyspark
>> >> > > > sc.parallelize([1,2,3]).count()
>> >> > > >
>> >> > > > No output
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > On Tue, Aug 9, 2016 at 11:13 AM, Vinay Shukla
>> >><vinayshu...@gmail.com
>> >> >
>> >> > > > wrote:
>> >> > > >
>> >> > > > > +1 (see point 5 below, existing issue, will file a tracking
>> >>issue )
>> >> > > > >
>> >> > > > > 1. Downloaded zeppelin-0.6.1-bin-all.tgz
>> >> > > > > 2. Installed on MacOSx Yosemite
>> >> > > > > 3. Ran Zeppelin Tutorial successfully
>> >> > > > > 4. Created a new note & validated spark 2.0 with sc.version &am

Re: Invalid ticket error fills up zeppelin log when anoymous access if

[Sachin Janani]

I also saw the same bug.It occurs when shiro authentication was enabled and
someone tries to change interpreter settings.This stacktrace is more
frequent and never stops.In spite of this everything works fine.It seems
like a bug

On Thu, Aug 4, 2016 at 5:09 AM, Weipu Zhao  wrote:

> Hi,
>
> When I play around with Zeppelin 0.6.0 release with Shiro following
> instructions in here
> ,
> if
> I just open the home page but don't login, I see the following ERROR
> message keep show up periodically (every 10s) in zeppelin log, which could
> potentially fill up this log file with this same error and make it really
> hard to trace the real error message:
>
>
> ERROR [2016-08-03 16:34:09,471] ({qtp636329330-37}
> NotebookServer.java[onMessage]:211) - Can't handle message
> java.lang.Exception: Invalid ticket  !=
> 5d56af6b-a49c-4dc1-9723-abf47876c389
> at
>
> org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:117)
> at
>
> org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:56)
> at
>
> org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
> at
>
> org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69)
> at
>
> org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65)
> at
>
> org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
> at
>
> org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161)
> at
>
> org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309)
> at
>
> org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214)
> at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220)
> at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258)
> at
>
> org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632)
> at
>
> org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480)
> at
> org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
> at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
> at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
> at java.lang.Thread.run(Thread.java:745)
>
>
> Am I missing some configurations? Is this expected? I'm happy to file a bug
> for this.
>
> Thanks,
> Weipu
>

Re: Garbage collection in Spark interpreter

[Sachin Janani]

Thanks Moon. It means that this is the issue with the scala interpreter
itself.

Regards,
-Sachin
On Jul 30, 2016 04:48, "moon soo Lee" <m...@apache.org> wrote:

> Hi,
>
> Here's related issue.
> https://issues.scala-lang.org/browse/SI-4331
>
> Restart interpreter will be the only way to release memory.
> It looks like there're some unreleased memory for keeping variable and
> generated class, even if you're manually releasing reference to the object,
> like
>
> var myObject = new MyObject
> 
> myObject = null
>
> Thanks,
> moon
>
>
> On Mon, Jul 25, 2016 at 10:48 PM Sachin Janani <sjan...@snappydata.io>
> wrote:
>
> > Hi All,
> > I was looking into the spark interpreter code to understand how it works
> > and found that it is using Spark REPL for executing scala code.As per my
> > understanding spark REPL will not do GC unless we restart the
> > interpreter.So my question here is
> > 1) if we are using Spark interpreter will the variables that we create
> will
> > ever be destroyed without restarting the interpreter?
> > 2) Have someone faced any issue related to GC in interpreter process
> > before?
> >
> >
> > Thanks and Regards,
> > Sachin J
> >
>

[jira] [Created] (ZEPPELIN-1234) Zeppelin server will wait indefinitely while restarting the already executing remote interpreter

[Sachin Janani (JIRA)]

Sachin Janani created ZEPPELIN-1234:
---

 Summary: Zeppelin server will wait indefinitely while restarting 
the already executing remote interpreter
 Key: ZEPPELIN-1234
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1234
 Project: Zeppelin
  Issue Type: Bug
  Components: zeppelin-interpreter
Affects Versions: 0.6.0
Reporter: Sachin Janani
Assignee: Sachin Janani
Priority: Minor
 Fix For: 0.6.1


As the life cycle of existing remote interpreter is controlled by user if may 
happen that zeppelin server will wait indefinitely while restarting the already 
executing remote interpreter 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Garbage collection in Spark interpreter

[Sachin Janani]

Hi All,
I was looking into the spark interpreter code to understand how it works
and found that it is using Spark REPL for executing scala code.As per my
understanding spark REPL will not do GC unless we restart the
interpreter.So my question here is
1) if we are using Spark interpreter will the variables that we create will
ever be destroyed without restarting the interpreter?
2) Have someone faced any issue related to GC in interpreter process before?


Thanks and Regards,
Sachin J

[jira] [Created] (ZEPPELIN-1196) Connecting to already running remote interpreter process with multiple interpreters in a group throws exception

[Sachin Janani (JIRA)]

Sachin Janani created ZEPPELIN-1196:
---

 Summary: Connecting to already running remote interpreter process 
with multiple interpreters in a group throws exception
 Key: ZEPPELIN-1196
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1196
 Project: Zeppelin
  Issue Type: Bug
  Components: zeppelin-interpreter
Affects Versions: 0.6.0
Reporter: Sachin Janani
Assignee: Sachin Janani
 Fix For: 0.6.1


Connecting to already running remote interpreter process with multiple 
interpreters in a group throws IllegalThreadException.Following is the stack 
trace:
{code}
java.lang.IllegalThreadStateException
at java.lang.Thread.start(Thread.java:705)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.reference(RemoteInterpreterProcess.java:174)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:155)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:207)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:279)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at 
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:328)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Actual execution time is not getting displayed in paragraph

[Sachin Janani]

Ok will create a issue and if possible submit a patch for this

Thanks,
SJ

On Tue, Jul 12, 2016 at 8:09 PM, Hyung Sung Shim <hss...@nflabs.com> wrote:

> Yea. It seems you're right.
> You can create issue for this.
>
> 2016-07-12 23:26 GMT+09:00 Sachin Janani <sjan...@snappydata.io>:
>
> > But i think this changes are overridden by
> > https://github.com/apache/zeppelin/pull/862 and the number of seconds
> are
> > not visible now
> >
> > On Tue, Jul 12, 2016 at 7:48 PM, Hyung Sung Shim <hss...@nflabs.com>
> > wrote:
> >
> > > Hi.
> > > Yes it's a known behaviour maybe since
> > > https://github.com/apache/zeppelin/pull/848.
> > >
> > > 2016-07-12 21:49 GMT+09:00 Sachin Janani <sjan...@snappydata.io>:
> > >
> > > > Hi All,
> > > > In the latest release of zeppelin it seems that the actual task
> > execution
> > > > time is not displayed on the paragraph which was previously working
> > > > properly.
> > > > After looking into the code I found that  it has been replaced with
> > > > Moment.js which shows length of time as string ,something like "Took
> a
> > > few
> > > > seconds" but not exactly the number of seconds .
> > > > Is this a know behaviour?
> > > >
> > > >
> > > > Thanks and Regards,
> > > > Sachin Janani
> > > >
> > >
> >
>

Re: Actual execution time is not getting displayed in paragraph

[Sachin Janani]

But i think this changes are overridden by
https://github.com/apache/zeppelin/pull/862 and the number of seconds are
not visible now

On Tue, Jul 12, 2016 at 7:48 PM, Hyung Sung Shim <hss...@nflabs.com> wrote:

> Hi.
> Yes it's a known behaviour maybe since
> https://github.com/apache/zeppelin/pull/848.
>
> 2016-07-12 21:49 GMT+09:00 Sachin Janani <sjan...@snappydata.io>:
>
> > Hi All,
> > In the latest release of zeppelin it seems that the actual task execution
> > time is not displayed on the paragraph which was previously working
> > properly.
> > After looking into the code I found that  it has been replaced with
> > Moment.js which shows length of time as string ,something like "Took a
> few
> > seconds" but not exactly the number of seconds .
> > Is this a know behaviour?
> >
> >
> > Thanks and Regards,
> > Sachin Janani
> >
>

Actual execution time is not getting displayed in paragraph

[Sachin Janani]

Hi All,
In the latest release of zeppelin it seems that the actual task execution
time is not displayed on the paragraph which was previously working
properly.
After looking into the code I found that  it has been replaced with
Moment.js which shows length of time as string ,something like "Took a few
seconds" but not exactly the number of seconds .
Is this a know behaviour?


Thanks and Regards,
Sachin Janani

Re: Running Interpreter on Remote Machine

[Sachin Janani]

Thanks moon for quick reply. Are there any plans to implement this proposal
in 0.6 version.

Regards,
-Sachin Janani
On May 31, 2016 22:55, "moon soo Lee" <m...@apache.org> wrote:

> Hi Sachin Janani,
>
> There're no special reason that interpreter runs only on the localhost,
> except for current interpreter starting mechanism support only localhost.
>
> So there should be code modification. RemoteInterpreterProcess.java[1] and
> bin/interpreter.sh[2] are directly related codes.
>
> Also you might want to check this proposal [3].
>
> Thanks,
> moon
>
> [1]
>
> https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterProcess.java
> [2]
> https://github.com/apache/incubator-zeppelin/blob/master/bin/interpreter.sh
> [3]
>
> https://cwiki.apache.org/confluence/display/ZEPPELIN/Cluster+Manager+Proposal
>
>
> On Tue, May 31, 2016 at 10:10 AM Sachin Janani <sjan...@snappydata.io>
> wrote:
>
> > Hi,
> > I am writing a custom interpreter for one of the service for which I
> > want the remote interpreter to be started on some remote machine
> > (other than localhost). Also we have a usecase wherein our service
> > will start interpreter before zeppelin server.But after looking to the
> > zeppelin code I found that RemoteInterpreterProcess.java starts
> > interpreter only on the localhost i.e the machine on which zeppelin
> > server is running and also there I didnt found anyway where zeppelin
> > can connect to the RemoteInterpreter instead of starting a new one.
> > My question here is,
> > a) was there any specific reason because of which interpreter was
> > started on localhost?
> > b) Is there any way we can allow zeppelin server to connect to already
> > running remote interpreter ?
> >
> > Thanks,
> > Sachin Janani
> >
>

Running Interpreter on Remote Machine

[Sachin Janani]

Hi,
I am writing a custom interpreter for one of the service for which I
want the remote interpreter to be started on some remote machine
(other than localhost). Also we have a usecase wherein our service
will start interpreter before zeppelin server.But after looking to the
zeppelin code I found that RemoteInterpreterProcess.java starts
interpreter only on the localhost i.e the machine on which zeppelin
server is running and also there I didnt found anyway where zeppelin
can connect to the RemoteInterpreter instead of starting a new one.
My question here is,
a) was there any specific reason because of which interpreter was
started on localhost?
b) Is there any way we can allow zeppelin server to connect to already
running remote interpreter ?

Thanks,
Sachin Janani