Re: [VOTE] Release Apache Zeppelin 0.10.0 (RC1)
+1 Paul Brenner Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Aug 12, 2021, 3:07 AM -0500, Fernando Barreiro Lostres , wrote: > +1 > Fernando Barreiro > Software developer > www.sonoc.io > This e-mail is for the exclusive use of its recipients and may contain > business secrets or other confidential or privileged information. Any > unauthorised use, copying, publication or distribution of this e-mail is > strictly prohibited. If you are not the intended recipient, please inform us > immediately by replying to this e-mail and delete it, including any > attachments or copies on your system. > > In accordance with the GDPR (EU) 2016/679 and the LOPDGDD 3/2018, we inform > you that this e-mail address and/or any other personal data you have provided > us with will be treated by SONOC with absolute confidentiality and with the > only purpose of providing you with the requested services, due to your > condition as a client, supplier or because you have requested information > from us at any time. These data will only be kept for as long as required to > comply with legal obligations. You can exercise your rights at any time by > sending an e-mail to: dataprotect...@sonoc.io. > El 12/8/21 a las 7:57, Surjan S Rawat escribió: > > +1 > > > > > On Wed, Aug 11, 2021 at 9:05 PM Jeff Zhang wrote: > > > > > > > > Hi folks, > > > > > > > > I propose the following RC to be released for the Apache Zeppelin > > > > 0.10.0 release. > > > > > > > > > > > > The commit id is 14cc810812ef2bd29a2c41ba37caa20f1aa3f3bc : > > > > https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=commit;h=14cc810812ef2bd29a2c41ba37caa20f1aa3f3bc > > > > This corresponds to the tag: v0.10.0-rc1 : > > > > https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.10.0-rc1 > > > > The release archives (tgz), signature, and checksums are here > > > > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.10.0-rc1/ > > > > > > > > The release candidate consists of the following source distribution > > > > archive > > > > zeppelin-0.10.0.tgz > > > > > > > > In addition, the following supplementary binary distributions are > > > > provided > > > > for user convenience at the same location > > > > zeppelin-0.10.0-bin-all.tgz > > > > > > > > > > > > The maven artifacts are here > > > > https://repository.apache.org/content/repositories/orgapachezeppelin-1291/org/apache/zeppelin/ > > > > > > > > You can find the KEYS file here: > > > > https://dist.apache.org/repos/dist/release/zeppelin/KEYS > > > > > > > > Release notes available at > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12349536&styleName=&projectId=12316221 > > > > Vote will be open for next 72 hours (close at 10PM 14/Aug PDT). > > > > > > > > [ ] +1 approve > > > > [ ] 0 no opinion > > > > [ ] -1 disapprove (and reason why) > > > > -- > > > > Best Regards > > > > > > > > Jeff Zhang
Re: [DISCUSS] Releasing 0.9.1
We have been having more and more trouble getting builds from source working so would love a new release. Paul Brenner Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Jul 5, 2021, 10:46 AM -0400, Jeff Zhang , wrote: > Hi Folks, > > It has been about half year since the last release of 0.9.0, after that we > have many fixes and improvements, what do you think of the release of 0.9.1 ? > > -- > Best Regards > > Jeff Zhang
Re: cluster mode is broken on latest build from source
Thanks for looking into this, ticket created here:
https://issues.apache.org/jira/browse/ZEPPELIN-5310
Paul Brenner
Head of Data Science
pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com
twitter @placeiq linkedin /placeiq
On Apr 2, 2021, 10:48 AM -0400, Paul Brenner , wrote:
>
> "spark_paul": {
> "id": "spark_paul",
> "name": "spark_paul",
> "group": "spark",
> "properties": {
> "SPARK_HOME": {
> "name": "SPARK_HOME",
> "value": "",
> "type": "string",
> "description": "Location of spark distribution"
> },
> "spark.master": {
> "name": "spark.master",
> "value": "yarn",
> "type": "string",
> "description": "Spark master uri. local | yarn-client | yarn-cluster | spark
> master address of standalone mode, ex) spark://master_host:7077"
> },
> "spark.submit.deployMode": {
> "name": "spark.submit.deployMode",
> "value": "client",
> "type": "string",
> "description": "The deploy mode of Spark driver program, either \"client\"
> or \"cluster\", Which means to launch driver program locally (\"client\") or
> remotely (\"cluster\") on one of the nodes inside the cluster."
> },
> "spark.app.name": {
> "name": "spark.app.name",
> "value": "zeppelin_dev_paul",
> "type": "string",
> "description": "The name of spark application."
> },
> "spark.driver.cores": {
> "name": "spark.driver.cores",
> "value": "1",
> "type": "number",
> "description": "Number of cores to use for the driver process, only in
> cluster mode."
> },
> "spark.driver.memory": {
> "name": "spark.driver.memory",
> "value": "5g",
> "type": "string",
> "description": "Amount of memory to use for the driver process, i.e. where
> SparkContext is initialized, in the same format as JVM memory strings with a
> size unit suffix (\"k\", \"m\", \"g\" or \"t\") (e.g. 512m, 2g)."
> },
> "spark.executor.cores": {
> "name": "spark.executor.cores",
> "value": "1",
> "type": "number",
> "description": "The number of cores to use on each executor"
> },
> "spark.executor.memory": {
> "name": "spark.executor.memory",
> "value": "3g",
> "type": "string",
> "description": "Executor memory per worker instance. ex) 512m, 32g"
> },
> "spark.executor.instances": {
> "name": "spark.executor.instances",
> "value": "2",
> "type": "number",
> "description": "The number of executors for static allocation."
> },
> "spark.files": {
> "name": "spark.files",
> "value": "",
> "type": "string",
> "description": "Comma-separated list of files to be placed in the working
> directory of each executor. Globs are allowed."
> },
> "spark.jars": {
> "name": "spark.jars",
> "value":
> "http://nexus.placeiq.net:8081/nexus/content/repositories/releases/com/placeiq/lap/4.1.25/lap-4.1.25.jar,hdfs://gandalf-nn.placeiq.net/lib/dap/0.1.0/dap-jar-assembled.jar";;,
> "type": "string",
> "description": "Comma-separated list of jars to include on the driver and
> executor classpaths. Globs are allowed."
> },
> "spark.jars.packages": {
> "name": "spark.jars.packages",
> "value": "ds-commons:ds-commons_2.11:0.1-SNAPSHOT",
> "type": "string",
> "description": "Comma-separated list of Maven coordinates of jars to include
> on the driver and executor classpaths. The coordinates should be
> groupId:artifactId:version. If spark.jars.ivySettings is given artifacts will
> be resolved according to the configuration in the file, otherwise artifacts
> will be searched for in the local maven repo, then maven central and
Re: cluster mode is broken on latest build from source
uot;string",
"description": "R binary executable path"
},
"zeppelin.R.image.width": {
"name": "zeppelin.R.image.width",
"value": "100%",
"type": "number",
"description": "Image width of R plotting"
},
"zeppelin.R.render.options": {
"name": "zeppelin.R.render.options",
"value": "out.format \u003d \u0027html\u0027, comment \u003d NA, echo \u003d
FALSE, results \u003d \u0027asis\u0027, message \u003d F, warning \u003d F,
fig.retina \u003d 2",
"type": "textarea",
"description": ""
},
"zeppelin.kotlin.shortenTypes": {
"name": "zeppelin.kotlin.shortenTypes",
"value": true,
"type": "checkbox",
"description": "Show short types instead of full, e.g. List\u003cString\u003e
or kotlin.collections.List\u003ckotlin.String\u003e"
},
"spark.dynamicAllocation.executorIdleTimeout": {
"name": "spark.dynamicAllocation.executorIdleTimeout",
"value": "2m",
"type": "textarea"
},
"spark.dynamicAllocation.enabled": {
"name": "spark.dynamicAllocation.enabled",
"value": "true",
"type": "textarea"
},
"spark.dynamicAllocation.minExecutors": {
"name": "spark.dynamicAllocation.minExecutors",
"value": "4",
"type": "textarea"
},
"spark.shuffle.service.enabled": {
"name": "spark.shuffle.service.enabled",
"value": "true",
"type": "textarea"
},
"spark.yarn.queue": {
"name": "spark.yarn.queue",
"value": "pbrenner",
"type": "textarea"
},
"spark.dynamicAllocation.cachedExecutorIdleTimeout": {
"name": "spark.dynamicAllocation.cachedExecutorIdleTimeout",
"value": "2m",
"type": "textarea"
},
"spark.jars.repositories": {
"name": "spark.jars.repositories",
"value": "http://nexus.placeiq.net:8081/nexus/content/repositories/snapshots";;,
"type": "textarea"
},
"spark.executor.memoryOverhead": {
"name": "spark.executor.memoryOverhead",
"value": "4g",
"type": "textarea"
},
"zeppelin.interpreter.connect.timeout": {
"name": "zeppelin.interpreter.connect.timeout",
"value": "30",
"type": "textarea"
}
},
"status": "READY",
"interpreterGroup": [
{
"name": "spark",
"class": "org.apache.zeppelin.spark.SparkInterpreter",
"defaultInterpreter": true,
"editor": {
"language": "scala",
"editOnDblClick": false,
"completionKey": "TAB",
"completionSupport": true
}
},
{
"name": "sql",
"class": "org.apache.zeppelin.spark.SparkSqlInterpreter",
"defaultInterpreter": false,
"editor": {
"language": "sql",
"editOnDblClick": false,
"completionKey": "TAB",
"completionSupport": true
}
},
{
"name": "pyspark",
"class": "org.apache.zeppelin.spark.PySparkInterpreter",
"defaultInterpreter": false,
"editor": {
"language": "python",
"editOnDblClick": false,
"completionKey": "TAB",
"completionSupport": true
}
},
{
"name": "ipyspark",
"class": "org.apache.zeppelin.spark.IPySparkInterpreter",
"defaultInterpreter": false,
"editor": {
"language": "python",
"editOnDblClick": false,
"completionSupport": true,
"completionKey": "TAB"
}
},
{
"name": "r",
"class": "org.apache.zeppelin.spark.SparkRInterpreter",
"defaultInterpreter": false,
"editor": {
"language": "r",
"editOnDblClick": false,
"completionSupport": false,
"completionKey": "TAB"
}
},
{
"name": "ir",
"class": "org.apache.zeppelin.spark.SparkIRInterpreter",
"defaultInterpreter": false,
"editor": {
"language": "r",
"editOnDblClick": false,
"completionSupport": true,
"completionKey": "TAB"
}
},
{
"
cluster mode is broken on latest build from source
We just built from the latest source code today to help test the problem in this open ticket. Unfortunately, cluster mode now appears broken (client mode seems to work fine). We see the following error when tryin to start any interpreter in cluster mode: org.apache.zeppelin.interpreter.InterpreterException: java.io.IOException: Fail to set additional jars for spark interpreter at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:129) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:271) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:442) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:71) at org.apache.zeppelin.scheduler.Job.run(Job.java:172) at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:132) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:182) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: Fail to set additional jars for spark interpreter at org.apache.zeppelin.interpreter.launcher.SparkInterpreterLauncher.buildEnvFromProperties(SparkInterpreterLauncher.java:163) at org.apache.zeppelin.interpreter.launcher.StandardInterpreterLauncher.launchDirectly(StandardInterpreterLauncher.java:77) at org.apache.zeppelin.interpreter.launcher.InterpreterLauncher.launch(InterpreterLauncher.java:110) at org.apache.zeppelin.interpreter.InterpreterSetting.createInterpreterProcess(InterpreterSetting.java:847) at org.apache.zeppelin.interpreter.ManagedInterpreterGroup.getOrCreateInterpreterProcess(ManagedInterpreterGroup.java:66) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getOrCreateInterpreterProcess(RemoteInterpreter.java:104) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:154) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:126) ... 13 more Caused by: java.io.IOException: Cannot run program "null/bin/spark-submit": error=2, No such file or directory at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048) at org.apache.zeppelin.interpreter.launcher.SparkInterpreterLauncher.detectSparkScalaVersion(SparkInterpreterLauncher.java:233) at org.apache.zeppelin.interpreter.launcher.SparkInterpreterLauncher.buildEnvFromProperties(SparkInterpreterLauncher.java:127) ... 20 more Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.(UNIXProcess.java:247) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029) ... 22 more I’m actually not sure, what is the best way to report and work with devs on an error like this? Should I open a ticket? Post in the slack? Send an email to the user list like I’m doing? I’d like to learn to be a better citizen in this community. Thanks! Paul Brenner Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
Access z.show table data in spark
I often find myself using z.show() to see some portion of a dataframe and then realizing that I want to use some of the values from that table in my next paragraph of code. For example, I may show a table of Lat/Longs and then once I look at it realize that I want to next filter a data frame for the Lat/Long that showed up in the first row. Is there currently or could there ever be a way to access those values in code? Currently the best I can do is click into the values to copy them and then paste them out. Alternately since I’m using spark I can re-run the query to collect those values out to a variable but that isn’t practical for long running queries. This is probably a long shot but there is a lot zeppelin is capable of that I don’t know about so figured it was worth asking. Also, something about the way z.show() tables are shown makes it really frustrating to copy and paste (I can’t select values in tables unless I click on them a few times) Paul Brenner Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
RE: passing extra data dynamically to spark job
I don’t think you can just email the list with the word “unsubscribe”. I’m not sure why people keep doing that (not saying you did this but a lot of people do). On the other hand if you go here: https://zeppelin.apache.org/community.html there is a link to unsubscribe next to “Users”. Basically it just creates an email for you to the address users-unsubscr...@zeppelin.apache.org which should do the trick. PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Nov 5, 2019, 4:39 PM -0500, Queimado, Fernando (Nokia - PT/Amadora) , wrote: > Hello > I already sent several “unsubscribe” mails, but I am not able to be removed > from this distribution list. > Can you please let me know how can I be removed? > Thank you > > From: Jeff Zhang > Sent: Saturday, November 2, 2019 6:05 AM > To: users > Subject: Re: passing extra data dynamically to spark job > > Could you be more specific what kind of data you want to pass to spark job, > to spark driver or to spark executor ? Giving an example would be very > helpful. > > mhd wrk 于2019年11月2日周六 上午2:38写道： > > What's the best way in zeppelin to pass extra data (e.g. stored in current > > user's session) to spark job? > > > -- > Best Regards > > Jeff Zhang
Re: Any way to diagnose TTransportException errors?
Thanks all, I will try 0.9 and report back. PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Sep 5, 2019, 5:52 AM -0400, James Srinivasan , wrote: > I had to use 0.9.1 due to using Accumulo 1.7 (which requires 0.9.1) in some > extra JARs I wanted to use with Spark. In the end, I built Zeppelin > specifying 0.9.1 and it worked for me. > > > On Wed, 4 Sep 2019 at 16:38, Paul Brenner wrote: > > > It looks like we do have two versions: > > > > > > ./zeppelin/spark/spark-dependencies/target/spark-2.4.0/pom.xml: > > > 0.9.3 > > > > > > ./zeppelin/pom.xml: 0.9.2 > > > > > > I’m always hesitant to rebuild blindly with changes. Did you align your > > > versions to 0.9.3 and have success? Can anyone weigh in on this > > > discrepancy? > > > 11:33 AM > > > ./zeppelin/pom.xml:0.9.2 > > > > > > > > > > > > PAUL BRENNER > > > Head of Data Science > > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com > > > twitter @placeiq linkedin /placeiq > > > On Sep 4, 2019, 7:57 AM -0400, James Srinivasan > > > , wrote: > > > > Is there a chance you have differing versions of libthrift on your > > > > classpath? I've seen errors (admittedly not looking like yours) for > > > > that reason? > > > > > > > > James > > > > > > > > > On Sun, 1 Sep 2019 at 00:57, Paul Brenner > > > > > wrote: > > > > > > We are using a recent build post 0.81 so 0.82? > > > > > > > > > > > > Restarting the interpreter helps in 75% of the cases, but the > > > > > > remaining few just won’t recover until we shut everything down and > > > > > > restart all if zeppelin. I suspect there is some other process that > > > > > > we aren’t identifying that needs killing. > > > > > > > > > > > > > > > > > > > > > > > > PAUL BRENNER > > > > > > Head of Data Science > > > > > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com > > > > > > twitter @placeiq linkedin /placeiq > > > > > > On Aug 31, 2019, 7:50 PM -0400, Jeff Zhang , > > > > > > wrote: > > > > > > > Which version do you use ? And does restarting interpreter work > > > > > > > for you ? > > > > > > > > > > > > > > > Paul Brenner 于2019年8月30日周五 下午11:45写道： > > > > > > > > > We run into the error pasted below semi-regularly and often > > > > > > > > > the only solution is to do a full restart of zeppelin to get > > > > > > > > > the user/notebook back up and running. I’m at a loss of where > > > > > > > > > to even look to try to debug this or address it. Anyone have > > > > > > > > > any ideas or any way to point me in the right direction? > > > > > > > > > > > > > > > > > > This is what the notebook shows: > > > > > > > > > org.apache.thrift.transport.TTransportException at > > > > > > > > > org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) > > > > > > > > > at > > > > > > > > > org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) > > > > > > > > > at > > > > > > > > > org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) > > > > > > > > > at > > > > > > > > > org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) > > > > > > > > > at > > > > > > > > > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) > > > > > > > > > at > > > > > > > > > org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) > > > > > > > > > at > > > > > > > > > org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_interpret(RemoteInterpreterService.java:274) > > > > > > > > > at > > > > > > > > > org.apache.zeppelin.interpreter.thrift.RemoteI
Re: Any way to diagnose TTransportException errors?
It looks like we do have two versions: ./zeppelin/spark/spark-dependencies/target/spark-2.4.0/pom.xml: 0.9.3 ./zeppelin/pom.xml: 0.9.2 I’m always hesitant to rebuild blindly with changes. Did you align your versions to 0.9.3 and have success? Can anyone weigh in on this discrepancy? 11:33 AM ./zeppelin/pom.xml:0.9.2 PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Sep 4, 2019, 7:57 AM -0400, James Srinivasan , wrote: > Is there a chance you have differing versions of libthrift on your classpath? > I've seen errors (admittedly not looking like yours) for that reason? > > James > > > On Sun, 1 Sep 2019 at 00:57, Paul Brenner wrote: > > > We are using a recent build post 0.81 so 0.82? > > > > > > Restarting the interpreter helps in 75% of the cases, but the remaining > > > few just won’t recover until we shut everything down and restart all if > > > zeppelin. I suspect there is some other process that we aren’t > > > identifying that needs killing. > > > > > > > > > > > > PAUL BRENNER > > > Head of Data Science > > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com > > > twitter @placeiq linkedin /placeiq > > > On Aug 31, 2019, 7:50 PM -0400, Jeff Zhang , wrote: > > > > Which version do you use ? And does restarting interpreter work for you > > > > ? > > > > > > > > > Paul Brenner 于2019年8月30日周五 下午11:45写道： > > > > > > We run into the error pasted below semi-regularly and often the > > > > > > only solution is to do a full restart of zeppelin to get the > > > > > > user/notebook back up and running. I’m at a loss of where to even > > > > > > look to try to debug this or address it. Anyone have any ideas or > > > > > > any way to point me in the right direction? > > > > > > > > > > > > This is what the notebook shows: > > > > > > org.apache.thrift.transport.TTransportException at > > > > > > org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) > > > > > > at > > > > > > org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) > > > > > > at > > > > > > org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) > > > > > > at > > > > > > org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) > > > > > > at > > > > > > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) > > > > > > at > > > > > > org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) > > > > > > at > > > > > > org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_interpret(RemoteInterpreterService.java:274) > > > > > > at > > > > > > org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:258) > > > > > > at > > > > > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter$4.call(RemoteInterpreter.java:233) > > > > > > at > > > > > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter$4.call(RemoteInterpreter.java:229) > > > > > > at > > > > > > org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:135) > > > > > > at > > > > > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:228) > > > > > > at > > > > > > org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:437) > > > > > > at org.apache.zeppelin.scheduler.Job.run(Job.java:188) at > > > > > > org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:315) > > > > > > at > > > > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > > > > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > > > > > > at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor
Re: Any way to diagnose TTransportException errors?
We are using a recent build post 0.81 so 0.82?
Restarting the interpreter helps in 75% of the cases, but the remaining few
just won’t recover until we shut everything down and restart all if zeppelin. I
suspect there is some other process that we aren’t identifying that needs
killing.
PAUL BRENNER
Head of Data Science
pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com
twitter @placeiq linkedin /placeiq
On Aug 31, 2019, 7:50 PM -0400, Jeff Zhang , wrote:
> Which version do you use ? And does restarting interpreter work for you ?
>
> > Paul Brenner 于2019年8月30日周五 下午11:45写道：
> > > We run into the error pasted below semi-regularly and often the only
> > > solution is to do a full restart of zeppelin to get the user/notebook
> > > back up and running. I’m at a loss of where to even look to try to debug
> > > this or address it. Anyone have any ideas or any way to point me in the
> > > right direction?
> > >
> > > This is what the notebook shows:
> > > org.apache.thrift.transport.TTransportException at
> > > org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> > > at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at
> > > org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
> > > at
> > > org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
> > > at
> > > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
> > > at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
> > > at
> > > org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_interpret(RemoteInterpreterService.java:274)
> > > at
> > > org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:258)
> > > at
> > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter$4.call(RemoteInterpreter.java:233)
> > > at
> > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter$4.call(RemoteInterpreter.java:229)
> > > at
> > > org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:135)
> > > at
> > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:228)
> > > at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:437) at
> > > org.apache.zeppelin.scheduler.Job.run(Job.java:188) at
> > > org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:315)
> > > at
> > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> > > at
> > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> > > at java.lang.Thread.run(Thread.java:748)
> > >
> > >
> > > This is what I pulled from the log:
> > >
> > > ERROR [2019-08-30 15:41:56,923] ({pool-2-thread-24} Job.java[run]:190) -
> > > Job failed
> > > java.lang.RuntimeException:
> > > org.apache.thrift.transport.TTransportException
> > > at
> > > org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:139)
> > > at
> > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:228)
> > > at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:437)
> > > at org.apache.zeppelin.scheduler.Job.run(Job.java:188)
> > > at
> > > org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:315)
> > > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> > > at
> > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker
Any way to diagnose TTransportException errors?
:69) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_interpret(RemoteInterpreterService.java:274) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:258) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter$4.call(RemoteInterpreter.java:233) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter$4.call(RemoteInterpreter.java:229) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:135) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:228) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:437) at org.apache.zeppelin.scheduler.Job.run(Job.java:188) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:315) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
z.show scroll broken/jumpy
Hi, When we first installed and started using zeppelin (before 0.8) using z.show to display the contents of a data frame worked great! In more recent versions (I’m sorry, i don’t know exactly which version it broke on), using z.show to show the contents of a data frame still produces a table, however scrolling down in that table is basically impossible. Often, it will scroll down a few rows and then jump back to the top or just freeze entirely. It seems to happen more with data frames that have many columns or large amounts of data per column? I haven’t yet found exactly how to reproduce. Have others experienced this? Is there already a ticket open (I looked but didn’t find one)? If not I’ll try to create a csv that has data which reliably reproduces this problem and create a ticket. Sorry for putting off reporting this for so long, I just kept hoping it would get fixed. PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
Re: [discuss] if runners permission is empty, every authenticated user can view the notebook
That sounds very reasonable and would work well for us. PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On May 24, 2019, 2:17 AM -0400, Jeff Zhang , wrote: > Hi Paul, > > The default value of Reader is all the users make sense for me, but regarding > the Writer/Runner, it seems better to be the owner user by default. Will that > affect your existing installation ? > > > Paul Brenner 于2019年5月23日周四 下午10:54写道： > > > If I’m understanding correctly, this is exactly how we want zeppelin to > > > behave in our environment: We want all notebooks to be viewable by anyone > > > who can authenticate into our zeppelin server. I would hate to lose this > > > feature or suddenly be required to change permissions on every created > > > notebook to make sure they remain viewable. We use zeppelin to share > > > notebooks within teams so don’t want this to be locked down by default. > > > > > > If a change is made, would it be possible to do it as an option that we > > > could turn off so we can continue to use zeppelin as is? > > > > > > > > > > > > > > > > > > PAUL BRENNER > > > Head of Data Science > > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com > > > twitter @placeiq linkedin /placeiq > > > > > > > > > > > > > > > > > > On May 23, 2019, 10:44 AM -0400, Jeff Zhang , wrote: > > > > I think the default value should be the user who created the note. > > > > > > > > > > > > > Xun Liu 于2019年5月23日周四 下午10:28写道： > > > > > > Hi Folks, > > > > > > > > > > > > https://issues.apache.org/jira/browse/ZEPPELIN-4167 > > > > > > if runners permission is empty, every authenticated user can view > > > > > > the notebook. > > > > > > > > > > > > I also think that if you don't set permissions, you shouldn't use > > > > > > anyone. > > > > > > This is more rigorous, More secure. > > > > > > > > > > > > Look at everyone's opinions, how? > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Best Regards > > > > > > > > Jeff Zhang > > > -- > Best Regards > > Jeff Zhang
Re: [discuss] if runners permission is empty, every authenticated user can view the notebook
If I’m understanding correctly, this is exactly how we want zeppelin to behave in our environment: We want all notebooks to be viewable by anyone who can authenticate into our zeppelin server. I would hate to lose this feature or suddenly be required to change permissions on every created notebook to make sure they remain viewable. We use zeppelin to share notebooks within teams so don’t want this to be locked down by default. If a change is made, would it be possible to do it as an option that we could turn off so we can continue to use zeppelin as is? PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On May 23, 2019, 10:44 AM -0400, Jeff Zhang , wrote: > I think the default value should be the user who created the note. > > > > Xun Liu 于2019年5月23日周四 下午10:28写道： > > > Hi Folks, > > > > > > https://issues.apache.org/jira/browse/ZEPPELIN-4167 > > > if runners permission is empty, every authenticated user can view the > > > notebook. > > > > > > I also think that if you don't set permissions, you shouldn't use anyone. > > > This is more rigorous, More secure. > > > > > > Look at everyone's opinions, how? > > > > > > > > > -- > Best Regards > > Jeff Zhang
Re: “error: not found: value z” when using cluster mode
Spark version 2.3.1 with scala 2.11.8
No error shows up in the interpreter log, I only see errors in the zeppelin
.log file which gives very limited info:
WARN [2019-05-16 01:51:59,655] ({pool-2-thread-4}
NotebookServer.java[afterStatusChange]:2316) - Job 20190515-171508_909555181 is
finished, status: ERROR, exception: null, result: %text test:
org.apache.spark.sql.DataFrame = [_c0: string, _c1: string ... 5 more fields]
:24: error: not found: value z
z.show(
^
I saw in the previous ticket that errors with zeppelin context and cluster
deploy mode weren’t showing up in testing unless tests were run on a multi node
cluster. I can confirm that we have a multinode cluster. Not sure how i would
simulate a single node cluster to test if that makes a difference.
PAUL BRENNER
Head of Data Science
pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com
twitter @placeiq linkedin /placeiq
On May 15, 2019, 9:49 PM -0400, Jeff Zhang , wrote:
> I tried branch-0.8, and it works for me, could you let me know what spark
> version do you use ? and what is the stacktrace ?
>
> > Paul Brenner 于2019年5月16日周四 上午4:27写道：
> > > We are using 0.8.2 and can’t use z.show() with cluster mode. We get the
> > > following error:
> > >
> > > :24: error: not found: value z z.show(
> > >
> > > This seems very similar to this issue which was marked resolved in 0.81:
> > >
> > > https://issues.apache.org/jira/browse/ZEPPELIN-3633
> > >
> > > Anyone familiar with this problem?
> > >
> > >
> > >
> > > PAUL BRENNER
> > > Head of Data Science
> > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com
> > > twitter @placeiq linkedin /placeiq
> > >
> > >
> > >
> > >
> > >
>
>
> --
> Best Regards
>
> Jeff Zhang
“error: not found: value z” when using cluster mode
We are using 0.8.2 and can’t use z.show() with cluster mode. We get the following error: :24: error: not found: value z z.show( This seems very similar to this issue which was marked resolved in 0.81: https://issues.apache.org/jira/browse/ZEPPELIN-3633 Anyone familiar with this problem? PAUL BRENNER Head of Data Science pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
Re: unsubscribe
Please stop spamming the list with these messages and follow the proper
procedure to unsubscribe using the appropriate link in the mailing list section
here:
http://zeppelin.apache.org/community.html
PAUL BRENNER
Head of Data Science
pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com
twitter @placeiq linkedin /placeiq
On May 2, 2019, 12:17 PM -0400, Chatterjee, Anirban , wrote:
> unsubscribe
>
> From: arvindsheri...@northwesternmutual.com
>
> Sent: Thursday, May 2, 2019 8:00 AM
> To: users@zeppelin.apache.org; Jeff Zhang
> Subject: Re: [EXTERNAL] Re: Binary distribution of Zeppelin - Master branch
>
> Well, almost got there, but failed in the “bower install” step. I did try
> creating a .bowerrc and setting “stric-ssl”: “false”. Did not work. Then on
> my Mac, using “Keychain access” “trusted” the entire certificate chain used
> by bower.io, but no sugar. Any ideas?
>
>
>
> Thanks
> Arvind
>
> From: Jeff Zhang
> Reply-To: "users@zeppelin.apache.org"
> Date: Thursday, May 2, 2019 at 2:39 AM
> To: users
> Subject: [EXTERNAL] Re: Binary distribution of Zeppelin - Master branch
>
> Try this:
>
> mvn clean package -Pbuild-distr -Pspark-2.2
>
> arvindsheri...@northwesternmutual.com
> 于2019年5月2日周四 上午9:13写道：
> > How to get a binary distribution of the master version of Zeppelin? A bug
> > is fixed with this PR that I want to get. Not able to build locally on my
> > machine, running into number of problems. Any help appreciated.
> >
> > https://github.com/apache/zeppelin/commit/938ed0c36f03a77b9cb271c428032ef821241c00
> >
> > Thanks
> > Arvind
> >
> >
> > This e-mail and any attachments may contain confidential information of
> > Northwestern Mutual. If you are not the intended recipient of this message,
> > be aware that any disclosure, copying, distribution or use of this e-mail
> > and any attachments is prohibited. If you have received this e-mail in
> > error, please notify Northwestern Mutual immediately by returning it to the
> > sender and delete all copies from your system. Please be advised that
> > communications with {SECURE MESSAGE} in the subject line have been sent
> > using a secure messaging system. Communications that do not have this tag
> > may not be secure and could be observed by a third party. Thank you for
> > your cooperation.
>
>
> --
> Best Regards
>
> Jeff Zhang
>
>
> This e-mail and any attachments may contain confidential information of
> Northwestern Mutual. If you are not the intended recipient of this message,
> be aware that any disclosure, copying, distribution or use of this e-mail and
> any attachments is prohibited. If you have received this e-mail in error,
> please notify Northwestern Mutual immediately by returning it to the sender
> and delete all copies from your system. Please be advised that communications
> with {SECURE MESSAGE} in the subject line have been sent using a secure
> messaging system. Communications that do not have this tag may not be secure
> and could be observed by a third party. Thank you for your cooperation.
>
Re: java.lang.NumberFormatException: Not a version: 9
Amazing. Using spark.jars.packages instead of the dependencies section of the interpreter completely fixes it. Thanks for the help! I noticed that the method I was originally using is listed as option #1 in the docs (here). Does it make sense to include a note that options 2 and 3 are the “standard” way and may succeed when method #1 fails? Or is that going into unnecessary detail for the docs or not even true in most cases? PAUL BRENNER Sr. Data Scientist pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Apr 21, 2019, 10:28 AM -0400, Jeff Zhang , wrote: > Hi Paul, > > I could not reproduce this issue in branch-0.8 (0.8.2) even using your > configuration( spark 2.4, yarn-client, add dependency via zeppelin > interpreter dependencies interface) > > One thing you can try is to add dependency via setting spark.jars.packages > which is the standard way to set additional jars/packages. > > > > > > Paul Brenner 于2019年4月21日周日 下午9:23写道： > > > > > > 1. I used Spark 2.4.0 > > > 2. I used yarn-client mode > > > 3. Dependency is added via zeppelin’s interpreter dependencies interface. > > > > > > Thanks for looking into this! We still don’t have a working fix in place > > > so are held back from migrating to the wonderful and glorious features of > > > 0.82. > > > > > > > > > > > > PAUL BRENNER > > > Sr. Data Scientist > > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com > > > twitter @placeiq linkedin /placeiq > > > On Apr 21, 2019, 1:44 AM -0400, Jeff Zhang , wrote: > > > > Hi Paul, > > > > > > > > Could you let me know the following questions ? > > > > > > > > 1. Which spark version do you use ? > > > > 2. Which mode do you use ? local / yarn /standalone > > > > 3. How did you add dependency ? via spark.jars.package or via > > > > zeppelin's interpreter dependencies ? > > > > > > > > > Paul Brenner 于2019年4月20日周六 下午8:00写道： > > > > > > Yes. > > > > > > > > > > > > Add com.databricks:spark-avro_2.11:3.2.0 as a dependency to a spark > > > > > > interpreter then try using that interpreter to run any code in a > > > > > > notebook to reproduce. > > > > > > > > > > > > For our internal library that was causing it I went through and > > > > > > tried excluding everything that that library imported. It turns out > > > > > > it was importing org.scala-lang:scala-library. Excluding that may > > > > > > have resolved the issue for our internal package. > > > > > > > > > > > > > > > > > > > > > > > > PAUL BRENNER > > > > > > Sr. Data Scientist > > > > > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com > > > > > > twitter @placeiq linkedin /placeiq > > > > > > On Apr 20, 2019, 3:30 AM -0400, Jeff Zhang , > > > > > > wrote: > > > > > > > Hi Paul, > > > > > > > > > > > > > > Could you describe how to reproduce it ? > > > > > > > > > > > > > > > Paul Brenner 于2019年4月20日周六 上午12:30写道： > > > > > > > > > I’m trying to move my company up from zeppelin 0.8 to 0.81 or > > > > > > > > > 0.82. However, we find that when including certain > > > > > > > > > dependencies on the newer versions of zeppelin spark > > > > > > > > > interpreters won’t start and instead throw the error I’ll > > > > > > > > > paste below. This is if we have zeppelin.spark.useNew set to > > > > > > > > > true. Setting it to false just gives a null pointer exception > > > > > > > > > instead. An example of a dependency that causes this is > > > > > > > > > com.databricks:spark-avro_2.11:3.2.0, but there are also some > > > > > > > > > internal packages we use that we haven’t been able to find > > > > > > > > > anything that should be causing this conflict. > > > > > > > > > > > > > > > > > > I found someone with a similar problem on ZEPPELIN-4074 but > > > > > > > > > no one seems to have any idea what to do. Any ideas? It > > > > > > > > > sounds li
Re: java.lang.NumberFormatException: Not a version: 9
1. I used Spark 2.4.0 2. I used yarn-client mode 3. Dependency is added via zeppelin’s interpreter dependencies interface. Thanks for looking into this! We still don’t have a working fix in place so are held back from migrating to the wonderful and glorious features of 0.82. PAUL BRENNER Sr. Data Scientist pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Apr 21, 2019, 1:44 AM -0400, Jeff Zhang , wrote: > Hi Paul, > > Could you let me know the following questions ? > > 1. Which spark version do you use ? > 2. Which mode do you use ? local / yarn /standalone > 3. How did you add dependency ? via spark.jars.package or via zeppelin's > interpreter dependencies ? > > > Paul Brenner 于2019年4月20日周六 下午8:00写道： > > > Yes. > > > > > > Add com.databricks:spark-avro_2.11:3.2.0 as a dependency to a spark > > > interpreter then try using that interpreter to run any code in a notebook > > > to reproduce. > > > > > > For our internal library that was causing it I went through and tried > > > excluding everything that that library imported. It turns out it was > > > importing org.scala-lang:scala-library. Excluding that may have resolved > > > the issue for our internal package. > > > > > > > > > > > > PAUL BRENNER > > > Sr. Data Scientist > > > pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com > > > twitter @placeiq linkedin /placeiq > > > On Apr 20, 2019, 3:30 AM -0400, Jeff Zhang , wrote: > > > > Hi Paul, > > > > > > > > Could you describe how to reproduce it ? > > > > > > > > > Paul Brenner 于2019年4月20日周六 上午12:30写道： > > > > > > I’m trying to move my company up from zeppelin 0.8 to 0.81 or 0.82. > > > > > > However, we find that when including certain dependencies on the > > > > > > newer versions of zeppelin spark interpreters won’t start and > > > > > > instead throw the error I’ll paste below. This is if we have > > > > > > zeppelin.spark.useNew set to true. Setting it to false just gives a > > > > > > null pointer exception instead. An example of a dependency that > > > > > > causes this is com.databricks:spark-avro_2.11:3.2.0, but there are > > > > > > also some internal packages we use that we haven’t been able to > > > > > > find anything that should be causing this conflict. > > > > > > > > > > > > I found someone with a similar problem on ZEPPELIN-4074 but no one > > > > > > seems to have any idea what to do. Any ideas? It sounds like > > > > > > isJavaAtLeast got fixed to work with JDK 9 in scala 12 (see here), > > > > > > but who invited JDK 9 to this party? I certainly didn’t. > > > > > > > > > > > > Zeppelin 0.8 is really struggling for us so we are desperate to > > > > > > upgrade but this is holding us back, would really appreciate any > > > > > > help at all! > > > > > > > > > > > > java.lang.NumberFormatException: Not a version: 9 at > > > > > > scala.util.PropertiesTrait$class.parts$1(Properties.scala:184) at > > > > > > scala.util.PropertiesTrait$class.isJavaAtLeast(Properties.scala:187) > > > > > > at scala.util.Properties$.isJavaAtLeast(Properties.scala:17) at > > > > > > scala.tools.util.PathResolverBase$Calculated$.javaBootClasspath(PathResolver.scala:276) > > > > > > at > > > > > > scala.tools.util.PathResolverBase$Calculated$.basis(PathResolver.scala:283) > > > > > > at > > > > > > scala.tools.util.PathResolverBase$Calculated$.containers$lzycompute(PathResolver.scala:293) > > > > > > at > > > > > > scala.tools.util.PathResolverBase$Calculated$.containers(PathResolver.scala:293) > > > > > > at > > > > > > scala.tools.util.PathResolverBase.containers(PathResolver.scala:309) > > > > > > at > > > > > > scala.tools.util.PathResolver.computeResult(PathResolver.scala:341) > > > > > > at > > > > > > scala.tools.util.PathResolver.computeResult(PathResolver.scala:332) > > > > > > at scala.tools.util.PathResolverBase.result(PathResolver.scala:314) > > > > > > at > > > > > > scala.tools.nsc.backend.JavaPlatform$class.classPath(JavaPlatform.scala:28)
Re: java.lang.NumberFormatException: Not a version: 9
Yes. Add com.databricks:spark-avro_2.11:3.2.0 as a dependency to a spark interpreter then try using that interpreter to run any code in a notebook to reproduce. For our internal library that was causing it I went through and tried excluding everything that that library imported. It turns out it was importing org.scala-lang:scala-library. Excluding that may have resolved the issue for our internal package. PAUL BRENNER Sr. Data Scientist pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Apr 20, 2019, 3:30 AM -0400, Jeff Zhang , wrote: > Hi Paul, > > Could you describe how to reproduce it ? > > > Paul Brenner 于2019年4月20日周六 上午12:30写道： > > > I’m trying to move my company up from zeppelin 0.8 to 0.81 or 0.82. > > > However, we find that when including certain dependencies on the newer > > > versions of zeppelin spark interpreters won’t start and instead throw the > > > error I’ll paste below. This is if we have zeppelin.spark.useNew set to > > > true. Setting it to false just gives a null pointer exception instead. An > > > example of a dependency that causes this is > > > com.databricks:spark-avro_2.11:3.2.0, but there are also some internal > > > packages we use that we haven’t been able to find anything that should be > > > causing this conflict. > > > > > > I found someone with a similar problem on ZEPPELIN-4074 but no one seems > > > to have any idea what to do. Any ideas? It sounds like isJavaAtLeast got > > > fixed to work with JDK 9 in scala 12 (see here), but who invited JDK 9 to > > > this party? I certainly didn’t. > > > > > > Zeppelin 0.8 is really struggling for us so we are desperate to upgrade > > > but this is holding us back, would really appreciate any help at all! > > > > > > java.lang.NumberFormatException: Not a version: 9 at > > > scala.util.PropertiesTrait$class.parts$1(Properties.scala:184) at > > > scala.util.PropertiesTrait$class.isJavaAtLeast(Properties.scala:187) at > > > scala.util.Properties$.isJavaAtLeast(Properties.scala:17) at > > > scala.tools.util.PathResolverBase$Calculated$.javaBootClasspath(PathResolver.scala:276) > > > at > > > scala.tools.util.PathResolverBase$Calculated$.basis(PathResolver.scala:283) > > > at > > > scala.tools.util.PathResolverBase$Calculated$.containers$lzycompute(PathResolver.scala:293) > > > at > > > scala.tools.util.PathResolverBase$Calculated$.containers(PathResolver.scala:293) > > > at scala.tools.util.PathResolverBase.containers(PathResolver.scala:309) > > > at scala.tools.util.PathResolver.computeResult(PathResolver.scala:341) at > > > scala.tools.util.PathResolver.computeResult(PathResolver.scala:332) at > > > scala.tools.util.PathResolverBase.result(PathResolver.scala:314) at > > > scala.tools.nsc.backend.JavaPlatform$class.classPath(JavaPlatform.scala:28) > > > at scala.tools.nsc.Global$GlobalPlatform.classPath(Global.scala:115) at > > > scala.tools.nsc.Global.scala$tools$nsc$Global$$recursiveClassPath(Global.scala:131) > > > at scala.tools.nsc.Global$GlobalMirror.rootLoader(Global.scala:64) at > > > scala.reflect.internal.Mirrors$Roots$RootClass.(Mirrors.scala:307) > > > at > > > scala.reflect.internal.Mirrors$Roots.RootClass$lzycompute(Mirrors.scala:321) > > > at scala.reflect.internal.Mirrors$Roots.RootClass(Mirrors.scala:321) at > > > scala.reflect.internal.Mirrors$Roots$EmptyPackageClass.(Mirrors.scala:330) > > > at > > > scala.reflect.internal.Mirrors$Roots.EmptyPackageClass$lzycompute(Mirrors.scala:336) > > > at > > > scala.reflect.internal.Mirrors$Roots.EmptyPackageClass(Mirrors.scala:336) > > > at > > > scala.reflect.internal.Mirrors$Roots.EmptyPackageClass(Mirrors.scala:276) > > > at scala.reflect.internal.Mirrors$RootsBase.init(Mirrors.scala:250) at > > > scala.tools.nsc.Global.rootMirror$lzycompute(Global.scala:73) at > > > scala.tools.nsc.Global.rootMirror(Global.scala:71) at > > > scala.tools.nsc.Global.rootMirror(Global.scala:39) at > > > scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass$lzycompute(Definitions.scala:257) > > > at > > > scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass(Definitions.scala:257) > > > at > > > scala.reflect.internal.Definitions$DefinitionsClass.init(Definitions.scala:1390) > > > at scala.tools.nsc.Global$Run.(Global.scala:1242) at > > > scala.tools.nsc.interpreter.IMain.scala$tools$ns
java.lang.NumberFormatException: Not a version: 9
I’m trying to move my company up from zeppelin 0.8 to 0.81 or 0.82. However, we find that when including certain dependencies on the newer versions of zeppelin spark interpreters won’t start and instead throw the error I’ll paste below. This is if we have zeppelin.spark.useNew set to true. Setting it to false just gives a null pointer exception instead. An example of a dependency that causes this is com.databricks:spark-avro_2.11:3.2.0, but there are also some internal packages we use that we haven’t been able to find anything that should be causing this conflict. I found someone with a similar problem on ZEPPELIN-4074 but no one seems to have any idea what to do. Any ideas? It sounds like isJavaAtLeast got fixed to work with JDK 9 in scala 12 (see here), but who invited JDK 9 to this party? I certainly didn’t. Zeppelin 0.8 is really struggling for us so we are desperate to upgrade but this is holding us back, would really appreciate any help at all! java.lang.NumberFormatException: Not a version: 9 at scala.util.PropertiesTrait$class.parts$1(Properties.scala:184) at scala.util.PropertiesTrait$class.isJavaAtLeast(Properties.scala:187) at scala.util.Properties$.isJavaAtLeast(Properties.scala:17) at scala.tools.util.PathResolverBase$Calculated$.javaBootClasspath(PathResolver.scala:276) at scala.tools.util.PathResolverBase$Calculated$.basis(PathResolver.scala:283) at scala.tools.util.PathResolverBase$Calculated$.containers$lzycompute(PathResolver.scala:293) at scala.tools.util.PathResolverBase$Calculated$.containers(PathResolver.scala:293) at scala.tools.util.PathResolverBase.containers(PathResolver.scala:309) at scala.tools.util.PathResolver.computeResult(PathResolver.scala:341) at scala.tools.util.PathResolver.computeResult(PathResolver.scala:332) at scala.tools.util.PathResolverBase.result(PathResolver.scala:314) at scala.tools.nsc.backend.JavaPlatform$class.classPath(JavaPlatform.scala:28) at scala.tools.nsc.Global$GlobalPlatform.classPath(Global.scala:115) at scala.tools.nsc.Global.scala$tools$nsc$Global$$recursiveClassPath(Global.scala:131) at scala.tools.nsc.Global$GlobalMirror.rootLoader(Global.scala:64) at scala.reflect.internal.Mirrors$Roots$RootClass.(Mirrors.scala:307) at scala.reflect.internal.Mirrors$Roots.RootClass$lzycompute(Mirrors.scala:321) at scala.reflect.internal.Mirrors$Roots.RootClass(Mirrors.scala:321) at scala.reflect.internal.Mirrors$Roots$EmptyPackageClass.(Mirrors.scala:330) at scala.reflect.internal.Mirrors$Roots.EmptyPackageClass$lzycompute(Mirrors.scala:336) at scala.reflect.internal.Mirrors$Roots.EmptyPackageClass(Mirrors.scala:336) at scala.reflect.internal.Mirrors$Roots.EmptyPackageClass(Mirrors.scala:276) at scala.reflect.internal.Mirrors$RootsBase.init(Mirrors.scala:250) at scala.tools.nsc.Global.rootMirror$lzycompute(Global.scala:73) at scala.tools.nsc.Global.rootMirror(Global.scala:71) at scala.tools.nsc.Global.rootMirror(Global.scala:39) at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass$lzycompute(Definitions.scala:257) at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass(Definitions.scala:257) at scala.reflect.internal.Definitions$DefinitionsClass.init(Definitions.scala:1390) at scala.tools.nsc.Global$Run.(Global.scala:1242) at scala.tools.nsc.interpreter.IMain.scala$tools$nsc$interpreter$IMain$$_initialize(IMain.scala:139) at scala.tools.nsc.interpreter.IMain.initializeSynchronous(IMain.scala:161) at org.apache.zeppelin.spark.SparkScala211Interpreter.open(SparkScala211Interpreter.scala:85) at org.apache.zeppelin.spark.NewSparkInterpreter.open(NewSparkInterpreter.java:102) at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:62) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:616) at org.apache.zeppelin.scheduler.Job.run(Job.java:188) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) PAUL BRENNER Sr. Data Scientist pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
yarn cluster mode and dependencies
Hi All, We are very excited about Zeppelin 0.81, especially the improved support for yarn cluster mode. One challenge we have run into so far is working with dependencies when using yarn cluster mode. For example if I set my interpreter with: master: yarn spark.submit.deployMode: cluster zeppelin.spark.useNew: true then in the dependencies section try to include something like: com.maxmind.geoip2:geoip2:2.5.0 I find that when I try to import that package in zeppelin it gives me an error as if the dependency is not being included: error: object maxmind is not a member of package com Is there a different process required for loading dependencies in yarn cluster mode on zeppelin? Also has anyone seen any documentation or anything written from people working with yarn cluster mode on zeppelin that might have some guidance? It turns out that “zeppelin yarn cluster” are not the most unique terms for googling. PAUL BRENNER Sr. Data Scientist pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
Migrate Notebooks to new format
Hi all, Now that https://issues.apache.org/jira/browse/ZEPPELIN-2619 is part of 0.9 is there already a tool or method to migrate a large amount of notebooks from 0.8 to be compatible with 0.9? If not should it be a relatively easy change like something we could create a little python script to handle? Any guidance would be appreciated. PAUL BRENNER Sr. Data Scientist pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq
Re: Zeppelin and impersonation
We just did this on our install recently following the steps in the guide here: https://zeppelin.apache.org/docs/0.8.0/usage/interpreter/user_impersonation.html If that doesn’t work maybe you could call out where it fails? PAUL BRENNER Sr. Data Scientist pbren...@placeiq.com | (217) 390-3033 | www.placeiq.com twitter @placeiq linkedin /placeiq On Dec 12, 2018, 3:06 AM -0500, Neil Morris , wrote: > Hi There, > > We run Cloudera 5.12, and have a Kerborised Hadoop Cluster. We have installed > zeppelin under its own local user and control access to zeppelin via AD. > > As the standards on our estate dictate, whatever runs on the cluster must be > auditable. We are therefore trying to configure zeppelin to impersonate the > logged in user, but experiencing difficulties > Can anyone supply a list of properties/variables that require configuring to > achieve this. > > Regards > > Neil Morris > Big Data Engineer > Argos Ltd. > 489-499 Avebury Boulevard, Milton Keynes MK9 2NW > > Mobile: 07964 784257 > LinkedIn > This email and any files transmitted with it are confidential and intended > solely for the use of the individual or entity to whom they are addressed. > Unauthorised disclosure, copying or dissemination of the contents is strictly > prohibited. The views expressed within this communication may not be official > policy, but the personal views of the originator. If you are not the intended > recipient or have received this message in error, please delete this e-mail > and advise the sender. All messages sent and received by Argos Limited are > monitored for viruses, high-risk file extensions, and inappropriate content. > Sainsbury's Argos is a trading name of both: 1) Argos Limited, Registered > office: 489-499 Avebury Boulevard, Milton Keynes, United Kingdom, MK9 2NW, > registered number: 01081551 (England and Wales); and 2) Sainsbury's > Supermarkets Ltd, Registered office: 33 Holborn, London, EC1N 2HT, registered > number: 03261722 (England and Wales). Both companies are subsidiaries of J > Sainsbury plc (185647).
Re: 0.9.0-SNAPSHOT
Sure, use whatever language you want. My understanding is that a snapshot is a built version that is not far enough along to get labeled with something fancier like “release candidate” or an actual point release. Regardless. It is a built version that gets pushed to maven (or put somewhere). I suppose you could claim that if I grab the source and build it myself then I am creating a snapshot? I have no idea if that is a valid use of the term snapshot. My real question is: Are there prebuilt snapshots of 0.9.0 somewhere or is the only option to build myself? The difference in effort to build from source isn’t great, but convincing my infra team to work with a prebuilt snapshot vs building from source is a significant difference. Paul Brenner SR. DATA SCIENTIST (217) 390-3033 On Nov 6, 2018, 12:56 PM -0500, Markus Härnvi , wrote: > > SNAPSHOT is Maven’s name for bleeding edge, not a point in time release. > > /Markus > > 6 nov. 2018 kl. 18:29 skrev Paul Brenner : > > > We are getting anxious to take advantage of some of the features in 0.9. > > Months ago there was some mention of a new release coming soon but I guess > > that lost momentum. Safe to assume it will still be a while? > > > > With that in mind, I noticed that there is a reference here > > https://zeppelin.apache.org/download.html#build-from-source to the > > 0.9.0-SNAPSHOT. Does a snapshot actually exist? Or is the only option to > > build a bleeding edge version from source? > > > > Thanks! > > > > Paul Brenner > > SR. DATA SCIENTIST > > (217) 390-3033 > >
0.9.0-SNAPSHOT
We are getting anxious to take advantage of some of the features in 0.9. Months ago there was some mention of a new release coming soon but I guess that lost momentum. Safe to assume it will still be a while? With that in mind, I noticed that there is a reference here https://zeppelin.apache.org/download.html#build-from-source to the 0.9.0-SNAPSHOT. Does a snapshot actually exist? Or is the only option to build a bleeding edge version from source? Thanks! Paul Brenner SR. DATA SCIENTIST (217) 390-3033
Re: [Discuss] 0.8.1 Release
I would second this if it doesn’t hold up the release too much. We would love to see this implemented. Paul Brenner SR. DATA SCIENTIST (217) 390-3033 On Oct 9, 2018, 12:33 PM -0400, Павел Мяснов , wrote: > I know it is marked as improvement, not a bug; but is it possible to include > ticket https://jira.apache.org/jira/browse/ZEPPELIN-3307 to this minor > release? I hit this problem quite often and it would be really nice to see > this problem solved soon. > > Pavel Myasnov > > On 2018/09/27 07:08:31, Jeff Zhang wrote: > > Hi folks,> > > > > It has been a while for 0.8.0 release, and we got many feedback for that,> > > so I think it is time for us to make 0.8.1 release for fix the bugs of> > > 0.8.0. Here's the umbrella tickets for 0.8.1 release> > > https://jira.apache.org/jira/browse/ZEPPELIN-3629> > > > > If you find any ticket that is necessary for 0.8.1 but not under this> > > umbrella ticket, feel free to link that. I will start the 0.8.1 release at> > > the beginning of Oct.> > >
Re: [Discuss] 0.8.1 Release
I added 3 tickets that I think are critical to basic functionality, but feel free to remove if you don’t agree: https://jira.apache.org/jira/browse/ZEPPELIN-3253 - `Tab` key indentation is broken in paragraph editor - this is in place of 3692 which was closed as a duplicate https://jira.apache.org/jira/browse/ZEPPELIN-3616 - Paragraph editor sections auto-collapse - This doesn’t happen all the time but when it does it makes zeppelin very hard to use https://jira.apache.org/jira/browse/ZEPPELIN-2931 - JS memory/object leak makes browser to lag in rendering Zeppelin notebooks - this is another fundamental usability issue Paul Brenner SR. DATA SCIENTIST (217) 390-3033 On Sep 27, 2018, 3:08 AM -0400, Jeff Zhang , wrote: > Hi folks, > > It has been a while for 0.8.0 release, and we got many feedback for that, so > I think it is time for us to make 0.8.1 release for fix the bugs of 0.8.0. > Here's the umbrella tickets for 0.8.1 release > https://jira.apache.org/jira/browse/ZEPPELIN-3629 > > If you find any ticket that is necessary for 0.8.1 but not under this > umbrella ticket, feel free to link that. I will start the 0.8.1 release at > the beginning of Oct. >
Re: Unsubscribe
I still am pretty sure this doesn’t work. Can anyone confirm? If you want to unsubscribe you probably need to send an email to users-unsubscr...@zeppelin.apache.org Paul Brenner SR. DATA SCIENTIST (217) 390-3033 On Sep 2, 2018, 5:57 PM -0400, Potato Farmer , wrote: Attachment Description: Binary data Attachment-1 Description: Binary data Attachment-2 Description: Binary data Attachment-3 Description: Binary data
Instructions for unsubscribing
Pretty sure just emailing the word unsubscribe to the list doesn’t work. If you want to unsubscribe please go to this link: http://zeppelin.apache.org/community.html In the column on the right you will see the Users mailing list and there is a link to unsubscribe. Click the unsubscribe link. Not sure how to grab that link and share it directly. You also may be able to just send an email to this address: users-unsubscr...@zeppelin.apache.org Paul Brenner SR. DATA SCIENTIST (217) 390-3033 On Aug 31, 2018, 2:03 PM -0400, michele crudele , wrote:
Re: Sometimes tab deletes text
ok, I went ahead and opened https://issues.apache.org/jira/browse/ZEPPELIN-3692 ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA32hiB6svhZ6dNQnrKw9xG29x7IMjDaZ2VqzxHv9JNbHsi7yvZOUwB7I-b-7bEVRwLKBU_pob5z9ksWBo ) If I find a better way to reproduce, more details, or if anyone else chimes in, I'll add to the ticket. Sorry I'm not better able to contribute to fixing this. ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAh3ZmWq4ml9OZLBmmIAUyW-c7fv5AmWhFLboiic7SSdI= ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAh3ZmWq4ml9OZLBmmIAUyW-c7fv5AmWhFLboiic7SSdI= ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAh3ZmWq4ml9OZLBmmIAUyW-c7fv5AmWhFLboiic7SSdI= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA33VmHao-k8LSJgflbBozFX5zqphNfrLucIjkqxaQ9XIJeaXa ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA33VmHao-k8LSJgflbBozFX5zqphNfrLucIjkqxaQ9XIJeaXa ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA33VmHao-k8LSJgflbBozFX5zqphNfrLucIjkqxaQ9XIJeaXa ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA33ZmA_Asl9OZJwfnKEQ8G3A5k4UrHKIQZalvdOOkilFQ7eNtx7whB80= ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA33ZmA_Asl9OZJwfnKEQ8G3A5k4UrHKIQZalvdOOkilFQ7eNtx7whB80= ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA33ZmA_Amn96XIAzhLUQ8G3A5oIYnD6Y3TfHuBe1Pf4LY4_VhaG02vRH4s_AIoB5RhA== ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErQEYA33ZmA_Amn96XIAzhLUQ8G3A5oIYnD6Y3TfHuBe1Pf4LY4_VhaG02vRH4s_AIoB5RhA== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAh3ZmWq4ml9OZLBmmIAUyWy8m8txlT_J2BuixGeBNeY7AqsGEScEbTqx_P7Jx2zzZQXvV52trzh6E8_iRykBOCxQ_zgJg4nz5t5Er_HGmBFEVx0a1AGahHQFULvOey_sp0YGqzd3SCkVpyXnaSDS6chcBwXHv ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAgG1wF7sjh56fKgWncVpuQTIn8cZ7R-g4V73rG-1PY8bfqMGaWskdQ_JhObIy1yDZQnKb9m1n0gTA8PCK3h4OVEUjjEpt-XP7qds49vc7kwYa2DGigzRfj0CU ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAgG1wF7sjh56fKgWncVpuQTIn8cZ7R-g4V73rG-1PY8bfqMGaWskdQ_JhObIy1yDZQnKb9m1n0gTA8PCK3h4OVEUjjEpt-XP7qds49vc7kwYa2DGigzRfj0CU ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAgG1wF7sjh56fKgWncVpuQTIn8cZ7R-g4V73rG-1PY8bfqMGaWskdQ_JhObIy1yDZQnKb9m1n0gTA8PCK3h4OVEUjjEpt-XP7qds49vc7kwYa2DGigzRfj0CU ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAgG1wF7sjh56fKgWncVpuQTIn8cZ7R-g4V73rG-1PY8bfqMGaWskdQ_JhObIy1yDZQnKb9m1n0gTA8PCK3h4OVEUjjEpt-XP7qds49vc7kwYa2DGigzRfj0CU ) ( https://share.polymail.io/v1/z/b/NWI2YjEzMWZlNjk0/KlQRBTEsQl6TBBvqq5P1ulqS2HpT7XuroULPqFkdrAJYNoqQhV95Y1HU1BfNTrXI1U3RwzkEO1Rjgxmq3iHJqsLp9-Y6ucg1HoNFuSH7xVkdZNUe5jite4eEd-mj4nsCjYFlHgK3evErCVMAgG1wF7sjh56fKgWncVp
Sometimes tab deletes text
ceiq.net:4046/jobs, Duplicate value: http://zeppelin-211.nym1.placeiq.net:4046/jobs http://errors.angularjs.org/1.5.7/ngRepeat/dupes?p0=url%20in%20paragraph.runtimeInfos.jobUrl.values&p1=string%3Ahttp%3A%2F%2Fzeppelin-211.nym1.placeiq.net%3A4046%2Fjobs&p2=http%3A%2F%2Fzeppelin-211.nym1.placeiq.net%3A4046%2Fjobs at vendor.49d751b0c72342f6.js:36 at vendor.49d751b0c72342f6.js:40 at e (vendor.49d751b0c72342f6.js:38) at o.$digest (vendor.49d751b0c72342f6.js:38) at n.safeDigest (vendor.49d751b0c72342f6.js:76) at b (vendor.49d751b0c72342f6.js:76) at n._onMessageHandler (vendor.49d751b0c72342f6.js:76) at WebSocket. (vendor.49d751b0c72342f6.js:36) (anonymous) @ vendor.49d751b0c72342f6.js:37 4app.5a2c363a867d674675d7.js:34 Uncaught TypeError: Cannot read property 'p20180731_170134_1204161345_1_table_gridApi' of undefined at t.value (app.5a2c363a867d674675d7.js:34) at t.value (app.5a2c363a867d674675d7.js:34) at app.5a2c363a867d674675d7.js:47 at dispatch (vendor.49d751b0c72342f6.js:30) at q.handle (vendor.49d751b0c72342f6.js:30) 2vendor.49d751b0c72342f6.js:37 Error: [ngRepeat:dupes] Duplicates in a repeater are not allowed. Use 'track by' expression to specify unique keys. Repeater: url in paragraph.runtimeInfos.jobUrl.values, Duplicate key: string:http://zeppelin-211.nym1.placeiq.net:4046/jobs, Duplicate value: http://zeppelin-211.nym1.placeiq.net:4046/jobs http://errors.angularjs.org/1.5.7/ngRepeat/dupes?p0=url%20in%20paragraph.runtimeInfos.jobUrl.values&p1=string%3Ahttp%3A%2F%2Fzeppelin-211.nym1.placeiq.net%3A4046%2Fjobs&p2=http%3A%2F%2Fzeppelin-211.nym1.placeiq.net%3A4046%2Fjobs at vendor.49d751b0c72342f6.js:36 at vendor.49d751b0c72342f6.js:40 at e (vendor.49d751b0c72342f6.js:38) at o.$digest (vendor.49d751b0c72342f6.js:38) at n.safeDigest (vendor.49d751b0c72342f6.js:76) at b (vendor.49d751b0c72342f6.js:76) at n._onMessageHandler (vendor.49d751b0c72342f6.js:76) at WebSocket. (vendor.49d751b0c72342f6.js:36) (anonymous) @ vendor.49d751b0c72342f6.js:37 vendor.49d751b0c72342f6.js:37 TypeError: Cannot read property 'append' of undefined at N (app.5a2c363a867d674675d7.js:47) at app.5a2c363a867d674675d7.js:47 at o.$broadcast (vendor.49d751b0c72342f6.js:38) at n. (app.5a2c363a867d674675d7.js:49) at b (vendor.49d751b0c72342f6.js:76) at n._onMessageHandler (vendor.49d751b0c72342f6.js:76) at WebSocket. (vendor.49d751b0c72342f6.js:36) (anonymous) @ vendor.49d751b0c72342f6.js:37 5app.5a2c363a867d674675d7.js:34 Uncaught TypeError: Cannot read property 'p20180731_170134_1204161345_1_table_gridApi' of undefined at t.value (app.5a2c363a867d674675d7.js:34) at t.value (app.5a2c363a867d674675d7.js:34) at app.5a2c363a867d674675d7.js:47 at dispatch (vendor.49d751b0c72342f6.js:30) at q.handle (vendor.49d751b0c72342f6.js:30) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRocUKHxLCSX4j647O1w0jxjhM3bDhmhFziLTmI8VVNzEaRIk0= ) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRocUKHxLCSX4j647O1w0jxjhM3bDhmhFziLTmI8VVNzEaRIk0= ) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRocUKHxLCSX4j647O1w0jxjhM3bDhmhFziLTmI8VVNzEaRIk0= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRoOFeHnLOSGIzi56L-yVaywgw2IlQ61BtXTbRi3qcjEDz1bVEqzDln ) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRoOFeHnLOSGIzi56L-yVaywgw2IlQ61BtXTbRi3qcjEDz1bVEqzDln ) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRoOFeHnLOSGIzi56L-yVaywgw2IlQ61BtXTbRi3qcjEDz1bVEqzDln ) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRoOFeHnLCSBtbw47O1yFawhlI5LFpw7QY4tTUEqx6defTxkDB-0raKExnGfrg= ) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc3NTk3/MJrFny_hrEalR4e92sDW37A3ATK8N4BnKopavBqcfLosfdKXvICvdzid_du-p5ELLJrA8SYMBXZFjjRDsd-5NqazD1BwbB_ZbwBUbcQyNkctERiAx8f0PhLCPFECPq5s5RLbxHOaCqRoOFeHnLCSBtbw47O1yFawhlI5LFpw7QY4tTUEqx6defTxkDB-0raKExnGfrg= ) ( https://share.polymail.io/v1/z/b/NWI2OWViNzc
Re: Stuck notebook
Ok, unfortunately this notebook died last week (and is still dead) so I don't want to share weeks of logs. Lets just put this on hold. When it happens again I'll share those logs. Thanks for the help! ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt1k3K97Je6yn1wqN3umgTslVW4xqYyTmBSl-BiEwTk30= ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt1k3K97Je6yn1wqN3umgTslVW4xqYyTmBSl-BiEwTk30= ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt1k3K97Je6yn1wqN3umgTslVW4xqYyTmBSl-BiEwTk30= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnwsOwtjk7KsLZG7zi-yL009ncS_M4ra5VPTUxXhJiobyfOcD6r3c13 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnwsOwtjk7KsLZG7zi-yL009ncS_M4ra5VPTUxXhJiobyfOcD6r3c13 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnwsOwtjk7KsLZG7zi-yL009ncS_M4ra5VPTUxXhJiobyfOcD6r3c13 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnwsOwtjk3KruxU6yn1yb02sikd8sBhUohN_3Kpbv938PaZizHYYRYjsv2WqMI= ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnwsOwtjk3KruxU6yn1yb02sikd8sBhUohN_3Kpbv938PaZizHYYRYjsv2WqMI= ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnwsOwtjk3Kruxe4yT7zrYwtykd8sBhYYtB7HaORjQE_gh8I_TOYxoLgr0m4YGcwyezDy4v0Q== ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnwsOwtjk3Kruxe4yT7zrYwtykd8sBhYYtB7HaORjQE_gh8I_TOYxoLgr0m4YGcwyezDy4v0Q== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt1k3K97Je6yn1wqN3umgTsp9-M9EDrCLPDS1b4gV-JfjW4yj5kIiMcuAiu8UC6PeAHvQ-zXjYR5S-bBgJu39KsvUbLjivXKL1moKlcctAXXIVoqDde8XJVglrkLcSBNyT5EV4TLkBEUXFUHV5xISAzQcv-i8Z ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt0Vbcuqdb-2TzxL926zdPqIJ_MMsdpDiBXHgB4Ah8P7DJ4Sjng4CKf748vcVB5OuAHf1w3H7UW476bxASryEK7aQHbHCiR633hMgCDCJ_eNhGBJ9GGwKUnbd9 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt0Vbcuqdb-2TzxL926zdPqIJ_MMsdpDiBXHgB4Ah8P7DJ4Sjng4CKf748vcVB5OuAHf1w3H7UW476bxASryEK7aQHbHCiR633hMgCDCJ_eNhGBJ9GGwKUnbd9 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt0Vbcuqdb-2TzxL926zdPqIJ_MMsdpDiBXHgB4Ah8P7DJ4Sjng4CKf748vcVB5OuAHf1w3H7UW476bxASryEK7aQHbHCiR633hMgCDCJ_eNhGBJ9GGwKUnbd9 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt0Vbcuqdb-2TzxL926zdPqIJ_MMsdpDiBXHgB4Ah8P7DJ4Sjng4CKf748vcVB5OuAHf1w3H7UW476bxASryEK7aQHbHCiR633hMgCDCJ_eNhGBJ9GGwKUnbd9 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt0Vbcuqdb-2TzxL926zdPq4J-McscpDiNWnoH5xt2KPqS82Hzg4CaZaw3vs5B-fOAEvN-zWvUU46kJhgV42II9-hadGazR6H6k8ixPl6L9esHzK6_6FmC9f07 ) ( https://share.polymail.io/v1/z/b/NWI2MDY3YzM4NDZh/50x33yIXGAHHnacL8edBZOGVngk9BHRe0RcEKaOwL5BBJm9rkc08TwaM8xV9tNl_EmdzSlT7mt4C792UQNGtbP17THk5M6prM1Um9U55YIZu2yd-AXAs7nBFguS5GNPF261RwL_5pTnw-fkt0Vbcuqdb-2TzxL926zdPq4J-NssdrziQU3
Stuck notebook
I have a notebook that is just completely stuck. All other notebooks seem to be fine, but when I try to run a paragraph in this particular notebook it just switches to pending immediately and never changes. If I click the play button again it switches instantly to abort. I've given it a day and nothing has recovered. Is there anything I can do short of restarting the entire zeppelin server? Some process I can kill? Any ideas? ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv1iyVOdaYn7BmHlGPOSvFYs-5S1Zjje7FZSz1PfJOAko= ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv1iyVOdaYn7BmHlGPOSvFYs-5S1Zjje7FZSz1PfJOAko= ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv1iyVOdaYn7BmHlGPOSvFYs-5S1Zjje7FZSz1PfJOAko= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZA2cevji-VftKAm6EtFE_MdTTELIqfAEtMYzuObOKWelsXc9pbHziV ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZA2cevji-VftKAm6EtFE_MdTTELIqfAEtMYzuObOKWelsXc9pbHziV ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZA2cevji-VftKAm6EtFE_MdTTELIqfAEtMYzuObOKWelsXc9pbHziV ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZA2cevjiyVYIiSn7BmFU_OMWrLIoTVOVYwrpKTmy-cYplbHJ8Ax8pGFkpwuAk= ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZA2cevjiyVYIiSn7BmFU_OMWrLIoTVOVYwrpKTmy-cYplbHJ8Ax8pGFkpwuAk= ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZA2cevjiyVYIiYl71oEkTINGrLIoTVClU8vZa0s8P6c_JJynQi4OJh4ogsCoGCHEgCzw1Ssw== ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZA2cevjiyVYIiYl71oEkTINGrLIoTVClU8vZa0s8P6c_JJynQi4OJh4ogsCoGCHEgCzw1Ssw== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv1iyVOdaYn7BmHlGPOSvFYtvKWA9-_cL1-Nqlb_9LzHg6bzZYYi1LwjuSLfiqoX6Ly1CTA4Sb62Tc90YyuNGXTRX-yBrkOiJxa5QpIpQzQbGHvGZHlQLQGg424iNCrVkOvkVFioRzZQysZROR6Wr5uWGXXOH4 ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv0TeDdMOdj_1gGE2OaHSZeMbLWxVg9di7qY__bfJJ1jAlbTZGcSVNz2WMK_jprWKLyFndEoKX936Y9E4prI_XEkTiilLpIS1zdd68p8Acd2tb50aNIv_U2Iqo ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv0TeDdMOdj_1gGE2OaHSZeMbLWxVg9di7qY__bfJJ1jAlbTZGcSVNz2WMK_jprWKLyFndEoKX936Y9E4prI_XEkTiilLpIS1zdd68p8Acd2tb50aNIv_U2Iqo ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv0TeDdMOdj_1gGE2OaHSZeMbLWxVg9di7qY__bfJJ1jAlbTZGcSVNz2WMK_jprWKLyFndEoKX936Y9E4prI_XEkTiilLpIS1zdd68p8Acd2tb50aNIv_U2Iqo ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv0TeDdMOdj_1gGE2OaHSZeMbLWxVg9di7qY__bfJJ1jAlbTZGcSVNz2WMK_jprWKLyFndEoKX936Y9E4prI_XEkTiilLpIS1zdd68p8Acd2tb50aNIv_U2Iqo ) ( https://share.polymail.io/v1/z/b/NWI1YjM5YTc3MGVk/DW9zykZxH9IjnNT69HfT6iEQi9T_oxUXs8Bo4vZ3bsaKHBT4Vfbltv7W5tidUr_LpQtbYGFhYlJC1BBPmak9yRlVmA0iMEBQt7RC4GhPinUxE5zAUu73vuW9PvT2U93z8aYyLRQelTZAkNKv0TeDdMOdj_1gGE2OaHSZe8bKWhVh9di3r435auFDwXp-f39ScSVd1XeHKPPpsHqLx1fTA5eX_37GvUYu4MzVCAi_kkT4ISF-Yt4Plbzo-lgaL3d00aTCsMDu ) (
Re: Multi-line scripts in spark interpreter
This behavior is coming from the new spark interpreter. Jeff opened ZEPPELIN-3587 to fix it. In the mean time you can use the old spark interpreter (set zeppelin.spark.useNew to false) to get around this. Hopefully you aren't dependent on the new spark interpreter. ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEWajTUYXBwH-r0FFZQrWW1LYYMXbcWNTB3kgkqCy72PU= ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEWajTUYXBwH-r0FFZQrWW1LYYMXbcWNTB3kgkqCy72PU= ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEWajTUYXBwH-r0FFZQrWW1LYYMXbcWNTB3kgkqCy72PU= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcu8kTEAavTFoHZxG7g2k8aDqqXmoG96bXk8k2NoW-CJz4H-B7deK9g ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcu8kTEAavTFoHZxG7g2k8aDqqXmoG96bXk8k2NoW-CJz4H-B7deK9g ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcu8kTEAavTFoHZxG7g2k8aDqqXmoG96bXk8k2NoW-CJz4H-B7deK9g ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcu8kTEAajTCNvLwH-r208YSvSYlI_30Khz3AMznqAuSGnrVMUuXbjGMX1r1Eo= ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcu8kTEAajTCNvLwH-r208YSvSYlI_30Khz3AMznqAuSGnrVMUuXbjGMX1r1Eo= ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcu8kTEAajTCNvByHKl3EQeT_SYlI_346t_zwcUtq_9N2dRze5S16ekDyvS6dsRdPiNXBOJbQ== ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcu8kTEAajTCNvByHKl3EQeT_SYlI_346t_zwcUtq_9N2dRze5S16ekDyvS6dsRdPiNXBOJbQ== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEWajTUYXBwH-r0FFZQrWW1NDosfE9j1NV_baiK2pTy-JK87yj6Y_0nfHzZB_hCRUPfc4tCpWqqiveDFDGCnWhYtnvnOfy2qtlDmosP_GPBRDhm1BbQQgXyo8QKmL_9moEpVVKabmAUBhtqpY4Q9gYRd4KCiPf ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEXrPFHJDE0DKt1k1YE-rKzs3psusjh0kbrOP4KWdR0apV8by9-ofykK_tYh-iBQkPfsdjG5OmtjGaD1jdHivhPYjz3q__waRnECBX32FY2MY-EenNIIY9cpoN ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEXrPFHJDE0DKt1k1YE-rKzs3psusjh0kbrOP4KWdR0apV8by9-ofykK_tYh-iBQkPfsdjG5OmtjGaD1jdHivhPYjz3q__waRnECBX32FY2MY-EenNIIY9cpoN ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEXrPFHJDE0DKt1k1YE-rKzs3psusjh0kbrOP4KWdR0apV8by9-ofykK_tYh-iBQkPfsdjG5OmtjGaD1jdHivhPYjz3q__waRnECBX32FY2MY-EenNIIY9cpoN ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEXrPFHJDE0DKt1k1YE-rKzs3psusjh0kbrOP4KWdR0apV8by9-ofykK_tYh-iBQkPfsdjG5OmtjGaD1jdHivhPYjz3q__waRnECBX32FY2MY-EenNIIY9cpoN ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI4NmJm/RwQQUVo2H_kWCS78pLVi9PIldQ2hmape3YYPFK7buLKn4LKJKPMGWYTOd2H7Vbs9WdGULOGVl7z4afgAb3g1VbNJxDtaM99_oOX4Trk0NyaERQoT1Uhm8nazbRhWxN_C33aRro1-2Jcuu1HEXrPFHJDE0DKt1k1YE-rKzc3os-sih0kXquH-LnRbxuAO4_Wp-ofiir3mYRSiGBEPccltCoamvjHERlDaUmjjJ8SuxrnuwahqByDk7R2sVfV_2dg0090rGtBL ) ( https://share.polymail.io/v1/z/b/NWI0N2FjMmI
Re: Paragraphs collapsing
I created https://issues.apache.org/jira/browse/ZEPPELIN-3616 ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2fD8-5ZZjzrIqop10D1CcNl3YoBY1BqzLkKtRRXRzAe9Krp_bRzHNSflM8zzt3f3dc736rdGH3bWobPv ) However we don’t yet know how to reliably reproduce. Will add more detail to the ticket if we come to better understand how to reproduce, but if anyone else experiencing this can contribute anything helpful (when this happens? how long it takes? do multiple users need to be on zeppelin? do other cells in the notebook need to be run?) that would be appreciated. ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQge74ppNQnXfMs5o42zcBMKucl3c7VRtZdwUsRMZdjfY= ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQge74ppNQnXfMs5o42zcBMKucl3c7VRtZdwUsRMZdjfY= ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQge74ppNQnXfMs5o42zcBMKucl3c7VRtZdwUsRMZdjfY= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2e344ZdImWaHuYR7lygAfsh1JJtJ5Ho5h9IyAA-xyh8rth1k ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2e344ZdImWaHuYR7lygAfsh1JJtJ5Ho5h9IyAA-xyh8rth1k ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2e344ZdImWaHuYR7lygAfsh1JJtJ5Ho5h9IyAA-xyh8rth1k ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2e74_81anXfMuIR503YPcMY_HYZQxR7VHY-gbfB5dnBg35QX8ZicwPg= ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2e74_81anXfMuIR503YPcMY_HYZQxR7VHY-gbfB5dnBg35QX8ZicwPg= ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2e74_81QlXrCv49_1nYPcMY_LoVc1hryNR-yXgfXhjSJLO6BNdjbv7sVboLIroQCCg== ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4H90Q2e74_81QlXrCv49_1nYPcMY_LoVc1hryNR-yXgfXhjSJLO6BNdjbv7sVboLIroQCCg== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQge74ppNQnXfMs5o42zcBMJkgfN8elk6zfgbtQgrVgDiRC8dUQDjsfDmka5RysoprbXgLomEZJkgh3QrauwUs9r9YftETRbMPuxqbw0wh7S5hCY05pa-JvwIEfJTuD7EeRHofS6VqCYcwyRMM0YVkPbIc3YnM ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQhvXu64ZVjTrKtYY5imhdKoQhf8UAnlT9L1O3QAfXmnCOCcdKUzDqcWe6bZQxvpZrbnFFs2cVOlJl3gLBr1tsqe5EPJkeXrwNpVApq2rFAxDoYgX3iPfAHKP7 ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQhvXu64ZVjTrKtYY5imhdKoQhf8UAnlT9L1O3QAfXmnCOCcdKUzDqcWe6bZQxvpZrbnFFs2cVOlJl3gLBr1tsqe5EPJkeXrwNpVApq2rFAxDoYgX3iPfAHKP7 ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQhvXu64ZVjTrKtYY5imhdKoQhf8UAnlT9L1O3QAfXmnCOCcdKUzDqcWe6bZQxvpZrbnFFs2cVOlJl3gLBr1tsqe5EPJkeXrwNpVApq2rFAxDoYgX3iPfAHKP7 ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTRd8Wi4XM-P-S3TOHOMVxlMFWZYGN7zgW6XAMGs2jyPS6z6BkNgaAa4vArG7J-ybIDZ4VsgQhvXu64ZVjTrKtYY5imhdKoQhf8UAnlT9L1O3QAfXmnCOCcdKUzDqcWe6bZQxvpZrbnFFs2cVOlJl3gLBr1tsqe5EPJkeXrwNpVApq2rFAxDoYgX3iPfAHKP7 ) ( https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e
Paragraphs collapsing
We are using 0.8 release and noticed that the editor section of paragraphs will randomly collapse when you leave a notebook open for a while. Clicking "hide editor" followed by "show editor" will bring them back but it is quite annoying and wasn't there in the pre-release version we were using. I looked through jira but didn't immediately find an open issue for this. Anyone know whats up? ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn7gX-a2ZVD-pvQyJLgSHgY7mrQMolRGo4oWlOgAY-WZE= ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn7gX-a2ZVD-pvQyJLgSHgY7mrQMolRGo4oWlOgAY-WZE= ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn7gX-a2ZVD-pvQyJLgSHgY7mrQMolRGo4oWlOgAY-WZE= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXDoRntgb-LGJNC_skSTwIzT7hLUBZLXWaZW_MqbJZvYA7eUgo8RqW ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXDoRntgb-LGJNC_skSTwIzT7hLUBZLXWaZW_MqbJZvYA7eUgo8RqW ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXDoRntgb-LGJNC_skSTwIzT7hLUBZLXWaZW_MqbJZvYA7eUgo8RqW ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXDoRntgX-MjhfD-pvSDwKiWDuI04TFGjx3v_aR0uzjPJxQn6GHl3XlG7JNew= ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXDoRntgX-MjhfD-pvSDwKiWDuI04TFGjx3v_aR0uzjPJxQn6GHl3XlG7JNew= ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXDoRntgX-MjhVB-dhTzcMjGDuI04TJ2v9zfv9b1CCyFieNZ0bS1paOqL6unut8q80h8ORfg== ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXDoRntgX-MjhVB-dhTzcMjGDuI04TJ2v9zfv9b1CCyFieNZ0bS1paOqL6unut8q80h8ORfg== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn7gX-a2ZVD-pvQyJLgSHgYxEMdTG_ja-8JEnd1FWcM5EDT9Dz3yn0tvV4nk9H6xgu21EZqEoRM1f_mjsJveM4YmkNUafbl96j0UP4ugJV8dkqH-HC3oEfTf6VPtlZgtAqeZT-pOOsPdzMJn5XPEvng7xWOKp5 ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn6R7oJnNQH6dpRT5K0H68eQwNdiuhhbXydRyH1lieKdkcTdDtzCHyu6tmmE8E5wQu2FhXuUwdL027mTMSqb14PTgRE-_WjNGhzwnUektnBE-k0_Xbs-YDXfs0 ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn6R7oJnNQH6dpRT5K0H68eQwNdiuhhbXydRyH1lieKdkcTdDtzCHyu6tmmE8E5wQu2FhXuUwdL027mTMSqb14PTgRE-_WjNGhzwnUektnBE-k0_Xbs-YDXfs0 ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn6R7oJnNQH6dpRT5K0H68eQwNdiuhhbXydRyH1lieKdkcTdDtzCHyu6tmmE8E5wQu2FhXuUwdL027mTMSqb14PTgRE-_WjNGhzwnUektnBE-k0_Xbs-YDXfs0 ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn6R7oJnNQH6dpRT5K0H68eQwNdiuhhbXydRyH1lieKdkcTdDtzCHyu6tmmE8E5wQu2FhXuUwdL027mTMSqb14PTgRE-_WjNGhzwnUektnBE-k0_Xbs-YDXfs0 ) ( https://share.polymail.io/v1/z/b/NWI0M2I5NWU4NmJm/1rVo9iKinRysHler5gdcH0DC_77dWkc-NKChI464_6MwZ_CPflgB3zN7x8Tb19cqdYpTZcNwm3sE4B-NIAyP0cMfmH-QTH8iUtZ6579WTCl8VNVYIqXw_I7Z-FzYfB4rfduIxMnHcTCXR5Fn6R7oJnNQH6dpRT5K0H68egwMdyughbX-cx6B0UuUPpNHX5n5zCHiobltm0QE-hwu11ZZqFkdJ03l0DsV5f56J3RMC_nHjN2s2AlnSDeTiXzlG8QiQL0VNbFy ) ( https://share.polym
Re: [EXTERNAL] Re: Zeppelin starting time - tied to the load of notebooks loading
Incase anyone else is trying to leave the mailing list, the way to do it is to go to this page: http://zeppelin.apache.org/community.html ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPpF-oJ8FbqEEcN_nYw9EuVolm4Cq1hb9klPLo-A3yZ-W-hJCApTNQPcwPr7YI1CLK1u8= ) Then on the right where it has mailing lists find "unsubscribe" right after "Users". Click that unsubscribe link and send the email it pre-populates for you. Yelling at Moon is not the preferred approach. ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV439U_iUy2Jvmj5KloMGp_w= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV439U_iUy2Jvmj5KloMGp_w= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV439U_iUy2Jvmj5KloMGp_w= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U6vPtBDpF0cNebUj8knGYVx7nQH--s44p3fdzk5nUPkq_w2 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U6vPtBDpF0cNebUj8knGYVx7nQH--s44p3fdzk5nUPkq_w2 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U6vPtBDpF0cNebUj8knGYVx7nQH--s44p3fdzk5nUPkq_w2 ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpRoExXNObWy5coF4s712m3ibdAsKAAGANb8_iidW0-hmfthQo= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpRoExXNObWy5coF4s712m3ibdAsKAAGANb8_iidW0-hmfthQo= ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpbqEFZM-3QzpcoF4s75Gq7mrNnmLPx4BW_aviiu3WvdLha9f__odR294zZfQ== ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DLf4P8U2vIIpbqEFZM-3QzpcoF4s75Gq7mrNnmLPx4BW_aviiu3WvdLha9f__odR294zZfQ== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPqU2vedRboExXP_iXw9YmV9QktjD52ucm06qu_Bi9bPS6mbSqlQDaG9bjaNZStDzXPqCKyfuAY5fvlD_pSF23iPTcKyWEAhjJuoQZ3-7QBLmgw3U_msVxS9jsn2kH3p3Uh7uoBqNXvVCNU9fa4XJHkSpSO7hA ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9oSrPFctNa5Q3A7sW619NS-B9O0sobSETrHIABe7DNpFAXJOO6mLtAKX5-0wu0D9A4CHdLw21wY0po7W6C7Nw4jJXxV_DZOsPrla5NMFesAFROeSWkol6TckltSrn0v1ogv_0_hW_drylm7S0hgjcFoj9btYRuCDXPanE2P2Mf42rlzfyXAP316XAaW2JGRfLpM7GhTPEK5ZwW3DH468Mhelg ) ( https://share.polymail.io/v1/z/b/NWI0MzdkNDk4NmJm/xLQITY8DhRwawHWvE198Gcyq6gNjbPHi9DHeAv9osgw1nZo9o
Re: [DISCUSS] Is interpreter binding necessary ?
For 2a, just making sure I understand and see if it covers our use case: we have multiple spark interpeters that we want to be able to set as default. They could all be pyspark, but differ by the configuration of max number of cores, or yarn queue. Is the plan to still allow for setting these differently configured interpreters as default? Thanks! ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FwkpA8Gi2XjMjqY8cwrzlU7tfVkikhgjKJ9xsKtD_D7M= ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FwkpA8Gi2XjMjqY8cwrzlU7tfVkikhgjKJ9xsKtD_D7M= ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FwkpA8Gi2XjMjqY8cwrzlU7tfVkikhgjKJ9xsKtD_D7M= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adj-uFmklAt2yuWiJoo5FfjqPkHdA-NBhhtyfMSajZ8y_m78pUn0-K ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adj-uFmklAt2yuWiJoo5FfjqPkHdA-NBhhtyfMSajZ8y_m78pUn0-K ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adj-uFmklAt2yuWiJoo5FfjqPkHdA-NBhhtyfMSajZ8y_m78pUn0-K ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adj-uFmkpAqTa8XjMjopFdyv3rE950DQVdS6e4drDi7LykAKYluR3g-OSP3Sk= ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adj-uFmkpAqTa8XjMjopFdyv3rE950DQVdS6e4drDi7LykAKYluR3g-OSP3Sk= ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adj-uFmkpAqTa2Vj4tpZpbz_3rE950PgZRWKOfXgJ27cRnqx-kn4SQ93HtpZ_lCYUJDj0DNA== ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adj-uFmkpAqTa2Vj4tpZpbz_3rE950PgZRWKOfXgJ27cRnqx-kn4SQ93HtpZ_lCYUJDj0DNA== ) SR. DATA SCIENTIST (217) 390-3033 ( tel:(217)%20390-3033 ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FwkpA8Gi2XjMjqY8cwrzlU4FrbFwTGPfeFRsp8cllrRO8G4Tys6zAM5S9TsCt2H2x-lSljbv4C4khoKCT_M7VHugJCDLqgR0Vlj9v6Sxk_xedlGJqAglByPCa123PcSo-s4itmu2fM7_YCFubo3HRVINfo5Rg ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FxVFWvX2zTn4lr5Mdk-O5SZxqb0YNEO2QRE5z88Rnt1ujGYTsoKTGPsqjSMDu1GGx-V3rnL30F5Nlo6iI6JCVQbkVSnrnmhIXiHWO30KeAWBv2fwtUizOfE8c ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FxVFWvX2zTn4lr5Mdk-O5SZxqb0YNEO2QRE5z88Rnt1ujGYTsoKTGPsqjSMDu1GGx-V3rnL30F5Nlo6iI6JCVQbkVSnrnmhIXiHWO30KeAWBv2fwtUizOfE8c ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FxVFWvX2zTn4lr5Mdk-O5SZxqb0YNEO2QRE5z88Rnt1ujGYTsoKTGPsqjSMDu1GGx-V3rnL30F5Nlo6iI6JCVQbkVSnrnmhIXiHWO30KeAWBv2fwtUizOfE8c ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FxVFWvX2zTn4lr5Mdk-O5SZxqb0YNEO2QRE5z88Rnt1ujGYTsoKTGPsqjSMDu1GGx-V3rnL30F5Nlo6iI6JCVQbkVSnrnmhIXiHWO30KeAWBv2fwtUizOfE8c ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy/pd940T9Ui4qGERrcLz0Pxmz26LP3hSe2jeSmkBL9mH9G2LqnZuk21lFYVkXoWXEGMuQRZCM34la8QU9fTClDzcRVPnflz-MHNetXmpZi14odv9uravBVNvdIw3jgmSaGe0Q2ttcXS3Adxv6FxVFWvX2zTn4lr5Mdk-O5SpxrbkYMEO2cQkx19NdtoBH4C834oKTWJNioS8vuyXmx9lPljaj0H5M76qCPpNOXW_VIUmz2mh4an3U97T5qjFMuEc3UoXfYFAVa ) ( https://share.polymail.io/v1/z/b/NWI0MmJhMmUwODgy
Re: [DISCUSS] Is interpreter binding necessary ?
I agree with Partridge. We have different interpreters defined with different queues and settings. So we need a way to quickly change the default interpreter and can’t rely on typing the desired interpreter at the start of each paragraph. ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWW0TiJaTPs_IOYGlF1ZvI7h9Qb2g_eDdzcp6fWnRGMKU= ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWW0TiJaTPs_IOYGlF1ZvI7h9Qb2g_eDdzcp6fWnRGMKU= ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWW0TiJaTPs_IOYGlF1ZvI7h9Qb2g_eDdzcp6fWnRGMKU= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stTsANWA0fiYqDXt-NFancGmYTJoNoEym-hk4ZudikiEh22ahQg0LL2 ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stTsANWA0fiYqDXt-NFancGmYTJoNoEym-hk4ZudikiEh22ahQg0LL2 ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stTsANWA0fiYqDXt-NFancGmYTJoNoEym-hk4ZudikiEh22ahQg0LL2 ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stTsANWA0TifPrFs_IOa3cE3drGrtRO83LeA-sOurZBpe40Kl9Vs2ciD7HZiFQ= ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stTsANWA0TifPrFs_IOa3cE3drGrtRO83LeA-sOurZBpe40Kl9Vs2ciD7HZiFQ= ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stTsANWA0TifPrPu_8AbHwC2NrGrtROwHHSEO8pkpgUNczTb1OqOVPmpWhChtSWVFdvwywOLA== ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stTsANWA0TifPrPu_8AbHwC2NrGrtROwHHSEO8pkpgUNczTb1OqOVPmpWhChtSWVFdvwywOLA== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWW0TiJaTPs_IOYGlF1ZvI7otRkiuQULto2YFLKcHRaV-yQzCzzfozP1Vkx88WZ1XBuYhJEPd237RkovCaAxj0DNIuDG3qWOUDdM3xXXYnBAZyQ61ybfDbOnVWvhsXK0DXpbBauRLrhIQKcCDAthsl-eAsaQQD ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWXF_0aLHKo78IZnVEhMSU9JZQkTGOWKEmiNQRK8zTcxetQTCt3vI1Mgt6wc9Va0nBuoEHAfF6w64gofiBF0a0U4MyTiXnQ-oBaof1lKHJ7EeRjvYnxfekhrV- ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWXF_0aLHKo78IZnVEhMSU9JZQkTGOWKEmiNQRK8zTcxetQTCt3vI1Mgt6wc9Va0nBuoEHAfF6w64gofiBF0a0U4MyTiXnQ-oBaof1lKHJ7EeRjvYnxfekhrV- ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWXF_0aLHKo78IZnVEhMSU9JZQkTGOWKEmiNQRK8zTcxetQTCt3vI1Mgt6wc9Va0nBuoEHAfF6w64gofiBF0a0U4MyTiXnQ-oBaof1lKHJ7EeRjvYnxfekhrV- ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWXF_0aLHKo78IZnVEhMSU9JZQkTGOWKEmiNQRK8zTcxetQTCt3vI1Mgt6wc9Va0nBuoEHAfF6w64gofiBF0a0U4MyTiXnQ-oBaof1lKHJ7EeRjvYnxfekhrV- ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT-RZWXF_0aLHKo78IZnVEhMSU95ZRkDGPWKEqjtYXLN_ZZF32U3m53vIlKBlxwsRVdlHBtY8JEOR6y65-6PCGWwW2Sc9vVjP2Q-YMfYdGpt09YXTQRsfeNqyy7v84 ) ( https://share.polymail.io/v1/z/b/NWIzZjZkNTc0YWE0/kVB6OMitKz7Pqm5NuaQG4awyekI99c0gkhUdEDv2kriJlBnjhW1b_KV6uy_oCGrO25Ri9NpPRXrqb1oYLH5U3-CVKF4hGqzYaRjNEfcRIrXjFevdugvD0d2pmfVXx7uzGRDDgZjI9stT
illegal start of definition with new spark interpreter
Hi all, When I try switching over to the new spark interpreter it seems there is a fundamental difference in how code is interpreted? Maybe that shouldn't be a surprise, but I'm wondering if other people have experienced it and if there is any work around or hope for a change in the future. Specifically, if I write some very normal code that looks like the following: df. groupBy ( "x" ). count (). filter ( $ "count" >= 2 ) everything works fine with the old interpreter, but the new interpreter complains: :1: error: illegal start of definition .filter($"count" >= 2) I realize that I can work around this by ending each line with a dot, but then * I'm coding like a psychopath and * I would have to go back and change every line of code in old notebooks Is this actually a bug/feature of the new spark interpreter or do I have some configuration problem. If it is a property of the new interpreter, is it always going to be this way? For now we are just telling our users not to use the new spark interpreter. ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjpmE2Bvg596DwyK05I1SsVY-kp8PsAj6WdQTW0U2L8LMgGIMg= ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjpmE2Bvg596DwyK05I1SsVY-kp8PsAj6WdQTW0U2L8LMgGIMg= ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjpmE2Bvg596DwyK05I1SsVY-kp8PsAj6WdQTW0U2L8LMgGIMg= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjp0ViB5g19rzgqL18D3zVWL_Yovqjcf3eTUmSdXsxBh2F4o-odu412 ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjp0ViB5g19rzgqL18D3zVWL_Yovqjcf3eTUmSdXsxBh2F4o-odu412 ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjp0ViB5g19rzgqL18D3zVWL_Yovqjcf3eTUmSdXsxBh2F4o-odu412 ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjp0ViB5g59sWI4K05I3jVUa6gnsKaWRmoHxaqN3CPVWF2pfMAieoC9dpglZUs= ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjp0ViB5g59sWI4K05I3jVUa6gnsKaWRmoHxaqN3CPVWF2pfMAieoC9dpglZUs= ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjp0ViB5g59sWIyI0NG2T5SbqgnsKaWdWkL1q6q9CmftrGMCtphsSZSCBjrabID3lyZuedEwA== ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjp0ViB5g59sWIyI0NG2T5SbqgnsKaWdWkL1q6q9CmftrGMCtphsSZSCBjrabID3lyZuedEwA== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjpmE2Bvg596DwyK05I1SsVY-kp8PmJJzNJlvrrvzDAqryODNZ5pCtDZZz9mle8pBBUf6jm44DjwLBrMDiahOeN-518iU_SOsoAPzAhd70cJ7GhYj8Re3xFG4oGMuFlUC6VvZab6MigiBSyzHi6ALGoUP-Nxsds0-PJ ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjpmE2BuRVrpSk3OwNO0zcUMrZ16uSIJClXnuCl7mWaqLGMFp5mpitddpT7lwmiohAXc7Tm4Imt0bZnLCLeh--W78M81h7OeIINJD8jafepfNMBMRYjosnFeOIoHhzy ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjpmE2BuRVrpSk3OwNO0zcUMrZ16uSIJClXnuCl7mWaqLGMFp5mpitddpT7lwmiohAXc7Tm4Imt0bZnLCLeh--W78M81h7OeIINJD8jafepfNMBMRYjosnFeOIoHhzy ) ( https://share.polymail.io/v1/z/b/NWIzZTQ5ZWY0MWMz/rznLZYVOWjGxxi2kFmK48vTZxo2CZHXAQmA_20mvA1WkQiUmf17mp3CRW1AIDwUEcCUCPfnAWAR5tbmsk7gI0f1UE2JEGNTdtJILqpKarT3lU8mACK-GjghWsZWiB9kb1s2Ioq_JiKjpmE2BuRVrpSk3OwNO0zcUMrZ16uSIJClXnuCl7mWaqLGMFp5mpitddpT7lwmiohAXc7Tm4Imt0bZnLCLeh--W78M81h7OeIINJD8jafepfNMBMRYjosnFeOIoHhzy ) (
Re: Re: Spark Interpreter Tutorial in Apache Zeppelin
This is great! It inspired us to take another crack at using three of the newish features (new spark interpreter, yarn-cluster mode, and impersonation). If we run into problems and then find solutions we will share in case they are worth including in the documentation. ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHSxrACRfMzAch0gWzeykdCmI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHSxrACRfMzAch0gWzeykdCmI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHSxrACRfMzAch0gWzeykdCmI= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72oEN-JhZ97M16f8QSkGBQdAxBxRHcrot_MzEHUJETwJiBHr ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72oEN-JhZ97M16f8QSkGBQdAxBxRHcrot_MzEHUJETwJiBHr ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72oEN-JhZ97M16f8QSkGBQdAxBxRHcrot_MzEHUJETwJiBHr ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbhzY8-H1qf-BXcJCwkK_QEIedSIBIQ8DXJf4eUC4QfR1OoXfQI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbhzY8-H1qf-BXcJCwkK_QEIedSIBIQ8DXJf4eUC4QfR1OoXfQI= ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbh5a8KJ0az4AHcJCwkKzgIEatCvLNxRiRKViOx7RXDQdE7OCXLRmVPo-QNzbw== ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vwppQ72kEKbh5a8KJ0az4AHcJCwkKzgIEatCvLNxRiRKViOx7RXDQdE7OCXLRmVPo-QNzbw== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49Qt2kEcOZ5Y8-H3bm_DTYHS1YVnFhGKoTuZ8UOlR-XjuBjGQ940bx8jNaBmCkhBSYIotlfJC4dxMbE-rTaW3Fd_2WP_5D2FegQUoz88mxhd7pAY27f6dPnm4aysy6TuBbqfHq45H_henvF2txpJCOCywHwhoRv ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUUsUn0JYIp6gNpBUlxKVlKh8Gw9mwrR6gYifniliCToIodARNSgR2NyA-bzBTy8doDSTvdj7DucSTMZCG8OVKD91U2yeQWJYhIHN ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg-URzCrBnrB6lsaUPE77UdnQClt2NroBPMWg1Vey1WXIsfUm0QUGEWDL6CadRXn5MeO87HHF4i16n7vi49QsHISPfN8c4KB26W-XGlbUksVnkJZIp6sMJJSkAGfg-InCUZywrRqm5qUnSJiFCIIrt4fJD0R0NzesLTGA2wfunjOpc7qDusfW8bxKb9hpQw0m11nsjlO7MuL ) ( https://share.polymail.io/v1/z/b/NWIxMDRlZWM4OWI3/JGgEsQTzSosYvQioT2pUycbf8VeyIKlLhOcSZopuzg8eOdC5WscX8eDX4p7Ykg
Working on a note that is being viewed by other users
Hi, In Zeppelin 0.8 we still find that if a notebook is opened by multiple users it becomes very hard to do any actual work on that notebook. If I’m working on a notebook and just a single coworker opens that notebook then the code I write randomly disappears after writing it quite regularly. The only solution right now is to talk to anyone who might be looking at the notebook and beg them to close it or to clone the notebook and start working on a new copy. I see that https://issues.apache.org/jira/browse/ZEPPELIN-3307 ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y2j9tUcuDh55KJSYevzb8SL1uYUr5gaLuG3TQybt0qdtRYSOimFHNLLMxr77O9I-XxSP9sFapJ2nwPER ) is open and there has been some progress at https://github.com/apache/zeppelin/pull/2848 ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y2bnslo-Hx57N5jUc-mU_Tj3uZUn5BfBtnbSGyX9kZEHJ-z__jlt96c7qMG-6vJUbRrGefc= ). However the ticket has this as a 0.9 change. I know 0.8 is getting close to release and don’t want to mess with all the work going into that, but if there is any chance at all this fix could sneak its way into 0.8 then that would just be amazing. Please? ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXHnQ3k3b56EInHFN9MYTVcfaYsbmPkVt3TCqpxCPgdS_Rim8= ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXHnQ3k3b56EInHFN9MYTVcfaYsbmPkVt3TCqpxCPgdS_Rim8= ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXHnQ3k3b56EInHFN9MYTVcfaYsbmPkVt3TCqpxCPgdS_Rim8= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y3X5r0Y_GEI2O5qWPemZ_zP3_55JzG_31edB1hmzoijeQYrW ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y3X5r0Y_GEI2O5qWPemZ_zP3_55JzG_31edB1hmzoijeQYrW ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y3X5r0Y_GEI2O5qWPemZ_zP3_55JzG_31edB1hmzoijeQYrW ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y3b5sRwtHFN9OpqUebeW8T29xoMj9wLti34UV8Fws2Ljav_4U8Nx1t0= ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y3b5sRwtHFN9OpqUebeW8T29xoMj9wLti34UV8Fws2Ljav_4U8Nx1t0= ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y3b5sRwnFF5zPZGSfLeW8T299YAv5AbKozDMWDTrmJRZTRWcYsgKij0mjaAGNq1zTg== ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXV2E3y3b5sRwnFF5zPZGSfLeW8T299YAv5AbKozDMWDTrmJRZTRWcYsgKij0mjaAGNq1zTg== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXHnQ3k3b56EInHFN9MYTVcfaYsWKip9ptpFKL6CmTRDnpnphBZPmlp0VsfayIn-cGzN5YvQTZI50JXqxdLK3b7Z0F9TJDsmNON5rakA9z2skahHI57CXiRfu63xVnE3gHR8MMdTXJHjtJS-lKXEt650zQLY_iNQ8D ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXHnQ3lG3vpVciDB57N5jUIKnEq3-jpMBzrEjFuXzJRjTrhNBeZvm7tE1qcPKWmedFwMJYvg2XMpsFQrYZL6XA-cNFqmNf8CtDLJXYjkWEry8FFluc5P6JAQM4qP02 ) ( https://share.polymail.io/v1/z/b/NWFlYjI5M2NlMzc3/pnYFED_0O3yPu9DdNIyvIY_hP7XAHneipj8AjB-QWysK-sw-4gkB1I7Fw3aq0341ghsuX0kpOxoXBekYE_X7jvI7FhqFh8rOguUeBuib_qCUz_MiJ0jCIvaGL1IYCxF1MxlFFUQddFPXHnQ3lG3vpVciDB57N5jUIKnEq3-jpMBzrEjFuXzJRjTrhNBeZvm7tE1qcPKWmedFwMJYvg2XMpsFQrYZL6XA
Manually import notes via copy notebook folder
Hopefully someone will jump in with a more specific answer but... We do this whenever we update zeppelin to a new version. We copy over both the notebook directory and the conf directory then restart. It works! But, hopefully someone can be more specific about what you need in conf. ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXp5Bwkj8Yt26o7V9tY2xG7CJFSVcmBI_S_yLn5nxiWLw= ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXp5Bwkj8Yt26o7V9tY2xG7CJFSVcmBI_S_yLn5nxiWLw= ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXp5Bwkj8Yt26o7V9tY2xG7CJFSVcmBI_S_yLn5nxiWLw= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6IJVX_5Nw1TsAs3_j50EuL3NHolWhHkrBa-CAChfihKtLUbwhMLa3 ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6IJVX_5Nw1TsAs3_j50EuL3NHolWhHkrBa-CAChfihKtLUbwhMLa3 ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6IJVX_5Nw1TsAs3_j50EuL3NHolWhHkrBa-CAChfihKtLUbwhMLa3 ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6IJVX_5Bwy2ESt26o5kEsay1IrFvrJ1f1LNnHncNPPgIs-aqnGWj7VBL4Uks= ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6IJVX_5Bwy2ESt26o5kEsay1IrFvrJ1f1LNnHncNPPgIs-aqnGWj7VBL4Uks= ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6IJVX_5Bwy2EYv2Om4Uoqbi1IrFvrFFT5P93gtVK_-S9RHPD8j2ZYehWslbxCHNTjflJ3FQ== ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6IJVX_5Bwy2EYv2Om4Uoqbi1IrFvrFFT5P93gtVK_-S9RHPD8j2ZYehWslbxCHNTjflJ3FQ== ) SR. DATA SCIENTIST (217) 390-3033 ( tel:(217)%20390-3033 ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXp5Bwkj8Yt26o7V9tY2xG7AT0Rg67f4mh_kvg5SJTGvzkPR5lDjAs2v4GbGBNMJDdIRE73ZF7DOALBBd1j_K1J1UKuUUpj_AyDJ8ZllyxokHcBbtKPehZRza4zDhf6zpnuymykut1niB1JbqKK96MKYMtu5-q ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXoItm3yodpyOu60NsMjMa9hn1RRSld5Pvrx665y9RALT7Px57HTgq16AYamAOPIzdIhh1zJd3EPpPBx9um6z1eAQW-w0klP8wEtW8ft-im13SjVngj5zIAtCa ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXoItm3yodpyOu60NsMjMa9hn1RRSld5Pvrx665y9RALT7Px57HTgq16AYamAOPIzdIhh1zJd3EPpPBx9um6z1eAQW-w0klP8wEtW8ft-im13SjVngj5zIAtCa ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXoItm3yodpyOu60NsMjMa9hn1RRSld5Pvrx665y9RALT7Px57HTgq16AYamAOPIzdIhh1zJd3EPpPBx9um6z1eAQW-w0klP8wEtW8ft-im13SjVngj5zIAtCa ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXoItm3yodpyOu60NsMjMa9hn1RRSld5Pvrx665y9RALT7Px57HTgq16AYamAOPIzdIhh1zJd3EPpPBx9um6z1eAQW-w0klP8wEtW8ft-im13SjVngj5zIAtCa ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq-9ihEhegNoOwyUCu2nteJ2jwIYIJL2pVF_RRJW1V75GAPSdG1p_I2wd5qdbmcNKYN4B311uFBlOC-kxRMpOja1AG2u0SsUkQrShDM5X-_6aYBXoItm3yodpyOu60NsMjMa9Rn0RBSkd5PjqRy84DxbF_6gLVdvHTg6zbITaWsOIZTdLRZ73YJ3GPoRThdp1-_3YkhL4xs1lPM9BdUPTKNWFm6TRWgZfMfeaprc ) ( https://share.polymail.io/v1/z/b/NWFlMzFjYTE4OTY4/dNnKmlylxn0x2Jr1438WvnPmk6G9pmCFrq
Adding interpreters after zeppelin build
When I last built zeppelin 0.8 I mistakenly didn’t include the angular interpreter in the build. Now a user is asking for it. Is there any way I can just build the angular interpreter and drop the built directory into zeppelin/interpreter then have it show up as an interpreter option? Or would I need to make major changes elsewhere? ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_cz9K77yjT-VQ4JIYZRe_1DGPgi7Er4r-sxtiROGRPNc= ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_cz9K77yjT-VQ4JIYZRe_1DGPgi7Er4r-sxtiROGRPNc= ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_cz9K77yjT-VQ4JIYZRe_1DGPgi7Er4r-sxtiROGRPNc= ) *Paul Brenner* ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpabOF_KzxKqLi7S_Qb6oxbKQi-mr7lcNE0vcnlRIyS5VjXrE3vc_K3 ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpabOF_KzxKqLi7S_Qb6oxbKQi-mr7lcNE0vcnlRIyS5VjXrE3vc_K3 ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpabOF_KzxKqLi7S_Qb6oxbKQi-mr7lcNE0vcnlRIyS5VjXrE3vc_K3 ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpabOF_Kz9KtuKpT-VQ64xZbVaxlLCvScwJTzyMv2OFMMIcjaUqsW3UdGXk8jk= ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpabOF_Kz9KtuKpT-VQ64xZbVaxlLCvScwJTzyMv2OFMMIcjaUqsW3UdGXk8jk= ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpabOF_Kz9KtuKjR-he7IdfaFaxlLCves8FXDirl7HyCCmqCVW1pejQ-gTxzc2Lbl2rbSv9lg== ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpabOF_Kz9KtuKjR-he7IdfaFaxlLCves8FXDirl7HyCCmqCVW1pejQ-gTxzc2Lbl2rbSv9lg== ) SR. DATA SCIENTIST (217) 390-3033 ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_cz9K77yjT-VQ4JIYZRe_1O-wKJVHHGzq3KitFCSoD1mtKefQsgofncnjfdzWHHpHZV5bjdU0QB2_C8W6Mtpz3337mKk_O5yS8ddNvVhk98EJseeTXRg9FhBUQHzuB73MOLzGHklUJPfHsUC9duqCXC7WK4lC ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_dCRcoqmmX6hW5o4ZNEjjzvKxK49ZFHakjf33FimqFRGyK-fOoQIZkJf9e9yVEGZHZlcVnNM4XAf7CM2hJoQzgCzn2uEyIJOQ753_DkyusBsZyIgKicuS1wu1 ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_dCRcoqmmX6hW5o4ZNEjjzvKxK49ZFHakjf33FimqFRGyK-fOoQIZkJf9e9yVEGZHZlcVnNM4XAf7CM2hJoQzgCzn2uEyIJOQ753_DkyusBsZyIgKicuS1wu1 ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_dCRcoqmmX6hW5o4ZNEjjzvKxK49ZFHakjf33FimqFRGyK-fOoQIZkJf9e9yVEGZHZlcVnNM4XAf7CM2hJoQzgCzn2uEyIJOQ753_DkyusBsZyIgKicuS1wu1 ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_dCRcoqmmX6hW5o4ZNEjjzvKxK49ZFHakjf33FimqFRGyK-fOoQIZkJf9e9yVEGZHZlcVnNM4XAf7CM2hJoQzgCzn2uEyIJOQ753_DkyusBsZyIgKicuS1wu1 ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2/Dbe_34w3p757YMkoeRsDeRp1g_syyCOsEbxC50yVe8fa2L8XGgt2FAf387PjJd6BJBM-dkG8GkMJNz4TDVquS_j0BM-Mb6uf3MYTlfxqu8D4Ci9C90SU6cd666upjV_mZvCvsxCNrIpaJfR_dCRcoqmmX6hW5o4ZNEjjzfKwKo9YFHaoi__xETqgAlvpOa7aoQIJioX2eNeVDX5HaVkbjcY4VAelQcWmascxmmC6wvcjIJ-d-J1MPDBaPShYALnzepCEv0Hz ) ( https://share.polymail.io/v1/z/b/NWFkNWZiZDQxYmI2
Re: TimeoutLifecycleManager not doing anything
These are Spark interpreters that aren’t getting killed. Does TimeoutLifecycleManager kill spark interpreters when the last submitted job finished was more than zeppelin.interpreter.lifecyclemanager.timeout.threshold milliseconds ago (+/- zeppelin.interpreter.lifecyclemanager.timeout.checkinterval)? Or is it based on something other than when the last job finished (leaving a notebook open in a browser tab maybe)? What happens if you have an interpreter set to be instantiated per note and isolated. If I run that interpreter on two different notebooks (creating two different spark jobs) and leave one idle but use the other, should the idle one still get killed? That would be ideal. I’m not sure what is causing these interpreters not to get killed so I don’t know how to explain how to reproduce the problem. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) SR. DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html ) On Fri, Apr 06, 2018 at 1:28 AM Jeff Zhang < Jeff Zhang ( Jeff Zhang ) > wrote: > > > Hi Paul, > > > What interpreter do you find that is not killed ? Unfortunately there's no > log for the lasttimeusing (I should add that for debugging). > > > And let me know if it is easy to reproduce. > > > > > > Paul Brenner < pbren...@placeiq.com >于2018年4月5日周四 下午11:21写道： > > >> >> Wow, looks like I was wrong. TimeoutLifecycleManager is definitely killing >> some idle interpreters, just not all idle interpreters. I have no idea >> what could be causing the difference. It looks like the manager is pulling >> some value for lasttimeusing here >> https://github.com/apache/zeppelin/blob/86f387e940eacb6dac7531a4ed2cadadaa381bbe/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/lifecycle/TimeoutLifecycleManager.java#L47 >> ( >> https://share.polymail.io/v1/z/b/NWFjNjNjMDc0ZWFi/6Zff_ZkywYC3DLCbIS8X_WEmw1V5BaikknznZ6LCyccNZKg9pLOcuXn-dfsZesa53zGcAv6M3lEqmXb3IGo21ejezflaXMGokN93jD1gpMd8ga0G2qZtbGCqRC3iyCA3sP6dnGVwSuyIpJOz_ZIrnMDJqQy8jv77XulymBRkRw6KViRLB-skqfm4plocl69EZ4kINl1cymifTZA27_f1MdHiCBWqXh5OpuesbRHHTMfR71SBpq8dWD3OF4Irlfdk5SFEKguu8BG4JXh_LT9SRBYaGRIJm2uP6s_THac9GNV_ljM_qgKTIOtCQfPRJALlgKpbSyD8evmeQ0WWxdPPd5qRY2_-_nhNdTlg6SzqRgNBdE9gHQvlpHFwDerhUZiYHC7TIL90 >> ) >> >> >> >> but I assume there is no way I can figure out what value that is for the >> idle interpreters I’m seeing that haven’t been killed. Is there anythin
Re: TimeoutLifecycleManager not doing anything
Wow, looks like I was wrong. TimeoutLifecycleManager is definitely killing some
idle interpreters, just not all idle interpreters. I have no idea what could be
causing the difference. It looks like the manager is pulling some value for
lasttimeusing here
https://github.com/apache/zeppelin/blob/86f387e940eacb6dac7531a4ed2cadadaa381bbe/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/lifecycle/TimeoutLifecycleManager.java#L47
(
https://share.polymail.io/v1/z/b/NWFjNjNjMDc0ZWFi/6Zff_ZkywYC3DLCbIS8X_WEmw1V5BaikknznZ6LCyccNZKg9pLOcuXn-dfsZesa53zGcAv6M3lEqmXb3IGo21ejezflaXMGokN93gyRjsNBJu68by6ptK23rSFzr3zwi7avA1ANxSvCNtYf_vZhtidjdqEq6zumxT-l2lxVvRxaDSTYBU7QstaPjrAEHn_xDN9MJNwULzTjNH5M07vKkZYW1WBD_WklE9OSqaVrcSISZu1qKra0dWCPZG4An1Kls42BOIgyl8AirMDY9IyRbRB0LDhBOkTaSoN7TGag8E9VsnTcqvR6IK7BOXajYPxTyhqddVWq_R_aWRVOA3fqJRZaff2Pn73lFfT1k9T2oSS9Wew1LTE78x00hKWkh_1r9w3i_sM4V61_eQlhLDxnO
)
but I assume there is no way I can figure out what value that is for the idle
interpreters I’m seeing that haven’t been killed. Is there anything else I can
look into or should I just accept that this feature is going to be partly
broken for us going forward?
( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) (
http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) (
https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) (
https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) (
https://www.linkedin.com/company/placeiq ) (
https://www.linkedin.com/company/placeiq ) SR. DATA SCIENTIST (217) 390-3033
(
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
) (
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
) (
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
) (
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
) (
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
) (
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 (
http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html )
On Thu, Apr 05, 2018 at 10:43 AM Jeff Zhang < Jeff Zhang ( Jeff Zhang
) > wrote:
>
>
>
> Try to look for logs like following in zeppelin server log file. Make sure
> you are using TimeoutLifecycleManager instead of NullLifecycleManager
>
>
> INFO [2018-04-04 18:12:26,209] ({main}
> InterpreterSettingManager.java[]:170) - Using LifecycleManager:
> org.apache.zeppelin.interpreter.lifecycle.NullLifecycleManager
>
>
> Paul Brenner < pbren...@placeiq.com >于2018年4月5日周四 下午10:32写道：
>
>
>>
>> We finally got our team up and running on a version of Zeppelin 0.8 built
>> from source. However, we can’t seem to get TimeoutLifecycleManager manager
>> to kill idle interpreters. When I look at the config page I see:
>>
>>
>>
>>
>> zeppelin.interpreter.lifecyclemanager.class
>> org.apache.zeppelin.interpreter.lifecycle.TimeoutLifecycleManager
>> zeppelin.interpreter.lifecyclemanager.timeout.checkinterval
>> 6
>> zeppelin.interpreter.lifecyclemanager.timeout.threshold
>> 360
>>
>>
>>
>>
>>
>> So it seems like everything should be configured correctly. However, if we
>
TimeoutLifecycleManager not doing anything
We finally got our team up and running on a version of Zeppelin 0.8 built from source. However, we can’t seem to get TimeoutLifecycleManager manager to kill idle interpreters. When I look at the config page I see: zeppelin.interpreter.lifecyclemanager.class org.apache.zeppelin.interpreter.lifecycle.TimeoutLifecycleManager zeppelin.interpreter.lifecyclemanager.timeout.checkinterval 6 zeppelin.interpreter.lifecyclemanager.timeout.threshold 360 So it seems like everything should be configured correctly. However, if we leave interpreters idling overnight they are still there idling the next morning. Is there any way to diagnose what is going wrong? Can anyone confirm that they have had success with TimeoutLifecycleManager? Should there be anything in any of the log files? ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) SR. DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html )
Re: Highlight Zeppelin 0.8 New Features
Love this. Shared it with my team and we discovered multiple new features. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html ) On Tue, Mar 13, 2018 at 1:18 PM Ruslan Dautkhanov < Ruslan Dautkhanov ( Ruslan Dautkhanov ) > wrote: > > Thanks Jeff! > > > That's great - our users were asking what are the highlights of the new > release. > > > > > -- > Ruslan Dautkhanov > > > On Tue, Mar 13, 2018 at 10:07 AM, moon soo Lee < m...@apache.org > wrote: > >> Looks great. I think online registry (helium) for visualization and spell >> is another important feature. >> >> >> Thanks, >> moon >> >> On Tue, Mar 13, 2018 at 12:41 AM Jeff Zhang < zjf...@gmail.com > wrote: >> >> >>> >>> I planned to publish this article after 0.8 release, but I think it would >>> be helpful for users to experience and verify these features before 0.8 >>> release. So I sent it out before 0.8 release. I would be very appreciated >>> that users can try these features via branch-0.8, and this is not a full >>> list of 0.8 new features, feel free to add if I miss any important >>> features. >>> >>> >>> https://medium.com/@zjffdu/ zeppelin-0-8-0-new-features- ea53e8810235 ( >>> https://medium.com/@zjffdu/zeppelin-0-8-0-new-features-ea53e8810235 ) >>> >>> >>> >>> >>> >>> >> >> > > >
Multiple groups in shiro config for url restriction
We ran into roles issues in 0.7.x versions of Zeppelin. If you are using 0.7.x this might be causing your trouble: https://issues.apache.org/jira/browse/ZEPPELIN-2640 ( https://share.polymail.io/v1/z/b/NWFhMTYxZmMxMWQ1/KUqx4IB8b_XDPr0u5Cb_-XEPoV2u_ZnkESc2dHVKJUJCXEk3OG_xpqibs6KRDGgwS19o5AjWfNV4qX8MwE7bHtYNxXrVNoagmNd9yxPfyPUfUjEFcfLZm75A6h0HQM_wCr363BGXvlbCalxboZVCTiwG5LCXrPmwJnDr3VsbmFM6k1ZibyxtZCWjiRcT0dPQ0nM2pKiaKNfL6RBwrFJmMaztfwjWDyLG ) This issue finally pushed us over the edge to try building 0.8.0 again. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html ) On Thu, Mar 08, 2018 at 11:14 AM LINZ Arnaud < LINZ Arnaud ( LINZ Arnaud ) > wrote: > > > > Hello, > > I try to restrict the interpreter configuration page to some specific > groups. > > /api/interpreter/** = authc, roles[admin1] > > works fine, but I have *multiple* ldap groups to authorize. > > I've tried : > > /api/interpreter/** = authc, roles[admin1,admin2] > /api/interpreter/** = authc, roles[admin1, admin2] > /api/interpreter/** = authc, roles[admin1;admin2] > /api/interpreter/** = authc, roles[admin1; admin2] > /api/interpreter/** = authc, roles[admin1 | admin2] > /api/interpreter/** = authc, roles[admin1], roles[admin2] > > But none works => it denies access to everybody. > > How can I do this ? > > Best regards, > Arnaud > > > > L'intégrité de ce message n'étant pas assurée sur internet, la société > expéditrice ne peut être tenue responsable de son contenu ni de ses pièces > jointes. Toute utilisation ou diffusion non autorisée est interdite. Si > vous n'êtes pas destinataire de ce message, merci de le détruire et > d'avertir l'expéditeur. > > The integrity of this message cannot be guaranteed on the Internet. The > company that sent this message cannot therefore be held liable for its > content nor attachments. Any unauthorized use or dissemination is > prohibited. If you are not the intended recipient of this message, then > please delete it and notify the sender. > > >
[DISCUSS] Roadmap 0.9 and future
Thanks for sharing the results of the meeting! Regarding the point "Need more frequent release”, was there any discussion around when 0.8.0 will be officially released? I remember a message a few months ago suggesting that it might be soon. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html ) On Wed, Mar 07, 2018 at 1:21 PM moon soo Lee < moon soo Lee ( moon soo Lee ) > wrote: > > Hi forks, > > > There were an offline meeting yesterday at PaloAlto with contributors and > users. We've shared idea about current state of project and future project > roadmap and wishlists (meeting note [1]). It was really inspiring and > exciting time. Let me try summarize, move this discussion to online. > > > There were many ideas related to Interpreter. Especially, there were > consensus that Spark support is one of biggest strength of Zeppelin and > need to make further improvement to keep the strengths. > > > * Spark > > > > * Immediate support of new spark release > > * Ramp up support of current Spark feature (e.g. Display job progress > correctly) > > * Spark streaming support > > * Handling Livy timeout > > > > * Other interpreters > > > > * Better Hive support (e.g. configuration) > > * Latest version PrestoDB support (pass property correctly) > > > > * Run interpreter in containerized environment > > * Let individual user upload custom library from user's machine directly > > * Interpreter documentation is not detail enough > > > > > And people in the meeting excited about ConInterpreter ZEPPELIN-3085 [2] > in upcoming release, regarding dynamic/inline configuration of > interpreter. > > > And there were ideas on other areas, too. like > > > * Separate Admin role and user role > * Sidebar with plugin widget > * Better integration with emerging framework like Tensorflow/MXNet/Ray > * Sharing data > * Schedule notebook from external scheduler > > > Regarding scheduling notebook, Luciano shared his project NotebookTools[3] > and it made people really excited. > > > Also, there were inspiring discussions about the community/project. > Current status and how can we make community/project more healthy. And > here's some ideas around the topic > > > * Need more frequent release > * More
Cannot define UDAF in %spark interpreter
Unfortunately, I don’t know why code that is working for you in spark shell
isn’t working in Zeppelin. But if you are looking for a quick fix perhaps this
could help?
I’ve had luck defining my UDAFs in zeppelin like:
val myUDAF = new UserDefinedAggregateFunction {}
So for example the following code compiles fine for me in zeppelin:
val FractionOfDayCoverage = new UserDefinedAggregateFunction {
// Input Data Type Schema
def inputSchema: StructType = StructType(Array(StructField("seconds",
LongType)))
// Intermediate Schema
def bufferSchema = StructType(Array(
StructField("times", ArrayType(LongType
// Returned Data Type .
def dataType = DoubleType
// Self-explaining
def deterministic = true
// This function is called whenever key changes
def initialize(buffer: MutableAggregationBuffer) = {
var timeArray = new ListBuffer[Long]()
buffer.update(0,timeArray)
}
// Iterate over each entry of a group
def update(buffer: MutableAggregationBuffer, input: Row) = {
if (!(input.isNullAt(0))){
var timeArray = new ListBuffer[Long]()
timeArray ++= buffer.getAs[List[Long]](0)
timeArray += input.getLong(0)
buffer.update(0,timeArray)
}}
// Merge two partial aggregates
def merge(buffer1: MutableAggregationBuffer, buffer2: Row) = {
var timeArray = new ListBuffer[Long]()
timeArray ++= buffer1.getAs[List[Long]](0)
timeArray ++= buffer2.getAs[List[Long]](0)
buffer1.update(0,timeArray)
}
// Called after all the entries are exhausted.
def evaluate(buffer: Row) = {
var timeArray = new ListBuffer[Long]()
timeArray ++= buffer.getAs[List[Long]](0).filter(x => x != null)
val times = timeArray.toArray
scala.util.Sorting.quickSort(times)
var intStart = times(0) - 30*60
var intEnd = times(0) + 30*60
var seen = 0L
for (t <- times) {
if (t > intEnd + 30*60) {
seen += (intEnd - intStart)
intStart = t - 30*60
intEnd = t + 30*60
} else {
intEnd = t + 30*60
}
}
seen += intEnd - intStart
math.min(seen.toDouble/(24*60*60), 1)
}
}
I’m using zeppelin 0.7.2 and spark 2.0.1 (I think) so perhaps there is a
version issue somewhere?
( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) (
http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) (
https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) (
https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) (
https://www.linkedin.com/company/placeiq ) (
https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033
(
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
) (
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
) (
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
) (
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
) (
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
) (
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 (
http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html )
On Tue, Feb 27, 2018 at 6:19 PM Vannson Raphael < Vannson Raphael ( Vannson
Raphael ) >
Is it possible to link a paragraph with editor showing by default
Hi, Is there any way to link a paragraph in a notebook so that the editor shows by default? I often want to share code snippets with coworkers. I found that using the Link This Paragraph function almost works well for this. However it is not ideal to have to tell people “click this link then hit ctrl-alt-e to show the editor”. My usual process is: * Select Link This Paragraph in the paragraph I want to share * Select the url and delete “?asIframe” * Share the edited url * Tell the person to hit ctrl-alt-e so that the editor shows up Anything I can do about step 4? ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/2017-Integrated-Marketing-Whitepaper_LP_Download.html )
Re: Setting spark.driver.memory
Sorry, yes, build issues with CDH. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) On Thu, Dec 28, 2017 at 6:12 PM Jeff Zhang < Jeff Zhang ( Jeff Zhang ) > wrote: > > > Do you mean build convergence issue with CDH ? It should be able to build > successfully with apache hadoop > > > > Paul Brenner < pbren...@placeiq.com >于2017年12月29日周五 上午7:10写道： > > >> >> >> Thanks for the quick response! >> >> >> Seeing as the other live thread in this group is about how we can’t build >> 0.8.0 anymore due to the dependency convergence issues, do I have any >> options in the near term? Do I just need to wait until 0.8 comes out in >> some unspecified number of months? Have people had success resolving these >> issues and getting 0.8 to build? I hit a dead end last time I tried and >> have been struggling to get time to dedicate to trying again. >> >> >> >> >> >> >> >> >> >> >> >> ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( >> http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( >> https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( >> https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( >> https://www.linkedin.com/company/placeiq ) ( >> https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( >> tel:(217)%20390-3033 ) >> >> >> >> >> ( >> http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ >> ) ( >> http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ >> ) ( >> http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ >> ) ( >> http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ >> ) ( >> http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ >> ) ( >> http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ >> ) ( >> http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ >> ) ( >> http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ >> ) ( >> http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative
Re: Setting spark.driver.memory
Thanks for the quick response! Seeing as the other live thread in this group is about how we can’t build 0.8.0 anymore due to the dependency convergence issues, do I have any options in the near term? Do I just need to wait until 0.8 comes out in some unspecified number of months? Have people had success resolving these issues and getting 0.8 to build? I hit a dead end last time I tried and have been struggling to get time to dedicate to trying again. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/CES2018_MeetingRequest.html ) On Thu, Dec 28, 2017 at 5:58 PM Jeff Zhang < Jeff Zhang ( Jeff Zhang ) > wrote: > > > This is a known issue, and fixed in 0.8.0 > > > https://issues.apache.org/jira/browse/ZEPPELIN-1263 > > > > > > > Paul Brenner < pbren...@placeiq.com >于2017年12月29日周五 上午2:22写道： > > >> >> We are on Zeppelin 0.7.2 and it I suspect that we are unable to set >> spark.driver.memory through the interpreter settings page. >> >> >> If I add a property “spark.driver.memory” to my interpreter and set it to >> 10g, I see in my spark application environment page that the spark >> property spark.driver.memory is intact set to 10g, but when I look at the >> executors tab I see my driver is only getting 384mb (which seems >> suspiciously like the amount I would get if I was actually getting a >> default 512mb). >> >> >> Digging around the web it sounds like people have had luck setting driver >> memory conf/zeppelin-env.sh ( e.g., >> http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Can-not-configure-driver-memory-size-td1513.html >> ( >> https://share.polymail.io/v1/z/b/NWE0NTMzZTJiNDk5/fb8ILoEIDvV495bIeoxmli2x06dNLmX9fdn32TWm4r_2E_eb58iBHrOUgR1IdZZV5FA-zX-LnlntRr0sDd2hp3rCP7C4TNKHHi8iK237Xxa_bttU1hPUHJs_j2Klm98jUhdvxiEVnEc2fSr903Dopc59FnamRjVVKhq4Macg3YCEdTaCMwd4XD9J_otoNQsgWqltSPWYHRfEeGZQjWysjJH1msfX50DAwC7CzDqSHyW5BqqN3uPCIAP8KiG_aoY9THg5KTObDvjZAPs1hy_pX9W3cNDtXaVw2-Bb-5X3wyFf6xIJIbunaWVNSP3qxw== >> ) ). >> >> >> >> >> * Can anyone confirm whether it is possible to set driver memory in >> interpreter settings? >> * If it isn’t possible, how can I find out which settings are settable >> through interpreter settings and which aren’t? >> * Also, if it isn’t possible, should I open a ticket for this? We really >> want users to be able to customize driver memory size. >> >> &g
Setting spark.driver.memory
We are on Zeppelin 0.7.2 and it I suspect that we are unable to set spark.driver.memory through the interpreter settings page. If I add a property “spark.driver.memory” to my interpreter and set it to 10g, I see in my spark application environment page that the spark property spark.driver.memory is intact set to 10g, but when I look at the executors tab I see my driver is only getting 384mb (which seems suspiciously like the amount I would get if I was actually getting a default 512mb). Digging around the web it sounds like people have had luck setting driver memory conf/zeppelin-env.sh ( e.g., http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Can-not-configure-driver-memory-size-td1513.html ( https://share.polymail.io/v1/z/b/NWE0NTMzZTJiNDk5/fb8ILoEIDvV495bIeoxmli2x06dNLmX9fdn32TWm4r_2E_eb58iBHrOUgR1IdZZV5FA-zX-LnlntRr0sDd2hp3rCP7C4TNKHHi8iK237Xxa_bttU1hPUHJs_j2Klm98jUhdvxiEVnEc2fSr903Dopc59FnamRjVVKhq4Macg3YCEdTaCMwd4XD9J_otoNQsgWqltSPWYHRfEeGZQjWysjJH1msfX50DAwC7CzDqSHyW5BqqN3uPCIAP8KiG_aoY9THg5KTObDvjZAPs1hy_pX9W3cNDtXaVw2-Bb-5X3wyFf6xIJIbunaWVNSP3qxw== ) ). * Can anyone confirm whether it is possible to set driver memory in interpreter settings? * If it isn’t possible, how can I find out which settings are settable through interpreter settings and which aren’t? * Also, if it isn’t possible, should I open a ticket for this? We really want users to be able to customize driver memory size. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) PlaceIQ:CES 2018 ( http://pages.placeiq.com/CES2018_MeetingRequest.html )
Re: Build broken, GitHub issues, snapshot missing?
We were able to build 0.8 in the past without problems. However, when we tried following the exact same steps on an identical VM last month we ran into the same issues Darren is facing. Hard to say if it is the exact same problem, but eventually I chased down this thread which seemed related to my troubles… https://github.com/eirslett/frontend-maven-plugin/issues/562 ( https://share.polymail.io/v1/z/b/NWEyZWMyZTA0Nzcx/-iEFfexYqrjucotO0Kl0u_QKDWu3U5M1fgPEmHPZd1W44O6G0_kd3rRw3JwnXQNnOl4Qa-3bwsnAUfmbv11Ur08cRy57JHVIHm8I1uJ8LmxI9Qp-hfjfEOVKY16-dcI51OpgXuCkn74VlmHLrCAEjvMPfun-CuUrYFAcu1p_KFrn_l9z1waQb-OfrdBj1mkioAG6EcVTa47Kyj7GSZN_Q6SuPbWNeuG4EmFhL4EKmHJW ) and is unresolved. We eventually gave up and just stuck with 0.72. I’m just chiming in to say that we would also love a 0.8 snapshot. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) PlaceIQ:Landmark by PlaceIQ ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) On Mon, Dec 11, 2017 at 12:24 PM Jeff Chung < Jeff Chung ( Jeff Chung ) > wrote: > > I had trouble building zeppelin too. My coworker could get it to build on > his Mac though. However even after it built, when I ran my notebook it > was looking for files in /zeppelin/build/spark*. I moved over the files > from spark-dependencies/target/spark* into that directory, but now get a > NullPointerException from the TSocket. I would also like to get a working > build with the latest. > > > > ( > https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=icon > ) Virus-free. www.avast.com ( > https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=link > ) > > ( #DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2 ) > > On Fri, Dec 8, 2017 at 7:46 AM, < dar...@ontrenet.com > wrote: > >> Hi >> >> >> Numerous issues trying to get Zeppelin built. >> >> >> Basically the build from source instructions are not working for me. >> >> >> Multiple "The requested profile does not exist" errors for basic stuff. >> -Pspark-2.0 etc >> >> >> There is no 0.8.0 snapshot or build anywhere? The links to it are all >> broken. >> >> >> We can not open GitHub issues for Zeppelin? I didn't see where. >> >> >> Is there a nightly Build? Or any working build with latest? >> >> >> Get Outlook for Android ( https://aka.ms/ghei36 ) >> >> >> > > >
Notebook URL not redirecting after login
I have experienced the same issue. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) PlaceIQ:Landmark by PlaceIQ ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) On Wed, Nov 29, 2017 at 1:00 PM Kevin Niemann < Kevin Niemann ( Kevin Niemann ) > wrote: > > Hi, > > > When I send out a link to a specific notebook and the user is not > authenticated (which is required) they are redirected to the login page. > After logging in successfully, Zeppelin does not redirect the user to the > notebook as I would expect. > > > Can anyone confirm if this is a known issue or should I file an Jira? > Perhaps I made a mistake in configuration. > > > Using Zeppelin 0.7.2 with LDAP authentication. > > > Thanks, > Kevin >
Re: Zeppelin Stops Loading Notes
As a bandaid for this, is there anyway to restart the zeppelin web server without killing running spark jobs? I suppose there would still be a risk that anyone actively editing a cell might lose their edits, but this would make it easier than finding a time when multiple people aren’t actively running jobs. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) PlaceIQ:Landmark by PlaceIQ ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) On Tue, Oct 17, 2017 at 1:57 PM Paul Brenner < Paul Brenner ( Paul Brenner ) > wrote: > > > Although zeppelin has died a few times since this email came up, today was > the first time where I was able to actually check the number of > interpreters. > > > All started interpreters: > 7 > Spark started interpreters: > 5 > > > That doesn’t seem unreasonable to me. > > > Here is what top is showing me, which doesn’t look like much load to me: > > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ > COMMAND > 30815 yarn 20 0 5021872 1.318g 35740 S 2.0 8.5 43:29.53 java > 14828 yarn 20 0 4882384 991068 18944 S 0.7 6.1 21:27.67 java > 37266 yarn 20 0 4991372 1.025g 35696 S 0.7 6.6 15:50.97 java > 39201 yarn 20 0 4981424 1.221g 34944 S 0.7 7.9 14:00.73 java > 43625 yarn 20 0 4970028 1.137g 34012 S 0.7 7.3 6:30.84 java > 29054 yarn 20 0 4895580 1.509g 39428 S 0.3 9.7 112:33.44 java > 46094 yarn 20 0 4092848 137112 12884 S 0.3 0.8 2:27.30 java > 29042 yarn 20 0 113124 1580 1320 S 0.0 0.0 0:00.00 > interpreter.sh > 29053 yarn 20 0 113120 648 392 S 0.0 0.0 0:00.00 > interpreter.sh > 30803 yarn 20 0 113124 1576 1320 S 0.0 0.0 0:00.00 > interpreter.sh > 30814 yarn 20 0 113120 644 392 S 0.0 0.0 0:00.00 > interpreter.sh > 37253 yarn 20 0 113124 1564 1308 S 0.0 0.0 0:00.00 > interpreter.sh > 37265 yarn 20 0 113120 652 396 S 0.0 0.0 0:00.00 > interpreter.sh > 39188 yarn 20 0 113124 1580 1320 S 0.0 0.0 0:00.00 > interpreter.sh > 39200 yarn 20 0 113120 648 392 S 0.0 0.0 0:00.00 > interpreter.sh > 43612 yarn 20 0 113124 1576 1320 S 0.0 0
Re: Zeppelin Stops Loading Notes
Although zeppelin has died a few times since this email came up, today was the
first time where I was able to actually check the number of interpreters.
All started interpreters:
7
Spark started interpreters:
5
That doesn’t seem unreasonable to me.
Here is what top is showing me, which doesn’t look like much load to me:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
30815 yarn
20 0 5021872 1.318g 35740 S 2.0 8.5 43:29.53 java
14828 yarn 20 0 4882384 991068 18944 S 0.7 6.1 21:27.67 java
37266 yarn
20 0 4991372 1.025g 35696 S 0.7 6.6 15:50.97 java
39201 yarn 20 0 4981424 1.221g 34944 S 0.7 7.9 14:00.73 java
43625 yarn
20 0 4970028 1.137g 34012 S 0.7 7.3 6:30.84 java
29054 yarn 20 0 4895580 1.509g 39428 S 0.3 9.7 112:33.44 java
46094 yarn
20 0 4092848 137112 12884 S 0.3 0.8 2:27.30 java
29042 yarn 20 0 113124 1580 1320 S 0.0 0.0 0:00.00
interpreter.sh
29053 yarn 20 0 113120 648 392 S 0.0 0.0 0:00.00
interpreter.sh
30803 yarn 20 0 113124 1576 1320 S 0.0 0.0 0:00.00
interpreter.sh
30814 yarn 20 0 113120 644 392 S 0.0 0.0 0:00.00
interpreter.sh
37253 yarn 20 0 113124 1564 1308 S 0.0 0.0 0:00.00
interpreter.sh
37265 yarn 20 0 113120 652 396 S 0.0 0.0 0:00.00
interpreter.sh
39188 yarn 20 0 113124 1580 1320 S 0.0 0.0 0:00.00
interpreter.sh
39200 yarn 20 0 113120 648 392 S 0.0 0.0 0:00.00
interpreter.sh
43612 yarn 20 0 113124 1576 1320 S 0.0 0.0 0:00.00
interpreter.sh
43624 yarn 20 0 113120 644 392 S 0.0 0.0 0:00.00
interpreter.sh
46636 yarn 20 0 113124 1516 1268 S 0.0 0.0 0:00.00
interpreter.sh
46647 yarn 20 0 113120 848 600 S 0.0 0.0 0:00.00
interpreter.sh
46648 yarn 20 0 4026284 150560 13024 S 0.0 0.9 1:56.46 java
finally here is what I see in the logs… I don’t know what is going on with that
authorization cache complaint but I assume not related?
INFO [2017-10-17 17:53:08,312] ({qtp1286783232-8117}
NotebookServer.java[onOpen]:156) - New connection from 10.201.12.29 : 54311
INFO [2017-10-17 17:53:08,394] ({qtp1286783232-8113}
NotebookServer.java[sendNote]:705) - New operation from 10.201.12.29 : 54311 :
gprabhu : GET_NOTE : 2CVZZ1XWN
INFO [2017-10-17 17:53:09,297] ({qtp1286783232-8117}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-10-17 17:53:09,317] ({qtp1286783232-8117}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-10-17 17:53:09,351] ({qtp1286783232-8117}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
WARN [2017-10-17 17:53:09,381] ({qtp1286783232-8117}
SecurityRestApi.java[ticket]:87) -
{"status":"OK","message":"","body":{"principal":"gprabhu","ticket":"d7d18244-99c5-4eeb-941c-243dc7cc0ca3","roles":"[]"}}
( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) (
http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) (
https://twitter.
Demo: Zeppelin Table of Contents Spell
Everyone, it is important that you understand that Ryan is my new favorite person. Thank you Ryan. I’m so excited about this. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) PlaceIQ:Landmark by PlaceIQ ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) On Mon, Oct 16, 2017 at 1:56 PM Ryan < Ryan ( Ryan ) > wrote: > > Check it out! > > > This feature was the biggest thing stopping me from switching from Jupyter > to Zeppelin, it makes it very easy to navigate large notebooks. > > > Don’t look at the code, I wrote it from within the chrome developer > console lol. > > > https://github.com/Submersible/zeppelin-toc-spell
Re: Zeppelin Stops Loading Notes
Does this issue need a Jira ticket? The problem is that I have no idea how to reproduce and I’m not sure if there is anything in the logs that is relevant. Any ideas how we can produce an actionable Jira ticket out of this? ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( https://www.linkedin.com/company/placeiq ) ( https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033 ( http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ ) ( http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ ) ( http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP ) ( http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ ) ( http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) ( http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ ) PlaceIQ:Landmark by PlaceIQ ( https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/ ) On Thu, Oct 12, 2017 at 8:31 AM Geoffrey Cheng < Geoffrey Cheng ( Geoffrey Cheng ) > wrote: > > we have the same issue. usually when multiple ppl using it, only header > loads. > > > we tried couldn't find solution, so we restart every single time. in > fact , we have to restart daily at least. > > On Oct 12, 2017 2:40 AM, "Fabian Böhnlein" < fabian.boehnl...@gmail.com > > wrote: > >> Hi Paul, Ben, >> >> >> we also see this happen regularly. It's more likely to happen when a >> handful of people are using it. >> >> >> We mostly run one spark interpreter per person. We also don't observe >> anything in the logs. The 'header' that you mentioned is actually still in >> the cache. >> >> >> Sometimes it's specific notes that don't load. >> Sometimes there's a hanging Spark interpreter, once it's killed notes load >> again. >> >> >> We're pretty clueless about it. >> >> >> Any front-end related logs we could enable to find out more? >> >> On Sat, 19 Aug 2017 at 20:19 Ben Vogan < b...@shopkick.com > wrote: >> >> >>> I have seen Zeppelin get into this state once. I restarted it without >>> investigating the logs however so I don't have anything useful to go on as >>> to why. >>> >>> >>> --Ben >>> >> >> >> On Sat, Aug 19, 2017 at 8:17 AM, Paul Brenner < pbren...@placeiq.com > wrote: >> >> >>> >>> You were correct. We had "export ZEPPELIN_SSL_PORT=false” in our >>> zeppelin-env.sh. I’m going to comment that out. I suspect it is actually >>> unrelated to the behavior we are seeing where pages stop loading though. >>> Anyone else see this happen? >>> >>> >>> I’ll report back if that happens again after the fix. >>> >>> >>> >>> >>> >>> >>> >>> >>> ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( >>> http://www.placeiq.com/ ) Paul Brenner ( https://twitte
notebooks rendering lag
I experience this regularly.
I have found that leaving these larger notebooks open in chrome can cause lag
to grow worse over time. Sometimes I can bring lag back down to a manageable
level by closing the tab completely and loading the notebook from a new tab.
Clearing output does not seem to help, so like your colleagues I’ll sometimes
resort to splitting to a separate notebook.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
On Tue, Sep 12, 2017 at 4:39 PM Ruslan Dautkhanov
<
mailto:Ruslan Dautkhanov
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Mid-size notebooks lag in browser rendering / responding to simple navigation
requests.
I've seen many times that once notebooks grow up above a "small" size,
rendering lags can happen.
Running latest Chrome with a decent Intel i7 processor.
For example, a notebook I am working on has around 35 paragraphs and is just
145k note.json
(there are no big data tables - nothhing crazy), starts lagging quite a bit
which doesn't help with UX.
I've noticed paragraphs in HTML code can be burried 10 levels deep in
DIV-DIV-... nesting.
This could be the root cause? Browser might have hard time calculating all
those nested
CSS styles etc?
I know some colleagues of mine start splitting notebooks into separate
notebooks
when they see this issue.
Not sure if this is a known issue and if everybody else experience the same?
Re: Zeppelin Stops Loading Notes
You were correct. We had "export ZEPPELIN_SSL_PORT=false” in our
zeppelin-env.sh. I’m going to comment that out. I suspect it is actually
unrelated to the behavior we are seeing where pages stop loading though. Anyone
else see this happen?
I’ll report back if that happens again after the fix.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
On Fri, Aug 18, 2017 at 6:37 PM moon soo Lee
<
mailto:moon soo Lee
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi,
One of configuration value in your conf/zeppelin-env.sh or
conf/zeppelin-site.xml seems "false" which expected to be to a number.
Do you have any environment variable or property set to "false" for the
configurations below?
ZEPPELIN_PORT,
zeppelin.server.port
ZEPPELIN_SSL_PORT,
zeppelin.server.ssl.port
ZEPPELIN_INTERPRETER_CONNECT_TIMEOUT,
zeppelin.interpreter.connect.timeout
ZEPPELIN_INTERPRETER_MAX_POOL_SIZE,
zeppelin.interpreter.max.poolsize
ZEPPELIN_INTERPRETER_OUTPUT_LIMIT,
zeppelin.interpreter.output.limit
Thanks,
moon
On Fri, Aug 18, 2017 at 2:30 PM Paul Brenner <
mailto:pbren...@placeiq.com
> wrote:
We have a team of 5 users who all use the same zeppelin server. Lately a few
times we have run into a case where zeppelin notes stop responding and then
when we try refreshing the webpage for the note all that loads is the zeppelin
header with no note. When I look at the logs I see:
INFO [2017-08-18 21:23:06,569] ({qtp1286783232-14114}
NotebookServer.java[sendNote]:705) - New operation from 10.201.12.26 : 55178 :
nshah : GET_NOTE : 2CR2ANDEX
INFO [2017-08-18 21:24:05,740] ({qtp1286783232-14115}
NotebookServer.java[onClose]:363) - Closed connection to 10.201.12.22 : 57366.
(1001) Idle Timeout
INFO [2017-08-18 21:24:08,084] ({qtp1286783232-14121}
NotebookServer.java[onClose]:363) - Closed connection to 10.201.12.22 : 57461.
(1001) Idle Timeout
INFO [2017-08-18 21:25:10,133] ({qtp1286783232-14122}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-08-18 21:25:10,157] ({qtp1286783232-14122}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-08-18 21:25:10,172] ({qtp1286783232-14122}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
WARN [2017-08-18 21:25:10,192] ({qtp1286783232-14122}
SecurityRestApi.java[ticket]:87) -
{"status":"OK","message":"","body":{"principal":"pbrenner&qu
Zeppelin Stops Loading Notes
We have a team of 5 users who all use the same zeppelin server. Lately a few
times we have run into a case where zeppelin notes stop responding and then
when we try refreshing the webpage for the note all that loads is the zeppelin
header with no note. When I look at the logs I see:
INFO [2017-08-18 21:23:06,569] ({qtp1286783232-14114}
NotebookServer.java[sendNote]:705) - New operation from 10.201.12.26 : 55178 :
nshah : GET_NOTE : 2CR2ANDEX
INFO [2017-08-18 21:24:05,740] ({qtp1286783232-14115}
NotebookServer.java[onClose]:363) - Closed connection to 10.201.12.22 : 57366.
(1001) Idle Timeout
INFO [2017-08-18 21:24:08,084] ({qtp1286783232-14121}
NotebookServer.java[onClose]:363) - Closed connection to 10.201.12.22 : 57461.
(1001) Idle Timeout
INFO [2017-08-18 21:25:10,133] ({qtp1286783232-14122}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-08-18 21:25:10,157] ({qtp1286783232-14122}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-08-18 21:25:10,172] ({qtp1286783232-14122}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
WARN [2017-08-18 21:25:10,192] ({qtp1286783232-14122}
SecurityRestApi.java[ticket]:87) -
{"status":"OK","message":"","body":{"principal":"pbrenner","ticket":"5f717a1a-46df-4178-bc9a-690f66064d0e","roles":"[]"}}
INFO [2017-08-18 21:25:10,252] ({qtp1286783232-14123}
NotebookServer.java[onOpen]:156) - New connection from 10.201.12.48 : 62413
ERROR [2017-08-18 21:25:10,353] ({qtp1286783232-14122}
NotebookServer.java[onMessage]:357) - Can't handle message
java.lang.NumberFormatException: For input string: "false"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:580)
at java.lang.Integer.parseInt(Integer.java:615)
at
org.apache.zeppelin.conf.ZeppelinConfiguration.getInt(ZeppelinConfiguration.java:213)
at
org.apache.zeppelin.conf.ZeppelinConfiguration.getInt(ZeppelinConfiguration.java:208)
at
org.apache.zeppelin.conf.ZeppelinConfiguration.dumpConfigurations(ZeppelinConfiguration.java:496)
at
org.apache.zeppelin.socket.NotebookServer.sendAllConfigurations(NotebookServer.java:1680)
at org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:318)
at
org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:59)
at
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
at
org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69)
at
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65)
at
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
at
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161)
at
org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309)
at
org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214)
at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220)
at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258)
at
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632)
at
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
Anyone have any idea what is going on or how we could trouble shoot?
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma
Re: Zeppelin security configuration
Hmmm I thought we were able to get ours working like that. Here is how we
defined roles:
activeDirectoryRealm.groupRolesMap = "CN=Security Data Science
Department,OU=Department Security Groups,OU=Security
Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"data_science", "CN=Security
Development Department,OU=Department Security Groups,OU=Security
Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"engineering", "CN=Security
Infrastructure Department,OU=Department Security Groups,OU=Security
Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"infra", "CN=Security Research &
Development Department,OU=Department Security Groups,OU=Security
Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"tech_heads", "CN=Security
Reporting & Analytics Department,OU=Department Security Groups,OU=Security
Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"reporting", "CN=Security Product
Department,OU=Department Security Groups,OU=Security
Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"product", "CN=Security Data
Operations Department,OU=Department Security Groups,OU=Security
Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"data_ops"
activeDirectoryRealm.authorizationCachingEnabled = true
activeDirectoryRealm.principalSuffix = @corp.placeiq.net
sessionManager = org.apache.shiro.web.session.mgt.DefaultWebSessionManager
securityManager.sessionManager = $sessionManager
securityManager.sessionManager.globalSessionTimeout = 8640
shiro.loginUrl = /api/login
securityManager.realm = $activeDirectoryRealm
[roles]
data_science = data_science
engineering = engineering
infra = infra
tech_heads = tech_heads
reporting = reporting
product = product
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
On Wed, Jun 28, 2017 at 4:05 PM goutham koneru
<
mailto:goutham koneru
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Paul,
I tried it this way and it did not work. I tried with and with out authc.
[roles]
adhdpadm = *
[urls]
/api/version = anon
/** = authc
/api/interpreter/** = authc,roles[adhdpadm]
/api/credential/** = authc,roles[adhdpadm]
Thanks,
Goutham.
On Wed, Jun 28, 2017 at 3:26 PM, goutham koneru
<
mailto:goutha...@gmail.com
>
wrote:
Thanks Paul.
Can you also share how you defined the roles like infra?
--Goutham.
On Wed, Jun 28, 2017 at 3:20 PM, Paul Brenner
<
mailto:pbren...@placeiq.com
>
wrote:
What happens if you remove authc after /api/interpreter/** ?
Our shiro.ini just has:
/api/interpreter/** = roles[engineering],roles[infra
],roles[tech_heads],roles[
data_science]
http://www.placeiq.com/ http://www.p
Zeppelin security configuration
What happens if you remove authc after /api/interpreter/** ?
Our shiro.ini just has:
/api/interpreter/** =
roles[engineering],roles[infra],roles[tech_heads],roles[data_science]
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
On Wed, Jun 28, 2017 at 3:11 PM goutham koneru
<
mailto:goutham koneru
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi,
I've enabled AD authentication by updating shiro.ini - this is just to login to
Zeppelin. I am using HDP 2.6.1 and Zeppelin 0.7.0.
ldapADGCRealm.userSearchFilter=(&(objectclass=user)(sAMAccountName={0})(|(memberOf=cn=adhdpadm,ou=Groups,ou=Corporate,dc=abccompany,dc=com)(memberOf=cn=adhdpdev,ou=Groups,ou=Corporate,dc=abccompany,dc=com)))
Now people belong to these groups are able to login. but all of them have
access to edit any interpreters.
People who belong to adhdpdev group should not be able to modify any settings.
I have tried with individual users by specifying in shiro.ini and it worked.
But how can I do that with groups? Is it possible?
/api/version = anon
/api/interpreter/** = authc, roles[admin]
/api/configurations/** = authc, roles[admin]
/api/credential/** = authc, roles[admin]
#/** = anon
/** = authc
Thanks,
Goutham.
spark.r interpreter becomes unresponsive after some time and R process quits silently
Great work documenting repeatable steps for this hard to nail down problem. I see similar problems running the spark (scala) interpreter but haven’t been as systematic about hunting down the issue as you. I do wonder if this is related somehow to https://share.polymail.io/v1/z/b/NTkwZGRlMzNiZmFi/Go00wlomvjABQNciq78PfdeRmR4K6c4M5l8KsTYGlks2sD4oe9jS7NYIkVZ2KKlntmyN0z2ZbiIFSP59SQpYL0hq_V6k3ZjCvIj_hSJLDj9DoLv9d08g_CcyOzm8nDm0hYZeZOp12dO42cm970BBLMdQE4GNuXkJXxBA8x9FHzXuJqALbU6-4HZjnzxjiNBKO7esfqjghuuz-eV-QrJnyI5hTNPgwp0O which just seems to have addressed killing off zombie processes but I’m not sure it covered where zombie processes are coming from. Perhaps we need to open a ticket for this? In the mean time if you don’t have the ability to restart zeppelin every time you run into this process you can probably just kill the interpreter process. I find myself doing that multiple times in an normal work day. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ On Sat, May 06, 2017 at 6:47 AM Pietro Pugni < mailto:Pietro Pugni > wrote: Hi all, I am facing a strange issue on two different machines that acts like servers. Each of them runs an instance of Zeppelin installed as a system.d service. The configuration is: - Ubuntu Server 16.04.2 LTS - Spark 2.1.0 - Microsoft Open R 3.3.2 - Zeppelin 0.7.1 (0.7.0 gave the same problems) zeppelin-env.sh has the following settings: export SPARK_HOME="/spark/home/directory" spark-env.sh has the following settings: export LANG="en_US" export SPARK_DAEMON_JAVA_OPTS+=" -Dspark.local.dir=/some/dir -Dspark.eventLog.dir=/some/dir/spark-events -Dhadoop.tmp.dir=/some/dir" export _JAVA_OPTIONS+=" -Djava.io.tmpdir=/some/dir" spark-defaults.conf is set as: spark.executor.memory 21g spark.driver.memory 21g spark.python.worker.memory 4g spark.sql.autoBroadcastJoinThreshold 0 I use Spark in stand-alone mode and it works perfectly. It also works correctly with Zeppelin but this is what happens: 1) Start zeppelin on the server using the command service zeppelin start 2) Connect to port 8080 using Mozilla Firefox from client 3) Insert username and password (I enabled Shiro authentication) 4) open a notebook 5) Execute the following code: %spark.r 2+2 6) The code runs correctly and I can see that R is currently running as a process. 7) Repeat steps 2-5 after some time (let’s say 2 or 3 hours) and Zeppelin remains forever on “Running” or, if the elapsed time is higher (for example 1 day) since the last run, it returns “Error”. The “time-to-be-unresponsive” seems to be random and unpredictable. Also, R is not present in the list of running processes. Spark session remains active because I can access Spark UI from port 4040 and the application name is “Zeppelin”, so it’s the Spark instance created by Zeppelin. I observed that sometimes I can simply restart the interpreter from Zeppelin UI, but many other times it doesn’t work and I have to restart Zeppelin ( service zeppelin restart ). This issue afflicts
Re: Can't download moderately large data or number of rows to csv
I’m not sure what the best solution is but I created a ticket here: https://share.polymail.io/v1/z/b/NTkwYTM4NTgzMzIy/ptA3bo_BAIo9IWGz0OXooezKKqlB7FL6rPYuPfHCNnGvRz-yUxCoYMxiNmygRARAMgtzeZ4jz5UxoPQtQlYe-nLRtaBMkhFwn2t7rMLPwtJuDIDVDy0E_azvjPZDVrjRLGkL40kqM-qpxMg6BgBzUgcrawJMQ7dnfV93mVHjjMxqbM4r9K-k5eXP9dX4T5JgwSKXPpVopDZn19r-bP671LA_2MU4-_Vh http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ On Wed, May 03, 2017 at 4:01 AM Rick Moritz < mailto:Rick Moritz > wrote: I think whether this is an issue or not, depends a lot on how you use Zeppelin, and what tools you need to integrate with. Sadly Excel is still around as a data processing tool, and many people who I introduce to Zeppelin are quite proficient with it, hence the desire to export to csv in a trivial manner -- or merely the presence of the "download CSV"-button incites them to expect it to work for reasonably sized data (i.e. up to around 10^6 rows). I do prefer Ruslan's idea, but I think Zeppelin should include something similar out of the box. The key requirement should be that the data doesn't have to travel through the notebook interface, but rather is made available in a temporary folder and then served via a download link. The downside to this approach is, that ideally you'd want this kind of operation to be interpreter agnostic. In that case every interpreter would need to offer an interface which allows to collect the data to a local-to-zeppelin temporary folder. Nonetheless, to turn Zeppelin into the serve-it-all solution that it could be, I do believe that "fixing" the csv-export is important. I'd definitely vote for a Jira advancing this issue. On Tue, May 2, 2017 at 9:33 PM, Kevin Niemann < mailto:kevin.niem...@gmail.com > wrote: We came across this issue as well, Zeppelin csv export is using the data URI scheme which is base64 encoding all the rows into a single string, Chrome seems to crash with over a few thousand rows, but Firefox has been able to handle over 100k for me. However, the Zeppelin notebook itself becomes slow at that point. I would also like better support for the ability to export a large set of rows, perhaps another tool is more preferred? On Tue, May 2, 2017 at 10:00 AM, Ruslan Dautkhanov < mailto:dautkha...@gmail.com > wrote: Good idea to introduce in Zeppelin a way to download full datasets without actually visualizing them. Not sure if this helps, we taught our users to use %sh hadoop fs -getmerge /hadoop/path/dir/ /some/nfs/mount/ for large files (they sometimes have to download datasets with millions of records). They run Zeppelin on edge nodes that have NFS mounts to a drop zone. ps. Hue has a limit too, by default 100k rows https://github.com/cloudera/hue/blob/release-3.12.0/desktop/conf.dist/hue.ini#L905 Not sure how much it scales up. -- Ruslan Dautkhanov On Tue, May 2, 2017 at 10:41 AM, Paul Brenner < mailto:pbren...@placeiq.com > wrote: There are limits to how much data the download to csv button will download (1.5MB? 3500 rows?) which limit zeppelin’s
Re: Zeppelin not loading the index page after redirection from IDP
Unfortunately I haven't seen a ton of Shiro expertise on this list. Maybe
someone will know the answer to your problem but my guess is that you are going
to have to troubleshoot this by stripping out all that fancy complexity until
you get a basic shiro.ini that works and then methodically add pieces back in
until you see what is breaking. Once you know what is going on we would all
appreciate your help adding to the documentation for using shiro with zeppelin.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
tel:(217)%20390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Wed, May 03, 2017 at 8:36 AM Jaideep Singh
<
mailto:Jaideep Singh
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Also attaching the screen shot for 2 JSession id which i got after redirection.
On Wed, May 3, 2017 at 5:18 PM, Jaideep Singh
<
mailto:jaideep...@gmail.com
>
wrote:
Hello,
I have used saml based sso authentication on zeppelin url which is on
localhost:8080. I am able to load the zeppelin page successfully if i disable
the shiro.ini file. I have used sso authentication with wso2, configured in
shiro.ini with metadata for idp and sp provided there.
But after redirection from idp to zeppelin / url i am not able to load the page.
Following are the assumption for problem occurence
*
Problem may be due to the websocket calls which are not initiating after
redirection, but i can see it works if no authentication applied.
*
I am getting JSessionid after redirection from IDP. Is Zeppelin server also
providing JSessionid which may cause conflicts?
Plese help me to identify the problem.
I am attaching the log file and shiro.ini
.
I have checked the log file the error i am getting is
17:01:05.402 [qtp1663619914-60 - /;JSESSIONID=804affc8-ea2c-
40ad-9db8-0492c9f1f134/api/
security/ticket] DEBUG o.e.jetty.servlet.
ServletHandler - chain=org.apache.zeppelin.
server.CorsFilter-5ae50ce6->
ShiroFilter->org.eclipse.
jetty.servlet.DefaultServlet-
69b2283a@5b910f06==org.
eclipse.jetty.servlet.
DefaultServlet,-1,true
17:01:05.402 [qtp1663619914-60 - /;JSESSIONID=804affc8-ea2c-
40ad-9db8-0492c9f1f134/api/
security/ticket] DEBUG o.e.jetty.servlet.
ServletHandler - call filter org.apache.zeppelin.server.
CorsFilter-5ae50ce6
17:01:05.402 [qtp1663619914-60 - /;JSESSIONID=804affc8-ea2c-
40ad-9db8-0492c9f1f134/api/
security/ticket] DEBUG o.e.jetty.servlet.
ServletHandler - call filter ShiroFilter
17:01:05.403 [qtp1663619914-60 - /;JSESSIONID=804affc8-ea2c-
40ad-9db8-0492c9f1f134/api/
security/ticket] DEBUG o.a.shiro.mgt.
DefaultSecurityManager - Resolved SubjectContext context session is invalid.
Ignoring and creating an anonymous (session-less) Subject instance.
org.apache.shiro.session.
UnknownSessionException: There is no session with id [804affc8-ea2c-40ad-9db8-
0492c9f1f134/api/security/
ticket]
at org.apache.shiro.session.mgt.
eis.AbstractSessionDAO.
readSession(
AbstractSessionDAO.java:170) ~[shiro-core-1.2.3.jar:1.2.3]
at org.apache.shiro.session.mgt.
DefaultSessionManager.
retrieveSessionFromDataSource(
DefaultSessionManager.jav
Re: Selecting z.show() text in chrome sometimes doesn't work
So far no one else has responded so perhaps I am the only one who has
experienced this. If I can figure out steps to reproduce then I’ll definitely
open a ticket.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Tue, May 02, 2017 at 4:40 PM moon soo Lee
<
mailto:moon soo Lee
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Will there be steps to reproduce the problem?
And please feel free to open a JIRA issue.
Thanks,
moon
On Tue, May 2, 2017 at 8:48 AM Paul Brenner <
mailto:pbren...@placeiq.com
> wrote:
Has anyone else encountered this? Sometimes when I use z.show to show a data
frame I can select the text that is shown (for easy copy and pasting into a
.filter() for example). However, other times I just can’t select the text. I
have no idea what causes the problem to come or go away. Can anyone confirm
this so that I know I’m not going crazy? Anyone have ideas what is causing it
or what I could do about it?
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
tel:(217)%20390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Can't download moderately large data or number of rows to csv
There are limits to how much data the download to csv button will download (1.5MB? 3500 rows?) which limit zeppelin’s usefulness for our BI teams. This limit comes up far before we run into issues with showing too many rows of data in zeppelin. Unfortunately (fortunately?) Hue is the other tool the BI team has been using and there they have no problem downloading much larger datasets to csv. This is definitely not a requirement I’ve ever run into in the way I use zeppelin since I would just use spark to write the data out. However, the BI team is not allowed to run spark jobs (they use hive via jdbc) so that download to csv button is pretty important to them. Would it be possible to significantly increase the limit? Even better would it be possible to download more data than is shown? I assume this is the type of thing I would need to open a ticket for, but I wanted to ask here first. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Selecting z.show() text in chrome sometimes doesn't work
Has anyone else encountered this? Sometimes when I use z.show to show a data frame I can select the text that is shown (for easy copy and pasting into a .filter() for example). However, other times I just can’t select the text. I have no idea what causes the problem to come or go away. Can anyone confirm this so that I know I’m not going crazy? Anyone have ideas what is causing it or what I could do about it? http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Re: Data Source Authorization - JDBC Credential
I have restarted interpreter after creating the entity in credential menu. It still doesn’t work. I think that, because this issue occurs with both credentials and when I set default.user, it is somehow an issue with how the snowflake driver is connecting with zeppelin’s jdbc driver. I tried tracing through the code on both ends but didn’t see any obvious issues. The stack trace shows the path the information is trying to travel: ava.sql.SQLException: Missing user name. at net.snowflake.client.jdbc.SnowflakeConnectionV1.(SnowflakeConnectionV1.java:209) at net.snowflake.client.jdbc.SnowflakeDriver.connect(SnowflakeDriver.java:350) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:79) at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:205) at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:836) at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:434) at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:361) at org.apache.commons.dbcp2.PoolingDriver.connect(PoolingDriver.java:129) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:270) at org.apache.zeppelin.jdbc.JDBCInterpreter.getConnectionFromPool(JDBCInterpreter.java:354) at org.apache.zeppelin.jdbc.JDBCInterpreter.getConnection(JDBCInterpreter.java:372) at org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:564) at org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:692) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:95) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:490) at org.apache.zeppelin.scheduler.Job.run(Job.java:175) at org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) So the user information looks like it should be passing out of the zeppelin jdbc interpreter into java.sql.DriverManager. Is that what is happening in the working version you are testing with? If I can hunt down any better information about how the user/pass is being passed to java.sql.DriverManager I might be able to get some help from the snowflake people… perhaps it is an issue on their side? I see the following in JDBCInterpreter.java: String user = interpreterContext . getAuthenticationInfo() . getUser() can I assume that is passing the proper user info to java.sql.DriverManager? http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-inte
Re: Preconfigure Spark interpreter
Whenever I’ve wanted to do this (preconfigure an interpreter using
interpreter.json instead of one by one adding each config into the webui) my
process was
First create an interpreter in the webUI and enter all my configs into that
interpreter via the webUI
In the webUI again, create the next interpreter that I want to preconfigure so
that zeppelin puts some skeleton code in the interpreter.json, creates an
interpreter ID, and I assume creates anything else that might be relevant?
Stop Zeppelin
Open interpreter.json and carefully copy the relevant contents of the first
interpreter section into the second interpreter section.
Restart zeppelin
Not sure which of those steps are necessary or might be excessive but it works
for me.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Sat, Apr 22, 2017 at 3:13 PM Serega Sheypak
<
mailto:Serega Sheypak
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Aha, thanks. I'm building Zeppelin from source, so I can put my custom settings
directly?
BTW, why does interpreter-list file don't contain spark interpreter?
2017-04-22 13:33 GMT+02:00 Fabian Böhnlein
<
mailto:fabian.boehnl...@gmail.com
>
:
Do it via the Ui once and you'll see how interpreter.json of the Zeppelin
installation will be changed.
On Sat, Apr 22, 2017, 11:35 Serega Sheypak <
mailto:serega.shey...@gmail.com
> wrote:
Hi, I need to pre-configure spark interpreter with my own artifacts and
internal repositories. How can I do it?
Re: Data Source Authorization - JDBC Credential
Using 0.7.1 and yes I tried removing default.user/default.password after
setting my credentials in the credentials section. It did not work.
I found that actually setting the correct value for default.user did not work
either. Same error. It seems like the zeppelin jdbc interpreter is not passing
the defined user and password to the snowflake jdbc connector.
However, I also was unable to set the
zeppelin.jdbc.auth.type. I saw it should be able to take “SIMPLE” or “KERBEROS”
as a value. Either option results in "
java.lang.ClassNotFoundException:
org.apache.hadoop.security.UserGroupInformation$AuthenticationMethod”. I’m not
sure if that is related.
One more question. Here is what I see in the log files:
INFO [2017-04-22 11:37:48,598] ({pool-2-thread-2}
JDBCInterpreter.java[open]:159) - key: zeppelin, value: jdbc.auth.type INFO
[2017-04-22 11:37:48,598] ({pool-2-thread-2} JDBCInterpreter.java[open]:159) -
key: common, value: max_count INFO [2017-04-22 11:37:48,598] ({pool-2-thread-2}
JDBCInterpreter.java[open]:159) - key: zeppelin, value: jdbc.principal INFO
[2017-04-22 11:37:48,598] ({pool-2-thread-2} JDBCInterpreter.java[open]:159) -
key: zeppelin, value: interpreter.localRepo INFO [2017-04-22 11:37:48,598]
({pool-2-thread-2} JDBCInterpreter.java[open]:159) - key: default, value: url
INFO [2017-04-22 11:37:48,598] ({pool-2-thread-2}
JDBCInterpreter.java[open]:159) - key: default, value: driver INFO [2017-04-22
11:37:48,601] ({pool-2-thread-2} JDBCInterpreter.java[open]:159) - key:
zeppelin, value: jdbc.keytab.location INFO [2017-04-22 11:37:48,601]
({pool-2-thread-2} JDBCInterpreter.java[open]:159) - key: zeppelin, value:
jdbc.concurrent.use INFO [2017-04-22 11:37:48,601] ({pool-2-thread-2}
JDBCInterpreter.java[open]:159) - key: zeppelin, value:
jdbc.concurrent.max_connection ERROR [2017-04-22 11:37:48,601]
({pool-2-thread-2} JDBCInterpreter.java[open]:177) - zeppelin will be ignored.
driver.zeppelin and zeppelin.url is mandatory.
To make that a bit more readable I can trim it down to…
INFO - key: zeppelin, value: jdbc.auth.type
INFO - key: common, value: max_count
INFO - key: zeppelin, value: jdbc.principal
INFO - key: zeppelin, value: interpreter.localRepo
INFO - key: default, value: url
INFO - key: default, value: driver
INFO - key: zeppelin, value: jdbc.keytab.location
INFO - key: zeppelin, value: jdbc.concurrent.use
INFO - key: zeppelin, value: jdbc.concurrent.max_connection
ERROR - zeppelin will be ignored. driver.zeppelin and zeppelin.url is
mandatory.
So I can confirm that it isn’t trying to grab the default.user, but I don’t see
anything that indicates it is trying to use credentials… Also is that ERROR
relevant?
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
tel:(217)%20390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Sat, Apr 22, 2017 at 1:21 AM moon soo Lee
<
mailto:moon soo Lee
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi,
Which version of Zeppelin are you using? Have you tried remove 'default.user'
and 'default.password' property from interpreter menu and cre
Re: Data Source Authorization - JDBC Credential
Are credentials confirmed working with the JDBC interpreter? I’m trying to get
jdbc working with snowflake. If I hardcore my username and password into the
default url everything works great… but this of course won’t work in a multi
user environment.
However, if I try to use default username, default password, or zeppelin
credentials I get stuck at "
java.sql.SQLException: Missing user name.”
Sounds like a different issue than the OP.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Thu, Apr 20, 2017 at 8:49 PM moon soo Lee
<
mailto:moon soo Lee
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi,
If you remove
'default.user'
'default.password'
properties from jdbc interpreter setting, then Zeppelin will use database
username and password from credential database for each user.
I also created a patch [1] to use credential database when 'default'.user' and
'default.password' is empty string.
Hope this helps.
Best,
moon
[1]
https://github.com/apache/zeppelin/pull/2269
On Mon, Apr 10, 2017 at 3:37 AM Arpad Beregszaszi <
mailto:arpad.beregsza...@gmx.de
> wrote:
Hi all,
I’m pretty new with Zeppeln and I need help with one problem regarding data
source authorization as its described here:
https://zeppelin.apache.org/docs/0.7.0/security/datasource_authorization.html
I can successfully connect Zeppelin to my MySQL Server. Now I want to give
different users access to their databases.
For that I want the JDBC interpreter to use different database credentials,
depending on the Zeppelin user as defined in shiro.ini.
But when I create credential information, the JDBC interpreter doesn’t use them
for the db connection, but the default username and password, which is empty.
My Interpreter Is instantiated per user.
Java.sql.SQLException: Access denied for user ‘ ‘ @ ‘IP‘ (using password: NO)
Anyone an idea of whats wrong?
Thanks, Arpad
Re: struggling with LDAP
I haven’t used any alternative tools for logging into ldap to test your settings but you could look into: https://share.polymail.io/v1/z/b/NThmN2ExZTk4NzM5/eIaecXfqzpvgJ4U4_otah9F6ocoNBr72ckozDNQV-5XVR4yWlzdcZx-ID2qZ1ad9vwYQJNTeWw4wPfcNe_zQzAMeavly76koV3RmZZnJ0JDjxO-2APSYgNnQMEsjvEAr16xkhyYzdcu-BxaX0xgWy8EHzEOx65D1XI6suxXIvRln6Y4KChBOA6f5TaIx8Eo3ONpQ6YsxWBhGECk= https://share.polymail.io/v1/z/b/NThmN2ExZTk4NzM5/eIaecXfqzpvgJ4U4_otah9F6ocoNBr72ckozDNQV-5XVR4yWlzdcZx-ID2qZ1ad9vwYQJNTeWw4wPfcNe_zQzAMeavly76koV3RmZZnJ0JDjxO-2APSYgNnQMEsjvEAr16xkhyYzdcu-BxaX0xgWy8EHzEOx65D1XI6suxXIvRln6Y4KChBOA6f5TaIx8Eo3ONpQ6YsxWBhGECk= https://share.polymail.io/v1/z/b/NThmN2ExZTk4NzM5/eIaecXfqzpvgJ4U4_otah9F6ocoNBr72ckozDNQV-5XVR4yWlzdcZx-ID2qZ1ad9vwYQJNTeWw4wPfcNe_zQzAMeavly76koV3RmZZnJ0JDjxO-2APSYgNnQMEsjvEAr16xkhyYzdcu-BxaX0xgWy8EHzEOx65D1XI6suxXIvRln6Y4KChBOA6f5TaIx8Eo3ONpQ6YsxWBhGECk= https://share.polymail.io/v1/z/b/NThmN2ExZTk4NzM5/eIaecXfqzpvgJ4U4_otah9F6ocoNBr72ckozDNQV-5XVR4yWlzdcZx-ID2qZ1ad9vwYQJNTeWw4wPfcNe_zQzAMeavly76koV3RmZZnJ0JDjxO-2APSYgNnQMEsjvEAr16xkhyYzdcu-BxaX0wMI0poTi0mt9pD4VpesuhHH4EZn6IsFGwRCDLK3SSwhWAU7arJiRIzF0zrtDYHT3Cl_yamLbzshVmsJiNFq4mLGqm_r https://share.polymail.io/v1/z/b/NThmN2ExZTk4NzM5/eIaecXfqzpvgJ4U4_otah9F6ocoNBr72ckozDNQV-5XVR4yWlzdcZx-ID2qZ1ad9vwYQJNTeWw4wPfcNe_zQzAMeavly76koV3RmZZnJ0JDjxO-2APSYgNnQMEsjvEAr16xkhyYzdcu-BxaX0wMI0poTi0mt9pD4VpesuhHH4EZn6IsFGwRCDLK3SSwhWAU7arJiRIzF0zrtDYHT3Cl_yamLbzshVmsJiNFq4mLGqm_r https://share.polymail.io/v1/z/b/NThmN2ExZTk4NzM5/eIaecXfqzpvgJ4U4_otah9F6ocoNBr72ckozDNQV-5XVR4yWlzdcZx-ID2qZ1ad9vwYQJNTeWw4wPfcNe_zQzAMeavly76koV3RmZZnJ0JDjxO-2APSYgNnQMEsjvEAr16xkhyYzdcu-BxaX0wMI0poTi0mt9pD4VpesuhHH4EZn6IsFGwRCDLK3SSwhWAU7arJiRIzF0zrtDYHT3Cl_yamLbzshVmsJiNFq4mLGqm_r The fact that your system user is found about not your personal account makes me suspicious of searchBase and groupRolesMap. Do you have “activeDirectoryRealm.searchBase” and “activeDirectoryRealm.groupRolesMap” appropriately enabled to match what your ldap server expects? For our ldap setup we use: activeDirectoryRealm.searchBase = OU=Departments,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net I also included: activeDirectoryRealm.groupRolesMap = "CN=Security Data Science Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":”data_science" [roles] data_science = data_science [urls] /api/interpreter/** = roles[data_science] /** = authc http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ On Wed, Apr 19, 2017 at 1:20 PM Knapp Michael < mailto:Knapp Michael > wrote: My mac is configured to forbid installing software by unidentified developers. I cannot install jxplorer. Is there an alternative? The error is coming up when I try to login. I tried using the principalSuffix, it did not change things. I discovered a co-worker had LDAP working for a different LDAP server under different conditions. He told me that he is logging in as the system account from the UI, which I had never tried or thought of before. I was always using my personal username and p
Re: struggling with LDAP
Have you tried downloading jxplorer ( https://share.polymail.io/v1/z/b/NThmNzdlMmY1M2Q4/4ULIk0PWssT9m_JkSH0DABBQXnzuCgzhWsyhnPBuhOSlesqCbWa29gOfWIHfzMl_KkcEjTygnnHE5ULbT4hkfGCo3ldYc1D21y4gr8tQkiH0VV8v4hCOt8a1pJ5LlTVrS5NQBpf6Ba77K4yf_NGEYgtOuXJp-BP4pCf4FLNHEXgWptDxLkamTAE= ) and confirming that you can connect to the ldaps server with your credentials? Also, when is this error coming up, at start up or when you try to login through zeppelin? When I switched to ldap instead of logging in as pbrenner for my user I had to use pbren...@corp.placeiq.net. Had to add “activeDirectoryRealm.principalSuffix“ to shiro.ini to get around that. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ On Wed, Apr 19, 2017 at 11:07 AM Knapp Michael < mailto:Knapp Michael > wrote: I think this got me one step closer. I was getting an exception stating there was no trusted path to the ldap server. Now I am getting the same exception as when I use non-secure LDAP, that I am “forbidden”. I am getting ldap error code 49, data 52e. From: Paul Brenner Reply-To: "users@zeppelin.apache.org" Date: Tuesday, April 18, 2017 at 4:24 PM To: "Knapp, Michael" , "users@zeppelin.apache.org" Cc: "Krishna, Krish" Subject: struggling with LDAP BEGIN CERTIFICATE-/,/-END CERTIFICATE-/p' > public.crt The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
struggling with LDAP
Wow, we just setup ldaps today, good timing. First we got everything worked with just ldap (not secure). Then all we had to do was generate keys for the latest version of java we had installed: openssl s_client -connect piq-corp-100.corp.placeiq.net:636 < /dev/null | sed -ne '/-BEGIN CERTIFICATE-/,/-END CERTIFICATE-/p' > public.crt /usr/java/latest/bin/keytool -import -alias piq-corp-100.corp.placeiq.net -keystore /usr/java/latest/jre/lib/security/cacerts -file ./public.crt And then everything worked fine. I definitely didn’t touch zeppelin-site.xml. Here is our shiro.ini in case that helps. It is possible that we set up some additional conf elsewhere that would be relevant but I’m having trouble thinking of anything. [users] [main] [users] [main] #activeDirectoryRealm = org.apache.zeppelin.server.ActiveDirectoryGroupRealm activeDirectoryRealm = org.apache.zeppelin.realm.ActiveDirectoryGroupRealm activeDirectoryRealm.systemUsername = our username activeDirectoryRealm.systemPassword = our password activeDirectoryRealm.searchBase = OU=Departments,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net activeDirectoryRealm.url = ldaps://corp.placeiq.net:636 activeDirectoryRealm.groupRolesMap = "CN=Security Data Science Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"data_science", "CN=Security Development Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"engineering", "CN=Security Infrastructure Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"infra", "CN=Security Research & Development Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"tech_heads", "CN=Security Reporting & Analytics Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"reporting", "CN=Security Product Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"product", "CN=Security Data Operations Department,OU=Department Security Groups,OU=Security Groups,OU=PlaceIQ,DC=corp,DC=placeiq,DC=net":"data_ops" activeDirectoryRealm.authorizationCachingEnabled = true activeDirectoryRealm.principalSuffix = @corp.placeiq.net sessionManager = org.apache.shiro.web.session.mgt.DefaultWebSessionManager securityManager.sessionManager = $sessionManager securityManager.sessionManager.globalSessionTimeout = 8640 shiro.loginUrl = /api/login securityManager.realm = $activeDirectoryRealm [roles] data_science = data_science engineering = engineering infra = infra tech_heads = tech_heads reporting = reporting [urls] /api/version = anon /api/interpreter/** = roles[engineering],roles[infra],roles[tech_heads],roles[data_science] #/** = anon /** = authc http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ On Tue, Apr 18, 2017 at 3:13 PM Knapp Michael < m
Restricting interpreters to users in certain groups
o.cache.MemoryConstrainedCacheManager #securityManager.cacheManager = $cacheManager securityManager.sessionManager = $sessionManager # 86,400,000 milliseconds = 24 hour securityManager.sessionManager.globalSessionTimeout = 8640 shiro.loginUrl = /api/login securityManager.realm = $activeDirectoryRealm [roles] data_science = data_science engineering = engineering infra = infra tech_heads = tech_heads reporting = reporting [urls] # anon means the access is anonymous. # authcBasic means Basic Auth Security # authc means Form based Auth Security # To enfore security, comment the line below and uncomment the next one /api/version = anon /api/interpreter/** = authc, roles[engineering],roles[infra],roles[tech_heads],roles[data_science] #/** = anon /** = authc http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Autosave is currently broken
I’ve seen a little discussion of this, but now that there is a ticket I think it is worth making sure everyone knows: Autosave is working inconsistently. Be careful that you don’t lose code. It seems that running and/or collapsing paragraphs causes code to be saved so that could be a temporary work around? https://share.polymail.io/v1/z/b/NThlZWE1ODA2ZTBj/ApbKHIKUjuqkxBIf1AQ1zZj2io1GcBpce0MRW1zgw6OfQfh7HncyGdOuy4IHKF6Dt9oWns4E8YcNVjRGnZdud2D8WeIVr99MRpKFLYrB-2cOCDCHQ0LXwGLgXgLGxjmOmnRTbOs6R02tM7iAHaxBnaQhlKDdojlHFfDCuLvS_0lORTK2DHCsOuTIbGJ82FjumPpGw0jFY_-l-WZmHkzSMyPyZa4o1dQg http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Re: Changing zeppelin theme/appearance
Amazing, thanks! I created https://share.polymail.io/v1/z/b/NThlM2MyNzgzZTU0/uxTj5va0fhXfUV2jHffZLSPESI_MY3bXsVIhL0dPq9GSWifIyUTbkmBndSXquPuUU9744YKSpZYxw3LB7-_1VZxZCBTq-3dTuaLVQNFOwcYxc3IhRAe9HM56kPcJXVRNPV1Tmmcr0mCX8XwogBn2cDZRLdoaOQ979VLInubrgHOdIKKGymwa_uBxkYEtR6onPbmTA4KayLDD9o7H1Ipr5-VNBT5IXSPm for the mobile issues. I’ll spend some time playing with Paragraph.controller.js and if I feel like I get a good handle on it I’ll propose edits for that STYLE.md file. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/ On Mon, Apr 03, 2017 at 3:44 PM moon soo Lee < mailto:moon soo Lee > wrote: Hi, Looks like file location in the doc is bit out dated. Please take a look Paragraph.controller.js instead https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/notebook/paragraph/paragraph.controller.js . And thanks for feedback on mobile env. I didn't see any related issue in JIRA. Please feel free to create one. Thanks, moon On Sat, Apr 1, 2017 at 6:22 AM Paul Brenner < mailto:pbren...@placeiq.com > wrote: I’m trying to figure out how to make changes to zeppelin’s appearance when editing code. For example, when I have code after an open quote the code is colored blue text with red background which is illegible. I was hoping to just change the Ace theme following this https://share.polymail.io/v1/z/b/NThkZWM3N2I2ZWI0/3ScmwdoSNIxRyiG1S_FDJukXehdBMqyhkBhhIIw9vXGCSv46WtulQHP2aZAgrjVHQPA4rALwFHL1scIr9oG3IfjwnS-wpYtdbPniicg3HL0q3BAIu2eeQnHhS4y82XCWEJlRONN59Wp_-hjNxYF6AAZKK4zDZ1fBe14-FkLRl14o6HGXwAiQ7B958H084Wj9BVc_936Y_Iy_sRK6l2jkgSdKSkXvgBb3eA8Otw== But I don’t know where app/scripts/controllers/paragraph.js or any other related file is??? Bonus points if anyone knows how to hide the toolbar when accessing notebooks on mobile that would be amazing… that thing is gigantic and blocks basically everything. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-join
Changing zeppelin theme/appearance
I’m trying to figure out how to make changes to zeppelin’s appearance when editing code. For example, when I have code after an open quote the code is colored blue text with red background which is illegible. I was hoping to just change the Ace theme following this https://share.polymail.io/v1/z/b/NThkZWM3N2I2ZWI0/3ScmwdoSNIxRyiG1S_FDJukXehdBMqyhkBhhIIw9vXGCSv46WtulQHP2aZAgrjVHQPA4rALwFHL1scIr9oG3IfjwnS-wpYtdbPniicg3HL0q3BAIu2eeQnHhS4y82XCWEJlRONN59Wp_-hjNxYF6AAZKK4zDZ1fBe14-FkLRl14o6HGXwAiQ7B958H084Wj9BVc_936Y_Iy_sRK6l2jkgSdKSkXvgBb3eA8Otw== But I don’t know where app/scripts/controllers/paragraph.js or any other related file is??? Bonus points if anyone knows how to hide the toolbar when accessing notebooks on mobile that would be amazing… that thing is gigantic and blocks basically everything. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Occasional blank table result on paragraph execution
I have this problem as well. It is incredibly annoying. I don’t think I’m
seeing it in 0.8.0 though.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Thu, Mar 30, 2017 at 12:47 PM Kevin Niemann
<
mailto:Kevin Niemann
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi,
On some paragraph executions I am getting a blank table result (just
whitespace), like 1/5 times. Starting with Zeppelin 0.7.0. The paragraph is
successful and changing the visualization mode shows that there was data
returned. Changing the report type or refreshing the browser will fix the issue
too but it is a bad experience for the user to have to do that. Has anyone
experienced this issue yet or created a Jira?
When this happens I get the following JavaScript console output. Otherwise
there are usually no errors.
TypeError: Cannot read property 'type' of undefined
at cells (handsonHelper.js:57)
at y.Core.getCellMeta (vendor.ee876a1abacbe752.js:325)
at y.Core._getColWidthFromSettings (vendor.ee876a1abacbe752.js:325)
at getColWidth (vendor.ee876a1abacbe752.js:325)
at x.getColumnWidth (vendor.ee876a1abacbe752.js:324)
at Object.columnWidthFn (vendor.ee876a1abacbe752.js:324)
at e._getColumnWidth (vendor.ee876a1abacbe752.js:322)
at e.calculate (vendor.ee876a1abacbe752.js:322)
at new e (vendor.ee876a1abacbe752.js:322)
at s.createColumnsCalculator (vendor.ee876a1abacbe752.js:324)
(anonymous) @ vendor.ee876a1abacbe752.js:37
(anonymous) @ vendor.ee876a1abacbe752.js:37
(anonymous) @ vendor.ee876a1abacbe752.js:38
e @ vendor.ee876a1abacbe752.js:36
(anonymous) @ vendor.ee876a1abacbe752.js:36
vendor.ee876a1abacbe752.js:37 Error: This method cannot be called because this
Handsontable instance has been destroyed
at y.Core.j (vendor.ee876a1abacbe752.js:325)
at t.value (visualization-table.js:31)
at t.value (visualization.js:96)
at result.controller.js:593
at n.$broadcast (vendor.ee876a1abacbe752.js:38)
at paragraph.controller.js:1028
at n.$broadcast (vendor.ee876a1abacbe752.js:38)
at n. (websocketEvents.factory.js:107)
at b (vendor.ee876a1abacbe752.js:75)
at n._onMessageHandler (vendor.ee876a1abacbe752.js:75)
(anonymous) @ vendor.ee876a1abacbe752.js:37
(anonymous) @ vendor.ee876a1abacbe752.js:37
$broadcast @ vendor.ee876a1abacbe752.js:38
(anonymous) @ paragraph.controller.js:1028
$broadcast @ vendor.ee876a1abacbe752.js:38
(anonymous) @ websocketEvents.factory.js:107
b @ vendor.ee876a1abacbe752.js:75
n._onMessageHandler @ vendor.ee876a1abacbe752.js:75
(anonymous) @ vendor.ee876a1abacbe752.js:36
handsonHelper.js:57 Uncaught TypeError: Cannot read property 'type' of undefined
at cells (handsonHelper.js:57)
at y.Core.getCellMeta (vendor.ee876a1abacbe752.js:325)
at y.Core._getColWidthFromSettings (vendor.ee876a1abacbe752.js:325)
at getColWidth (vendor.ee876a1abacbe752.js:325)
at x.getColumnWidth (vendor.ee876a1abacbe752.js:324)
at x.getStretchedColumnWidth (vendor.ee876a1abacbe752.js:324)
at r.sumCel
Using Zeppelin with a remote git repository
Does anyone currently use zeppelin with a remote git repository? I know there are built in features for local repositories and I see an open ticket requesting to have a UI button for pushing ( https://share.polymail.io/v1/z/b/NThkMmI0M2FjNmFl/hTArYPkqRNC4P17VE6rrNAhyY6zvgR6oJywYqQyrCW1Froj1P44qQzgB4mbIBS704-y8YvUll7dB37u1eciBp4Xq6Tiza73MW6iDUH2e9faiEi01eQkcME5U15ra08fBi3PCwJ-qQq52nlAr_9AQtbniscNTNNyl5WA4l1O7iiZGIm2iqg3tENs8UeL_H3BtdblW_AX7xG_eXk-5aZY1UWFXlJp2QcPo doesn’t look like it is high priority though). Does anyone have a workflow they would be willing to share for how they use zeppelin with a remote git repository? http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Isolation issues
When you start zeppelin can you do it as a user with fewer privileges? We
created a user specifically for starting zeppelin server and set access limits
to that user. Kind of a hack, so perhaps others will chime in with more elegant
solutions.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
tel:(217)%20390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Mon, Mar 06, 2017 at 7:18 AM Angelo Steffenel
<
mailto:Angelo Steffenel
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Dear all, I’m trying to set Zeppelin as the frontend for a small cluster I use
with my students.
After a few tests I found that anyone can access and even modify system files
(for example, they can make "ls /etc" or even "rm -rf ~" when using %sh).
Is there a way to define a homedir so that all the users see resides below that
directory (like the --notebook-dir option in Jupyter)? I know that this can be
achieved using Docker but it seems an unnecessary layer…
Sorry if my question is dumb, I'm just starting using Zeppelin but I was unable
to find an answer in the docs or in the mailing list archives.
Best regards,
Angelo
Alert when paragraph finishes
I know it is a long shot, but is the ability to be alerted when a paragraph finishes already implemented somewhere? I found this unfinished pull request so I assume it just isn’t a high priority right now, but wanted to double check: https://github.com/apache/zeppelin/pull/560 https://github.com/apache/zeppelin/pull/560 https://github.com/apache/zeppelin/pull/560 http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Re: Re: Zeppelin unable to respond after some time
I don’t believe that this explains my issue. Running the Scala REPL also keeps
a session alive for as long as the REPL is running. I’ve had REPLs open for
days (sh don’t tell anyone) that have correspondingly kept sessions alive
for the same period of time with no problem. I only see this issue in zeppelin.
We run zeppelin on a server and allow multiple users to connect, each with
their own interpreters. We also find that zeppelin memory usage on the server
will steadily creep up over time. Executing sys.exit in a spark paragraph,
restarting the interpreter, and using yarn application -kill often will cause
zeppelin to end the related interpreter process but not always. So over time we
find that many zombie processes pile up and eat up resources.
The only way to keep on top of this is to regularly login to the zeppelin
server and kill zombie jobs. Here is a command that I’ve found helpful. When
you know that a specific user has no active zeppelin interpreters running then
execute the following:
ps aux | grep zeppelin | grep "2BSGYY7S8" | grep java | awk -F " "
'{print$2}' | xargs sudo -u yarn kill -9
where “2BSGYY7S8" is the interpreter id (found in interpreter.json) and “yarn”
is actually the name of the user that originally started zeppelin with:
zeppelin-daemon.sh start
To kill every interpreter except for a specific users just flip it around with:
ps aux | grep zeppelin | grep -v "2BSGYY7S8" |grep -v
"zeppelin.server.ZeppelinServer" | grep java | awk -F " " '{print$2}' | xargs
sudo -u yarn kill -9
If I do this every few days zeppelin keeps humming along pretty smoothly most
of the time.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Fri, Feb 17, 2017 at 3:23 PM "xyun...@simuwell.com"
<
mailto:
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
body { line-height: 1.5; }blockquote { margin-top: 0px; margin-bottom: 0px;
margin-left: 0.5em; }div.foxdiv20170217121700549974 { }body { font-size:
10.5pt; font-family: 'Segoe UI'; color: rgb(0, 0, 0); line-height: 1.5; }
The problem could be not only the resource, but the session. If you run a chunk
of spark code and you should see the a running application in the spark UI, but
in your code if you shut it down after the job is finished, then on the spark
UI you will see the hob is finished. Within zeppelin, each job will start the
spark session only once(different interpreter mode could be set if you want
notebooks to share the session or not), if you closed it ,it will never restart
it again. The only way to get the same code work again is to restat the
interpreter or restart zeppelin. I`m not sure if I explain clearly, but hope it
could help
From:
mailto:pbren...@placeiq.com
Date:
2017-02-17 12:14
To:
mailto:users@zeppelin.apache.org
Subject:
Re: Re: Zeppelin unable to respond after some time
I’ve definitely had this problem with jobs that don’t take all the resources on
the cluster. Also, my experience matches what ot
Re: Re: Zeppelin unable to respond after some time
I’ve definitely had this problem with jobs that don’t take all the resources on
the cluster. Also, my experience matches what others have reported: just
restarting zeppelin and re-runing the stuck paragraph solves the issue.
I’ve also experienced this problem with for loops. Some for loops which write
to disk but absolutely don’t have any variables that are increasing in size
will hang in Zeppelin. If I run the exact same code in the scala REPL it goes
through without problem.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Fri, Feb 17, 2017 at 2:12 PM "xyun...@simuwell.com"
<
mailto:
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
body { line-height: 1.5; }blockquote { margin-top: 0px; margin-bottom: 0px;
margin-left: 0.5em; }div.foxdiv20170217110832132410 { }body { font-size:
10.5pt; font-family: 'Segoe UI'; color: rgb(0, 0, 0); line-height: 1.5; }
I have solved the similar issue before. You should check on spark UI and
probably you will see your single job is taking all the resources. Therefore
further job that submitting to the same cluster will just hang on there. When
you restart zeppelin then the old job is killed and all the resource it took
will be released
xyun...@simuwell.com
From:
mailto:rushikeshraut...@gmail.com
Date:
2017-02-17 02:29
To:
mailto:users@zeppelin.apache.org
Subject:
Re: Zeppelin unable to respond after some time
Yes happens with r and spark codes frequently
On Feb 17, 2017 3:25 PM, "小野圭二" <
mailto:onoke...@gmail.com
> wrote:
yes, almost every time.
There are not any special operations.
Just run the tutorial demos.
>From my feeling, it happens in R demo frequently.
2017-02-17 18:50 GMT+09:00 Jeff Zhang
<
mailto:zjf...@gmail.com
>
:
Is it easy to reproduce it ?
小野圭二 <
mailto:onoke...@gmail.com
>于2017年2月17
日周五 下午5:47写道：
I am facing on the same issue now.
2017-02-17 18:25 GMT+09:00 RUSHIKESH RAUT
<
mailto:rushikeshraut...@gmail.com
>
:
Hi all,
I am facing a issue while using Zeppelin. I am trying to load some data(not
that big data) into Zeppelin and then build some visualization on it. The
problem is that when I try to run the code first time it's working but after
some time the same code doesn't work. It remains in running state on gui, but
no logs are generated in Zeppelin logs. Also all further tasks are hanging in
pending state.
As soon as I restart Zeppelin it works. So I am guessing it's some memory
issue. I have read that Zeppelin stores the data in memory so it is possible
that it runs out of memory after some time.
How do I debug this issue? How much is the default memory that Zeppelin takes
at start? Also is there any way that I can run Zeppelin with specified memory
so that I can start the process with more memory. Because it doesn't make sense
to restart Zeppelin after every half hour
Thanks,
Rushikesh Raut
Re: After upgrading to 0.7.0 behaviour changed for REPL
This is a super useful tip. Is it documented somewhere? If not is there
somewhere on GitHub that I should be digging into to find similar features?
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Tue, Feb 14, 2017 at 3:36 AM Bruno Aranda
<
mailto:Bruno Aranda
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi Moon,
Didn't know you could do that and it solves the problem.
Many thanks!
Bruno
On Tue, 14 Feb 2017 at 00:21 moon soo Lee <
mailto:m...@apache.org
> wrote:
Hi,
The behavior is changed since Zeppelin support multiple result in a paragraph
[1].
If you're using %spark interpreter, one possible workaround is clear output
before print something. For example
// do something
// clear output
z.getInterpreterContext.out.clear
// display something
z.show(df)
Hope this helps.
Thanks,
moon
[1]
https://issues.apache.org/jira/browse/ZEPPELIN-212
On Mon, Feb 13, 2017 at 7:40 AM Bruno Aranda <
mailto:bara...@apache.org
> wrote:
Hi,
I have recently upgraded to 0.7.0. In 0.6.2 I used to have many notes that at
the end they do
z.show(df)
or
println("%html ...")
, etc. When those lines were executed, the output was changed to a table or
HTML, and all the REPL removed, which I found to be a nice thing when creating
a report.
However, now I can see the REPL output above the table or the HTML. Has this
changed?
I know you can change the setting in the interpreter, but I used to find a nice
thing to be able to see a REPL error on failure, but hide the output when
printing the final table or HTML.
Is there any solution? I want to be able to generate nice dashboards without
technical code in the middle, but at the same time be able to see the code when
things fail.
Thanks,
Bruno
Another instance of Derby already booted the database .../metastore_db
We had this same problem. Copying or symlinking hive-site.xml to the zeppelin
conf directory and then restarting solved it for us.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Fri, Jan 27, 2017 at 9:51 AM Jan Rasehorn
<
mailto:Jan Rasehorn
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hello,
I was running into an issue with a query on a temp table and to test it I
opened another notebook in another tab. When I execute this new notebook, I got
an error:
Caused by: java.sql.SQLException: Failed to start database 'metastore_db' with
class loader
org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@1ec187c, see the
next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown
Source)
at
org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown
Source)
... 132 more
Caused by: java.sql.SQLException: Another instance of Derby may have already
booted the database /opt/zeppelin-0.6.2/bin/metastore_db
I'm running Spark in isolated mode.
Does anybody know how to fix that?
Re: notebook interpreter restart
Did you try setting your interpreter to “Isolated” mode? Is it currently in
“shared” mode?
If you haven’t played with this setting before then:
1. Open the interpreters page
2. Find your interpreter and click the edit button in the top right corner
3. Beneath the word “option” at the top left there should be a drop down that
says “shared”, “scoped”, or “isolated”.
4. Set that drop down to isolated and then scroll down and click save.
By doing that, we get a separate YARN application for each notebook running on
the same interpreter.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Wed, Jan 25, 2017 at 9:12 PM Alec Lee
<
mailto:Alec Lee
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hello, Paul
Thank you so much for prompt reply. Our understanding is each interpreter takes
one application on YARN, if multiple notebooks share same interpreter will run
through same YARN application.
As you mentioned this “… which will kill any other YARN application associated
with that interpreter.” , we seem never see more than one YARN application in
YARN UI, the case we had, I use one interpreter but wrote many notebooks, but
no matter how many notebooks spark jobs, I only see one YARN application. So I
am curious how to make single interpreter being associated with more than YARN
applications.
Thanks
AL
On Jan 25, 2017, at 5:39 PM, Paul Brenner <
mailto:pbren...@placeiq.com
> wrote:
Alec,
The way we use zeppelin at our company is to set our interpreters to
“isolated”. That way each notebook gets it’s own application on yarn.
This mostly works well. The one downside is that if you stop a notebook (e.g.
by calling sys.exit in a cell of a spark notebook) it does stop the YARN
application most of the time but you can’t restart that notebook until you have
restarted the interpreter… which will kill any other YARN application
associated with that interpreter.
So our full setup is that we give each user an interpreter (which is good
because we can set each user’s interpreter to have their username in
spark.yarn.queue) and set each user’s interpreter to isolated.
Honestly I still don’t understand what scoped does… maybe that would work as
well?
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-
notebook interpreter restart
Alec,
The way we use zeppelin at our company is to set our interpreters to
“isolated”. That way each notebook gets it’s own application on yarn.
This mostly works well. The one downside is that if you stop a notebook (e.g.
by calling sys.exit in a cell of a spark notebook) it does stop the YARN
application most of the time but you can’t restart that notebook until you have
restarted the interpreter… which will kill any other YARN application
associated with that interpreter.
So our full setup is that we give each user an interpreter (which is good
because we can set each user’s interpreter to have their username in
spark.yarn.queue) and set each user’s interpreter to isolated.
Honestly I still don’t understand what scoped does… maybe that would work as
well?
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Wed, Jan 25, 2017 at 8:20 PM Alec Lee
<
mailto:Alec Lee
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi, all
Currently we are exploring feature of zeppelin, now the situation we are using
YARN to manage spark jobs. In terms of the experiments, we conclude that one
interpreter is corresponding to An application in YARN cluster, that means all
the notebooks from zeppelin with same interpreter go through single Application
in YARN. Also we found if out code shuts down the application in YARN, then any
notebooks fail to run after this point - error like this “can’t call a stop
spark context …..” . The only solution for this is to restart the interpreter.
How to get around this without restart the interpreter?
Thanks
AL
Re: zeppelin memory usage
It looks like one of our big problems is that zeppelin doesn’t always kill all
completed processes. Is there an accepted way to kill a spark instance? Most of
the time executing sys.exit in a paragraph will kill the spark instance in yarn
and I believe also kill the corresponding zeppelin process… but not 100% of the
time.
Similar with restarting the interpreter… most of the time kills the spark
instance in yarn and kills the corresponding zeppelin process but not always.
Currently we have to check yarn and use “yarn application -kill” on anything
that doesn’t get cleaned up properly there. We also have to login to the
zeppelin vm and manually hunt down old processes that are still running days
after their interpreters were stopped.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Tue, Jan 24, 2017 at 12:53 PM t p
<
mailto:t p
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Running in a VM we’ve noticed Zeppelin consume lot of memory and have
encountered out-of-memory and GC issues - with a couple of users.
In our case, I attributed it to the use-case: Spark interpreter connecting to a
Postgres DB to load few tables into data frames which had large number of rows
We registered these DF's as temp tables (createOrReplaceTempView) while the
notebook ran. When we ran joins across these temp tables, using spark sql, we
ran out of memory.
While we’re on AWS, we were not in a position to run/provision scalable
clusters (using YARN etc.) and neither did we want to provision very large EC2
instances.
To keep memory in check, we’ve changed our approach to use JDBC+Postgres to
push down the predicates to Postgres and use Spark data frames for gathering
the results (much smaller result sets) to interface with Zeppelin UI/pages for
displaying the results etc. Effectively, we ended with dividing the work load -
postgres provided the right balance of memory/disk/cpu for querying and spark
interfaced well with zeppelin for analytics (esp across pages for drill down
use case).
It’d be great to hear experience's from others who use Zeppelin on a single
VM/host or in _non_ clustered environments.
On Jan 24, 2017, at 12:26 PM, Paul Brenner <
mailto:pbren...@placeiq.com
> wrote:
We are using zeppelin with multiple users on the same server and often run out
of memory on the dedicated VM that zeppelin runs on. It isn’t uncommon to run
out of memory on the VM zeppelin is running on when just 3-4 users are using
zeppelin. Is this normal behavior? Does each user’s spark interpreter usually
consume 500mb - 1gb of memory on the vm?
I thought I saw reports of companies using zeppelin with 10s or 100 users, is
there something we are doing wrong?
The VM zeppelin runs on currently only has 3gb of ram so we can raise that
number a little, but I don’t see how we could ever get to 10 simultaneous users.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/Pl
zeppelin memory usage
We are using zeppelin with multiple users on the same server and often run out of memory on the dedicated VM that zeppelin runs on. It isn’t uncommon to run out of memory on the VM zeppelin is running on when just 3-4 users are using zeppelin. Is this normal behavior? Does each user’s spark interpreter usually consume 500mb - 1gb of memory on the vm? I thought I saw reports of companies using zeppelin with 10s or 100 users, is there something we are doing wrong? The VM zeppelin runs on currently only has 3gb of ram so we can raise that number a little, but I don’t see how we could ever get to 10 simultaneous users. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq DATA SCIENTIST (217) 390-3033 http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
Re: Latest keyboard shortcuts
There should be a little black and white keyboard button at the top right of
every notebook that brings up the keyboard shortcut list, if I'm not mistaken.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
tel:(217)%20390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Wed, Jan 18, 2017 at 10:50 AM Stephen Boesch
<
mailto:Stephen Boesch
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
bump. Without keyboard shortcuts a notebook is nearly unusable: certainly they
must exist just where is a document for same?
thanks.
2017-01-17 9:58 GMT-08:00 Stephen Boesch
<
mailto:java...@gmail.com
>
:
There was an old jira for keyboard shortcuts. But there did not appear to be an
associated document
https://issues.apache.org/jira/browse/ZEPPELIN-391
Is there a comprehensive cheat-sheet for the shortcuts? Especially to compare
to the excellent jupyter keyboard shortcuts; e.g. dd to delete a cell.
Thanks!
stephenb
Re: 'File size limit Exceeded' when importing notes - even for small files
Just a tip that when I ran into this problem I found that using the “clear
output” button and then exporting my notebook made it easy to get below the
size limit. Not very helpful if you need ALL the output, but maybe you can
selectively clear output from some paragraphs?
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Tue, Jan 17, 2017 at 4:55 PM Ruslan Dautkhanov
<
mailto:Ruslan Dautkhanov
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
>From the screenshot "JSON file size cannot exceed MB".
Notice there is no number between "exceed" and "MB".
Not sure if we're missing a setting or an environment variable to define the
limit?
It now prevents us from importing any notebooks.
--
Ruslan Dautkhanov
On Tue, Jan 17, 2017 at 11:54 AM, Ruslan Dautkhanov
<
mailto:dautkha...@gmail.com
>
wrote:
'File size limit Exceeded' when importing notes - even for small files
This happens even for tiny files - a few Kb.
Is this a known issue?
Running Zeppelin 0.7.0 from a few weeks old snapshot.
See attached screenshot.
--
Ruslan Dautkhanov
Re: Using CDH dynamic resource pools with Zeppelin
My understanding is that this kind of user specific control isn’t coming until
v0.70. Currently when we run zeppelin all tasks are submitted by the user that
started the zeppelin process (so we start zeppelin from the yarn account and
everything is submitted as yarn). At least for spark there is a user queue
parameter that can be set in the interpreter which ensures that users are only
getting the resources they are allowed. We just create a different interpreter
for each user and set that parameter. It isn’t perfect, and might not even be
available for your JDBC, but I thought the detail might help.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq
https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq
https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Wed, Jan 11, 2017 at 8:04 AM Yaar Reuveni
<
mailto:Yaar Reuveni
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hey,
Since no answer yet, I'll try a simpler question.
I have Zeppelin defined with a
JDBC
interpreter configured with
Impala
that works against a CDH5.5 Hadoop cluster.
When I run queries from Zeppelin, these queries run without a user in Hadoop,
also no user seen in the Cloudera manager.
How can I configure it so there is a user defined on the connection and on the
running queries?
Thanks,
Yaar
On Tue, Dec 20, 2016 at 10:25 AM, Yaar Reuveni
<
mailto:ya...@liveperson.com
>
wrote:
Hey,
We're using a cloudera distribution hadoop.
We want to know how can we configure Zeppelin user authentication and link
between users and
https://www.cloudera.com/documentation/enterprise/5-8-x/topics/cm_mc_resource_pools.html
in our YARN Hadoop cluster
Thanks,
Yaar
--
This message may contain confidential and/or privileged information.
If you are not the addressee or authorized to receive this on behalf of the
addressee you must not use, copy, disclose or take action based on this message
or any information herein.
If you have received this message in error, please advise the sender
immediately by reply email and delete this message. Thank you.
Re: ClassNotFoundException with Scalding on Zeppelin managed on YARN
Thank you! That definitely did the trick.
I was trying to use ZEPPELIN_CLASSPATH_OVERRIDES to load the jars and couldn’t
figure out why it wasn’t working. Also
mode.asInstanceOf[Hdfs].conf.get("tmpjars").split(",").foreach(println) was
exactly the command that I was looking for to diagnose this problem. Switching
over to loading jars through the args.string got everything working.
On Thu, Dec 22, 2016 at 3:37 PM Prasad Wagle
<
mailto:Prasad Wagle
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hi Paul,
It looks like the cascading jars are not distributed to the YARN cluster. Can
you please try adding "zeppelin/interpreter/
scalding/*" to the args.string property of the scalding interpreter?
Here's the args.string we use:
-libjars /home/zeppelin-user/zeppelin/
interpreter/scalding/*,/home/
zeppelin-user/deploy-bundle-
201608111417/libs/* -Dscalding.reducer.estimator.
classes=com.twitter.scalding.
reducer_estimation.
InputSizeReducerEstimator -Delephantbird.use.combine.
input.format=true -Delephantbird.combine.split.
size=134217728 --hdfs --repl
tmpjars contains jars that are distributed to the YARN cluster. You can see its
contents with the command below:
%scalding
mode.asInstanceOf[Hdfs].conf.get("tmpjars").split(",").foreach(println)
Thanks,
Prasad
On Thu, Dec 22, 2016 at 9:31 AM, Paul Brenner
<
mailto:pbren...@placeiq.com
>
wrote:
I'm trying to get Scalding working on Zeppelin while using YARN. I followed the
steps in the docs
https://share.polymail.io/v1/z/b/NTg1YzBkOTc5ZTkx/2oW5SQjbADW8zb9nS3JO5g421bQMXDLTC0FeCJ_WR7eecFsW9CWa-tzokB9aSLwG5t9yQ9B6QpcS8AmXjjFFxJ31Thy9lN7HSvilaEeoI6Az7C53CrnFmUoMnta-EYrRI5uEQhbztPSzTrQle-3E00nNiVc7M6poouix37ZlX2VacVqONwmxpu6FSMs2x-_t20QRzFz8S7lneRPUBtpzIyxBRLcRL4CMf1AeMxQIVl3FkoStgA==
to build the interpreter and set up the classpath override. When I run in
local mode, code executes properly. However when I run on my cluster via YARN
my jobs fail with:
Error: java.lang.
ClassNotFoundException: cascading.CascadingException
or
Error: java.lang.
ClassNotFoundException: cascading.tuple.TupleException
What is even stranger to me is that I can go into Zeppelin and execute:
import cascading.tuple.TupleException import cascading.CascadingException
And both appear to have no problem finding those classes. It is only when I try
to actually use scalding (on YARN), like loading data into a typed pipe and
dumping that I get the ClassNotFoundException. Any ideas on how to debug or
what to fix?
(I already posted this on Stack Overflow with no luck:
https://share.polymail.io/v1/z/b/NTg1YzBkOTc5ZTkx/2oW5SQjbADW8zb9nS3JO5g421bQMXDLTC0FeCJ_WR7eecFsW9CWa-tzokB9aSLwG5t9yQ9B6QpcS8AmXjjFFxJ31Thy9lN7HSvilaEeoI6Az7C53CrnFmUoMnta-EYrRI5uEQhbztPSzB6ElJ-PAwFLHk1sne6d3tKW61fUlXHcQZkGEK0jyp-yaS91unqy7hlcPyFvqV_lgfB3NDNd4PGFMQK4UWIUMywUEsXGgXRQGgho1Hlj-0iyZtbcZrE3vMNtVzjO8HWJpq45DjiV-N210k6sXeYh5YrKTEiEpER4B
)
