Re: Slack invitation
Fair enough. Waiting for an invitation then. On Mon, Jun 6, 2022 at 10:36 PM Jeff Zhang wrote: > Hi Ricardo, > > This slack workspace is owned by apache, Zeppelin is one channel of this > workspace. Non-apache members can only join this workspace via invitation. > > > > On Tue, Jun 7, 2022 at 8:20 AM Ricardo Martinelli de Oliveira < > rmart...@redhat.com> wrote: > >> Is there a reason why the invite link is not public? I'd like to join >> too, but it's odd to me the invite is not open to anyone. >> >> On Mon, Jun 6, 2022 at 5:21 PM Gurdasani, Amit >> wrote: >> >>> Hello Jeff, >>> >>> >>> >>> May I please have an invitation to the Slack instance as well? >>> >>> >>> >>> Thanks, >>> >>> >>> >>> Amit Gurdasani >>> >>> Amazon Web Services >>> >>> >>> >>> *From: *Jeff Zhang >>> *Reply to: *"users@zeppelin.apache.org" >>> *Date: *Friday, 25 June 2021 at 20:32 >>> *To: *users >>> *Subject: *RE: [EXTERNAL] Slack invitation >>> >>> >>> >>> *CAUTION*: This email originated from outside of the organization. Do >>> not click links or open attachments unless you can confirm the sender and >>> know the content is safe. >>> >>> >>> >>> done >>> >>> >>> >>> Joshua Ox 于2021年6月26日周六 上午3:13写道： >>> >>> Please add me to slack. Thanks! >>> >>> On 2021/06/13 23:39:55, Jeff Zhang wrote: >>> > Done >>> > >>> > Beomyeong Kim 于2021年6月14日周一 上午5:56写道： >>> > >>> > > >>> > > Hello, >>> > > >>> > > >>> > > Could you invite me to the Zeppelin Slack workspace? >>> > > >>> > > >>> > > Regards >>> > > >>> > > >>> > > Kim >>> > > >>> > > >>> > > >>> > > >>> > > >>> > >>> > -- >>> > Best Regards >>> > >>> > Jeff Zhang >>> > >>> >>> >>> >>> >>> -- >>> >>> Best Regards >>> >>> Jeff Zhang >>> >> >> >> -- >> >> Ricardo Martinelli De Oliveira >> >> Senior Software Engineer, AI Managed Services >> >> Red Hat Brazil <https://www.redhat.com/> >> >> Av. Brigadeiro Faria Lima, 3900 >> >> 8th floor >> >> rmart...@redhat.comT: +551135426125 >> M: +5511970696531 >> @redhatjobs <https://twitter.com/redhatjobs> redhatjobs >> <https://www.facebook.com/redhatjobs> @redhatjobs >> <https://instagram.com/redhatjobs> >> <https://www.redhat.com/> >> > > > -- > Best Regards > > Jeff Zhang > -- Ricardo Martinelli De Oliveira Senior Software Engineer, AI Managed Services Red Hat Brazil <https://www.redhat.com/> Av. Brigadeiro Faria Lima, 3900 8th floor rmart...@redhat.comT: +551135426125 M: +5511970696531 @redhatjobs <https://twitter.com/redhatjobs> redhatjobs <https://www.facebook.com/redhatjobs> @redhatjobs <https://instagram.com/redhatjobs> <https://www.redhat.com/>
Re: Slack invitation
Is there a reason why the invite link is not public? I'd like to join too, but it's odd to me the invite is not open to anyone. On Mon, Jun 6, 2022 at 5:21 PM Gurdasani, Amit wrote: > Hello Jeff, > > > > May I please have an invitation to the Slack instance as well? > > > > Thanks, > > > > Amit Gurdasani > > Amazon Web Services > > > > *From: *Jeff Zhang > *Reply to: *"users@zeppelin.apache.org" > *Date: *Friday, 25 June 2021 at 20:32 > *To: *users > *Subject: *RE: [EXTERNAL] Slack invitation > > > > *CAUTION*: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and know > the content is safe. > > > > done > > > > Joshua Ox 于2021年6月26日周六 上午3:13写道： > > Please add me to slack. Thanks! > > On 2021/06/13 23:39:55, Jeff Zhang wrote: > > Done > > > > Beomyeong Kim 于2021年6月14日周一 上午5:56写道： > > > > > > > > Hello, > > > > > > > > > Could you invite me to the Zeppelin Slack workspace? > > > > > > > > > Regards > > > > > > > > > Kim > > > > > > > > > > > > > > > > > > > -- > > Best Regards > > > > Jeff Zhang > > > > > > > -- > > Best Regards > > Jeff Zhang > -- Ricardo Martinelli De Oliveira Senior Software Engineer, AI Managed Services Red Hat Brazil <https://www.redhat.com/> Av. Brigadeiro Faria Lima, 3900 8th floor rmart...@redhat.comT: +551135426125 M: +5511970696531 @redhatjobs <https://twitter.com/redhatjobs> redhatjobs <https://www.facebook.com/redhatjobs> @redhatjobs <https://instagram.com/redhatjobs> <https://www.redhat.com/>
Re: install-interpreter.sh cannot resolve dependencies
@Jeff I created the JIRA for this issue: https://issues.apache.org/jira/browse/ZEPPELIN-4583 Expect a PR on this in about 2 days. I'm going to send to master branch but I wonder if we can backport to 0.8.x branch. On Wed, Jan 22, 2020 at 12:04 PM Ricardo Martinelli de Oliveira < rmart...@redhat.com> wrote: > I found the problem with the interpreter installation. It turns out that > Zeppelin tries to resolve maven dependencies in http://repo1.maven.org > (the unsecured website) and it is returning HTTP 501, meaning that we can't > use HTTP to access Maven Central but the secured HTTPS website. Even the > JUnit tests are failling. > > After changing the code and the test to the HTTP Maven Central it worked. > > I'm going to create a JIRA for this and send a PR as soon as possible. > > On Tue, Jan 21, 2020 at 12:13 PM Ricardo Martinelli de Oliveira < > rmart...@redhat.com> wrote: > >> Jeff, >> >> Yeah, interpreter-list is outdated, but even if I change the values in >> the file or specifying --artifact >> org.apache.zeppelin:zeppelin-markdown:0.8.2 I get the same error. >> >> Is there any other place I need to change? If necessary, I can open an >> issue and send a PR to it. >> >> >> On Tue, Jan 21, 2020 at 11:33 AM Jeff Zhang wrote: >> >>> It seems you are using zeppelin 0.8.2, but install-interpreter.sh try to >>> install 0.8.0, I think this is a bug that we didn't update the file >>> interpreter-list >>> >>> https://github.com/apache/zeppelin/blob/branch-0.8/conf/interpreter-list >>> >>> >>> Ricardo Martinelli de Oliveira 于2020年1月21日周二 >>> 下午10:21写道： >>> >>>> Hello, >>>> >>>> I created a container version of zeppelin with the netinst distribution >>>> in it in order to have a small container image and install only the >>>> interpreters I'm going to use. However, when running install-interpreter.sh >>>> I get this error no matter is the interpreter I'm going to install: >>>> >>>> ./install-interpreter.sh -n jdbc >>>> OpenJDK >>>> 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was >>>> removed in 8.0 >>>> SLF4J: Class path contains multiple SLF4J bindings. >>>> SLF4J: Found binding in >>>> [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>> SLF4J: Found binding in >>>> [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>>> explanation. >>>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>>> Install jdbc(org.apache.zeppelin:zeppelin-jdbc:0.8.0) to >>>> /home/rmartine/Development/zeppelin-0.8.2-bin-netinst/interpreter/jdbc ... >>>> org.sonatype.aether.RepositoryException: Cannot fetch dependencies for >>>> org.apache.zeppelin:zeppelin-jdbc:0.8.0 >>>> >>>> Is anyone having the same issue? >>>> >>>> -- >>>> >>>> Ricardo Martinelli De Oliveira >>>> >>>> Data Engineer, AI CoE >>>> >>>> Red Hat Brazil <https://www.redhat.com/> >>>> >>> >>> >>> -- >>> Best Regards >>> >>> Jeff Zhang >>> >> >> >> -- >> >> Ricardo Martinelli De Oliveira >> >> Data Engineer, AI CoE >> >> Red Hat Brazil <https://www.redhat.com/> >> >> Av. Brigadeiro Faria Lima, 3900 >> >> 8th floor >> >> rmart...@redhat.comT: +551135426125 >> M: +5511970696531 >> @redhatjobs <https://twitter.com/redhatjobs> redhatjobs >> <https://www.facebook.com/redhatjobs> @redhatjobs >> <https://instagram.com/redhatjobs> >> <https://www.redhat.com/> >> > > > -- > > Ricardo Martinelli De Oliveira > > Data Engineer, AI CoE > > Red Hat Brazil <https://www.redhat.com/> > > Av. Brigadeiro Faria Lima, 3900 > > 8th floor > > rmart...@redhat.comT: +551135426125 > M: +5511970696531 > @redhatjobs <https://twitter.com/redhatjobs> redhatjobs > <https://www.facebook.com/redhatjobs> @redhatjobs > <https://instagram.com/redhatjobs> > <https://www.redhat.com/> > -- Ricardo Martinelli De Oliveira Data Engineer, AI CoE Red Hat Brazil <https://www.redhat.com/> Av. Brigadeiro Faria Lima, 3900 8th floor rmart...@redhat.comT: +551135426125 M: +5511970696531 @redhatjobs <https://twitter.com/redhatjobs> redhatjobs <https://www.facebook.com/redhatjobs> @redhatjobs <https://instagram.com/redhatjobs> <https://www.redhat.com/>
Re: install-interpreter.sh cannot resolve dependencies
I found the problem with the interpreter installation. It turns out that Zeppelin tries to resolve maven dependencies in http://repo1.maven.org (the unsecured website) and it is returning HTTP 501, meaning that we can't use HTTP to access Maven Central but the secured HTTPS website. Even the JUnit tests are failling. After changing the code and the test to the HTTP Maven Central it worked. I'm going to create a JIRA for this and send a PR as soon as possible. On Tue, Jan 21, 2020 at 12:13 PM Ricardo Martinelli de Oliveira < rmart...@redhat.com> wrote: > Jeff, > > Yeah, interpreter-list is outdated, but even if I change the values in the > file or specifying --artifact org.apache.zeppelin:zeppelin-markdown:0.8.2 I > get the same error. > > Is there any other place I need to change? If necessary, I can open an > issue and send a PR to it. > > > On Tue, Jan 21, 2020 at 11:33 AM Jeff Zhang wrote: > >> It seems you are using zeppelin 0.8.2, but install-interpreter.sh try to >> install 0.8.0, I think this is a bug that we didn't update the file >> interpreter-list >> >> https://github.com/apache/zeppelin/blob/branch-0.8/conf/interpreter-list >> >> >> Ricardo Martinelli de Oliveira 于2020年1月21日周二 >> 下午10:21写道： >> >>> Hello, >>> >>> I created a container version of zeppelin with the netinst distribution >>> in it in order to have a small container image and install only the >>> interpreters I'm going to use. However, when running install-interpreter.sh >>> I get this error no matter is the interpreter I'm going to install: >>> >>> ./install-interpreter.sh -n jdbc >>> OpenJDK >>> 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was >>> removed in 8.0 >>> SLF4J: Class path contains multiple SLF4J bindings. >>> SLF4J: Found binding in >>> [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>> explanation. >>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>> Install jdbc(org.apache.zeppelin:zeppelin-jdbc:0.8.0) to >>> /home/rmartine/Development/zeppelin-0.8.2-bin-netinst/interpreter/jdbc ... >>> org.sonatype.aether.RepositoryException: Cannot fetch dependencies for >>> org.apache.zeppelin:zeppelin-jdbc:0.8.0 >>> >>> Is anyone having the same issue? >>> >>> -- >>> >>> Ricardo Martinelli De Oliveira >>> >>> Data Engineer, AI CoE >>> >>> Red Hat Brazil <https://www.redhat.com/> >>> >> >> >> -- >> Best Regards >> >> Jeff Zhang >> > > > -- > > Ricardo Martinelli De Oliveira > > Data Engineer, AI CoE > > Red Hat Brazil <https://www.redhat.com/> > > Av. Brigadeiro Faria Lima, 3900 > > 8th floor > > rmart...@redhat.comT: +551135426125 > M: +5511970696531 > @redhatjobs <https://twitter.com/redhatjobs> redhatjobs > <https://www.facebook.com/redhatjobs> @redhatjobs > <https://instagram.com/redhatjobs> > <https://www.redhat.com/> > -- Ricardo Martinelli De Oliveira Data Engineer, AI CoE Red Hat Brazil <https://www.redhat.com/> Av. Brigadeiro Faria Lima, 3900 8th floor rmart...@redhat.comT: +551135426125 M: +5511970696531 @redhatjobs <https://twitter.com/redhatjobs> redhatjobs <https://www.facebook.com/redhatjobs> @redhatjobs <https://instagram.com/redhatjobs> <https://www.redhat.com/>
Re: install-interpreter.sh cannot resolve dependencies
Jeff, Yeah, interpreter-list is outdated, but even if I change the values in the file or specifying --artifact org.apache.zeppelin:zeppelin-markdown:0.8.2 I get the same error. Is there any other place I need to change? If necessary, I can open an issue and send a PR to it. On Tue, Jan 21, 2020 at 11:33 AM Jeff Zhang wrote: > It seems you are using zeppelin 0.8.2, but install-interpreter.sh try to > install 0.8.0, I think this is a bug that we didn't update the file > interpreter-list > > https://github.com/apache/zeppelin/blob/branch-0.8/conf/interpreter-list > > > Ricardo Martinelli de Oliveira 于2020年1月21日周二 > 下午10:21写道： > >> Hello, >> >> I created a container version of zeppelin with the netinst distribution >> in it in order to have a small container image and install only the >> interpreters I'm going to use. However, when running install-interpreter.sh >> I get this error no matter is the interpreter I'm going to install: >> >> ./install-interpreter.sh -n jdbc >> OpenJDK >> 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was >> removed in 8.0 >> SLF4J: Class path contains multiple SLF4J bindings. >> SLF4J: Found binding in >> [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: Found binding in >> [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >> explanation. >> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >> Install jdbc(org.apache.zeppelin:zeppelin-jdbc:0.8.0) to >> /home/rmartine/Development/zeppelin-0.8.2-bin-netinst/interpreter/jdbc ... >> org.sonatype.aether.RepositoryException: Cannot fetch dependencies for >> org.apache.zeppelin:zeppelin-jdbc:0.8.0 >> >> Is anyone having the same issue? >> >> -- >> >> Ricardo Martinelli De Oliveira >> >> Data Engineer, AI CoE >> >> Red Hat Brazil <https://www.redhat.com/> >> > > > -- > Best Regards > > Jeff Zhang > -- Ricardo Martinelli De Oliveira Data Engineer, AI CoE Red Hat Brazil <https://www.redhat.com/> Av. Brigadeiro Faria Lima, 3900 8th floor rmart...@redhat.comT: +551135426125 M: +5511970696531 @redhatjobs <https://twitter.com/redhatjobs> redhatjobs <https://www.facebook.com/redhatjobs> @redhatjobs <https://instagram.com/redhatjobs> <https://www.redhat.com/>
install-interpreter.sh cannot resolve dependencies
Hello, I created a container version of zeppelin with the netinst distribution in it in order to have a small container image and install only the interpreters I'm going to use. However, when running install-interpreter.sh I get this error no matter is the interpreter I'm going to install: ./install-interpreter.sh -n jdbc OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/rmartine/Development/zeppelin-0.8.2-bin-netinst/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Install jdbc(org.apache.zeppelin:zeppelin-jdbc:0.8.0) to /home/rmartine/Development/zeppelin-0.8.2-bin-netinst/interpreter/jdbc ... org.sonatype.aether.RepositoryException: Cannot fetch dependencies for org.apache.zeppelin:zeppelin-jdbc:0.8.0 Is anyone having the same issue? -- Ricardo Martinelli De Oliveira Data Engineer, AI CoE Red Hat Brazil <https://www.redhat.com/>
Env var suport in interpreter-setting.json
Hi, Does anyone know if there is env var support in interpreter-setting.json? I'd like to configure zeppelin.spark.uiWebUrl parameter default value with the value of my SPARK_UI_URL env var. -- Ricardo Martinelli de Oliveira Senior Software Engineer T: +55 11 3524-6125 | M: +55 11 9 7069-6531 Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&source=g> . <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil pelo *Great Place to Work*.
Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json
I totally agree with the change. As I created an image for Zeppelin, it's
been painful store the notebooks in GitHub with a directory named with some
random hash and with the note.json in it. Having .zpln is even better
since I only need to store a file in the root of my repo and copy to the
right location.
With this scenario, I'd like to say this is an important feature to add in
Zeppelin. I'll be glad to help with anything, including code.
Em dom, 12 de ago de 2018 20:34, Jeff Zhang escreveu:
> Motivation
>
>The motivation of ZEPPELIN-2619 is to change the notes storage
> structure. Previously we store it using {noteId}/note.json, we’d like to
> change it into {note_name}_{note_id}.zpln. There are several reasons for
> this change.
>
>
>1.
>
>{noteId}/note.json is not scalable. We put all notes in one root
>folder in flat structure. And when zeppelin server starts, we need to read
>all note.json to get the note file name and build the note folder structure
>(Because we need to get the note name which is stored in note.json to build
>the notebook menu). This would be a nightmare when you have large amounts
>of notes.
>2.
>
>{noteId}/note.json is not maintainable. It is difficult for a
>developer/administrator to find note file based on note name.
>3.
>
>{noteId}/note.json has no folder structure. Currently zeppelin have to
>build the folder structure internally in memory according note name which
>is a big overhead.
>
>
> New Approach
>
>As I mentioned above, I propose to change the note storage structure to
> {note_name}_{note_id}.zpln. note_name could contains folders, e.g.
> folder_1/mynote_abcd.zpln
>
> This kind of note storage structure could bring several benefits.
>
>1.
>
>We don’t need to load all notes when zeppelin starts. We just need to
>list each folder to get the note name and note_id.
>2.
>
>It is much maintainable so that it is easy to find the note file based
>on note name.
>3.
>
>It has the folder structure already. That can be mapped to the note
>folder structure.
>
>
> Side Effect
>
> This approach only works for file system storage, so that means we have to
> drop support for MongoNotebookRepo. I think it is ok because I didn’t see
> any users talk about this in community, so I assume no one is using it.
>
>
> This is overall design, welcome any comments and feedback. Thanks.
>
>
> Here's the google docs, you can also comment it here.
>
>
> https://docs.google.com/document/d/126egAQmhQOL4ynxJ3AQJQRBBLdW8TATYcGkDL1DNZoE/edit?usp=sharing
>
>
>
>
Re: Zeppelin 0.8 rc1
I'm pretty sure it is not released yet. On Wed, May 16, 2018 at 2:50 PM, Ruslan Dautkhanov wrote: > I didn't know 0.8 rc1/rc2 were out. Was it advertised on the dev list? > > Thanks for sharing this. > > > > -- > Ruslan Dautkhanov > > On Sun, May 13, 2018 at 1:23 AM, Rotem Herzberg < > rotem.herzb...@gigaspaces.com> wrote: > >> Hello all, >> >> I've downloaded and built the zeppelin v0.8.0-rc1 >> <https://github.com/apache/zeppelin/releases/tag/v0.8.0-rc1> build but >> when I try to run zeppelin the zeppelin process dies and I can't access the >> notebooks. >> >> How can I solve this problem? Other zeppelin builds work fine on my >> machine. >> >> I noticed that rc2 was out and now doesn't appear in the releases. When >> will it be available? >> >> Thanks in advance, >> >> >> -- >> <http://www.gigaspaces.com/?utm_source=Signature&utm_medium=Email> >> *Rotem Herzberg* >> SW Engineer | GigaSpaces Technologies >> >> rotem.herzb...@gigaspaces.com | M +972547718880 >> >> <https://twitter.com/gigaspaces> >> <https://www.linkedin.com/company/gigaspaces> >> <https://www.facebook.com/gigaspaces> >> > > -- Ricardo Martinelli de Oliveira Senior Software Engineer T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531 Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&source=g> . <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil pelo *Great Place to Work*.
Re: Importing notes
Me neither. You're right again. =D On Thu, Feb 1, 2018 at 11:52 AM, Partridge, Lucas (GE Aviation) < lucas.partri...@ge.com> wrote: > Sorry, I probably shouldn’t have used the word ‘as-is’. You don’t need to > copy the whole notebook folder – only the folders beneath that that contain > the notebook json files you want to make available to your new instance of > Zeppelin. I usually only copy the notebooks I want, not all of them. > You’ll notice each Zeppelin gets some standard tutorial notebooks anyway > (which appear to have the same ids each time). I appreciate it might be a > bit of a pain working out which folders contain the notebooks you want if > you have a lot of notebooks though… > > > > *From:* Ricardo Martinelli de Oliveira [mailto:rmart...@redhat.com] > *Sent:* 01 February 2018 13:31 > > *To:* users@zeppelin.apache.org > *Subject:* EXT: Re: Importing notes > > > > You're right, Lucas. Copying the notebook folder as-is do the trick. I'm > wondering now if there is a way to generate those unique ids to avoid > copying the whole structure. > > Or maybe I can consider that a limitation of the import feature I'm doing > now. > > > > On Thu, Feb 1, 2018 at 10:15 AM, Partridge, Lucas (GE Aviation) < > lucas.partri...@ge.com> wrote: > > As far as I know all you have to do is copy the contents of the notebook > folder as-is into the same folder of the new Zeppelin instance. That’s what > I did when I moved from one Zeppelin version to another recently and it all > appears to work! I think Zeppelin just reads the contents of that folder > on startup. AFAIK no database is involved. I think it’s much simpler than > you think. > > > > Just give it a try and see if that works for you. I guess there may be > interpreter backward-compatibility issues if you try skipping too many > Zeppelin versions at once. I don’t know how that situation’s handled. > > > > *From:* Ricardo Martinelli de Oliveira [mailto:rmart...@redhat.com] > *Sent:* 01 February 2018 11:18 > *To:* users@zeppelin.apache.org > *Subject:* EXT: Re: Importing notes > > > > It doesn't matter where you store the notebooks (in a volume or directly > in the container), what I'm trying to achieve is copy my notebooks > somewhere that zeppelin could read and import all notebooks inside that > path without having to manually click on the "Import Notebook" link. > Imagine I have a folder with dozens of notebooks, it will be a painful task > import them one by one. > > I'm still doing research about this and if I findsomething I'll share with > you. > > > > On Wed, Jan 31, 2018 at 3:45 PM, Mohit Jaggi wrote: > > I think the names are merely descriptions and are stored in the notebooks. > I think you can mount a volume in your container and store the notebooks on > that volume. > > > > On Wed, Jan 31, 2018 at 8:36 AM, Michael Segel > wrote: > > If you look at the names of the notebooks, they appear to be Unique IDs > and not the name/label you provided when you created them. So there has to > be a link between the name of the notebook and the reference. Where is > that being stored? That’s what is missing. > > > > Just out of curiosity… would it be possible to store the notes in a > central repo outside of the container? > > > > > > On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira < > rmart...@redhat.com> wrote: > > > > I did a quick research in the configuration and the code and the store > type is what defines the way the notes will be stored. The default is Git, > which means it will be stored in the notebook directory and can be > versioned using git. > > However, I see that VFS implementation is supported and by VFS I was > wondering if there is a mechanism that scans the notebook directory and > look for new notebooks. > > > > On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel > wrote: > > I don’t think you can… > > If you look in the ../notebook directory, the notes are all identified by > an unique id. > > My guess? That the references are stored within a database. (Derby? ) > > > > > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira < > rmart...@redhat.com> wrote: > > > > Hello, > > > > Is there a way to import notes from a command line? I am trying to write > a script that imports all my notes in a zeppelin docker container, but the > only ways to import is from the web UI or REST. In the script, zeppelin is > not started (there is no reason to be) so I'm trying to find a way to > import the note in a disconnected way. > > > > Any idea
Re: Importing notes
You're right, Lucas. Copying the notebook folder as-is do the trick. I'm wondering now if there is a way to generate those unique ids to avoid copying the whole structure. Or maybe I can consider that a limitation of the import feature I'm doing now. On Thu, Feb 1, 2018 at 10:15 AM, Partridge, Lucas (GE Aviation) < lucas.partri...@ge.com> wrote: > As far as I know all you have to do is copy the contents of the notebook > folder as-is into the same folder of the new Zeppelin instance. That’s what > I did when I moved from one Zeppelin version to another recently and it all > appears to work! I think Zeppelin just reads the contents of that folder > on startup. AFAIK no database is involved. I think it’s much simpler than > you think. > > > > Just give it a try and see if that works for you. I guess there may be > interpreter backward-compatibility issues if you try skipping too many > Zeppelin versions at once. I don’t know how that situation’s handled. > > > > *From:* Ricardo Martinelli de Oliveira [mailto:rmart...@redhat.com] > *Sent:* 01 February 2018 11:18 > *To:* users@zeppelin.apache.org > *Subject:* EXT: Re: Importing notes > > > > It doesn't matter where you store the notebooks (in a volume or directly > in the container), what I'm trying to achieve is copy my notebooks > somewhere that zeppelin could read and import all notebooks inside that > path without having to manually click on the "Import Notebook" link. > Imagine I have a folder with dozens of notebooks, it will be a painful task > import them one by one. > > I'm still doing research about this and if I findsomething I'll share with > you. > > > > On Wed, Jan 31, 2018 at 3:45 PM, Mohit Jaggi wrote: > > I think the names are merely descriptions and are stored in the notebooks. > I think you can mount a volume in your container and store the notebooks on > that volume. > > > > On Wed, Jan 31, 2018 at 8:36 AM, Michael Segel > wrote: > > If you look at the names of the notebooks, they appear to be Unique IDs > and not the name/label you provided when you created them. So there has to > be a link between the name of the notebook and the reference. Where is > that being stored? That’s what is missing. > > > > Just out of curiosity… would it be possible to store the notes in a > central repo outside of the container? > > > > > > On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira < > rmart...@redhat.com> wrote: > > > > I did a quick research in the configuration and the code and the store > type is what defines the way the notes will be stored. The default is Git, > which means it will be stored in the notebook directory and can be > versioned using git. > > However, I see that VFS implementation is supported and by VFS I was > wondering if there is a mechanism that scans the notebook directory and > look for new notebooks. > > > > On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel > wrote: > > I don’t think you can… > > If you look in the ../notebook directory, the notes are all identified by > an unique id. > > My guess? That the references are stored within a database. (Derby? ) > > > > > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira < > rmart...@redhat.com> wrote: > > > > Hello, > > > > Is there a way to import notes from a command line? I am trying to write > a script that imports all my notes in a zeppelin docker container, but the > only ways to import is from the web UI or REST. In the script, zeppelin is > not started (there is no reason to be) so I'm trying to find a way to > import the note in a disconnected way. > > > > Any ideas to do this? > > > > > -- > > *Ricardo Martinelli de Oliveira* > Senior Software Engineer > T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531 > Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil > <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&source=g> > . > > <https://red.ht/sig> > > *TRIED. TESTED. TRUSTED.* <https://redhat.com/trusted> > > Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil > pelo *Great Place to Work*. > > > > > > > > > -- > > *Ricardo Martinelli de Oliveira* > Senior Software Engineer > T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531 > Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil > <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&
Re: Importing notes
It doesn't matter where you store the notebooks (in a volume or directly in the container), what I'm trying to achieve is copy my notebooks somewhere that zeppelin could read and import all notebooks inside that path without having to manually click on the "Import Notebook" link. Imagine I have a folder with dozens of notebooks, it will be a painful task import them one by one. I'm still doing research about this and if I findsomething I'll share with you. On Wed, Jan 31, 2018 at 3:45 PM, Mohit Jaggi wrote: > I think the names are merely descriptions and are stored in the notebooks. > I think you can mount a volume in your container and store the notebooks on > that volume. > > On Wed, Jan 31, 2018 at 8:36 AM, Michael Segel > wrote: > >> If you look at the names of the notebooks, they appear to be Unique IDs >> and not the name/label you provided when you created them. So there has to >> be a link between the name of the notebook and the reference. Where is >> that being stored? That’s what is missing. >> >> Just out of curiosity… would it be possible to store the notes in a >> central repo outside of the container? >> >> >> On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira < >> rmart...@redhat.com> wrote: >> >> I did a quick research in the configuration and the code and the store >> type is what defines the way the notes will be stored. The default is Git, >> which means it will be stored in the notebook directory and can be >> versioned using git. >> >> However, I see that VFS implementation is supported and by VFS I was >> wondering if there is a mechanism that scans the notebook directory and >> look for new notebooks. >> >> On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel < >> msegel_had...@hotmail.com> wrote: >> >>> I don’t think you can… >>> >>> If you look in the ../notebook directory, the notes are all identified >>> by an unique id. >>> >>> My guess? That the references are stored within a database. (Derby? ) >>> >>> >>> > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira < >>> rmart...@redhat.com> wrote: >>> > >>> > Hello, >>> > >>> > Is there a way to import notes from a command line? I am trying to >>> write a script that imports all my notes in a zeppelin docker container, >>> but the only ways to import is from the web UI or REST. In the script, >>> zeppelin is not started (there is no reason to be) so I'm trying to find a >>> way to import the note in a disconnected way. >>> > >>> > Any ideas to do this? >>> >>> >> >> >> -- >> Ricardo Martinelli de Oliveira >> Senior Software Engineer >> T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531 >> Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil >> <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&source=g> >> . >> <https://red.ht/sig> >> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> >> >> Red Hat é reconhecida entre as melhores empresas para trabalhar no >> Brasil pelo *Great Place to Work*. >> >> >> > -- Ricardo Martinelli de Oliveira Senior Software Engineer T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531 Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&source=g> . <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil pelo *Great Place to Work*.
Re: Importing notes
I did a quick research in the configuration and the code and the store type is what defines the way the notes will be stored. The default is Git, which means it will be stored in the notebook directory and can be versioned using git. However, I see that VFS implementation is supported and by VFS I was wondering if there is a mechanism that scans the notebook directory and look for new notebooks. On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel wrote: > I don’t think you can… > > If you look in the ../notebook directory, the notes are all identified by > an unique id. > > My guess? That the references are stored within a database. (Derby? ) > > > > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira < > rmart...@redhat.com> wrote: > > > > Hello, > > > > Is there a way to import notes from a command line? I am trying to write > a script that imports all my notes in a zeppelin docker container, but the > only ways to import is from the web UI or REST. In the script, zeppelin is > not started (there is no reason to be) so I'm trying to find a way to > import the note in a disconnected way. > > > > Any ideas to do this? > > -- Ricardo Martinelli de Oliveira Senior Software Engineer T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531 Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&source=g> . <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil pelo *Great Place to Work*.
Importing notes
Hello, Is there a way to import notes from a command line? I am trying to write a script that imports all my notes in a zeppelin docker container, but the only ways to import is from the web UI or REST. In the script, zeppelin is not started (there is no reason to be) so I'm trying to find a way to import the note in a disconnected way. Any ideas to do this?
