Re: Importing notes

2018-02-01 Thread Ricardo Martinelli de Oliveira
Me neither. You're right again. =D

On Thu, Feb 1, 2018 at 11:52 AM, Partridge, Lucas (GE Aviation) <
lucas.partri...@ge.com> wrote:

> Sorry, I probably shouldn’t have used the word ‘as-is’.  You don’t need to
> copy the whole notebook folder – only the folders beneath that that contain
> the notebook json files you want to make available to your new instance of
> Zeppelin.  I usually only copy the notebooks I want, not all of them.
> You’ll notice each Zeppelin gets some standard tutorial notebooks anyway
> (which appear to have the same ids each time).  I appreciate it might be a
> bit of a pain working out which folders contain the notebooks you want if
> you have a lot of notebooks though…
>
>
>
> *From:* Ricardo Martinelli de Oliveira [mailto:rmart...@redhat.com]
> *Sent:* 01 February 2018 13:31
>
> *To:* users@zeppelin.apache.org
> *Subject:* EXT: Re: Importing notes
>
>
>
> You're right, Lucas. Copying the notebook folder as-is do the trick. I'm
> wondering now if there is a way to generate those unique ids to avoid
> copying the whole structure.
>
> Or maybe I can consider that a limitation of the import feature I'm doing
> now.
>
>
>
> On Thu, Feb 1, 2018 at 10:15 AM, Partridge, Lucas (GE Aviation) <
> lucas.partri...@ge.com> wrote:
>
> As far as I know all you have to do is copy the contents of the notebook
> folder as-is into the same folder of the new Zeppelin instance. That’s what
> I did when I moved from one Zeppelin version to another recently and it all
> appears to work!  I think Zeppelin just reads the contents of that folder
> on startup. AFAIK no database is involved. I think it’s much simpler than
> you think.
>
>
>
> Just give it a try and see if that works for you. I guess there may be
> interpreter backward-compatibility issues if you try skipping too many
> Zeppelin versions at once. I don’t know how that situation’s handled.
>
>
>
> *From:* Ricardo Martinelli de Oliveira [mailto:rmart...@redhat.com]
> *Sent:* 01 February 2018 11:18
> *To:* users@zeppelin.apache.org
> *Subject:* EXT: Re: Importing notes
>
>
>
> It doesn't matter where you store the notebooks (in a volume or directly
> in the container), what I'm trying to achieve is copy my notebooks
> somewhere that zeppelin could read and import all notebooks inside that
> path without having to manually click on the "Import Notebook" link.
> Imagine I have a folder with dozens of notebooks, it will be a painful task
> import them one by one.
>
> I'm still doing research about this and if I findsomething I'll share with
> you.
>
>
>
> On Wed, Jan 31, 2018 at 3:45 PM, Mohit Jaggi  wrote:
>
> I think the names are merely descriptions and are stored in the notebooks.
> I think you can mount a volume in your container and store the notebooks on
> that volume.
>
>
>
> On Wed, Jan 31, 2018 at 8:36 AM, Michael Segel 
> wrote:
>
> If you look at the names of the notebooks, they appear to be Unique IDs
> and not the name/label you provided when you created them.  So there has to
> be a link between the name of the notebook and the reference.  Where is
> that being stored?  That’s what is missing.
>
>
>
> Just out of curiosity… would it be possible to store the notes in a
> central repo outside of the container?
>
>
>
>
>
> On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira <
> rmart...@redhat.com> wrote:
>
>
>
> I did a quick research in the configuration and the code and the store
> type is what defines the way the notes will be stored. The default is Git,
> which means it will be stored in the notebook directory and can be
> versioned using git.
>
> However, I see that VFS implementation is supported and by VFS I was
> wondering if there is a mechanism that scans the notebook directory and
> look for new notebooks.
>
>
>
> On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel 
> wrote:
>
> I don’t think you can…
>
> If you look in the ../notebook directory, the notes are all identified by
> an unique id.
>
> My guess? That the references are stored within a database. (Derby? )
>
>
>
> > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira <
> rmart...@redhat.com> wrote:
> >
> > Hello,
> >
> > Is there a way to import notes from a command line? I am trying to write
> a script that imports all my notes in a zeppelin docker container, but the
> only ways to import is from the web UI or REST. In the script, zeppelin is
> not started (there is no reason to be) so I'm trying to find a way to
> import the note in a disconnected way.
> >
> > Any idea

Re: Importing notes

2018-02-01 Thread Ricardo Martinelli de Oliveira
You're right, Lucas. Copying the notebook folder as-is do the trick. I'm
wondering now if there is a way to generate those unique ids to avoid
copying the whole structure.

Or maybe I can consider that a limitation of the import feature I'm doing
now.

On Thu, Feb 1, 2018 at 10:15 AM, Partridge, Lucas (GE Aviation) <
lucas.partri...@ge.com> wrote:

> As far as I know all you have to do is copy the contents of the notebook
> folder as-is into the same folder of the new Zeppelin instance. That’s what
> I did when I moved from one Zeppelin version to another recently and it all
> appears to work!  I think Zeppelin just reads the contents of that folder
> on startup. AFAIK no database is involved. I think it’s much simpler than
> you think.
>
>
>
> Just give it a try and see if that works for you. I guess there may be
> interpreter backward-compatibility issues if you try skipping too many
> Zeppelin versions at once. I don’t know how that situation’s handled.
>
>
>
> *From:* Ricardo Martinelli de Oliveira [mailto:rmart...@redhat.com]
> *Sent:* 01 February 2018 11:18
> *To:* users@zeppelin.apache.org
> *Subject:* EXT: Re: Importing notes
>
>
>
> It doesn't matter where you store the notebooks (in a volume or directly
> in the container), what I'm trying to achieve is copy my notebooks
> somewhere that zeppelin could read and import all notebooks inside that
> path without having to manually click on the "Import Notebook" link.
> Imagine I have a folder with dozens of notebooks, it will be a painful task
> import them one by one.
>
> I'm still doing research about this and if I findsomething I'll share with
> you.
>
>
>
> On Wed, Jan 31, 2018 at 3:45 PM, Mohit Jaggi  wrote:
>
> I think the names are merely descriptions and are stored in the notebooks.
> I think you can mount a volume in your container and store the notebooks on
> that volume.
>
>
>
> On Wed, Jan 31, 2018 at 8:36 AM, Michael Segel 
> wrote:
>
> If you look at the names of the notebooks, they appear to be Unique IDs
> and not the name/label you provided when you created them.  So there has to
> be a link between the name of the notebook and the reference.  Where is
> that being stored?  That’s what is missing.
>
>
>
> Just out of curiosity… would it be possible to store the notes in a
> central repo outside of the container?
>
>
>
>
>
> On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira <
> rmart...@redhat.com> wrote:
>
>
>
> I did a quick research in the configuration and the code and the store
> type is what defines the way the notes will be stored. The default is Git,
> which means it will be stored in the notebook directory and can be
> versioned using git.
>
> However, I see that VFS implementation is supported and by VFS I was
> wondering if there is a mechanism that scans the notebook directory and
> look for new notebooks.
>
>
>
> On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel 
> wrote:
>
> I don’t think you can…
>
> If you look in the ../notebook directory, the notes are all identified by
> an unique id.
>
> My guess? That the references are stored within a database. (Derby? )
>
>
>
> > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira <
> rmart...@redhat.com> wrote:
> >
> > Hello,
> >
> > Is there a way to import notes from a command line? I am trying to write
> a script that imports all my notes in a zeppelin docker container, but the
> only ways to import is from the web UI or REST. In the script, zeppelin is
> not started (there is no reason to be) so I'm trying to find a way to
> import the note in a disconnected way.
> >
> > Any ideas to do this?
>
>
>
>
> --
>
> *Ricardo Martinelli de Oliveira*
> Senior Software Engineer
> T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531
> Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil
> <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&source=g>
> .
>
> <https://red.ht/sig>
>
> *TRIED. TESTED. TRUSTED.* <https://redhat.com/trusted>
>
>  Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil
> pelo *Great Place to Work*.
>
>
>
>
>
>
>
>
> --
>
> *Ricardo Martinelli de Oliveira*
> Senior Software Engineer
> T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531
> Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil
> <https://maps.google.com/?q=Av.+Brigadeiro+Faria+Lima+3900,+8%C2%B0+Andar.+S%C3%A3o+Paulo,+Brasil&entry=gmail&

Re: Importing notes

2018-02-01 Thread Ricardo Martinelli de Oliveira
It doesn't matter where you store the notebooks (in a volume or directly in
the container), what I'm trying to achieve is copy my notebooks somewhere
that zeppelin could read and import all notebooks inside that path without
having to manually click on the "Import Notebook" link. Imagine I have a
folder with dozens of notebooks, it will be a painful task import them one
by one.

I'm still doing research about this and if I findsomething I'll share with
you.

On Wed, Jan 31, 2018 at 3:45 PM, Mohit Jaggi  wrote:

> I think the names are merely descriptions and are stored in the notebooks.
> I think you can mount a volume in your container and store the notebooks on
> that volume.
>
> On Wed, Jan 31, 2018 at 8:36 AM, Michael Segel 
> wrote:
>
>> If you look at the names of the notebooks, they appear to be Unique IDs
>> and not the name/label you provided when you created them.  So there has to
>> be a link between the name of the notebook and the reference.  Where is
>> that being stored?  That’s what is missing.
>>
>> Just out of curiosity… would it be possible to store the notes in a
>> central repo outside of the container?
>>
>>
>> On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira <
>> rmart...@redhat.com> wrote:
>>
>> I did a quick research in the configuration and the code and the store
>> type is what defines the way the notes will be stored. The default is Git,
>> which means it will be stored in the notebook directory and can be
>> versioned using git.
>>
>> However, I see that VFS implementation is supported and by VFS I was
>> wondering if there is a mechanism that scans the notebook directory and
>> look for new notebooks.
>>
>> On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel <
>> msegel_had...@hotmail.com> wrote:
>>
>>> I don’t think you can…
>>>
>>> If you look in the ../notebook directory, the notes are all identified
>>> by an unique id.
>>>
>>> My guess? That the references are stored within a database. (Derby? )
>>>
>>>
>>> > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira <
>>> rmart...@redhat.com> wrote:
>>> >
>>> > Hello,
>>> >
>>> > Is there a way to import notes from a command line? I am trying to
>>> write a script that imports all my notes in a zeppelin docker container,
>>> but the only ways to import is from the web UI or REST. In the script,
>>> zeppelin is not started (there is no reason to be) so I'm trying to find a
>>> way to import the note in a disconnected way.
>>> >
>>> > Any ideas to do this?
>>>
>>>
>>
>>
>> --
>> Ricardo Martinelli de Oliveira
>> Senior Software Engineer
>> T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531
>> Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil
>> 
>> .
>> 
>> TRIED. TESTED. TRUSTED. 
>>
>>  Red Hat é reconhecida entre as melhores empresas para trabalhar no
>> Brasil pelo *Great Place to Work*.
>>
>>
>>
>


-- 
Ricardo Martinelli de Oliveira
Senior Software Engineer
T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531
Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil

.

TRIED. TESTED. TRUSTED. 

 Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil
pelo *Great Place to Work*.


Re: Importing notes

2018-01-31 Thread Mohit Jaggi
I think the names are merely descriptions and are stored in the notebooks.
I think you can mount a volume in your container and store the notebooks on
that volume.

On Wed, Jan 31, 2018 at 8:36 AM, Michael Segel 
wrote:

> If you look at the names of the notebooks, they appear to be Unique IDs
> and not the name/label you provided when you created them.  So there has to
> be a link between the name of the notebook and the reference.  Where is
> that being stored?  That’s what is missing.
>
> Just out of curiosity… would it be possible to store the notes in a
> central repo outside of the container?
>
>
> On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira <
> rmart...@redhat.com> wrote:
>
> I did a quick research in the configuration and the code and the store
> type is what defines the way the notes will be stored. The default is Git,
> which means it will be stored in the notebook directory and can be
> versioned using git.
>
> However, I see that VFS implementation is supported and by VFS I was
> wondering if there is a mechanism that scans the notebook directory and
> look for new notebooks.
>
> On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel  > wrote:
>
>> I don’t think you can…
>>
>> If you look in the ../notebook directory, the notes are all identified by
>> an unique id.
>>
>> My guess? That the references are stored within a database. (Derby? )
>>
>>
>> > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira <
>> rmart...@redhat.com> wrote:
>> >
>> > Hello,
>> >
>> > Is there a way to import notes from a command line? I am trying to
>> write a script that imports all my notes in a zeppelin docker container,
>> but the only ways to import is from the web UI or REST. In the script,
>> zeppelin is not started (there is no reason to be) so I'm trying to find a
>> way to import the note in a disconnected way.
>> >
>> > Any ideas to do this?
>>
>>
>
>
> --
> Ricardo Martinelli de Oliveira
> Senior Software Engineer
> T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531
> Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil
> 
> .
> 
> TRIED. TESTED. TRUSTED. 
>
>  Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil
> pelo *Great Place to Work*.
>
>
>


Re: Importing notes

2018-01-31 Thread Michael Segel
If you look at the names of the notebooks, they appear to be Unique IDs and not 
the name/label you provided when you created them.  So there has to be a link 
between the name of the notebook and the reference.  Where is that being 
stored?  That’s what is missing.

Just out of curiosity… would it be possible to store the notes in a central 
repo outside of the container?

On Jan 31, 2018, at 4:44 AM, Ricardo Martinelli de Oliveira 
mailto:rmart...@redhat.com>> wrote:

I did a quick research in the configuration and the code and the store type is 
what defines the way the notes will be stored. The default is Git, which means 
it will be stored in the notebook directory and can be versioned using git.

However, I see that VFS implementation is supported and by VFS I was wondering 
if there is a mechanism that scans the notebook directory and look for new 
notebooks.

On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel 
mailto:msegel_had...@hotmail.com>> wrote:
I don’t think you can…

If you look in the ../notebook directory, the notes are all identified by an 
unique id.

My guess? That the references are stored within a database. (Derby? )


> On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira 
> mailto:rmart...@redhat.com>> wrote:
>
> Hello,
>
> Is there a way to import notes from a command line? I am trying to write a 
> script that imports all my notes in a zeppelin docker container, but the only 
> ways to import is from the web UI or REST. In the script, zeppelin is not 
> started (there is no reason to be) so I'm trying to find a way to import the 
> note in a disconnected way.
>
> Any ideas to do this?




--
Ricardo Martinelli de Oliveira
Senior Software Engineer
T: +55 11 3524-6125 | M: +55 11 9 7069-6531
Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, 
Brasil.
[https://www.redhat.com/files/brand/email/sig-redhat.png]
TRIED. TESTED. TRUSTED.


 Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil pelo 
Great Place to Work.



Re: Importing notes

2018-01-31 Thread moon soo Lee
I'm not sure this helps but there's a rest api endpoint that reload the
notebooks from notebook storage.
https://github.com/apache/zeppelin/blob/master/zeppelin-server/src/main/java/org/apache/zeppelin/rest/NotebookRepoRestApi.java#L82

Thanks,
moon

On Wed, Jan 31, 2018 at 2:44 AM Ricardo Martinelli de Oliveira <
rmart...@redhat.com> wrote:

> I did a quick research in the configuration and the code and the store
> type is what defines the way the notes will be stored. The default is Git,
> which means it will be stored in the notebook directory and can be
> versioned using git.
>
> However, I see that VFS implementation is supported and by VFS I was
> wondering if there is a mechanism that scans the notebook directory and
> look for new notebooks.
>
> On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel  > wrote:
>
>> I don’t think you can…
>>
>> If you look in the ../notebook directory, the notes are all identified by
>> an unique id.
>>
>> My guess? That the references are stored within a database. (Derby? )
>>
>>
>> > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira <
>> rmart...@redhat.com> wrote:
>> >
>> > Hello,
>> >
>> > Is there a way to import notes from a command line? I am trying to
>> write a script that imports all my notes in a zeppelin docker container,
>> but the only ways to import is from the web UI or REST. In the script,
>> zeppelin is not started (there is no reason to be) so I'm trying to find a
>> way to import the note in a disconnected way.
>> >
>> > Any ideas to do this?
>>
>>
>
>
> --
> Ricardo Martinelli de Oliveira
> Senior Software Engineer
> T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531
> Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil
> 
> .
> 
> TRIED. TESTED. TRUSTED. 
>
>  Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil
> pelo *Great Place to Work*.
>


Re: Importing notes

2018-01-31 Thread Ricardo Martinelli de Oliveira
I did a quick research in the configuration and the code and the store type
is what defines the way the notes will be stored. The default is Git, which
means it will be stored in the notebook directory and can be versioned
using git.

However, I see that VFS implementation is supported and by VFS I was
wondering if there is a mechanism that scans the notebook directory and
look for new notebooks.

On Tue, Jan 30, 2018 at 10:43 PM, Michael Segel 
wrote:

> I don’t think you can…
>
> If you look in the ../notebook directory, the notes are all identified by
> an unique id.
>
> My guess? That the references are stored within a database. (Derby? )
>
>
> > On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira <
> rmart...@redhat.com> wrote:
> >
> > Hello,
> >
> > Is there a way to import notes from a command line? I am trying to write
> a script that imports all my notes in a zeppelin docker container, but the
> only ways to import is from the web UI or REST. In the script, zeppelin is
> not started (there is no reason to be) so I'm trying to find a way to
> import the note in a disconnected way.
> >
> > Any ideas to do this?
>
>


-- 
Ricardo Martinelli de Oliveira
Senior Software Engineer
T: +55 11 3524-6125 <+55%2011%203524-6126> | M: +55 11 9 7069-6531
Av. Brigadeiro Faria Lima 3900, 8° Andar. São Paulo, Brasil

.

TRIED. TESTED. TRUSTED. 

 Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil
pelo *Great Place to Work*.


Re: Importing notes

2018-01-30 Thread Michael Segel
I don’t think you can…

If you look in the ../notebook directory, the notes are all identified by an 
unique id. 

My guess? That the references are stored within a database. (Derby? ) 
 

> On Jan 30, 2018, at 6:25 PM, Ricardo Martinelli de Oliveira 
>  wrote:
> 
> Hello,
> 
> Is there a way to import notes from a command line? I am trying to write a 
> script that imports all my notes in a zeppelin docker container, but the only 
> ways to import is from the web UI or REST. In the script, zeppelin is not 
> started (there is no reason to be) so I'm trying to find a way to import the 
> note in a disconnected way.
> 
> Any ideas to do this? 



Re: Importing notes

2018-01-30 Thread 小野圭二
interest question, i also want to know how to do it. :-)

2018-01-31 9:25 GMT+09:00 Ricardo Martinelli de Oliveira <
rmart...@redhat.com>:

> Hello,
>
> Is there a way to import notes from a command line? I am trying to write a
> script that imports all my notes in a zeppelin docker container, but the
> only ways to import is from the web UI or REST. In the script, zeppelin is
> not started (there is no reason to be) so I'm trying to find a way to
> import the note in a disconnected way.
>
> Any ideas to do this?
>