Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json
another reason for keeping noteId is uniqueness in case of multi-user environments. In that case users have separate zeppelin workspaces, which is something we are using in production: see ZEPPELIN_NOTEBOOK_PUBLIC=false in the doc [1]. In that case users might be very confused when they can not create notebooks with a name that already exists, but they most likely don't see (yet). So I like the proposal {note_name}_{note_id}.zpln. where note_name could contains folders, e.g. folder_1/mynote_abcd.zpln. Even though I like {note_name}.{note_id}.zpln (dot in between note_name and note_id) even better :-) Regards Andreas [1] http://zeppelin.apache.org/docs/0.8.0/setup/security/notebook_authorization.html#separate-notebook-workspaces-public-vs-private On 2018/08/18 08:42:44, Jeff Zhang wrote: > BTW, I also prefer to use note name as identify of note if the issue I > mentioned before is acceptable for most of users. > > > > Jeff Zhang 于2018年8月18日周六 下午4:40写道: > > > > > I am afraid we can not remove noteId, as noteId is the unique identifier > > of note and is immutable which is used in a lot places, such as paragraph > > share and rest api. > > If we use note name as note id then it may break user's app if note name > > is changed > > > > > > Jongyoul Lee 于2018年8月18日周六 下午2:33写道: > > > >> Hi, thanks for this kind of discussion. > >> > >> About noteId, How about changing note id to note name? AFAIK, Note id is > >> just an identifier and we can set any value to it. > >> > >> There’re two potential problems. We should be more careful to handle note > >> id as it could have very various type of characters. And Second, in case > >> where someone changes a note name, those who are seeing and updating the > >> same note wouldn’t access that note. We could handle it by using > >> websockets. > >> > >> WDYT? > >> > >> On Tue, 14 Aug 2018 at 6:14 PM Jeff Zhang wrote: > >> > >>> >>> But I’m still not comfortable with note ids in the name of the > >>> notebook itself. Those names would look ugly if you shared your notebooks > >>> on github for example. You don’t see Jupyter notebooks with names like > >>> that. If you have to keep the note ids with the notebooks could you not > >>> simply put the note id at the top of the notebook as Ruslan suggested? > >>> Then > >>> you’d only have to read the first line of each notebook. > >>> > >>> I know putting note_id in the note file name is not so elegant, but this > >>> is what we have to compromise to keep compatibility as we use noteId to > >>> uniquely identify note right now. And I don't think putting noteId in the > >>> top first line of note would help much. We still have to read note files > >>> which take much more time than just read the file names via file system. > >>> > >>> Regarding the readability of note file name, I think it won't affect > >>> much. E.g. This is the note book file name like: *My Project/My Spark > >>> Tutorial Note_2A94M5J1Z.zpln* > >>> What user see in notebook menu is still *My Project/My Spark Tutorial* > >>> *Note > >>> *which is no difference from what we see now. > >>> > >>> And thanks again for the feedback and comments, I am so glad to see so > >>> many discussion in community. > >>> > >>> > >>> > >>> Partridge, Lucas (GE Aviation) 于2018年8月14日周二 > >>> 下午4:29写道: > >>> > I agree you’re inviting consistency issues if you maintained a separate > note id-to-note name mapping file. > > > > But I’m still not comfortable with note ids in the name of the notebook > itself. Those names would look ugly if you shared your notebooks on > github > for example. You don’t see Jupyter notebooks with names like that. If > you > have to keep the note ids with the notebooks could you not simply put the > note id at the top of the notebook as Ruslan suggested? Then you’d only > have to read the first line of each notebook. > > > > Presumably if you copied the notebooks to another Zeppelin server they > would be restored with the same note ids there too? And hopefully there > would be no id clash with notebooks already on that server… > > > > *From:* Jeff Zhang > *Sent:* 14 August 2018 03:49 > *To:* users@zeppelin.apache.org > > > *Subject:* EXT: Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln > instead of [NOTEID]/note.json > > > > > > Thanks for the discussion. > > >>> I'm afraid about non-latin symbols in folder and note name. And > what about hieroglyphs? > > AFAIK, linux allow all the characters to be file name except `\0` and > '/'. I can create file name with Chinese character in linux, I guess you > can use Russian as well. > > > > >>> If I understand correctly, this is being done solely to speed up > loading list of notebooks? What if a list of notebook names, their ids, > folder
livy2.sql or spark2.sql does not show result
I am using HDP3.0 (having zeppelin 0.8.0). Below queries do not show any result, even though downloading the csv show the data correctly (e.g. if there is no tables, show the header). %livy2.sql show tables %spark2.sql show tables Infrequently I saw the table show a short time and then disappear. I guess it is html rendering issue. Any idea? Any setting is related to this? Sql interpreters worked fine in HDP2.6 using zeppelin 0.7.3. Appreciate any clue.
Re: livy2.sql or spark2.sql does not show result
Here is the javascript error if it helps: Error: [ngRepeat:iidexp] '_item_' in '_item_ in _collection_' should be an identifier or '(_key_, _value_)' expression, but got '/gateway/ui/zeppelin/app'. http://errors.angularjs.org/1.5.7/ngRepeat/iidexp?p0=%2Fgateway%2Fui%2Fzeppelin%2Fapp b/<@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:36:376 Kghttps://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:40:30580 Z@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:37:4755 S@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:36:30480 S@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:36:30611 S@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:36:30611 N@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:36:29413 X/<@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:37:440 d@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:36:30833 m@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:37:909 mghttps://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:40:17582 xc/this.$gethttps://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:38:10966 a/n.prototype.safeDigest@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:76:1460 b@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:76:3748 a/n.prototype._onMessageHandler@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:76:3960 R/<@ https://mydomain.com/gateway/ui/zeppelin/scripts/vendor.49d751b0c72342f6.js:36:5633 " On Thu, Aug 30, 2018 at 3:02 PM Lian Jiang wrote: > I am using HDP3.0 (having zeppelin 0.8.0). > > Below queries do not show any result, even though downloading the csv show > the data correctly (e.g. if there is no tables, show the header). > > %livy2.sql > show tables > > %spark2.sql > show tables > > Infrequently I saw the table show a short time and then disappear. I guess > it is html rendering issue. > > Any idea? Any setting is related to this? Sql interpreters worked fine in > HDP2.6 using zeppelin 0.7.3. > > Appreciate any clue. > > >
Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json
Hi, I have a bit different thoughts about the conflicts of the name of a new note created. In a multiuser environment, AFAIK, most teams and companies, generally, use a prefix for the group policy internally. In my case, user/{user_id}/{notebook_name_they_want}.zpln. In this case, naming conflicts rarely happen. And it will be stored under a specific folder. If someone needed two different same named notes in the same directory, I might not be appropriate. WDYT? JL On Fri, Aug 31, 2018 at 4:44 AM, andreas.we...@gmail.com < andreas.we...@gmail.com> wrote: > another reason for keeping noteId is uniqueness in case of multi-user > environments. In that case users have separate zeppelin workspaces, which > is something we are using in production: see ZEPPELIN_NOTEBOOK_PUBLIC=false > in the doc [1]. In that case users might be very confused when they can not > create notebooks with a name that already exists, but they most likely > don't see (yet). > > So I like the proposal {note_name}_{note_id}.zpln. where note_name could > contains folders, e.g. folder_1/mynote_abcd.zpln. Even though I like > {note_name}.{note_id}.zpln (dot in between note_name and note_id) even > better :-) > > Regards > Andreas > > > [1] http://zeppelin.apache.org/docs/0.8.0/setup/security/ > notebook_authorization.html#separate-notebook-workspaces-public-vs-private > > On 2018/08/18 08:42:44, Jeff Zhang wrote: > > BTW, I also prefer to use note name as identify of note if the issue I > > mentioned before is acceptable for most of users. > > > > > > > > Jeff Zhang 于2018年8月18日周六 下午4:40写道: > > > > > > > > I am afraid we can not remove noteId, as noteId is the unique > identifier > > > of note and is immutable which is used in a lot places, such as > paragraph > > > share and rest api. > > > If we use note name as note id then it may break user's app if note > name > > > is changed > > > > > > > > > Jongyoul Lee 于2018年8月18日周六 下午2:33写道: > > > > > >> Hi, thanks for this kind of discussion. > > >> > > >> About noteId, How about changing note id to note name? AFAIK, Note id > is > > >> just an identifier and we can set any value to it. > > >> > > >> There’re two potential problems. We should be more careful to handle > note > > >> id as it could have very various type of characters. And Second, in > case > > >> where someone changes a note name, those who are seeing and updating > the > > >> same note wouldn’t access that note. We could handle it by using > websockets. > > >> > > >> WDYT? > > >> > > >> On Tue, 14 Aug 2018 at 6:14 PM Jeff Zhang wrote: > > >> > > >>> >>> But I’m still not comfortable with note ids in the name of the > > >>> notebook itself. Those names would look ugly if you shared your > notebooks > > >>> on github for example. You don’t see Jupyter notebooks with names > like > > >>> that. If you have to keep the note ids with the notebooks could you > not > > >>> simply put the note id at the top of the notebook as Ruslan > suggested? Then > > >>> you’d only have to read the first line of each notebook. > > >>> > > >>> I know putting note_id in the note file name is not so elegant, but > this > > >>> is what we have to compromise to keep compatibility as we use noteId > to > > >>> uniquely identify note right now. And I don't think putting noteId > in the > > >>> top first line of note would help much. We still have to read note > files > > >>> which take much more time than just read the file names via file > system. > > >>> > > >>> Regarding the readability of note file name, I think it won't affect > > >>> much. E.g. This is the note book file name like: *My Project/My > Spark > > >>> Tutorial Note_2A94M5J1Z.zpln* > > >>> What user see in notebook menu is still *My Project/My Spark > Tutorial* *Note > > >>> *which is no difference from what we see now. > > >>> > > >>> And thanks again for the feedback and comments, I am so glad to see > so > > >>> many discussion in community. > > >>> > > >>> > > >>> > > >>> Partridge, Lucas (GE Aviation) 于2018年8月14日周二 > > >>> 下午4:29写道: > > >>> > > I agree you’re inviting consistency issues if you maintained a > separate > > note id-to-note name mapping file. > > > > > > > > But I’m still not comfortable with note ids in the name of the > notebook > > itself. Those names would look ugly if you shared your notebooks > on github > > for example. You don’t see Jupyter notebooks with names like > that. If you > > have to keep the note ids with the notebooks could you not simply > put the > > note id at the top of the notebook as Ruslan suggested? Then you’d > only > > have to read the first line of each notebook. > > > > > > > > Presumably if you copied the notebooks to another Zeppelin server > they > > would be restored with the same note ids there too? And hopefully > there > > would be no id clash with notebooks already on that server… > > > > > > > > *From:* Jeff Zhang > > >>>
Re: "Read replica" for Zeppelin
Hi, You can also take a look at zepl.com. We prodive provide a way to perioadically sync notebook from s3 and you can share it as read only. Regards, Anthony On Wed, 29 Aug 2018 at 10:22 PM Jongyoul Lee wrote: > I like this idea, totally. > > I have an exactly same issue and thought to provide read-only mode. BTW, > currently, Zeppelin server doesn't look proper for now. I, personally, have > an idea to make a simple webserver only as a viewer. > > JL > > On Wed, Aug 29, 2018 at 9:55 PM, peay wrote: > >> Hello, >> >> I have a Zeppelin server with a S3 repo backend for notebooks. >> >> I would like to have a second Zeppelin instance to access the notebooks >> in read only mode. Mostly for security reasons, but also in general some >> weak form of HA. >> >> Any suggestion on how to achieve this? I've set it up naively, but the >> missing piece is getting the read-only Zeppelin to reload notebooks from S3 >> periodically (or when getting web server requests, for instance). Any help >> would be appreciated. >> >> Thanks! >> >> > > > -- > 이종열, Jongyoul Lee, 李宗烈 > http://madeng.net >