[jira] [Created] (ZEPPELIN-4019) Interpreter process get the notes from zeppelin server
Xun Liu created ZEPPELIN-4019: - Summary: Interpreter process get the notes from zeppelin server Key: ZEPPELIN-4019 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4019 Project: Zeppelin Issue Type: Sub-task Affects Versions: 0.9.0 Reporter: Xun Liu Assignee: Xun Liu Now, the interpreter is executed according to the paragraph. Click the run button in the paragraph, and only the code content in the current paragraph can be obtained in the interpreter process. To pass the Dashboard paragraph in the submarine interpreter, you need to submit all the code content in this note to tensorflow for execution. So, I think need to get the note data in sever through `RemoteInterpreterEventServer` in the interpreter process. I implemented two other methods, so that the interpreter can get the note in the server, the actual running effect is not the best solution. 1) By having the interpreter directly access the external storage of the note repository, such as HDFS, S3. 1. But this limits the need to store notes in an external storage system. 2. In hdfs with kerberos authentication system enabled, not all users can access the note folder. 2) Get the note from the server from the REST client in the interpreter. 1. Need to let zeppelin/api/notes intercept in shrio.ini. 2. Or let the interpreter access the REST interface of the server through the user and password, but it is not safe. In addition, in [ZEPPELIN-4018 Workflow and orchestration|https://issues.apache.org/jira/browse/ZEPPELIN-4018], it is also necessary to query all the notes and paragraphs of the user in the workflow paragraph for the execution of the note. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4020) User DN not escaped if enabled support for nested groups(ldapRealm)
Ilya Makarov created ZEPPELIN-4020:
--
Summary: User DN not escaped if enabled support for nested
groups(ldapRealm)
Key: ZEPPELIN-4020
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4020
Project: Zeppelin
Issue Type: Bug
Components: security
Affects Versions: 0.8.0
Reporter: Ilya Makarov
HI!
We use ldapReam and need nested group.
Out shiro.ini config contains:
{code:java}
ldapRealm.groupSearchEnableMatchingRuleInChain = true{code}
We have an issue: groups are not returned if CN contain backslash.
Example:
{code:java}
...
DEBUG [2019-02-25 21: 12: 01,986] ({qtp1509563803-15} LdapRealm.java
[getUserDn]: 942) - SearchBase, SearchFilter, UserSearchScope: OU = Main, DC =
COMPANY, DC = ru, objectclass = person) (sAMAccou
ntName = ilya.makarov)), subtree
DEBUG [2019-02-25 21: 12: 01,997] ({qtp1509563803-15} LdapRealm.java
[getUserDn]: 951) - UserDN Returned, Principal: CN = Makarov \, Ilya, OU =
Main, DC = COMPANY, DC = ru,
ilya.makarov
DEBUG [2019-02-25 21: 12: 01,997] ({qtp1509563803-15} LdapRealm.java [rolesFor:
358) - Ldap PagingSize: 100
DEBUG [2019-02-25 21: 12: 02,001] ({qtp1509563803-15} LdapRealm.java [rolesFor:
445) - User RoleNames: ilya.makarov :: []
DEBUG [2019-02-25 21: 12: 02,001] ({qtp1509563803-15} LdapRealm.java
[queryForAuthorizationInfo]: 297) - RolesNames Authorization: []{code}
If we debug it with strace:
{code:java}
10487 sendto (233, "0 \ 201 \ 377 \ 2 \ 1 \ 5c \ 201 \ 271 \ 4'OU = DWH, OU =
Resources, OU = Main, DC = COMPANY, DC = en \ n \ 1 \ 2 \ n \ 1 \ 3 \ 2 \ 1 \ 0
\ 2 \ 1 \ 0 \ 1 \ 1 \ 0 \ 240} \ 243 \ 24 \ 4 \ vobjectClass \ 4 \ 5group \
251e \ 201 \ 0271.2.840.113556.1.4.1941 \ 202 \ 6member \ 203? CN = Makarov,
Ilya, OU = Main, DC = COMPANY, DC = en \ 204 \ 1 \ \ 0 \ 240> 0! \ 4 \
0261.2.840.113556.1.4.319 \ 4 \ 0070 \ 5 \ 2 \ 1d \ 4 \ \ 31 \ 4 \
0272.16.840.1.113730.3.4.2 ", 258, 0, NULL, 0) = 258
12676 <... recvfrom resumed> "0 \ 204 \ 0 \ 0 \ 0A \ 2 \ 1 \ 5e \ 204 \ 0 \ 0 \
0 \ 7 \ n \ 1 \ 0 \ 4 \ 0 \ 4 \ 0 \ 240 \ 204 \ 0 \ 0 \ 0 + 0 \ 204 \ 0 \ 0 \
0% \ 4 \ 0261.2.840.113556.1.4.319 \ 4 \ v0 \ 204 \ 0 \ 0 \ 0 \ 5 \ 2 \ 1 \ 0 \
4 \ 0 ", 8192, 0, NULL, NULL) = 71{code}
Sended `CN = Makarov, Ilya..`
But according to doc
(https://docs.microsoft.com/ru-ru/windows/desktop/ADSI/search-filter-syntax#special-characters):
Backslash `\` should be replaced with `\ 5c`.(Backslash was lost and not
properly escaped)
Following ldapsearch command successfully return groups:
{code:java}
ldapsearch -H ldap: //ldap.COMPANY.ru: 389 -D ad-t...@company.ru -W -b "OU =
DWH, OU = Resources, OU = Main, DC = COMPANY, DC = ru" -s sub '(& (objectClass
= group) (member: 1.2.840.113556.1.4.1941: = CN = Makarov \ 5c, Ilya, OU =
Main, DC = COMPANY, DC = ru))' cn{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4021) The columns with same column names are not appearing in the result
Jugal Sharma created ZEPPELIN-4021: -- Summary: The columns with same column names are not appearing in the result Key: ZEPPELIN-4021 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4021 Project: Zeppelin Issue Type: Bug Components: zeppelin-interpreter Affects Versions: 0.8.0 Reporter: Jugal Sharma I am using Zeppelin 0.8.0 and running a simple SELECT query from two different tables. These tables are parquet table and in these tables a few column names are same. When I listing the column names, only one unique column is appearing in the result pane. Query: SELECT table1.columnA , table2.columnA, table1.columnB, table2.columnC FROM table1 INNER JOIN table2 ON table1.key1 = table2.key1 In the result it will only show the 3 columns instead of four. It will show table1.*columnA*, table1.*columnB*, table2.*columnC*. *ColumnA* from *table2* will not appear in the result pan. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
Windows Supports
Hi Dev and Users, Recently, personally, I've got reports that Z couldn't run under Windows' environments. I think we need to discuss how to handle issues supporting windows. AFAIK, there are not many resources to test Z under Windows by committers or contributors. If we couldn't support Windows well, how about removing bin/*.cmd and focusing on alternatives like dockers. WDYT? JL -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net
Re: Windows Supports
Testing on windows can also be done as CI on appveyer. I don’t completely get your comment on .cmd file though. Are you suggesting we don’t support windows and users can “run on windows” by basically running Linux in a virtual environment? Docker is one and there is Linux on Windows https://docs.microsoft.com/en-us/windows/wsl/install-win10 From: Jongyoul Lee Sent: Monday, February 25, 2019 6:29 PM To: dev; users Subject: Windows Supports Hi Dev and Users, Recently, personally, I've got reports that Z couldn't run under Windows' environments. I think we need to discuss how to handle issues supporting windows. AFAIK, there are not many resources to test Z under Windows by committers or contributors. If we couldn't support Windows well, how about removing bin/*.cmd and focusing on alternatives like dockers. WDYT? JL -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net
