[jira] [Updated] (ATLAS-3461) Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Kumar Mishra (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3461:
-
Attachment: ATLAS-3461-3.patch

> Impala process and lineage is not getting created appropriately if query 
> contains variation like comment or extra spaces
> 
>
> Key: ATLAS-3461
> URL: https://issues.apache.org/jira/browse/ATLAS-3461
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: ATLAS-3461-3.patch
>
>
> Some examples of such queries are at Impala:
> creAted external table /*test*/ impala1 aS – temp  fff
>       /* temp */ – sdfrnfkjef select
>       select * from t1;
> Create /*dd*/ table impala2 aS select * from t1;
>  
> From JDBC:
> If we add more spaces in between create and table as shown below and use jdbc 
> to execute the query then the impala process is not getting created at Atlas.
> create table testSun2 as select * from t1;



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (ATLAS-3461) Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Kumar Mishra (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3461:
-
Attachment: (was: ATLAS-3461-1.patch)

> Impala process and lineage is not getting created appropriately if query 
> contains variation like comment or extra spaces
> 
>
> Key: ATLAS-3461
> URL: https://issues.apache.org/jira/browse/ATLAS-3461
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: ATLAS-3461-3.patch
>
>
> Some examples of such queries are at Impala:
> creAted external table /*test*/ impala1 aS – temp  fff
>       /* temp */ – sdfrnfkjef select
>       select * from t1;
> Create /*dd*/ table impala2 aS select * from t1;
>  
> From JDBC:
> If we add more spaces in between create and table as shown below and use jdbc 
> to execute the query then the impala process is not getting created at Atlas.
> create table testSun2 as select * from t1;



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (ATLAS-3482) Enhance basic search to enable search on entity system attributes

[Le Ma (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Le Ma updated ATLAS-3482:
-
Summary: Enhance basic search to enable search on entity system attributes  
(was: Support search by system attributes for entity )

> Enhance basic search to enable search on entity system attributes
> -
>
> Key: ATLAS-3482
> URL: https://issues.apache.org/jira/browse/ATLAS-3482
> Project: Atlas
>  Issue Type: Bug
>Reporter: Le Ma
>Assignee: Le Ma
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (ATLAS-3483) Support adding/deleting labels

[Le Ma (Jira)]

Le Ma created ATLAS-3483:


 Summary: Support adding/deleting labels
 Key: ATLAS-3483
 URL: https://issues.apache.org/jira/browse/ATLAS-3483
 Project: Atlas
  Issue Type: Improvement
Reporter: Le Ma
Assignee: Le Ma


The current implementation of label only exposes setLabel endpoint to users. 
setLabel will replace the existing labels with labels passed in with function. 
It would be nice to have the enhancement to support add labels to existing 
label and, delete label.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/#review218315
---


Ship it!




Ship It!

- Sarath Subramanian


On Oct. 21, 2019, 3:45 p.m., Sidharth Mishra wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71620/
> ---
> 
> (Updated Oct. 21, 2019, 3:45 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-3461
> https://issues.apache.org/jira/browse/ATLAS-3461
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Now even if the Impala queries contains comment/ extra spaces, Atlas will 
> create the impala process approproately.
> Even "create external table" will create Impala process at Atlas and user can 
> see lineage.
> 
> 
> Diffs
> -
> 
>   
> addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
>  b9dd894f8 
>   
> addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
>  dc4d1333e 
>   
> addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json
>  PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71620/diff/4/
> 
> 
> Testing
> ---
> 
> 1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. 
> Now after the fix it works.
> 2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
> and Impala Shell
> 
> a) create table testMon4 as select * from t1;
> 
> b) creAte external table /*test*/ testMo3 aS -- temp  fff
>   /* temp */ -- sdfrnfkjef select
>   select * from t1;
>   
> 
> c) Create /*dd*/ table testMon4 aS select * from t1;
> 
> d) alter view  testMonView2 as select * from t1;
> 
> e) create view testMonView4 as select * from t1;
> 
> f) alter view  testMonView4 as select * from t1;
> 
> g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
>(STUD_ID int, 
>DEPT_ID int, 
>NAME string 
>) 
>ROW FORMAT DELIMITED 
>FIELDS TERMINATED BY ',' 
>STORED AS TEXTFILE 
>LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Mishra]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/
---

(Updated Oct. 21, 2019, 10:45 p.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
Subramanian.


Bugs: ATLAS-3461
https://issues.apache.org/jira/browse/ATLAS-3461


Repository: atlas


Description
---

Now even if the Impala queries contains comment/ extra spaces, Atlas will 
create the impala process approproately.
Even "create external table" will create Impala process at Atlas and user can 
see lineage.


Diffs (updated)
-

  
addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
 b9dd894f8 
  
addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
 dc4d1333e 
  
addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json 
PRE-CREATION 


Diff: https://reviews.apache.org/r/71620/diff/4/

Changes: https://reviews.apache.org/r/71620/diff/3-4/


Testing
---

1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. Now 
after the fix it works.
2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
and Impala Shell

a) create table testMon4 as select * from t1;

b) creAte external table /*test*/ testMo3 aS -- temp  fff
  /* temp */ -- sdfrnfkjef select
  select * from t1;
  

c) Create /*dd*/ table testMon4 aS select * from t1;

d) alter view  testMonView2 as select * from t1;

e) create view testMonView4 as select * from t1;

f) alter view  testMonView4 as select * from t1;

g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
   (STUD_ID int, 
   DEPT_ID int, 
   NAME string 
   ) 
   ROW FORMAT DELIMITED 
   FIELDS TERMINATED BY ',' 
   STORED AS TEXTFILE 
   LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';


Thanks,

Sidharth Mishra

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/#review218314
---


Fix it, then Ship it!





addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
Lines 47 (patched)


consider ordering private methods after all public methods.


- Sarath Subramanian


On Oct. 21, 2019, 2:01 p.m., Sidharth Mishra wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71620/
> ---
> 
> (Updated Oct. 21, 2019, 2:01 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-3461
> https://issues.apache.org/jira/browse/ATLAS-3461
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Now even if the Impala queries contains comment/ extra spaces, Atlas will 
> create the impala process approproately.
> Even "create external table" will create Impala process at Atlas and user can 
> see lineage.
> 
> 
> Diffs
> -
> 
>   
> addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
>  b9dd894f8 
>   
> addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
>  dc4d1333e 
>   
> addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json
>  PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71620/diff/3/
> 
> 
> Testing
> ---
> 
> 1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. 
> Now after the fix it works.
> 2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
> and Impala Shell
> 
> a) create table testMon4 as select * from t1;
> 
> b) creAte external table /*test*/ testMo3 aS -- temp  fff
>   /* temp */ -- sdfrnfkjef select
>   select * from t1;
>   
> 
> c) Create /*dd*/ table testMon4 aS select * from t1;
> 
> d) alter view  testMonView2 as select * from t1;
> 
> e) create view testMonView4 as select * from t1;
> 
> f) alter view  testMonView4 as select * from t1;
> 
> g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
>(STUD_ID int, 
>DEPT_ID int, 
>NAME string 
>) 
>ROW FORMAT DELIMITED 
>FIELDS TERMINATED BY ',' 
>STORED AS TEXTFILE 
>LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Le Ma]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/#review218312
---




addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
Line 33 (original), 33 (patched)


Hey Sid, thanks for the patch. I am not sure about the regex there "^[ ]*", 
does this mean the beginning of the line can have multiple white spaces? I saw 
you added this square brackets at diff2. '\bcreate\b' means exact match word 
"create", then if there are spaces before "create", will it still match?

thanks,
Le


- Le Ma


On Oct. 21, 2019, 9:01 p.m., Sidharth Mishra wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71620/
> ---
> 
> (Updated Oct. 21, 2019, 9:01 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-3461
> https://issues.apache.org/jira/browse/ATLAS-3461
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Now even if the Impala queries contains comment/ extra spaces, Atlas will 
> create the impala process approproately.
> Even "create external table" will create Impala process at Atlas and user can 
> see lineage.
> 
> 
> Diffs
> -
> 
>   
> addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
>  b9dd894f8 
>   
> addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
>  dc4d1333e 
>   
> addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json
>  PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71620/diff/3/
> 
> 
> Testing
> ---
> 
> 1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. 
> Now after the fix it works.
> 2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
> and Impala Shell
> 
> a) create table testMon4 as select * from t1;
> 
> b) creAte external table /*test*/ testMo3 aS -- temp  fff
>   /* temp */ -- sdfrnfkjef select
>   select * from t1;
>   
> 
> c) Create /*dd*/ table testMon4 aS select * from t1;
> 
> d) alter view  testMonView2 as select * from t1;
> 
> e) create view testMonView4 as select * from t1;
> 
> f) alter view  testMonView4 as select * from t1;
> 
> g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
>(STUD_ID int, 
>DEPT_ID int, 
>NAME string 
>) 
>ROW FORMAT DELIMITED 
>FIELDS TERMINATED BY ',' 
>STORED AS TEXTFILE 
>LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Mishra]

> On Oct. 21, 2019, 10:02 p.m., Le Ma wrote:
> > addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
> > Line 33 (original), 33 (patched)
> > 
> >
> > Hey Sid, thanks for the patch. I am not sure about the regex there "^[ 
> > ]*", does this mean the beginning of the line can have multiple white 
> > spaces? I saw you added this square brackets at diff2. '\bcreate\b' means 
> > exact match word "create", then if there are spaces before "create", will 
> > it still match?
> > 
> > thanks,
> > Le

Hi Le,

^ is for line start and [ ]* is for zero or more white spaces at beginning. Yes 
\b\b will ensure the exact word match and even if it has multiple spaces it ll 
be taken care by [ ]* at beginning.

Thanks,
Sid


- Sidharth


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/#review218312
---


On Oct. 21, 2019, 9:01 p.m., Sidharth Mishra wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71620/
> ---
> 
> (Updated Oct. 21, 2019, 9:01 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-3461
> https://issues.apache.org/jira/browse/ATLAS-3461
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Now even if the Impala queries contains comment/ extra spaces, Atlas will 
> create the impala process approproately.
> Even "create external table" will create Impala process at Atlas and user can 
> see lineage.
> 
> 
> Diffs
> -
> 
>   
> addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
>  b9dd894f8 
>   
> addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
>  dc4d1333e 
>   
> addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json
>  PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71620/diff/3/
> 
> 
> Testing
> ---
> 
> 1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. 
> Now after the fix it works.
> 2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
> and Impala Shell
> 
> a) create table testMon4 as select * from t1;
> 
> b) creAte external table /*test*/ testMo3 aS -- temp  fff
>   /* temp */ -- sdfrnfkjef select
>   select * from t1;
>   
> 
> c) Create /*dd*/ table testMon4 aS select * from t1;
> 
> d) alter view  testMonView2 as select * from t1;
> 
> e) create view testMonView4 as select * from t1;
> 
> f) alter view  testMonView4 as select * from t1;
> 
> g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
>(STUD_ID int, 
>DEPT_ID int, 
>NAME string 
>) 
>ROW FORMAT DELIMITED 
>FIELDS TERMINATED BY ',' 
>STORED AS TEXTFILE 
>LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Mishra]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/
---

(Updated Oct. 21, 2019, 9:01 p.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
Subramanian.


Bugs: ATLAS-3461
https://issues.apache.org/jira/browse/ATLAS-3461


Repository: atlas


Description
---

Now even if the Impala queries contains comment/ extra spaces, Atlas will 
create the impala process approproately.
Even "create external table" will create Impala process at Atlas and user can 
see lineage.


Diffs (updated)
-

  
addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
 b9dd894f8 
  
addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
 dc4d1333e 
  
addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json 
PRE-CREATION 


Diff: https://reviews.apache.org/r/71620/diff/3/

Changes: https://reviews.apache.org/r/71620/diff/2-3/


Testing
---

1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. Now 
after the fix it works.
2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
and Impala Shell

a) create table testMon4 as select * from t1;

b) creAte external table /*test*/ testMo3 aS -- temp  fff
  /* temp */ -- sdfrnfkjef select
  select * from t1;
  

c) Create /*dd*/ table testMon4 aS select * from t1;

d) alter view  testMonView2 as select * from t1;

e) create view testMonView4 as select * from t1;

f) alter view  testMonView4 as select * from t1;

g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
   (STUD_ID int, 
   DEPT_ID int, 
   NAME string 
   ) 
   ROW FORMAT DELIMITED 
   FIELDS TERMINATED BY ',' 
   STORED AS TEXTFILE 
   LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';


Thanks,

Sidharth Mishra

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/#review218310
---




addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
Lines 41 (patched)


INSERT_SELECT_FROM => INSERT_SELECT_FROM_PATTERN



addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
Line 34 (original), 49 (patched)


removedCommentQueryText => queryTextWithNoComments



addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
Lines 50 (patched)


consider moving the matching check to a method and use the method in all 
conditions.

private static boolean isMatches(String queryText, Pattern pattern) {
   return pattern.matcher(queryText).matches();
}



addons/impala-bridge/src/test/resources/WALimpala.wal
Lines 1 (patched)


remove wal file if not needed for test.


- Sarath Subramanian


On Oct. 21, 2019, 11:24 a.m., Sidharth Mishra wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71620/
> ---
> 
> (Updated Oct. 21, 2019, 11:24 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-3461
> https://issues.apache.org/jira/browse/ATLAS-3461
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Now even if the Impala queries contains comment/ extra spaces, Atlas will 
> create the impala process approproately.
> Even "create external table" will create Impala process at Atlas and user can 
> see lineage.
> 
> 
> Diffs
> -
> 
>   
> addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
>  b9dd894f8 
>   
> addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
>  dc4d1333e 
>   addons/impala-bridge/src/test/resources/WALimpala.wal PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
>  PRE-CREATION 
>   
> addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json
>  PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71620/diff/2/
> 
> 
> Testing
> ---
> 
> 1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. 
> Now after the fix it works.
> 2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
> and Impala Shell
> 
> a) create table testMon4 as select * from t1;
> 
> b) creAte external table /*test*/ testMo3 aS -- temp  fff
>   /* temp */ -- sdfrnfkjef select
>   select * from t1;
>   
> 
> c) Create /*dd*/ table testMon4 aS select * from t1;
> 
> d) alter view  testMonView2 as select * from t1;
> 
> e) create view testMonView4 as select * from t1;
> 
> f) alter view  testMonView4 as select * from t1;
> 
> g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
>(STUD_ID int, 
>DEPT_ID int, 
>NAME string 
>) 
>ROW FORMAT DELIMITED 
>FIELDS TERMINATED BY ',' 
>STORED AS TEXTFILE 
>LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 71619: ATLAS-3464: Define Entities stored in Atlas for ML Governance

[Na Li via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71619/
---

(Updated Oct. 21, 2019, 6:51 p.m.)


Review request for atlas, Austin Nobis, Ashutosh Mestry, Karthik Manamcheri, 
Sridhar K, Madhan Neethiraj, and Sarath Subramanian.


Bugs: atlas-3464
https://issues.apache.org/jira/browse/atlas-3464


Repository: atlas


Description
---

Define entities used for Machine Learning Governance


Diffs (updated)
-

  addons/models/4000-MachineLearning/4010-ml_model.json PRE-CREATION 


Diff: https://reviews.apache.org/r/71619/diff/5/

Changes: https://reviews.apache.org/r/71619/diff/4-5/


Testing
---

verified it is valid json file


Thanks,

Na Li

Re: Review Request 71619: ATLAS-3464: Define Entities stored in Atlas for ML Governance

[Na Li via Review Board]

> On Oct. 21, 2019, 6:11 p.m., Sarath Subramanian wrote:
> > Move the ml model to a new directory in addons/models => 
> > 4000-MachineLearning
> > 
> > -ml_model.json => 4010-ml_model.json

done. Thanks!


- Na


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71619/#review218305
---


On Oct. 21, 2019, 6:51 p.m., Na Li wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71619/
> ---
> 
> (Updated Oct. 21, 2019, 6:51 p.m.)
> 
> 
> Review request for atlas, Austin Nobis, Ashutosh Mestry, Karthik Manamcheri, 
> Sridhar K, Madhan Neethiraj, and Sarath Subramanian.
> 
> 
> Bugs: atlas-3464
> https://issues.apache.org/jira/browse/atlas-3464
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Define entities used for Machine Learning Governance
> 
> 
> Diffs
> -
> 
>   addons/models/4000-MachineLearning/4010-ml_model.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71619/diff/5/
> 
> 
> Testing
> ---
> 
> verified it is valid json file
> 
> 
> Thanks,
> 
> Na Li
> 
>

[jira] [Created] (ATLAS-3482) Support search by system attributes for entity

[Le Ma (Jira)]

Le Ma created ATLAS-3482:


 Summary: Support search by system attributes for entity 
 Key: ATLAS-3482
 URL: https://issues.apache.org/jira/browse/ATLAS-3482
 Project: Atlas
  Issue Type: Bug
Reporter: Le Ma
Assignee: Le Ma






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Mishra]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/
---

(Updated Oct. 21, 2019, 6:24 p.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
Subramanian.


Bugs: ATLAS-3461
https://issues.apache.org/jira/browse/ATLAS-3461


Repository: atlas


Description
---

Now even if the Impala queries contains comment/ extra spaces, Atlas will 
create the impala process approproately.
Even "create external table" will create Impala process at Atlas and user can 
see lineage.


Diffs (updated)
-

  
addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
 b9dd894f8 
  
addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
 dc4d1333e 
  addons/impala-bridge/src/test/resources/WALimpala.wal PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json 
PRE-CREATION 


Diff: https://reviews.apache.org/r/71620/diff/2/

Changes: https://reviews.apache.org/r/71620/diff/1-2/


Testing
---

1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. Now 
after the fix it works.
2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
and Impala Shell

a) create table testMon4 as select * from t1;

b) creAte external table /*test*/ testMo3 aS -- temp  fff
  /* temp */ -- sdfrnfkjef select
  select * from t1;
  

c) Create /*dd*/ table testMon4 aS select * from t1;

d) alter view  testMonView2 as select * from t1;

e) create view testMonView4 as select * from t1;

f) alter view  testMonView4 as select * from t1;

g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
   (STUD_ID int, 
   DEPT_ID int, 
   NAME string 
   ) 
   ROW FORMAT DELIMITED 
   FIELDS TERMINATED BY ',' 
   STORED AS TEXTFILE 
   LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';


Thanks,

Sidharth Mishra

Re: Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Mishra]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/
---

(Updated Oct. 21, 2019, 6:22 p.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
Subramanian.


Bugs: ATLAS-3461
https://issues.apache.org/jira/browse/ATLAS-3461


Repository: atlas


Description
---

Now even if the Impala queries contains comment/ extra spaces, Atlas will 
create the impala process approproately.
Even "create external table" will create Impala process at Atlas and user can 
see lineage.


Diffs
-

  
addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
 b9dd894f8 
  
addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
 dc4d1333e 
  addons/impala-bridge/src/test/resources/WALimpala.wal PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json 
PRE-CREATION 


Diff: https://reviews.apache.org/r/71620/diff/1/


Testing (updated)
---

1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. Now 
after the fix it works.
2. Validated manually by running below mentioned query from Impala:JDBC, Hue 
and Impala Shell

a) create table testMon4 as select * from t1;

b) creAte external table /*test*/ testMo3 aS -- temp  fff
  /* temp */ -- sdfrnfkjef select
  select * from t1;
  

c) Create /*dd*/ table testMon4 aS select * from t1;

d) alter view  testMonView2 as select * from t1;

e) create view testMonView4 as select * from t1;

f) alter view  testMonView4 as select * from t1;

g) create EXTERNAL TABLE IF NOT EXISTS thusday_ext1
   (STUD_ID int, 
   DEPT_ID int, 
   NAME string 
   ) 
   ROW FORMAT DELIMITED 
   FIELDS TERMINATED BY ',' 
   STORED AS TEXTFILE 
   LOCATION '/warehouse/tablespace/external/hive/db1.db/thusday_ext1';


Thanks,

Sidharth Mishra

[jira] [Updated] (ATLAS-3425) gremlin Script Execution Failed

[Sarath Subramanian (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-3425:
--
Component/s:  atlas-core

> gremlin Script Execution Failed
> ---
>
> Key: ATLAS-3425
> URL: https://issues.apache.org/jira/browse/ATLAS-3425
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Le Ma
>Assignee: Le Ma
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: error log, image.png
>
>
> In basic search, query parameters are:
>  * typeName: 
>  * classificationName
>  * tag attribute is boolean.
>  * fulltext query is tag attribute name
> No results is found. below error message is found in the backend log
> Please check the attached image for basic seach parameters. 
> javax.script.ScriptException: javax.script.ScriptException: 
> groovy.lang.MissingPropertyException: No such property: in for class: 
> org.apache.tinkerpop.gremlin.structure.T at 
> org.apache.tinkerpop.gremlin.groovy.jsr223.GremlinGroovyScriptEngine.eval(GremlinGroovyScriptEngine.java:378)
>  at javax.script.AbstractScriptEngine.eval(AbstractScriptEngine.java:233)
>  at 
> org.apache.atlas.repository.graphdb.janus.AtlasJanusGraph.executeGremlinScript(AtlasJanusGraph.java:368)
>  at 
> org.apache.atlas.discovery.ClassificationSearchProcessor.filter(ClassificationSearchProcessor.java:339)
>  at 
> org.apache.atlas.discovery.SearchProcessor.filter(SearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.FreeTextSearchProcessor.execute(FreeTextSearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithSearchContext(EntityDiscoveryService.java:471)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithParameters(EntityDiscoveryService.java:458)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$FastClassBySpringCGLIB$$1af2cf1f.invoke()
>  at 
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>  at 
> org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>  at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$EnhancerBySpringCGLIB$$95d844c8.searchWithParameters()
>  at 
> org.apache.atlas.web.rest.DiscoveryREST.searchWithParameters(DiscoveryREST.java:342)
>  at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
>  at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>  at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)
>  at 
> org.eclipse.jetty.servlet.Servl

[jira] [Updated] (ATLAS-3425) gremlin Script Execution Failed

[Sarath Subramanian (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-3425:
--
Affects Version/s: 2.0.0

> gremlin Script Execution Failed
> ---
>
> Key: ATLAS-3425
> URL: https://issues.apache.org/jira/browse/ATLAS-3425
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Le Ma
>Assignee: Le Ma
>Priority: Major
> Attachments: error log, image.png
>
>
> In basic search, query parameters are:
>  * typeName: 
>  * classificationName
>  * tag attribute is boolean.
>  * fulltext query is tag attribute name
> No results is found. below error message is found in the backend log
> Please check the attached image for basic seach parameters. 
> javax.script.ScriptException: javax.script.ScriptException: 
> groovy.lang.MissingPropertyException: No such property: in for class: 
> org.apache.tinkerpop.gremlin.structure.T at 
> org.apache.tinkerpop.gremlin.groovy.jsr223.GremlinGroovyScriptEngine.eval(GremlinGroovyScriptEngine.java:378)
>  at javax.script.AbstractScriptEngine.eval(AbstractScriptEngine.java:233)
>  at 
> org.apache.atlas.repository.graphdb.janus.AtlasJanusGraph.executeGremlinScript(AtlasJanusGraph.java:368)
>  at 
> org.apache.atlas.discovery.ClassificationSearchProcessor.filter(ClassificationSearchProcessor.java:339)
>  at 
> org.apache.atlas.discovery.SearchProcessor.filter(SearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.FreeTextSearchProcessor.execute(FreeTextSearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithSearchContext(EntityDiscoveryService.java:471)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithParameters(EntityDiscoveryService.java:458)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$FastClassBySpringCGLIB$$1af2cf1f.invoke()
>  at 
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>  at 
> org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>  at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$EnhancerBySpringCGLIB$$95d844c8.searchWithParameters()
>  at 
> org.apache.atlas.web.rest.DiscoveryREST.searchWithParameters(DiscoveryREST.java:342)
>  at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
>  at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>  at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)
>  at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1712)
>  at org

[jira] [Updated] (ATLAS-3425) gremlin Script Execution Failed

[Sarath Subramanian (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-3425:
--
Fix Version/s: 2.1.0

> gremlin Script Execution Failed
> ---
>
> Key: ATLAS-3425
> URL: https://issues.apache.org/jira/browse/ATLAS-3425
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Le Ma
>Assignee: Le Ma
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: error log, image.png
>
>
> In basic search, query parameters are:
>  * typeName: 
>  * classificationName
>  * tag attribute is boolean.
>  * fulltext query is tag attribute name
> No results is found. below error message is found in the backend log
> Please check the attached image for basic seach parameters. 
> javax.script.ScriptException: javax.script.ScriptException: 
> groovy.lang.MissingPropertyException: No such property: in for class: 
> org.apache.tinkerpop.gremlin.structure.T at 
> org.apache.tinkerpop.gremlin.groovy.jsr223.GremlinGroovyScriptEngine.eval(GremlinGroovyScriptEngine.java:378)
>  at javax.script.AbstractScriptEngine.eval(AbstractScriptEngine.java:233)
>  at 
> org.apache.atlas.repository.graphdb.janus.AtlasJanusGraph.executeGremlinScript(AtlasJanusGraph.java:368)
>  at 
> org.apache.atlas.discovery.ClassificationSearchProcessor.filter(ClassificationSearchProcessor.java:339)
>  at 
> org.apache.atlas.discovery.SearchProcessor.filter(SearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.FreeTextSearchProcessor.execute(FreeTextSearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithSearchContext(EntityDiscoveryService.java:471)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithParameters(EntityDiscoveryService.java:458)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$FastClassBySpringCGLIB$$1af2cf1f.invoke()
>  at 
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>  at 
> org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>  at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$EnhancerBySpringCGLIB$$95d844c8.searchWithParameters()
>  at 
> org.apache.atlas.web.rest.DiscoveryREST.searchWithParameters(DiscoveryREST.java:342)
>  at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
>  at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>  at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)
>  at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletH

[jira] [Resolved] (ATLAS-3425) gremlin Script Execution Failed

[Sarath Subramanian (Jira)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian resolved ATLAS-3425.
---
Resolution: Fixed

> gremlin Script Execution Failed
> ---
>
> Key: ATLAS-3425
> URL: https://issues.apache.org/jira/browse/ATLAS-3425
> Project: Atlas
>  Issue Type: Bug
>Reporter: Le Ma
>Assignee: Le Ma
>Priority: Major
> Attachments: error log, image.png
>
>
> In basic search, query parameters are:
>  * typeName: 
>  * classificationName
>  * tag attribute is boolean.
>  * fulltext query is tag attribute name
> No results is found. below error message is found in the backend log
> Please check the attached image for basic seach parameters. 
> javax.script.ScriptException: javax.script.ScriptException: 
> groovy.lang.MissingPropertyException: No such property: in for class: 
> org.apache.tinkerpop.gremlin.structure.T at 
> org.apache.tinkerpop.gremlin.groovy.jsr223.GremlinGroovyScriptEngine.eval(GremlinGroovyScriptEngine.java:378)
>  at javax.script.AbstractScriptEngine.eval(AbstractScriptEngine.java:233)
>  at 
> org.apache.atlas.repository.graphdb.janus.AtlasJanusGraph.executeGremlinScript(AtlasJanusGraph.java:368)
>  at 
> org.apache.atlas.discovery.ClassificationSearchProcessor.filter(ClassificationSearchProcessor.java:339)
>  at 
> org.apache.atlas.discovery.SearchProcessor.filter(SearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.FreeTextSearchProcessor.execute(FreeTextSearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithSearchContext(EntityDiscoveryService.java:471)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithParameters(EntityDiscoveryService.java:458)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$FastClassBySpringCGLIB$$1af2cf1f.invoke()
>  at 
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>  at 
> org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>  at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$EnhancerBySpringCGLIB$$95d844c8.searchWithParameters()
>  at 
> org.apache.atlas.web.rest.DiscoveryREST.searchWithParameters(DiscoveryREST.java:342)
>  at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
>  at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>  at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)
>  at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1712)
>  at org.apache.atlas.web.filters.AuditFil

[jira] [Commented] (ATLAS-3425) gremlin Script Execution Failed

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956349#comment-16956349
 ] 

ASF subversion and git services commented on ATLAS-3425:


Commit c88ea51103367ee28c0bb03ce1aac04dfaaf2df5 in atlas's branch 
refs/heads/master from Le Ma
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=c88ea51 ]

ATLAS-3425 gremlin Script Execution Failed Due To Unsupported Functions

Signed-off-by: Sarath Subramanian 


> gremlin Script Execution Failed
> ---
>
> Key: ATLAS-3425
> URL: https://issues.apache.org/jira/browse/ATLAS-3425
> Project: Atlas
>  Issue Type: Bug
>Reporter: Le Ma
>Assignee: Le Ma
>Priority: Major
> Attachments: error log, image.png
>
>
> In basic search, query parameters are:
>  * typeName: 
>  * classificationName
>  * tag attribute is boolean.
>  * fulltext query is tag attribute name
> No results is found. below error message is found in the backend log
> Please check the attached image for basic seach parameters. 
> javax.script.ScriptException: javax.script.ScriptException: 
> groovy.lang.MissingPropertyException: No such property: in for class: 
> org.apache.tinkerpop.gremlin.structure.T at 
> org.apache.tinkerpop.gremlin.groovy.jsr223.GremlinGroovyScriptEngine.eval(GremlinGroovyScriptEngine.java:378)
>  at javax.script.AbstractScriptEngine.eval(AbstractScriptEngine.java:233)
>  at 
> org.apache.atlas.repository.graphdb.janus.AtlasJanusGraph.executeGremlinScript(AtlasJanusGraph.java:368)
>  at 
> org.apache.atlas.discovery.ClassificationSearchProcessor.filter(ClassificationSearchProcessor.java:339)
>  at 
> org.apache.atlas.discovery.SearchProcessor.filter(SearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.FreeTextSearchProcessor.execute(FreeTextSearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithSearchContext(EntityDiscoveryService.java:471)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithParameters(EntityDiscoveryService.java:458)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$FastClassBySpringCGLIB$$1af2cf1f.invoke()
>  at 
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>  at 
> org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>  at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$EnhancerBySpringCGLIB$$95d844c8.searchWithParameters()
>  at 
> org.apache.atlas.web.rest.DiscoveryREST.searchWithParameters(DiscoveryREST.java:342)
>  at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
>  at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
>  at 
> com.sun.jersey.spi.container.servlet.ServletC

[jira] [Commented] (ATLAS-3425) gremlin Script Execution Failed

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956350#comment-16956350
 ] 

ASF subversion and git services commented on ATLAS-3425:


Commit 1aa297184537c9900985667ecaf1857d95178335 in atlas's branch 
refs/heads/branch-2.0 from Le Ma
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=1aa2971 ]

ATLAS-3425 gremlin Script Execution Failed Due To Unsupported Functions

Signed-off-by: Sarath Subramanian 
(cherry picked from commit c88ea51103367ee28c0bb03ce1aac04dfaaf2df5)


> gremlin Script Execution Failed
> ---
>
> Key: ATLAS-3425
> URL: https://issues.apache.org/jira/browse/ATLAS-3425
> Project: Atlas
>  Issue Type: Bug
>Reporter: Le Ma
>Assignee: Le Ma
>Priority: Major
> Attachments: error log, image.png
>
>
> In basic search, query parameters are:
>  * typeName: 
>  * classificationName
>  * tag attribute is boolean.
>  * fulltext query is tag attribute name
> No results is found. below error message is found in the backend log
> Please check the attached image for basic seach parameters. 
> javax.script.ScriptException: javax.script.ScriptException: 
> groovy.lang.MissingPropertyException: No such property: in for class: 
> org.apache.tinkerpop.gremlin.structure.T at 
> org.apache.tinkerpop.gremlin.groovy.jsr223.GremlinGroovyScriptEngine.eval(GremlinGroovyScriptEngine.java:378)
>  at javax.script.AbstractScriptEngine.eval(AbstractScriptEngine.java:233)
>  at 
> org.apache.atlas.repository.graphdb.janus.AtlasJanusGraph.executeGremlinScript(AtlasJanusGraph.java:368)
>  at 
> org.apache.atlas.discovery.ClassificationSearchProcessor.filter(ClassificationSearchProcessor.java:339)
>  at 
> org.apache.atlas.discovery.SearchProcessor.filter(SearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.FreeTextSearchProcessor.execute(FreeTextSearchProcessor.java:156)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithSearchContext(EntityDiscoveryService.java:471)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService.searchWithParameters(EntityDiscoveryService.java:458)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$FastClassBySpringCGLIB$$1af2cf1f.invoke()
>  at 
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>  at 
> org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>  at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
>  at 
> org.apache.atlas.discovery.EntityDiscoveryService$$EnhancerBySpringCGLIB$$95d844c8.searchWithParameters()
>  at 
> org.apache.atlas.web.rest.DiscoveryREST.searchWithParameters(DiscoveryREST.java:342)
>  at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
>  at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
>  at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletC

Re: Review Request 71619: ATLAS-3464: Define Entities stored in Atlas for ML Governance

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71619/#review218305
---



Move the ml model to a new directory in addons/models => 4000-MachineLearning

-ml_model.json => 4010-ml_model.json

- Sarath Subramanian


On Oct. 20, 2019, 9:13 p.m., Na Li wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71619/
> ---
> 
> (Updated Oct. 20, 2019, 9:13 p.m.)
> 
> 
> Review request for atlas, Austin Nobis, Ashutosh Mestry, Karthik Manamcheri, 
> Sridhar K, Madhan Neethiraj, and Sarath Subramanian.
> 
> 
> Bugs: atlas-3464
> https://issues.apache.org/jira/browse/atlas-3464
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Define entities used for Machine Learning Governance
> 
> 
> Diffs
> -
> 
>   addons/models/1000-Hadoop/-ml_model.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71619/diff/4/
> 
> 
> Testing
> ---
> 
> verified it is valid json file
> 
> 
> Thanks,
> 
> Na Li
> 
>

Re: Review Request 71619: ATLAS-3464: Define Entities stored in Atlas for ML Governance

[Anand Patil via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71619/#review218304
---


Ship it!




Ship It!

- Anand Patil


On Oct. 21, 2019, 4:13 a.m., Na Li wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71619/
> ---
> 
> (Updated Oct. 21, 2019, 4:13 a.m.)
> 
> 
> Review request for atlas, Austin Nobis, Ashutosh Mestry, Karthik Manamcheri, 
> Sridhar K, Madhan Neethiraj, and Sarath Subramanian.
> 
> 
> Bugs: atlas-3464
> https://issues.apache.org/jira/browse/atlas-3464
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Define entities used for Machine Learning Governance
> 
> 
> Diffs
> -
> 
>   addons/models/1000-Hadoop/-ml_model.json PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/71619/diff/4/
> 
> 
> Testing
> ---
> 
> verified it is valid json file
> 
> 
> Thanks,
> 
> Na Li
> 
>

[jira] [Commented] (ATLAS-3481) Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load SSL keystore"

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956210#comment-16956210
 ] 

ASF subversion and git services commented on ATLAS-3481:


Commit 85a5eeba1701abf6ff8f852174194307f4a892ae in atlas's branch 
refs/heads/master from Nixon Rodrigues
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=85a5eeb ]

ATLAS-3481 - Fix for trustore.password for Kafka in SSL

Change-Id: I9908e250afa98d7469e7f4b629e9cfab5923aff3
Signed-off-by: Sarath Subramanian 


> Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load 
> SSL keystore"
> --
>
> Key: ATLAS-3481
> URL: https://issues.apache.org/jira/browse/ATLAS-3481
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
>
> {code:java}
> 2019-10-17 23:09:54,872 ERROR org.apache.atlas.hook.AtlasHook: [Atlas 
> Notifier 0]: Failed to send notification - attempt #3; error=Failed to 
> construct kafka producer
> 2019-10-17 23:09:54,872 ERROR org.apache.atlas.hook.AtlasHook: [Atlas 
> Notifier 0]: 
> org.apache.kafka.common.KafkaException: Failed to construct kafka producer
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:433)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:298)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.atlas.kafka.KafkaNotification.getOrCreateProducer(KafkaNotification.java:329)
>  ~[?:?]
>   at 
> org.apache.atlas.kafka.KafkaNotification.sendInternal(KafkaNotification.java:235)
>  ~[?:?]
>   at 
> org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:89)
>  ~[?:?]
>   at org.apache.atlas.hook.AtlasHook$3.run(AtlasHook.java:203) ~[?:?]
>   at java.security.AccessController.doPrivileged(Native Method) 
> ~[?:1.8.0_222]
>   at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_222]
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
>  ~[hadoop-common-3.1.1.7.0.2.0-135.jar:?]
>   at 
> org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:208) 
> ~[?:?]
>   at org.apache.atlas.hook.AtlasHook$2.run(AtlasHook.java:166) ~[?:?]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[?:1.8.0_222]
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[?:1.8.0_222]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  ~[?:1.8.0_222]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  ~[?:1.8.0_222]
>   at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
> Caused by: org.apache.kafka.common.KafkaException: 
> org.apache.kafka.common.KafkaException: 
> org.apache.kafka.common.KafkaException: Failed to load SSL keystore 
> /var/run/cloudera-scm-agent/process/1546333489-hive_on_tez-HIVESERVER2/cm-auto-global_truststore.jks
>  of type JKS
>   at 
> org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:160)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:146)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:67)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:99)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.newSender(KafkaProducer.java:441)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:422)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   ... 15 more
> Caused by: org.apache.kafka.common.KafkaException: 
> org.apache.kafka.common.KafkaException: Failed to load SSL keystore 
> /var/run/cloudera-scm-agent/process/1546333489-hive_on_tez-HIVESERVER2/cm-auto-global_truststore.jks
>  of type JKS
>   at 
> org.apache.kafka.common.security.ssl.SslEngineBuilder.createSSLContext(SslEngineBuilder.java:160)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.security.ssl.SslEngineBuilder.(SslEngineBuilder.java:102)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:93) 
> ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.network.SaslChan

[jira] [Commented] (ATLAS-3481) Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load SSL keystore"

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956211#comment-16956211
 ] 

ASF subversion and git services commented on ATLAS-3481:


Commit 3db262068e56bb39c79a8c72f31daf556b7e7dc4 in atlas's branch 
refs/heads/branch-2.0 from Nixon Rodrigues
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=3db2620 ]

ATLAS-3481 - Fix for trustore.password for Kafka in SSL

Change-Id: I9908e250afa98d7469e7f4b629e9cfab5923aff3
Signed-off-by: Sarath Subramanian 
(cherry picked from commit 85a5eeba1701abf6ff8f852174194307f4a892ae)


> Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load 
> SSL keystore"
> --
>
> Key: ATLAS-3481
> URL: https://issues.apache.org/jira/browse/ATLAS-3481
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
>
> {code:java}
> 2019-10-17 23:09:54,872 ERROR org.apache.atlas.hook.AtlasHook: [Atlas 
> Notifier 0]: Failed to send notification - attempt #3; error=Failed to 
> construct kafka producer
> 2019-10-17 23:09:54,872 ERROR org.apache.atlas.hook.AtlasHook: [Atlas 
> Notifier 0]: 
> org.apache.kafka.common.KafkaException: Failed to construct kafka producer
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:433)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:298)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.atlas.kafka.KafkaNotification.getOrCreateProducer(KafkaNotification.java:329)
>  ~[?:?]
>   at 
> org.apache.atlas.kafka.KafkaNotification.sendInternal(KafkaNotification.java:235)
>  ~[?:?]
>   at 
> org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:89)
>  ~[?:?]
>   at org.apache.atlas.hook.AtlasHook$3.run(AtlasHook.java:203) ~[?:?]
>   at java.security.AccessController.doPrivileged(Native Method) 
> ~[?:1.8.0_222]
>   at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_222]
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
>  ~[hadoop-common-3.1.1.7.0.2.0-135.jar:?]
>   at 
> org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:208) 
> ~[?:?]
>   at org.apache.atlas.hook.AtlasHook$2.run(AtlasHook.java:166) ~[?:?]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[?:1.8.0_222]
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[?:1.8.0_222]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  ~[?:1.8.0_222]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  ~[?:1.8.0_222]
>   at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
> Caused by: org.apache.kafka.common.KafkaException: 
> org.apache.kafka.common.KafkaException: 
> org.apache.kafka.common.KafkaException: Failed to load SSL keystore 
> /var/run/cloudera-scm-agent/process/1546333489-hive_on_tez-HIVESERVER2/cm-auto-global_truststore.jks
>  of type JKS
>   at 
> org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:160)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:146)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:67)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:99)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.newSender(KafkaProducer.java:441)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:422)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   ... 15 more
> Caused by: org.apache.kafka.common.KafkaException: 
> org.apache.kafka.common.KafkaException: Failed to load SSL keystore 
> /var/run/cloudera-scm-agent/process/1546333489-hive_on_tez-HIVESERVER2/cm-auto-global_truststore.jks
>  of type JKS
>   at 
> org.apache.kafka.common.security.ssl.SslEngineBuilder.createSSLContext(SslEngineBuilder.java:160)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.security.ssl.SslEngineBuilder.(SslEngineBuilder.java:102)
>  ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
>   at 
> org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:93) 
> ~[kafka-clients-2.3.0.

Re: Review Request 71640: ATLAS-3481:Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load SSL keystore"

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71640/#review218303
---


Ship it!




Ship It!

- Sarath Subramanian


On Oct. 21, 2019, 5:35 a.m., Nixon Rodrigues wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71640/
> ---
> 
> (Updated Oct. 21, 2019, 5:35 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Mehul Parikh, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3481
> https://issues.apache.org/jira/browse/ATLAS-3481
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Problem:- Kafka Producer was failing in SSL env since truststore passsword 
> was not set correctly from jckes crendential providor file.
> 
> This patch provide fix to getPassword truststore.password value from 
> crendential providor set with key "cert.stores.credential.provider.path".
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/security/SecurityUtil.java PRE-CREATION 
>   notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java 
> 46c68be1f 
>   webapp/src/main/java/org/apache/atlas/web/service/SecureEmbeddedServer.java 
> 4ee8526c9 
> 
> 
> Diff: https://reviews.apache.org/r/71640/diff/1/
> 
> 
> Testing
> ---
> 
> Tested Atlas at hive hook for kafka producer and Atlas for kafka consumer in 
> SSL and kerberos+ssl env.
> 
> PC - https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1481/console
> 
> 
> Thanks,
> 
> Nixon Rodrigues
> 
>

Re: Review Request 71640: ATLAS-3481:Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load SSL keystore"

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71640/#review218302
---


Ship it!




Ship It!

- Madhan Neethiraj


On Oct. 21, 2019, 12:35 p.m., Nixon Rodrigues wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71640/
> ---
> 
> (Updated Oct. 21, 2019, 12:35 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Mehul Parikh, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3481
> https://issues.apache.org/jira/browse/ATLAS-3481
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Problem:- Kafka Producer was failing in SSL env since truststore passsword 
> was not set correctly from jckes crendential providor file.
> 
> This patch provide fix to getPassword truststore.password value from 
> crendential providor set with key "cert.stores.credential.provider.path".
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/security/SecurityUtil.java PRE-CREATION 
>   notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java 
> 46c68be1f 
>   webapp/src/main/java/org/apache/atlas/web/service/SecureEmbeddedServer.java 
> 4ee8526c9 
> 
> 
> Diff: https://reviews.apache.org/r/71640/diff/1/
> 
> 
> Testing
> ---
> 
> Tested Atlas at hive hook for kafka producer and Atlas for kafka consumer in 
> SSL and kerberos+ssl env.
> 
> PC - https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1481/console
> 
> 
> Thanks,
> 
> Nixon Rodrigues
> 
>

[jira] [Commented] (ATLAS-3472) Port jsp's to Servlet

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956131#comment-16956131
 ] 

ASF subversion and git services commented on ATLAS-3472:


Commit 4cd97b37ee2b8b795ddf0b1d66dd11d2d26bcb4a in atlas's branch 
refs/heads/branch-2.0 from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=4cd97b3 ]

ATLAS-3472 :- Fix to port jsp's to Servlet.

Signed-off-by: nixonrodrigues 
(cherry picked from commit e0afb12d49a65d38d340a283a20c0657729c8f48)


> Port jsp's to Servlet
> -
>
> Key: ATLAS-3472
> URL: https://issues.apache.org/jira/browse/ATLAS-3472
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
>
> jsp's are having issue in java11. 
>  
> {code:java}
> 2019-10-05 22:04:25,226 ERROR - [etp1515638188-87 - 
> ca845b5e-047b-4bde-9d3a-a50f54aa791e:] ~ Error compiling file: 
> /tmp/jetty-ma1001-2_vpc_cloudera_com-31000-atlas-_-any-533814582762387932.dir/org/apache/jsp/login_jsp.java
>  (Compiler:391)
> 2019-10-05 22:04:25,301 ERROR - [etp1515638188-87:] ~ Error compiling file: 
> /tmp/jetty-ma1001-2_vpc_cloudera_com-31000-atlas-_-any-533814582762387932.dir/org/apache/jsp/error_jsp.java
>  (Compiler:391) {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (ATLAS-3472) Port jsp's to Servlet

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/ATLAS-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956128#comment-16956128
 ] 

ASF subversion and git services commented on ATLAS-3472:


Commit e0afb12d49a65d38d340a283a20c0657729c8f48 in atlas's branch 
refs/heads/master from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=e0afb12 ]

ATLAS-3472 :- Fix to port jsp's to Servlet.

Signed-off-by: nixonrodrigues 


> Port jsp's to Servlet
> -
>
> Key: ATLAS-3472
> URL: https://issues.apache.org/jira/browse/ATLAS-3472
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
>
> jsp's are having issue in java11. 
>  
> {code:java}
> 2019-10-05 22:04:25,226 ERROR - [etp1515638188-87 - 
> ca845b5e-047b-4bde-9d3a-a50f54aa791e:] ~ Error compiling file: 
> /tmp/jetty-ma1001-2_vpc_cloudera_com-31000-atlas-_-any-533814582762387932.dir/org/apache/jsp/login_jsp.java
>  (Compiler:391)
> 2019-10-05 22:04:25,301 ERROR - [etp1515638188-87:] ~ Error compiling file: 
> /tmp/jetty-ma1001-2_vpc_cloudera_com-31000-atlas-_-any-533814582762387932.dir/org/apache/jsp/error_jsp.java
>  (Compiler:391) {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Review Request 71640: ATLAS-3481:Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load SSL keystore"

[Nixon Rodrigues]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71640/
---

Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Mehul Parikh, and 
Sarath Subramanian.


Bugs: ATLAS-3481
https://issues.apache.org/jira/browse/ATLAS-3481


Repository: atlas


Description
---

Problem:- Kafka Producer was failing in SSL env since truststore passsword was 
not set correctly from jckes crendential providor file.

This patch provide fix to getPassword truststore.password value from 
crendential providor set with key "cert.stores.credential.provider.path".


Diffs
-

  intg/src/main/java/org/apache/atlas/security/SecurityUtil.java PRE-CREATION 
  notification/src/main/java/org/apache/atlas/kafka/KafkaNotification.java 
46c68be1f 
  webapp/src/main/java/org/apache/atlas/web/service/SecureEmbeddedServer.java 
4ee8526c9 


Diff: https://reviews.apache.org/r/71640/diff/1/


Testing
---

Tested Atlas at hive hook for kafka producer and Atlas for kafka consumer in 
SSL and kerberos+ssl env.

PC - https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1481/console


Thanks,

Nixon Rodrigues

[jira] [Created] (ATLAS-3481) Hive Hook fails with "org.apache.kafka.common.KafkaException: Failed to load SSL keystore"

[Nixon Rodrigues (Jira)]

Nixon Rodrigues created ATLAS-3481:
--

 Summary: Hive Hook fails with 
"org.apache.kafka.common.KafkaException: Failed to load SSL keystore"
 Key: ATLAS-3481
 URL: https://issues.apache.org/jira/browse/ATLAS-3481
 Project: Atlas
  Issue Type: Bug
Reporter: Nixon Rodrigues
Assignee: Nixon Rodrigues


{code:java}
2019-10-17 23:09:54,872 ERROR org.apache.atlas.hook.AtlasHook: [Atlas Notifier 
0]: Failed to send notification - attempt #3; error=Failed to construct kafka 
producer
2019-10-17 23:09:54,872 ERROR org.apache.atlas.hook.AtlasHook: [Atlas Notifier 
0]: 


org.apache.kafka.common.KafkaException: Failed to construct kafka producer
at 
org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:433) 
~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:298) 
~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.atlas.kafka.KafkaNotification.getOrCreateProducer(KafkaNotification.java:329)
 ~[?:?]
at 
org.apache.atlas.kafka.KafkaNotification.sendInternal(KafkaNotification.java:235)
 ~[?:?]
at 
org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:89)
 ~[?:?]
at org.apache.atlas.hook.AtlasHook$3.run(AtlasHook.java:203) ~[?:?]
at java.security.AccessController.doPrivileged(Native Method) 
~[?:1.8.0_222]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_222]
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
 ~[hadoop-common-3.1.1.7.0.2.0-135.jar:?]
at 
org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:208) 
~[?:?]
at org.apache.atlas.hook.AtlasHook$2.run(AtlasHook.java:166) ~[?:?]
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[?:1.8.0_222]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
~[?:1.8.0_222]
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
~[?:1.8.0_222]
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
~[?:1.8.0_222]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
Caused by: org.apache.kafka.common.KafkaException: 
org.apache.kafka.common.KafkaException: org.apache.kafka.common.KafkaException: 
Failed to load SSL keystore 
/var/run/cloudera-scm-agent/process/1546333489-hive_on_tez-HIVESERVER2/cm-auto-global_truststore.jks
 of type JKS
at 
org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:160)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:146)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:67)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:99) 
~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.clients.producer.KafkaProducer.newSender(KafkaProducer.java:441)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:422) 
~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
... 15 more
Caused by: org.apache.kafka.common.KafkaException: 
org.apache.kafka.common.KafkaException: Failed to load SSL keystore 
/var/run/cloudera-scm-agent/process/1546333489-hive_on_tez-HIVESERVER2/cm-auto-global_truststore.jks
 of type JKS
at 
org.apache.kafka.common.security.ssl.SslEngineBuilder.createSSLContext(SslEngineBuilder.java:160)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.common.security.ssl.SslEngineBuilder.(SslEngineBuilder.java:102)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:93) 
~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:156)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:146)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:67)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:99) 
~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.clients.producer.KafkaProducer.newSender(KafkaProducer.java:441)
 ~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
at 
org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:422) 
~[kafka-clients-2.3.0.7.0.2.0-135.jar:?]
... 15 more
Caused by: org.apache.kafka.com

[jira] [Created] (ATLAS-3480) atlas2.0 版本集成开启kerberos认证的solr ，认证不通过

[youtakeoff (Jira)]

youtakeoff created ATLAS-3480:
-

 Summary: atlas2.0 版本集成开启kerberos认证的solr ，认证不通过
 Key: ATLAS-3480
 URL: https://issues.apache.org/jira/browse/ATLAS-3480
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 2.0.0
Reporter: youtakeoff


当我使用 atlas2.0 版本 ，底层使用开启kerberos认证的solr 
作为atlas的搜索引擎时，atlas无法通过solr的kerberos的认证。solr 用的是cdh的7.4版本。

已经测试过账号没有问题。

后台solr http 响应的是401.

是否可以提供一份正确的atlas-application.properties 配置文件



--
This message was sent by Atlassian Jira
(v8.3.4#803005)