Review Request 71620: ATLAS-3461: Impala process and lineage is not getting created appropriately if query contains variation like comment or extra spaces

[Sidharth Mishra]

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71620/
-----------------------------------------------------------

Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, and Sarath 
Subramanian.


Bugs: ATLAS-3461
    https://issues.apache.org/jira/browse/ATLAS-3461


Repository: atlas


Description
-------

Now even if the Impala queries contains comment/ extra spaces, Atlas will 
create the impala process approproately.
Even "create external table" will create Impala process at Atlas and user can 
see lineage.


Diffs
-----

  
addons/impala-bridge/src/main/java/org/apache/atlas/impala/hook/ImpalaOperationParser.java
 b9dd894f8 
  
addons/impala-bridge/src/test/java/org/apache/atlas/impala/ImpalaLineageToolIT.java
 dc4d1333e 
  addons/impala-bridge/src/test/resources/WALimpala.wal PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaAlterViewAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateTableAsSelectWithCommentSpaces.json
 PRE-CREATION 
  
addons/impala-bridge/src/test/resources/impalaCreateViewWithCommentSpaces.json 
PRE-CREATION 


Diff: https://reviews.apache.org/r/71620/diff/1/


Testing
-------

1. Unit Tests added to ImpalaLineageToolIT and without fix it was failing. Now 
after the fix it works.
2. Validated manually by running below mentioned query from Impala:JDBC:

create     table testMon4 as select * from t1;

creAte external table /*test*/ testMo3 aS -- temp  fff
      /* temp dddd*/ -- sdfrnfkjef select
      select * from t1;
      

Create /*dd*/ table testMon4 aS select * from t1;

creAte external table /*test*/ testMon10 aS -- temp  fff
      /* temp dddd*/ -- sdfrnfkjef select
      select * from t1;

alter view  testMonView2 as select * from t1;

create     view testMonView4 as select * from t1;

alter view  testMonView4 as select * from t1;

CREATE EXTERNAL TABLE IF NOT EXISTS mondaysecond1
LIKE t1
LOCATION '/warehouse/tablespace/external/hive/db1.db/mondaysecond1';


Thanks,

Sidharth Mishra