[jira] [Updated] (IMPALA-9096) Create external table ddls should send column lineages.

2020-02-12 Thread Anurag Mantripragada (Jira) 


 [ 
https://issues.apache.org/jira/browse/IMPALA-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anurag Mantripragada updated IMPALA-9096:
-
Description: 
Create external table with specified columns should create column lineages for 
tools like Altas to consume.

 

For example:

create EXTERNAL TABLE IF NOT EXISTS friday_ext6
 (STUD_ID int,
 DEPT_ID int,
 NAME string
 )
 ROW FORMAT DELIMITED
 FIELDS TERMINATED BY ‘,’
 STORED AS TEXTFILE;

Currently we send a lineage like:
{code:java}
 {
 "queryText":"create EXTERNAL TABLE IF NOT EXISTS friday_ext5 (STUD_ID int, 
DEPT_IDint, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘,’ 
STORED AS TEXTFILE LOCATION 
‘/warehouse/tablespace/external/hive/testdb.db/friday_ext5’",
 "queryId":"4b471ac0ca2b0f93:029db79c",
 "hash":"867fae20bc6c8254c05774cc923a99fa",
 "user":"admin",
 "timestamp":1572028716,
 "endTime":1572028716,
 "edges":[],
 "vertices":[],
 
"tableLocation":"hdfs://sid-cdp-2-1.gce.cloudera.com:8020/warehouse/tablespace/external/hive/testdb.db/friday_ext"
}
 {code}
Atlas needs fully qualified table name to create lineage. 

  was:
Create external table with specified columns should create column lineages for 
tools like Altas to consume.

 

For example:

create EXTERNAL TABLE IF NOT EXISTS friday_ext6
(STUD_ID int,
DEPT_ID int,
NAME string
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ‘,’
STORED AS TEXTFILE;

Currently we send a lineage like:
{code:java}
 {
 "queryText":"create EXTERNAL TABLE IF NOT EXISTS friday_ext5 (STUD_ID int, 
DEPT_IDint, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘,’ 
STORED AS TEXTFILE LOCATION 
‘/warehouse/tablespace/external/hive/testdb.db/friday_ext5’",
 "queryId":"4b471ac0ca2b0f93:029db79c",
 "hash":"867fae20bc6c8254c05774cc923a99fa",
 "user":"admin",
 "timestamp":1572028716,
 "endTime":1572028716,
 "edges":[],
 "vertices":[],
 
"tableLocation":"hdfs://sid-cdp-2-1.gce.cloudera.com:8020/warehouse/tablespace/external/hive/testdb.db/friday_ext"
}
 {code}
Atlas needs fully qualified table name to create lineage.

 

 

 


> Create external table ddls should send column lineages.
> ---
>
> Key: IMPALA-9096
> URL: https://issues.apache.org/jira/browse/IMPALA-9096
> Project: IMPALA
>  Issue Type: Improvement
>  Components: Frontend
>Reporter: Anurag Mantripragada
>Priority: Minor
>
> Create external table with specified columns should create column lineages 
> for tools like Altas to consume.
>  
> For example:
> create EXTERNAL TABLE IF NOT EXISTS friday_ext6
>  (STUD_ID int,
>  DEPT_ID int,
>  NAME string
>  )
>  ROW FORMAT DELIMITED
>  FIELDS TERMINATED BY ‘,’
>  STORED AS TEXTFILE;
> Currently we send a lineage like:
> {code:java}
>  {
>  "queryText":"create EXTERNAL TABLE IF NOT EXISTS friday_ext5 (STUD_ID int, 
> DEPT_IDint, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘,’ 
> STORED AS TEXTFILE LOCATION 
> ‘/warehouse/tablespace/external/hive/testdb.db/friday_ext5’",
>  "queryId":"4b471ac0ca2b0f93:029db79c",
>  "hash":"867fae20bc6c8254c05774cc923a99fa",
>  "user":"admin",
>  "timestamp":1572028716,
>  "endTime":1572028716,
>  "edges":[],
>  "vertices":[],
>  
> "tableLocation":"hdfs://sid-cdp-2-1.gce.cloudera.com:8020/warehouse/tablespace/external/hive/testdb.db/friday_ext"
> }
>  {code}
> Atlas needs fully qualified table name to create lineage. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

[jira] [Updated] (IMPALA-9096) Create external table ddls should send column lineages.

2020-02-12 Thread Anurag Mantripragada (Jira) 


 [ 
https://issues.apache.org/jira/browse/IMPALA-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anurag Mantripragada updated IMPALA-9096:
-
Priority: Minor  (was: Critical)

> Create external table ddls should send column lineages.
> ---
>
> Key: IMPALA-9096
> URL: https://issues.apache.org/jira/browse/IMPALA-9096
> Project: IMPALA
>  Issue Type: Improvement
>  Components: Frontend
>Reporter: Anurag Mantripragada
>Priority: Minor
>
> Create external table with specified columns should create column lineages 
> for tools like Altas to consume.
>  
> For example:
> create EXTERNAL TABLE IF NOT EXISTS friday_ext6
> (STUD_ID int,
> DEPT_ID int,
> NAME string
> )
> ROW FORMAT DELIMITED
> FIELDS TERMINATED BY ‘,’
> STORED AS TEXTFILE;
> Currently we send a lineage like:
> {code:java}
>  {
>  "queryText":"create EXTERNAL TABLE IF NOT EXISTS friday_ext5 (STUD_ID int, 
> DEPT_IDint, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘,’ 
> STORED AS TEXTFILE LOCATION 
> ‘/warehouse/tablespace/external/hive/testdb.db/friday_ext5’",
>  "queryId":"4b471ac0ca2b0f93:029db79c",
>  "hash":"867fae20bc6c8254c05774cc923a99fa",
>  "user":"admin",
>  "timestamp":1572028716,
>  "endTime":1572028716,
>  "edges":[],
>  "vertices":[],
>  
> "tableLocation":"hdfs://sid-cdp-2-1.gce.cloudera.com:8020/warehouse/tablespace/external/hive/testdb.db/friday_ext"
> }
>  {code}
> Atlas needs fully qualified table name to create lineage.
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

[jira] [Updated] (IMPALA-9096) Create external table ddls should send column lineages.

2020-02-12 Thread Tim Armstrong (Jira) 


 [ 
https://issues.apache.org/jira/browse/IMPALA-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tim Armstrong updated IMPALA-9096:
--
Component/s: Frontend

> Create external table ddls should send column lineages.
> ---
>
> Key: IMPALA-9096
> URL: https://issues.apache.org/jira/browse/IMPALA-9096
> Project: IMPALA
>  Issue Type: Improvement
>  Components: Frontend
>Reporter: Anurag Mantripragada
>Priority: Critical
>
> Create external table with specified columns should create column lineages 
> for tools like Altas to consume.
>  
> For example:
> create EXTERNAL TABLE IF NOT EXISTS friday_ext6
> (STUD_ID int,
> DEPT_ID int,
> NAME string
> )
> ROW FORMAT DELIMITED
> FIELDS TERMINATED BY ‘,’
> STORED AS TEXTFILE;
> Currently we send a lineage like:
> {code:java}
>  {
>  "queryText":"create EXTERNAL TABLE IF NOT EXISTS friday_ext5 (STUD_ID int, 
> DEPT_IDint, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘,’ 
> STORED AS TEXTFILE LOCATION 
> ‘/warehouse/tablespace/external/hive/testdb.db/friday_ext5’",
>  "queryId":"4b471ac0ca2b0f93:029db79c",
>  "hash":"867fae20bc6c8254c05774cc923a99fa",
>  "user":"admin",
>  "timestamp":1572028716,
>  "endTime":1572028716,
>  "edges":[],
>  "vertices":[],
>  
> "tableLocation":"hdfs://sid-cdp-2-1.gce.cloudera.com:8020/warehouse/tablespace/external/hive/testdb.db/friday_ext"
> }
>  {code}
> Atlas needs fully qualified table name to create lineage.
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org