[jira] [Updated] (HIVE-20960) Make MM compactor run in a transaction and remove CompactorMR.createCompactorMarker()

2019-01-05 Thread Eugene Koifman (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eugene Koifman updated HIVE-20960:
--
Summary: Make MM compactor run in a transaction and remove 
CompactorMR.createCompactorMarker()  (was: remove 
CompactorMR.createCompactorMarker())

> Make MM compactor run in a transaction and remove 
> CompactorMR.createCompactorMarker()
> -
>
> Key: HIVE-20960
> URL: https://issues.apache.org/jira/browse/HIVE-20960
> Project: Hive
>  Issue Type: Sub-task
>  Components: Transactions
>Affects Versions: 4.0.0
>Reporter: Eugene Koifman
>Assignee: Eugene Koifman
>Priority: Major
> Attachments: HIVE-20960.01.patch, HIVE-20960.02.patch, 
> HIVE-20960.03.patch, HIVE-20960.04.patch, HIVE-20960.05.patch
>
>
> Now that we have HIVE-20823, we know if a dir is produced by compactor from 
> the name and {{CompactorMR.createCompactorMarker()}} can be removed.
>  
> Also includes a fix to insert_only ACID table so that compactor produced 
> base_X has the base_X_vY format as for full CRUD tables
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20960) Make MM compactor run in a transaction and remove CompactorMR.createCompactorMarker()

2019-01-05 Thread Eugene Koifman (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eugene Koifman updated HIVE-20960:
--
Description: 
Now that we have HIVE-20823, we know if a dir is produced by compactor from the 
name and {{CompactorMR.createCompactorMarker()}} can be removed.

 

Also includes a fix to insert_only (MM tables) ACID table so that compactor 
produced base_X has the base_X_vY format as for full CRUD tables

 

 

  was:
Now that we have HIVE-20823, we know if a dir is produced by compactor from the 
name and {{CompactorMR.createCompactorMarker()}} can be removed.

 

Also includes a fix to insert_only ACID table so that compactor produced base_X 
has the base_X_vY format as for full CRUD tables

 

 


> Make MM compactor run in a transaction and remove 
> CompactorMR.createCompactorMarker()
> -
>
> Key: HIVE-20960
> URL: https://issues.apache.org/jira/browse/HIVE-20960
> Project: Hive
>  Issue Type: Sub-task
>  Components: Transactions
>Affects Versions: 4.0.0
>Reporter: Eugene Koifman
>Assignee: Eugene Koifman
>Priority: Major
> Attachments: HIVE-20960.01.patch, HIVE-20960.02.patch, 
> HIVE-20960.03.patch, HIVE-20960.04.patch, HIVE-20960.05.patch
>
>
> Now that we have HIVE-20823, we know if a dir is produced by compactor from 
> the name and {{CompactorMR.createCompactorMarker()}} can be removed.
>  
> Also includes a fix to insert_only (MM tables) ACID table so that compactor 
> produced base_X has the base_X_vY format as for full CRUD tables
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-20960) remove CompactorMR.createCompactorMarker()

2019-01-05 Thread Eugene Koifman (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eugene Koifman updated HIVE-20960:
--
Attachment: HIVE-20960.05.patch

> remove CompactorMR.createCompactorMarker()
> --
>
> Key: HIVE-20960
> URL: https://issues.apache.org/jira/browse/HIVE-20960
> Project: Hive
>  Issue Type: Sub-task
>  Components: Transactions
>Affects Versions: 4.0.0
>Reporter: Eugene Koifman
>Assignee: Eugene Koifman
>Priority: Major
> Attachments: HIVE-20960.01.patch, HIVE-20960.02.patch, 
> HIVE-20960.03.patch, HIVE-20960.04.patch, HIVE-20960.05.patch
>
>
> Now that we have HIVE-20823, we know if a dir is produced by compactor from 
> the name and {{CompactorMR.createCompactorMarker()}} can be removed.
>  
> Also includes a fix to insert_only ACID table so that compactor produced 
> base_X has the base_X_vY format as for full CRUD tables
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21085) Materialized views registry starts non-external tez session

2019-01-05 Thread Jesus Camacho Rodriguez (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-21085:
---
Attachment: HIVE-21085.patch

> Materialized views registry starts non-external tez session
> ---
>
> Key: HIVE-21085
> URL: https://issues.apache.org/jira/browse/HIVE-21085
> Project: Hive
>  Issue Type: Bug
>  Components: Materialized views
>Reporter: Prasanth Jayachandran
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-21085.patch, HIVE-21085.patch, HIVE-21085.patch
>
>
> Materialized views registry is doing SessionState.start() which will start 
> regular tez session. In the presence of external tez sessions, it should get 
> session from external sessions pool. There are also other places where 
> SessionState.start() might be invoked.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)