[jira] [Updated] (HIVE-21056) Make CompactionInfo extend CompactionInfoStruct

[ https://issues.apache.org/jira/browse/HIVE-21056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21056: -- Component/s: Transactions > Make CompactionInfo extend CompactionInfoStruct > -

[jira] [Updated] (HIVE-20859) clean up invocation of Worker/Cleaner/Initiator in test code

[ https://issues.apache.org/jira/browse/HIVE-20859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20859: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status: Resolved

[jira] [Updated] (HIVE-20859) clean up invocation of Worker/Cleaner/Initiator in test code

[ https://issues.apache.org/jira/browse/HIVE-20859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20859: -- Description: there are many places like {{CompactorTest}} that use {code:java|title=TestCompact

[jira] [Commented] (HIVE-20859) clean up invocation of Worker/Cleaner/Initiator in test code

[ https://issues.apache.org/jira/browse/HIVE-20859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726985#comment-16726985 ] Eugene Koifman commented on HIVE-20859: --- +1 > clean up invocation of Worker/Cleane

[jira] [Updated] (HIVE-20960) remove CompactorMR.createCompactorMarker()

[ https://issues.apache.org/jira/browse/HIVE-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20960: -- Description: Now that we have HIVE-20823, we know if a dir is produced by compactor from the n

[jira] [Commented] (HIVE-20960) remove CompactorMR.createCompactorMarker()

[ https://issues.apache.org/jira/browse/HIVE-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725428#comment-16725428 ] Eugene Koifman commented on HIVE-20960: --- [~ikryvenko], yes HIVE-20823.   > remove

[jira] [Commented] (HIVE-20936) Allow the Worker thread in the metastore to run outside of it

[ https://issues.apache.org/jira/browse/HIVE-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725349#comment-16725349 ] Eugene Koifman commented on HIVE-20936: --- looks like it needs to be rebased > Allow

[jira] [Resolved] (HIVE-21058) Make Compactor run in a transaction (Umbrella)

[ https://issues.apache.org/jira/browse/HIVE-21058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-21058. --- Resolution: Fixed > Make Compactor run in a transaction (Umbrella) >

[jira] [Updated] (HIVE-21020) log which table/partition is being processed by a txn in Worker

[ https://issues.apache.org/jira/browse/HIVE-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21020: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-21058 > log which table/partition is bein

[jira] [Updated] (HIVE-20942) Worker should heartbeat its own txn

[ https://issues.apache.org/jira/browse/HIVE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20942: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-21058 > Worker should heartbeat its own t

[jira] [Updated] (HIVE-20862) QueryId no longer shows up in the logs

[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20862: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-21058 > QueryId no longer shows up in the

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-21058 > Handle Compactor transaction abor

[jira] [Updated] (HIVE-21058) Make Compactor run in a transaction (Umbrella)

[ https://issues.apache.org/jira/browse/HIVE-21058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21058: -- Issue Type: New Feature (was: Bug) > Make Compactor run in a transaction (Umbrella) >

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-21058 > Make Compactor run in a t

[jira] [Assigned] (HIVE-21058) Make Compactor run in a transaction (Umbrella)

[ https://issues.apache.org/jira/browse/HIVE-21058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-21058: - > Make Compactor run in a transaction (Umbrella) > -

[jira] [Resolved] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-20943. --- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a > Handle Compactor trans

[jira] [Commented] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724647#comment-16724647 ] Eugene Koifman commented on HIVE-20943: --- patch 4 removes a comment   committed pa

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Status: Open (was: Patch Available) > Handle Compactor transaction abort properly > --

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Description: A transactions in which the Worker runs may fail after base_x_cZ (delta_x_y_cZ) is

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Attachment: HIVE-20943.04.patch > Handle Compactor transaction abort properly > ---

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Attachment: HIVE-20943.03.patch > Handle Compactor transaction abort properly > ---

[jira] [Commented] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724588#comment-16724588 ] Eugene Koifman commented on HIVE-20943: --- patch 3 is a rebase of patch 2 > Handle C

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Attachment: HIVE-20943.03.patch > Handle Compactor transaction abort properly > ---

[jira] [Commented] (HIVE-20936) Allow the Worker thread in the metastore to run outside of it

[ https://issues.apache.org/jira/browse/HIVE-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723564#comment-16723564 ] Eugene Koifman commented on HIVE-20936: --- added some RB comments > Allow the Worker

[jira] [Updated] (HIVE-19081) Add partition should prevent loading acid files

[ https://issues.apache.org/jira/browse/HIVE-19081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19081: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status: Resolved

[jira] [Commented] (HIVE-19081) Add partition should prevent loading acid files

[ https://issues.apache.org/jira/browse/HIVE-19081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723398#comment-16723398 ] Eugene Koifman commented on HIVE-19081: --- +1 patch 2 > Add partition should prevent

[jira] [Resolved] (HIVE-17204) support un-bucketed tables in acid

[ https://issues.apache.org/jira/browse/HIVE-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17204. --- Resolution: Fixed > support un-bucketed tables in acid > -- >

[jira] [Updated] (HIVE-17204) support un-bucketed tables in acid

[ https://issues.apache.org/jira/browse/HIVE-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17204: -- Fix Version/s: 3.0.0 > support un-bucketed tables in acid > --

[jira] [Comment Edited] (HIVE-17206) make a version of Compactor specific to unbucketed tables

[ https://issues.apache.org/jira/browse/HIVE-17206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721921#comment-16721921 ] Eugene Koifman edited comment on HIVE-17206 at 12/15/18 1:01 AM: --

[jira] [Resolved] (HIVE-17206) make a version of Compactor specific to unbucketed tables

[ https://issues.apache.org/jira/browse/HIVE-17206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17206. --- Resolution: Won't Fix this would mean the either we have to change ROW_IDs during compaction

[jira] [Commented] (HIVE-18983) Add support for table properties inheritance in Create table like

[ https://issues.apache.org/jira/browse/HIVE-18983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720721#comment-16720721 ] Eugene Koifman commented on HIVE-18983: --- [~ashutoshc] is it safe to copy all prope

[jira] [Commented] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720716#comment-16720716 ] Eugene Koifman commented on HIVE-20941: --- committed patch 6 to master   thanks Igo

[jira] [Commented] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720714#comment-16720714 ] Eugene Koifman commented on HIVE-20941: --- Notes for myself: {{AcidUtils.getAcidStat

[jira] [Updated] (HIVE-21020) log which table/partition is being processed by a txn in Worker

[ https://issues.apache.org/jira/browse/HIVE-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21020: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status: Resolved

[jira] [Updated] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20941: -- Fix Version/s: 4.0.0 > Compactor produces a delete_delta_x_y even if there are no input delete

[jira] [Resolved] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-20941. --- Resolution: Fixed > Compactor produces a delete_delta_x_y even if there are no input delete e

[jira] [Updated] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20941: -- Status: Open (was: Patch Available) > Compactor produces a delete_delta_x_y even if there are

[jira] [Updated] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20941: -- Attachment: HIVE-20941.06.patch > Compactor produces a delete_delta_x_y even if there are no in

[jira] [Commented] (HIVE-21036) extend OpenTxnRequest with transaction type

[ https://issues.apache.org/jira/browse/HIVE-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16719573#comment-16719573 ] Eugene Koifman commented on HIVE-21036: --- FYI, [~ikryvenko] > extend OpenTxnRequest

[jira] [Commented] (HIVE-20936) Allow the Worker thread in the metastore to run outside of it

[ https://issues.apache.org/jira/browse/HIVE-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16719572#comment-16719572 ] Eugene Koifman commented on HIVE-20936: --- [~jmarhuen] I left some comments on RB >

[jira] [Commented] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16719450#comment-16719450 ] Eugene Koifman commented on HIVE-20943: --- [~vgumashta] could you review please > Ha

[jira] [Commented] (HIVE-21036) extend OpenTxnRequest with transaction type

[ https://issues.apache.org/jira/browse/HIVE-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16719437#comment-16719437 ] Eugene Koifman commented on HIVE-21036: --- should be done after HIVE-20943 and HIVE-2

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Attachment: HIVE-20943.02.patch > Handle Compactor transaction abort properly > ---

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Attachment: HIVE-20943.02.patch > Handle Compactor transaction abort properly > ---

[jira] [Commented] (HIVE-19081) Add partition should prevent loading acid files

[ https://issues.apache.org/jira/browse/HIVE-19081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717659#comment-16717659 ] Eugene Koifman commented on HIVE-19081: --- [~ikryvenko], could you take this one plea

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Attachment: HIVE-20943.01.patch > Handle Compactor transaction abort properly > ---

[jira] [Updated] (HIVE-20943) Handle Compactor transaction abort properly

[ https://issues.apache.org/jira/browse/HIVE-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20943: -- Assignee: Eugene Koifman Status: Patch Available (was: Open) > Handle Compactor transact

[jira] [Commented] (HIVE-20936) Allow the Worker thread in the metastore to run outside of it

[ https://issues.apache.org/jira/browse/HIVE-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16715527#comment-16715527 ] Eugene Koifman commented on HIVE-20936: --- [~jmarhuen] could you rebase the patch >

[jira] [Updated] (HIVE-21020) log which table/partition is being processed by a txn in Worker

[ https://issues.apache.org/jira/browse/HIVE-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21020: -- Attachment: HIVE-21020.01.patch > log which table/partition is being processed by a txn in Work

[jira] [Updated] (HIVE-21020) log which table/partition is being processed by a txn in Worker

[ https://issues.apache.org/jira/browse/HIVE-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21020: -- Status: Patch Available (was: Open) > log which table/partition is being processed by a txn in

[jira] [Assigned] (HIVE-21020) log which table/partition is being processed by a txn in Worker

[ https://issues.apache.org/jira/browse/HIVE-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-21020: - Assignee: Eugene Koifman > log which table/partition is being processed by a txn in Work

[jira] [Updated] (HIVE-21025) LLAP IO fails on read if partition column is included in the table and the query has a predicate on the partition column

[ https://issues.apache.org/jira/browse/HIVE-21025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21025: -- Description: Hive doesn't officially support the case when a partitioning column is also inclu

[jira] [Updated] (HIVE-21020) log which table/partition is being processed by a txn in Worker

[ https://issues.apache.org/jira/browse/HIVE-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21020: -- Description: Make sure we have info in the log that ties cat.table.part with txnid of the comp

[jira] [Updated] (HIVE-21020) log which table/partition is being processed by a txn in Worker

[ https://issues.apache.org/jira/browse/HIVE-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21020: -- Description: Make sure we have info in the log that ties cat.table.part with txnid of the comp

[jira] [Updated] (HIVE-20942) Worker should heartbeat its own txn

[ https://issues.apache.org/jira/browse/HIVE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20942: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status: Resolved

[jira] [Comment Edited] (HIVE-20942) Worker should heartbeat its own txn

[ https://issues.apache.org/jira/browse/HIVE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713392#comment-16713392 ] Eugene Koifman edited comment on HIVE-20942 at 12/7/18 11:06 PM: --

[jira] [Commented] (HIVE-20942) Worker should heartbeat its own txn

[ https://issues.apache.org/jira/browse/HIVE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713390#comment-16713390 ] Eugene Koifman commented on HIVE-20942: --- +1 > Worker should heartbeat its own txn

[jira] [Updated] (HIVE-21017) Throw proper exception in case of alter table add partition on an ACID table

[ https://issues.apache.org/jira/browse/HIVE-21017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-21017: -- Description: I don't think ACID is relevant here.  The issue is adding existing data to a bucke

[jira] [Comment Edited] (HIVE-20942) Worker should heartbeat its own txn

[ https://issues.apache.org/jira/browse/HIVE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711961#comment-16711961 ] Eugene Koifman edited comment on HIVE-20942 at 12/6/18 8:00 PM: ---

[jira] [Commented] (HIVE-20942) Worker should heartbeat its own txn

[ https://issues.apache.org/jira/browse/HIVE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711961#comment-16711961 ] Eugene Koifman commented on HIVE-20942: --- [~ikryvenko], I agree that you should keep

[jira] [Commented] (HIVE-20942) Worker should heartbeat its own txn

[ https://issues.apache.org/jira/browse/HIVE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710478#comment-16710478 ] Eugene Koifman commented on HIVE-20942: --- I think you need put \{{heartbeater.cancel

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available

[jira] [Assigned] (HIVE-20960) remove CompactorMR.createCompactorMarker()

[ https://issues.apache.org/jira/browse/HIVE-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20960: - > remove CompactorMR.createCompactorMarker() > -- >

[jira] [Comment Edited] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16695124#comment-16695124 ] Eugene Koifman edited comment on HIVE-20941 at 11/21/18 7:14 PM: --

[jira] [Commented] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16695124#comment-16695124 ] Eugene Koifman commented on HIVE-20941: --- Actually, I just realized that there may s

[jira] [Commented] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16695102#comment-16695102 ] Eugene Koifman commented on HIVE-20941: --- +1   > Compactor produces a delete_delta

[jira] [Updated] (HIVE-20948) Eliminate file rename in compactor

[ https://issues.apache.org/jira/browse/HIVE-20948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20948: -- Description: Once HIVE-20823 is committed, we should investigate if it's possible to have comp

[jira] [Updated] (HIVE-20948) Eliminate file rename in compactor

[ https://issues.apache.org/jira/browse/HIVE-20948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20948: -- Description: Once HIVE-20823 is committed, we should investigate if it's possible to have comp

[jira] [Updated] (HIVE-20948) Eliminate file rename in compactor

[ https://issues.apache.org/jira/browse/HIVE-20948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20948: -- Description: Once HIVE-20823 is committed, we should investigate if it's possible to have comp

[jira] [Updated] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20730: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-20738 > Do delete event filtering

[jira] [Resolved] (HIVE-20738) Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader

[ https://issues.apache.org/jira/browse/HIVE-20738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-20738. --- Resolution: Fixed Fix Version/s: 4.0.0 all subtasks are finished > Enable Delete Even

[jira] [Commented] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692566#comment-16692566 ] Eugene Koifman commented on HIVE-20823: --- no related failures > Make Compactor run

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.14.patch > Make Compactor run in a transaction > ---

[jira] [Updated] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20941: -- Description: see example in HIVE-20901   Probably change logic in CompactorMR.CompactorMap.ma

[jira] [Updated] (HIVE-20941) Compactor produces a delete_delta_x_y even if there are no input delete events

[ https://issues.apache.org/jira/browse/HIVE-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20941: -- Description: see example in HIVE-20901 > Compactor produces a delete_delta_x_y even if there ar

[jira] [Updated] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20901: -- Description: suppose we run minor compaction 2 times, via alter table The 2nd request to compa

[jira] [Updated] (HIVE-20936) Allow the Worker thread in the metastore to run outside of it

[ https://issues.apache.org/jira/browse/HIVE-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20936: -- Component/s: Transactions > Allow the Worker thread in the metastore to run outside of it > ---

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.13.patch > Make Compactor run in a transaction > ---

[jira] [Updated] (HIVE-20919) Break up UpdateDeleteSemanticAnalyzer

[ https://issues.apache.org/jira/browse/HIVE-20919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20919: -- Component/s: (was: Hive) Transactions > Break up UpdateDeleteSemanticAnaly

[jira] [Updated] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20730: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status: Resolved

[jira] [Updated] (HIVE-20888) TxnHandler: sort() called on immutable lists

[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20888: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status: Resolved

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.12.patch > Make Compactor run in a transaction > ---

[jira] [Commented] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687023#comment-16687023 ] Eugene Koifman commented on HIVE-20730: --- +1 > Do delete event filtering even if hi

[jira] [Commented] (HIVE-20888) TxnHandler: sort() called on immutable lists

[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687019#comment-16687019 ] Eugene Koifman commented on HIVE-20888: --- +1 > TxnHandler: sort() called on immutab

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.11.patch > Make Compactor run in a transaction > ---

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.11.patch > Make Compactor run in a transaction > ---

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.10.patch > Make Compactor run in a transaction > ---

[jira] [Commented] (HIVE-20905) querying streaming table fails with out of memory exception

[ https://issues.apache.org/jira/browse/HIVE-20905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684189#comment-16684189 ] Eugene Koifman commented on HIVE-20905: --- Is modifying "conf"  issue?  This is likel

[jira] [Updated] (HIVE-20905) querying streaming table fails with out of memory exception

[ https://issues.apache.org/jira/browse/HIVE-20905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20905: -- Component/s: (was: Hive) Transactions Metastore > queryin

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.09.patch > Make Compactor run in a transaction > ---

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.08.patch > Make Compactor run in a transaction > ---

[jira] [Assigned] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20901: - > running compactor when there is nothing to do produces duplicate data > --

[jira] [Resolved] (HIVE-20392) make compaction atomic on S3

[ https://issues.apache.org/jira/browse/HIVE-20392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-20392. --- Resolution: Won't Fix will be handled in HIVE-20823 > make compaction atomic on S3 > ---

[jira] [Commented] (HIVE-20888) TxnHandler: sort() called on immutable lists

[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680581#comment-16680581 ] Eugene Koifman commented on HIVE-20888: --- cc [~ikryvenko] > TxnHandler: sort() call

[jira] [Updated] (HIVE-20888) TxnHandler: sort() called on immutable lists

[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20888: -- Component/s: Transactions > TxnHandler: sort() called on immutable lists >

[jira] [Resolved] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-18772. --- Resolution: Duplicate Fix Version/s: 4.0.0 Release Note: n/a this is addressed in

[jira] [Commented] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679133#comment-16679133 ] Eugene Koifman commented on HIVE-20823: --- patch 5 bunch more test fixes and some rea

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.07.patch > Make Compactor run in a transaction > ---

[jira] [Commented] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679147#comment-16679147 ] Eugene Koifman commented on HIVE-20730: --- [~saurabhseth] is this ready to be committ

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.05.patch > Make Compactor run in a transaction > ---

<    1   2   3   4   5   6   7   8   9   10   >