[jira] [Assigned] (HIVE-18126) Mechanics of multiple commands with OVERWRITE in a singe transactions

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18126: - > Mechanics of multiple commands with OVERWRITE in a singe transactions >

[jira] [Assigned] (HIVE-18125) Support arbitrary file names in input to Load Data

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18125: - > Support arbitrary file names in input to Load Data >

[jira] [Assigned] (HIVE-17232) "No match found" Compactor finds a bucket file thinking it's a directory

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17232: - Assignee: Eugene Koifman (was: Steve Yeom) > "No match found" Compactor finds a

[jira] [Assigned] (HIVE-18124) clean up isAcidTable() API

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18124: - > clean up isAcidTable() API > --- > > Key:

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.19.patch > Support LOAD DATA for transactional tables >

[jira] [Commented] (HIVE-18090) acid heartbeat fails when metastore is connected via hadoop credential

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260895#comment-16260895 ] Eugene Koifman commented on HIVE-18090: --- HIVE-12366 is where shared thread pool for heartbeat was

[jira] [Updated] (HIVE-18090) acid heartbeat fails when metastore is connected via hadoop credential

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18090: -- Affects Version/s: (was: 3.0.0) 1.3.0 2.0.0 >

[jira] [Updated] (HIVE-18090) acid heartbeat fails when metastore is connected via hadoop credential

2017-11-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18090: -- Component/s: Transactions > acid heartbeat fails when metastore is connected via hadoop

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.17.patch patch 17 has vectorized code path and some test fixes >

[jira] [Commented] (HIVE-16669) Fine tune Compaction to take advantage of Acid 2.0

2017-11-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260160#comment-16260160 ] Eugene Koifman commented on HIVE-16669: --- consider: delta_26_29 and delete_delta_29_29 - current

[jira] [Updated] (HIVE-18110) OrcInputFormat.combineOrCreateETLStrategy() doesn't combine if there are deltas

2017-11-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18110: -- Description: this method has {noformat} if (!deltas.isEmpty() || combinedCtx == null) {

[jira] [Commented] (HIVE-17457) Acid Insert Overwrite when the transaction fails

2017-11-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259996#comment-16259996 ] Eugene Koifman commented on HIVE-17457: --- If the file is readable it's simpler than this: all rows

[jira] [Commented] (HIVE-18104) Issue in HIVE Update Command for set columns

2017-11-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259468#comment-16259468 ] Eugene Koifman commented on HIVE-18104: --- [~ranjanravi90], What version of Hive was this observed in?

[jira] [Updated] (HIVE-18104) Issue in HIVE Update Command for set columns

2017-11-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18104: -- Component/s: Transactions > Issue in HIVE Update Command for set columns >

[jira] [Updated] (HIVE-18102) Hive insertion for complex types not working when "transactional=true"

2017-11-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18102: -- Component/s: Transactions > Hive insertion for complex types not working when

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.16.patch > Support LOAD DATA for transactional tables >

[jira] [Commented] (HIVE-18090) acid heartbeat fails when metastore is connected via hadoop credential

2017-11-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257735#comment-16257735 ] Eugene Koifman commented on HIVE-18090: --- you have {noformat} tblproperties('transactional'='tur');

[jira] [Assigned] (HIVE-18098) Add support for Export/Import for Acid tables

2017-11-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18098: - Assignee: Eugene Koifman > Add support for Export/Import for Acid tables >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.14.patch > Support LOAD DATA for transactional tables >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.12.patch > Support LOAD DATA for transactional tables >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.11.patch > Support LOAD DATA for transactional tables >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.10.patch 10 is the same as 9 - build bot lost it again > Support LOAD

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.09.patch > Support LOAD DATA for transactional tables >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.08.patch > Support LOAD DATA for transactional tables >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Status: Patch Available (was: Open) > Support LOAD DATA for transactional tables >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Attachment: HIVE-17361.07.patch HIVE-17361.07.patch - WIP > Support LOAD DATA for

[jira] [Updated] (HIVE-17970) MM LOAD DATA with OVERWRITE doesn't use base_n directory concept

2017-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17970: -- Summary: MM LOAD DATA with OVERWRITE doesn't use base_n directory concept (was: LOAD DATA with

[jira] [Updated] (HIVE-18045) can VectorizedOrcAcidRowBatchReader be used all the time

2017-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18045: -- Description: Can we use VectorizedOrcAcidRowBatchReader for non-vectorized queries? It would

[jira] [Assigned] (HIVE-18045) can VectorizedOrcAcidRowBatchReader be used all the time

2017-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18045: - > can VectorizedOrcAcidRowBatchReader be used all the time >

[jira] [Commented] (HIVE-16669) Fine tune Compaction to take advantage of Acid 2.0

2017-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247974#comment-16247974 ] Eugene Koifman commented on HIVE-16669: --- Can Major compaction use Vectorized reader underneath? >

[jira] [Comment Edited] (HIVE-17457) Acid Insert Overwrite when the transaction fails

2017-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16159992#comment-16159992 ] Eugene Koifman edited comment on HIVE-17457 at 11/10/17 6:09 PM: - the

[jira] [Commented] (HIVE-17138) FileSinkOperator/Compactor doesn't create empty files for acid path

2017-11-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246850#comment-16246850 ] Eugene Koifman commented on HIVE-17138: --- check usages of AcidUtils.getAcidState() specifically when

[jira] [Commented] (HIVE-17922) Enable runWorker() UDF to launch compactor from .q tests

2017-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244757#comment-16244757 ] Eugene Koifman commented on HIVE-17922: --- TestAcidOnTez - may be fix Compactor in Qfiles?

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241341#comment-16241341 ] Eugene Koifman commented on HIVE-17856: --- 2) Everything in Acid relies on AcidUtils.getAcidState() -

[jira] [Updated] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17921: -- Description: Consider {noformat} select ROW__ID, count(*) from over10k_orc_bucketed group by

[jira] [Resolved] (HIVE-17944) OrcSplit.canUseLlapIo() disables LLAP IO for non-vectorized acid reads

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17944. --- Resolution: Won't Fix subsumed by HIVE-17915 > OrcSplit.canUseLlapIo() disables LLAP IO for

[jira] [Assigned] (HIVE-17915) Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO elevator over original acid files

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17915: - Assignee: Teddy Choi > Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO

[jira] [Updated] (HIVE-17915) Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO elevator over original acid files

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17915: -- Priority: Critical (was: Minor) > Enable VectorizedOrcAcidRowBatchReader to be used with LLAP

[jira] [Updated] (HIVE-17915) Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO elevator over original acid files

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17915: -- Description: Since HIVE-12631, LLAP IO can support Acid tables but when reading "original"

[jira] [Resolved] (HIVE-17850) can VectorizedOrcAcidRowReader be removed once HIVE-17458 is done?

2017-11-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17850. --- Resolution: Fixed Fix Version/s: 3.0.0 removed in HIVE-17458 > can

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239103#comment-16239103 ] Eugene Koifman commented on HIVE-17458: --- llap_fast_acid is an unstable test, all others have age > 1

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Updated] (HIVE-14988) Support INSERT OVERWRITE into a partition on transactional tables

2017-11-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-14988: -- Description: Insert overwrite operation on transactional table will currently raise an error.

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238233#comment-16238233 ] Eugene Koifman commented on HIVE-17458: --- correct. It tests for whether ROW__ID needs to be

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.16.patch patch 16 addresses RB comments >

[jira] [Comment Edited] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236716#comment-16236716 ] Eugene Koifman edited comment on HIVE-17458 at 11/2/17 10:35 PM: - 1. acid

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236716#comment-16236716 ] Eugene Koifman commented on HIVE-17458: --- 1. acid 2.0 is the only acid supported by hive 3.0. The

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236159#comment-16236159 ] Eugene Koifman commented on HIVE-17856: --- It looks like LOAD DATA with OVERWRITE for MM also does the

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236051#comment-16236051 ] Eugene Koifman commented on HIVE-17947: --- +1 patch 3 > Concurrent inserts might fail for ACID table

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Description: LOAD DATA was not supported since ACID was introduced. Need to fill this gap

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.15.patch patch 15 fixes TestVectorizedOrcAcidRowBatchReader - test issue

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234451#comment-16234451 ] Eugene Koifman commented on HIVE-17947: --- Nit: It may be more efficient to check the file before

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234292#comment-16234292 ] Eugene Koifman commented on HIVE-17458: --- [~sershe] there is 1 minor related failure but it's ready

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.14.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234135#comment-16234135 ] Eugene Koifman commented on HIVE-17458: --- patch14 for build (same as 13) >

[jira] [Assigned] (HIVE-17951) Clarify OrcSplit.hasBase() etc

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17951: - > Clarify OrcSplit.hasBase() etc > -- > > Key:

[jira] [Updated] (HIVE-16952) AcidUtils.parseBaseOrDeltaBucketFilename() end clause

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16952: -- Priority: Major (was: Minor) > AcidUtils.parseBaseOrDeltaBucketFilename() end clause >

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227700#comment-16227700 ] Eugene Koifman commented on HIVE-17458: --- Patch 13 restores OrcSplit.canUseLlapIo() as before, which

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.13.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Commented] (HIVE-16952) AcidUtils.parseBaseOrDeltaBucketFilename() end clause

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227674#comment-16227674 ] Eugene Koifman commented on HIVE-16952: --- note that Load Data can simply move files with arbitrary

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227227#comment-16227227 ] Eugene Koifman commented on HIVE-17458: --- I'll make RB once I fix some of the issues here >

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227198#comment-16227198 ] Eugene Koifman commented on HIVE-17947: --- My $0.02 The other uses of listStatusRecursively() look

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227156#comment-16227156 ] Eugene Koifman commented on HIVE-17947: --- [~dvoros] since this checks all the files in a (bucketed)

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226933#comment-16226933 ] Eugene Koifman commented on HIVE-17947: --- [~ashutoshc], I think you told me that not using {noformat}

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.12.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.12.patch patch 12 should fix all the llap errors >

[jira] [Updated] (HIVE-17923) 'cluster by' should not be needed for a bucketed table

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17923: -- Description: given {noformat} CREATE TABLE over10k_orc_bucketed(t tinyint, si

[jira] [Updated] (HIVE-17923) 'cluster by' should not be needed for a bucketed table

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17923: -- Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-17458) > 'cluster by' should

[jira] [Assigned] (HIVE-16952) AcidUtils.parseBaseOrDeltaBucketFilename() end clause

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-16952: - Assignee: Eugene Koifman > AcidUtils.parseBaseOrDeltaBucketFilename() end clause >

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Issue Type: New Feature (was: Bug) > Support LOAD DATA for transactional tables >

[jira] [Assigned] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17900: - Assignee: (was: Eugene Koifman) > analyze stats on columns triggered by Compactor

[jira] [Updated] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17900: -- Affects Version/s: 1.0.0 > analyze stats on columns triggered by Compactor generates malformed

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.11.patch same as patch 10 > VectorizedOrcAcidRowBatchReader doesn't

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222604#comment-16222604 ] Eugene Koifman commented on HIVE-17458: --- [~sershe] could you review please >

[jira] [Assigned] (HIVE-17922) Enable runWorker() UDF to launch compactor from .q tests

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17922: - > Enable runWorker() UDF to launch compactor from .q tests >

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.10.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221467#comment-16221467 ] Eugene Koifman commented on HIVE-17458: --- HIVE-12631 is a prerequisite >

[jira] [Assigned] (HIVE-17916) remove ConfVars.HIVE_VECTORIZATION_ROW_IDENTIFIER_ENABLED

2017-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17916: - > remove ConfVars.HIVE_VECTORIZATION_ROW_IDENTIFIER_ENABLED >

[jira] [Updated] (HIVE-16722) Converting bucketed non-acid table to acid should perform validation

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16722: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-16722) Converting bucketed non-acid table to acid should perform validation

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16722: -- Attachment: HIVE-16722.04.patch patch 4 incorporates Alan's suggestion > Converting bucketed

[jira] [Commented] (HIVE-17482) External LLAP client: acquire locks for tables queried directly by LLAP

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219623#comment-16219623 ] Eugene Koifman commented on HIVE-17482: --- [~jdere] It occurred to me that this may lead to deadlocks.

[jira] [Commented] (HIVE-17695) collapse union all produced directories into delta directory name suffix for MM

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219592#comment-16219592 ] Eugene Koifman commented on HIVE-17695: --- This would also help AcidUtils.getAcidState(). It would

[jira] [Commented] (HIVE-17673) JavaUtils.extractTxnId() etc

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219574#comment-16219574 ] Eugene Koifman commented on HIVE-17673: --- AcidUtils.extractInsertOnlyTxnId(Path file) should probably

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219526#comment-16219526 ] Eugene Koifman commented on HIVE-17856: --- The general idea of how full Acid IOW works is given Insert

[jira] [Commented] (HIVE-17858) MM - some union cases are broken

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219499#comment-16219499 ] Eugene Koifman commented on HIVE-17858: --- +1 pending tests > MM - some union cases are broken >

[jira] [Commented] (HIVE-17748) ReplCopyTask doesn't support multi-file CopyWork

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219299#comment-16219299 ] Eugene Koifman commented on HIVE-17748: --- +1 > ReplCopyTask doesn't support multi-file CopyWork >

[jira] [Commented] (HIVE-17750) add a flag to automatically create most tables as MM

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219286#comment-16219286 ] Eugene Koifman commented on HIVE-17750: --- +1 > add a flag to automatically create most tables as MM

[jira] [Commented] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219113#comment-16219113 ] Eugene Koifman commented on HIVE-17900: --- Worker.StatsUpdater.gatherStats() is missing a "," when

[jira] [Assigned] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17900: - Assignee: Eugene Koifman > analyze stats on columns triggered by Compactor generates

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.09.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.08.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.07.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.07.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

<    13   14   15   16   17   18   19   20   21   22   >