[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.01.patch 01.patch is a prototype to enable _VectorizedOrcAcidRowBatchRead

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Status: Patch Available (was: Open) > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Status: Open (was: Patch Available) > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.02.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Commented] (HIVE-12631) LLAP IO: support ORC ACID tables

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211478#comment-16211478 ] Eugene Koifman commented on HIVE-12631: --- There is this code in UpdateDeleteSemanticA

[jira] [Assigned] (HIVE-17850) can VectorizedOrcAcidRowReader be removed once HIVE-17458 is done?

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17850: - > can VectorizedOrcAcidRowReader be removed once HIVE-17458 is done? > --

[jira] [Reopened] (HIVE-16850) Only open a new transaction when there's no currently opened transaction

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reopened HIVE-16850: --- it's not fixed - this code is still there > Only open a new transaction when there's no currently

[jira] [Commented] (HIVE-16850) Only open a new transaction when there's no currently opened transaction

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211715#comment-16211715 ] Eugene Koifman commented on HIVE-16850: --- yes, the point is that it should not. We c

[jira] [Commented] (HIVE-17698) FileSinkDesk.getMergeInputDirName() uses stmtId=0

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211718#comment-16211718 ] Eugene Koifman commented on HIVE-17698: --- +1 > FileSinkDesk.getMergeInputDirName() u

[jira] [Commented] (HIVE-17645) MM tables patch conflicts with HIVE-17482 (Spark/Acid integration)

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211844#comment-16211844 ] Eugene Koifman commented on HIVE-17645: --- Ask [~jdere] > MM tables patch conflicts w

[jira] [Updated] (HIVE-17854) LlapRecordReader should have getRowNumber() like org.apache.orc.RecordReader

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17854: -- Description: getRowNumber() is required to read data in non-acid tables that were converted to

[jira] [Updated] (HIVE-17854) LlapRecordReader should have getRowNumber() like org.apache.orc.RecordReader

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17854: -- Description: getRowNumber() is required to read data in non-acid tables that were converted to

[jira] [Commented] (HIVE-17645) MM tables patch conflicts with HIVE-17482 (Spark/Acid integration)

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211914#comment-16211914 ] Eugene Koifman commented on HIVE-17645: --- There is a single LM for the warehouse. Ha

[jira] [Commented] (HIVE-10378) Hive Update statement set keyword work with lower case only and doesn't give any error if wrong column name specified in the set clause.

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211976#comment-16211976 ] Eugene Koifman commented on HIVE-10378: --- [~osayankin] could you include a test with

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Status: Patch Available (was: Open) > VectorizedOrcAcidRowBatchReader doesn't handle 'original'

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.03.patch patch 3 - checkpoint can fully vectorized original file reads in

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.04.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213578#comment-16213578 ] Eugene Koifman commented on HIVE-17458: --- patch 4 adds support for delete events need

[jira] [Commented] (HIVE-17850) can VectorizedOrcAcidRowReader be removed once HIVE-17458 is done?

2017-10-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213579#comment-16213579 ] Eugene Koifman commented on HIVE-17850: --- OrcInputFormat uses this when the split is

[jira] [Commented] (HIVE-17850) can VectorizedOrcAcidRowReader be removed once HIVE-17458 is done?

2017-10-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213589#comment-16213589 ] Eugene Koifman commented on HIVE-17850: --- FileSplit is not OrcSplit > can Vectorized

[jira] [Commented] (HIVE-17850) can VectorizedOrcAcidRowReader be removed once HIVE-17458 is done?

2017-10-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213612#comment-16213612 ] Eugene Koifman commented on HIVE-17850: --- OrcInputFormat.getRecordReader() does some

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.05.patch patch 5 fixes some tests > VectorizedOrcAcidRowBatchReader does

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215870#comment-16215870 ] Eugene Koifman commented on HIVE-17458: --- On disabling LLAP cache {noformat} [2:07 P

[jira] [Comment Edited] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215870#comment-16215870 ] Eugene Koifman edited comment on HIVE-17458 at 10/23/17 9:23 PM: ---

[jira] [Updated] (HIVE-17878) create table like table doesn't preserve ACID properties

2017-10-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17878: -- Component/s: Transactions > create table like table doesn't preserve ACID properties > -

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.06.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Commented] (HIVE-17232) "No match found" Compactor finds a bucket file thinking it's a directory

2017-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217477#comment-16217477 ] Eugene Koifman commented on HIVE-17232: --- Some comments: 1. Table.java is a generated

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.07.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.07.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.08.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.09.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Assigned] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17900: - Assignee: Eugene Koifman > analyze stats on columns triggered by Compactor generates malf

[jira] [Commented] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219113#comment-16219113 ] Eugene Koifman commented on HIVE-17900: --- Worker.StatsUpdater.gatherStats() is missin

[jira] [Commented] (HIVE-17750) add a flag to automatically create most tables as MM

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219286#comment-16219286 ] Eugene Koifman commented on HIVE-17750: --- +1 > add a flag to automatically create mo

[jira] [Commented] (HIVE-17748) ReplCopyTask doesn't support multi-file CopyWork

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219299#comment-16219299 ] Eugene Koifman commented on HIVE-17748: --- +1 > ReplCopyTask doesn't support multi-fi

[jira] [Commented] (HIVE-17858) MM - some union cases are broken

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219499#comment-16219499 ] Eugene Koifman commented on HIVE-17858: --- +1 pending tests > MM - some union cases a

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219526#comment-16219526 ] Eugene Koifman commented on HIVE-17856: --- The general idea of how full Acid IOW works

[jira] [Commented] (HIVE-17673) JavaUtils.extractTxnId() etc

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219574#comment-16219574 ] Eugene Koifman commented on HIVE-17673: --- AcidUtils.extractInsertOnlyTxnId(Path file)

[jira] [Commented] (HIVE-17695) collapse union all produced directories into delta directory name suffix for MM

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219592#comment-16219592 ] Eugene Koifman commented on HIVE-17695: --- This would also help AcidUtils.getAcidState

[jira] [Commented] (HIVE-17482) External LLAP client: acquire locks for tables queried directly by LLAP

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219623#comment-16219623 ] Eugene Koifman commented on HIVE-17482: --- [~jdere] It occurred to me that this may le

[jira] [Updated] (HIVE-16722) Converting bucketed non-acid table to acid should perform validation

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16722: -- Attachment: HIVE-16722.04.patch patch 4 incorporates Alan's suggestion > Converting bucketed no

[jira] [Updated] (HIVE-16722) Converting bucketed non-acid table to acid should perform validation

2017-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16722: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Assigned] (HIVE-17916) remove ConfVars.HIVE_VECTORIZATION_ROW_IDENTIFIER_ENABLED

2017-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17916: - > remove ConfVars.HIVE_VECTORIZATION_ROW_IDENTIFIER_ENABLED > ---

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221467#comment-16221467 ] Eugene Koifman commented on HIVE-17458: --- HIVE-12631 is a prerequisite > VectorizedO

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.10.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Assigned] (HIVE-17922) Enable runWorker() UDF to launch compactor from .q tests

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17922: - > Enable runWorker() UDF to launch compactor from .q tests >

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222604#comment-16222604 ] Eugene Koifman commented on HIVE-17458: --- [~sershe] could you review please > Vector

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.11.patch same as patch 10 > VectorizedOrcAcidRowBatchReader doesn't hand

[jira] [Updated] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17900: -- Affects Version/s: 1.0.0 > analyze stats on columns triggered by Compactor generates malformed S

[jira] [Assigned] (HIVE-17900) analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17900: - Assignee: (was: Eugene Koifman) > analyze stats on columns triggered by Compactor gen

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17361: -- Issue Type: New Feature (was: Bug) > Support LOAD DATA for transactional tables > -

[jira] [Assigned] (HIVE-16952) AcidUtils.parseBaseOrDeltaBucketFilename() end clause

2017-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-16952: - Assignee: Eugene Koifman > AcidUtils.parseBaseOrDeltaBucketFilename() end clause > --

[jira] [Updated] (HIVE-17923) 'cluster by' should not be needed for a bucketed table

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17923: -- Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-17458) > 'cluster by' should not

[jira] [Updated] (HIVE-17923) 'cluster by' should not be needed for a bucketed table

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17923: -- Description: given {noformat} CREATE TABLE over10k_orc_bucketed(t tinyint, si smalli

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.12.patch patch 12 should fix all the llap errors > VectorizedOrcAcidRowB

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.12.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226933#comment-16226933 ] Eugene Koifman commented on HIVE-17947: --- [~ashutoshc], I think you told me that not

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227156#comment-16227156 ] Eugene Koifman commented on HIVE-17947: --- [~dvoros] since this checks all the files i

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227198#comment-16227198 ] Eugene Koifman commented on HIVE-17947: --- My $0.02 The other uses of listStatusRecurs

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227227#comment-16227227 ] Eugene Koifman commented on HIVE-17458: --- I'll make RB once I fix some of the issues

[jira] [Commented] (HIVE-16952) AcidUtils.parseBaseOrDeltaBucketFilename() end clause

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227674#comment-16227674 ] Eugene Koifman commented on HIVE-16952: --- note that Load Data can simply move files w

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.13.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227700#comment-16227700 ] Eugene Koifman commented on HIVE-17458: --- Patch 13 restores OrcSplit.canUseLlapIo() a

[jira] [Updated] (HIVE-16952) AcidUtils.parseBaseOrDeltaBucketFilename() end clause

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16952: -- Priority: Major (was: Minor) > AcidUtils.parseBaseOrDeltaBucketFilename() end clause >

[jira] [Assigned] (HIVE-17951) Clarify OrcSplit.hasBase() etc

2017-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17951: - > Clarify OrcSplit.hasBase() etc > -- > > Key: HI

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234135#comment-16234135 ] Eugene Koifman commented on HIVE-17458: --- patch14 for build (same as 13) > Vectorize

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.14.patch > VectorizedOrcAcidRowBatchReader doesn't handle 'original' file

[jira] [Commented] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234292#comment-16234292 ] Eugene Koifman commented on HIVE-17458: --- [~sershe] there is 1 minor related failure

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234451#comment-16234451 ] Eugene Koifman commented on HIVE-17947: --- Nit: It may be more efficient to check the

[jira] [Updated] (HIVE-17458) VectorizedOrcAcidRowBatchReader doesn't handle 'original' files

2017-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17458: -- Attachment: HIVE-17458.15.patch patch 15 fixes TestVectorizedOrcAcidRowBatchReader - test issue

[jira] [Commented] (HIVE-9731) WebHCat MapReduce Streaming Job does not allow StreamXmlRecordReader to be specified

2015-02-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335608#comment-14335608 ] Eugene Koifman commented on HIVE-9731: -- +1 for patch 2 > WebHCat MapReduce Streaming

[jira] [Commented] (HIVE-9086) Add language support to PURGE data while dropping partitions.

2015-02-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14336980#comment-14336980 ] Eugene Koifman commented on HIVE-9086: -- [~mithun], do you want me to check in the patc

[jira] [Updated] (HIVE-9675) Support START TRANSACTION/COMMIT/ROLLBACK commands

2015-03-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-9675: - Attachment: HIVE-9675.6.patch partial implementation; checkpoint to run full test suite > Support

[jira] [Commented] (HIVE-9977) Compactor not running on partitions after dynamic partitioned insert

2015-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369994#comment-14369994 ] Eugene Koifman commented on HIVE-9977: -- A few minor nits: TestTxnHandler - unsed impor

[jira] [Updated] (HIVE-9675) Support START TRANSACTION/COMMIT/ROLLBACK commands

2015-03-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-9675: - Attachment: HIVE-9675.7.patch fix streaming; fix to fix to lock manager to make it reentrant; updat

[jira] [Commented] (HIVE-9675) Support START TRANSACTION/COMMIT/ROLLBACK commands

2015-03-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371806#comment-14371806 ] Eugene Koifman commented on HIVE-9675: -- patch 7 also includes fix to ErrorMsgs.java wh

[jira] [Reopened] (HIVE-9486) Use session classloader instead of application loader

2015-03-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reopened HIVE-9486: -- [~navis], [~ashutoshc], this change broke webhcat. JavaUtils is not on the classpath of the Launche

[jira] [Updated] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-03-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10066: -- Description: >From [~hitesh]: "Tez is a client-side only component ( no daemons, etc ) and there

[jira] [Updated] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10066: -- Description: >From [~hitesh]: "Tez is a client-side only component ( no daemons, etc ) and there

[jira] [Updated] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10066: -- Component/s: WebHCat Tez > Hive on Tez job submission through WebHCat doesn't s

[jira] [Updated] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10066: -- Attachment: HIVE-10066.patch added a new property to webhcat config to specify additional artifa

[jira] [Commented] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382824#comment-14382824 ] Eugene Koifman commented on HIVE-10066: --- this is the way "hadoop jar -files /foo/bar

[jira] [Updated] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10066: -- Attachment: HIVE-10066.2.patch patch 2 addresses comments from [~thejas] > Hive on Tez job subm

[jira] [Updated] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-03-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10066: -- Attachment: HIVE-10066.3.patch > Hive on Tez job submission through WebHCat doesn't ship Tez art

[jira] [Commented] (HIVE-9272) Tests for utf-8 support

2015-03-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14384513#comment-14384513 ] Eugene Koifman commented on HIVE-9272: -- [~asreekumar], renaming files after checkout i

[jira] [Commented] (HIVE-10050) Support overriding memory configuration for AM launched for TempletonControllerJob

2015-03-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14384850#comment-14384850 ] Eugene Koifman commented on HIVE-10050: --- +1 > Support overriding memory configurati

[jira] [Commented] (HIVE-5113) webhcat should allow configuring memory used by templetoncontroller map job in hadoop2

2015-03-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387129#comment-14387129 ] Eugene Koifman commented on HIVE-5113: -- looks like this has been superseded by HIVE-10

[jira] [Assigned] (HIVE-10147) ACID tables and BucketizedHiveInputFormat clash

2015-03-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-10147: - Assignee: Eugene Koifman > ACID tables and BucketizedHiveInputFormat clash >

[jira] [Updated] (HIVE-10150) delete from acidTbl where a in(select a from nonAcidOrcTbl) fails

2015-03-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10150: -- Description: this query raises an error "10297,FAILED: SemanticException [Error 10297]: Attempt

[jira] [Assigned] (HIVE-8323) Ensure "transactional" tbl property can only be set on tables using AcidOutputFormat

2015-03-30 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-8323: Assignee: Eugene Koifman > Ensure "transactional" tbl property can only be set on tables usi

[jira] [Updated] (HIVE-10151) insert into A select from B is broken when both A and B are Acid tables and bucketed the same way

2015-03-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10151: -- Summary: insert into A select from B is broken when both A and B are Acid tables and bucketed th

[jira] [Updated] (HIVE-10148) update of bucking column should not be allowed

2015-03-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10148: -- Description: update tbl set a = 5; should raise an error if 'a' is a bucketing column. Such oper

[jira] [Updated] (HIVE-10148) update of bucking column should not be allowed

2015-03-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10148: -- Attachment: HIVE-10148.patch > update of bucking column should not be allowed >

[jira] [Updated] (HIVE-10152) ErrorMsg.formatToErrorMsgMap has bad regex

2015-03-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10152: -- Attachment: HIVE-10152.patch > ErrorMsg.formatToErrorMsgMap has bad regex >

[jira] [Updated] (HIVE-10150) delete from acidTbl where a in(select a from nonAcidOrcTbl) fails

2015-03-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10150: -- Attachment: HIVE-10050.patch > delete from acidTbl where a in(select a from nonAcidOrcTbl) fails

[jira] [Commented] (HIVE-10152) ErrorMsg.formatToErrorMsgMap has bad regex

2015-04-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391305#comment-14391305 ] Eugene Koifman commented on HIVE-10152: --- the failure is unrelated. ran the test loc

[jira] [Updated] (HIVE-10148) update of bucking column should not be allowed

2015-04-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10148: -- Attachment: HIVE-10148.2.patch [~alangates], new patch fixes the tests and adds a negative one.

[jira] [Commented] (HIVE-10148) update of bucking column should not be allowed

2015-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392903#comment-14392903 ] Eugene Koifman commented on HIVE-10148: --- I don't think these failures a related to t

[jira] [Updated] (HIVE-10148) update of bucking column should not be allowed

2015-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10148: -- Attachment: HIVE-10148.3.patch > update of bucking column should not be allowed > --

[jira] [Commented] (HIVE-10200) Add lockId to all ACID log statements

2015-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393370#comment-14393370 ] Eugene Koifman commented on HIVE-10200: --- [~leftylev], That's because it's really, re

<    1   2   3   4   5   6   7   8   9   10   >