[jira] [Updated] (HIVE-18293) Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18293: -- Attachment: HIVE-18293.01.patch reattaching the same patch - build bot was restarted and lost th

[jira] [Assigned] (HIVE-18293) Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18293: - Assignee: Eugene Koifman (was: Johannes Alberti) > Hive is failing to compact tables con

[jira] [Updated] (HIVE-18293) Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18293: -- Status: Patch Available (was: Open) > Hive is failing to compact tables contained within a fold

[jira] [Assigned] (HIVE-18293) Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18293: - Assignee: Johannes Alberti (was: Eugene Koifman) > Hive is failing to compact tables con

[jira] [Updated] (HIVE-18317) Improve error messages in TransactionalValidationListerner

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18317: -- Summary: Improve error messages in TransactionalValidationListerner (was: Improve error message

[jira] [Updated] (HIVE-18317) Improve error messages in TransactionalValidationListerner

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18317: -- Attachment: HIVE-18317.03.patch > Improve error messages in TransactionalValidationListerner > -

[jira] [Commented] (HIVE-18316) HiveEndPoint should only work with full acid tables

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299323#comment-16299323 ] Eugene Koifman commented on HIVE-18316: --- no related failures [~sershe] could you rev

[jira] [Commented] (HIVE-18316) HiveEndPoint should only work with full acid tables

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299397#comment-16299397 ] Eugene Koifman commented on HIVE-18316: --- HiveEndPoint is what represents what partit

[jira] [Commented] (HIVE-18315) update tests use non-acid tables

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299400#comment-16299400 ] Eugene Koifman commented on HIVE-18315: --- no related failures [~jdere] could you revi

[jira] [Updated] (HIVE-18316) HiveEndPoint should only work with full acid tables

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18316: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-18317) Improve error messages in TransactionalValidationListerner

2017-12-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18317: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-18324) drop database failed for not empty tables, but acid table info in metastore is still deleted

2017-12-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18324: -- Component/s: Transactions > drop database failed for not empty tables, but acid table info in m

[jira] [Commented] (HIVE-18285) StatsTask uses a cached ql.metadata.Table object

2017-12-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16300971#comment-16300971 ] Eugene Koifman commented on HIVE-18285: --- this patch should not add any time to compi

[jira] [Updated] (HIVE-18221) test acid default

2017-12-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Status: Open (was: Patch Available) > test acid default > - > >

[jira] [Updated] (HIVE-18315) update tests use non-acid tables

2017-12-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18315: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-18288) merge/concat not supported on Acid table

2017-12-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18288: -- Summary: merge/concat not supported on Acid table (was: merge/concat not support on Acid table)

[jira] [Commented] (HIVE-13567) Enable auto-gather column stats by default

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301766#comment-16301766 ] Eugene Koifman commented on HIVE-13567: --- [~kgyrtkirk], I noticed that this patch exp

[jira] [Commented] (HIVE-18293) Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301797#comment-16301797 ] Eugene Koifman commented on HIVE-18293: --- failures are not related +1 > Hive is fail

[jira] [Updated] (HIVE-18221) test acid default

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Status: Patch Available (was: Open) > test acid default > - > >

[jira] [Updated] (HIVE-18221) test acid default

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.18.patch > test acid default > - > > Key:

[jira] [Commented] (HIVE-18294) add switch to make acid table the default

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301868#comment-16301868 ] Eugene Koifman commented on HIVE-18294: --- I would prefer to only have the prop in Met

[jira] [Updated] (HIVE-18293) Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18293: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-18294) add switch to make acid table the default

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18294: -- Attachment: HIVE-18294.05.patch > add switch to make acid table the default > --

[jira] [Commented] (HIVE-18294) add switch to make acid table the default

2017-12-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16302051#comment-16302051 ] Eugene Koifman commented on HIVE-18294: --- patch 5 removes the prop from HiveConf. >

[jira] [Assigned] (HIVE-18336) add Safe Mode

2017-12-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18336: - > add Safe Mode > - > > Key: HIVE-18336 > URL: ht

[jira] [Updated] (HIVE-18294) add switch to make acid table the default

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18294: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-13000) Hive returns useless parsing error

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308476#comment-16308476 ] Eugene Koifman commented on HIVE-13000: --- There need to be a patch attached that pass

[jira] [Commented] (HIVE-18354) Fix test TestAcidOnTez

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308504#comment-16308504 ] Eugene Koifman commented on HIVE-18354: --- it's not clear why stats would cause any ch

[jira] [Updated] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18353: -- Component/s: Transactions > CompactorMR should call jobclient.close() to trigger cleanup > -

[jira] [Commented] (HIVE-18348) Hive creates 4 different connection pools to metastore of different size

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308513#comment-16308513 ] Eugene Koifman commented on HIVE-18348: --- TxnHandler needs to use 2 pools otherwise i

[jira] [Commented] (HIVE-18348) Hive creates 4 different connection pools to metastore of different size

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308532#comment-16308532 ] Eugene Koifman commented on HIVE-18348: --- It does require 2 pools. connPoolMutex is u

[jira] [Updated] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18190: -- Attachment: HIVE-18190.05.patch > Consider looking at ORC file schema rather than using _metadat

[jira] [Commented] (HIVE-18336) add Safe Mode

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308654#comment-16308654 ] Eugene Koifman commented on HIVE-18336: --- It would be useful to add optional validati

[jira] [Updated] (HIVE-18221) test acid default

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.19.patch > test acid default > - > > Key:

[jira] [Updated] (HIVE-17482) External LLAP client: acquire locks for tables queried directly by LLAP

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17482: -- Component/s: Transactions > External LLAP client: acquire locks for tables queried directly by L

[jira] [Updated] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18190: -- Attachment: HIVE-18190.06.patch > Consider looking at ORC file schema rather than using _metadat

[jira] [Updated] (HIVE-18221) test acid default

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.20.patch > test acid default > - > > Key:

[jira] [Updated] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18190: -- Attachment: HIVE-18190.07.patch > Consider looking at ORC file schema rather than using _metadat

[jira] [Commented] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309907#comment-16309907 ] Eugene Koifman commented on HIVE-18190: --- no related failures [~alangates] could you

[jira] [Updated] (HIVE-17683) Annotate Query Plan with locking information

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17683: -- Priority: Critical (was: Major) > Annotate Query Plan with locking information > --

[jira] [Commented] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310065#comment-16310065 ] Eugene Koifman commented on HIVE-18238: --- Why not make the Driver make clone of the p

[jira] [Comment Edited] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310065#comment-16310065 ] Eugene Koifman edited comment on HIVE-18238 at 1/3/18 6:53 PM: -

[jira] [Commented] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310209#comment-16310209 ] Eugene Koifman commented on HIVE-18238: --- [~stakiar] does Hive really support paralle

[jira] [Commented] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310235#comment-16310235 ] Eugene Koifman commented on HIVE-18238: --- in that case it may be better to explicitly

[jira] [Updated] (HIVE-18221) test acid default

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.21.patch > test acid default > - > > Key:

[jira] [Commented] (HIVE-18221) test acid default

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310257#comment-16310257 ] Eugene Koifman commented on HIVE-18221: --- patch 21 includes HIVE-18125 (temp WIP to r

[jira] [Commented] (HIVE-18238) Driver execution may not have configuration changing sideeffects

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310297#comment-16310297 ] Eugene Koifman commented on HIVE-18238: --- I think AcidUtils.CONF_ACID_KEY (hive.doing

[jira] [Updated] (HIVE-15077) Acid LockManager is unfair

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15077: -- Priority: Blocker (was: Major) > Acid LockManager is unfair > -- > >

[jira] [Commented] (HIVE-18221) test acid default

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310755#comment-16310755 ] Eugene Koifman commented on HIVE-18221: --- org.apache.hadoop.hive.cli.TestSparkCliDriv

[jira] [Updated] (HIVE-18221) test acid default

2018-01-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.22.patch > test acid default > - > > Key:

[jira] [Assigned] (HIVE-18377) avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tests

2018-01-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18377: - > avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tests >

[jira] [Updated] (HIVE-18221) test acid default

2018-01-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.23.patch > test acid default > - > > Key:

[jira] [Updated] (HIVE-18377) avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tests

2018-01-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18377: -- Attachment: HIVE-18377.02.patch > avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tes

[jira] [Updated] (HIVE-18377) avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tests

2018-01-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18377: -- Status: Patch Available (was: Open) > avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUni

[jira] [Commented] (HIVE-18377) avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tests

2018-01-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313819#comment-16313819 ] Eugene Koifman commented on HIVE-18377: --- This won't work because doing this also ena

[jira] [Updated] (HIVE-18221) test acid default

2018-01-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.24.patch > test acid default > - > > Key:

[jira] [Commented] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313970#comment-16313970 ] Eugene Koifman commented on HIVE-18353: --- LGTM > CompactorMR should call jobclient.c

[jira] [Comment Edited] (HIVE-18377) avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tests

2018-01-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313819#comment-16313819 ] Eugene Koifman edited comment on HIVE-18377 at 1/5/18 10:17 PM:

[jira] [Updated] (HIVE-18388) LLAP RecordReader may fail for ACID scan if included cols is null

2018-01-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18388: -- Component/s: Transactions > LLAP RecordReader may fail for ACID scan if included cols is null >

[jira] [Commented] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16314798#comment-16314798 ] Eugene Koifman commented on HIVE-18379: --- [~steveyeom2017] could you fix the checksty

[jira] [Commented] (HIVE-18380) ALTER TABLE CONCATENATE is not supported on Micro-managed table

2018-01-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317481#comment-16317481 ] Eugene Koifman commented on HIVE-18380: --- I think concatenating/compacting contiguous

[jira] [Updated] (HIVE-18221) test acid default

2018-01-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.26.patch patch 26 fixes (hacks) MetastoreConf so that it agrees with Hive

[jira] [Updated] (HIVE-18412) FileSinkOperator thows NullPointerException

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18412: -- Component/s: Transactions > FileSinkOperator thows NullPointerException > -

[jira] [Commented] (HIVE-18412) FileSinkOperator thows NullPointerException

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318784#comment-16318784 ] Eugene Koifman commented on HIVE-18412: --- [~bbonnet] do you have repro query? > File

[jira] [Commented] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318820#comment-16318820 ] Eugene Koifman commented on HIVE-18399: --- +1 > load data should rename files consist

[jira] [Commented] (HIVE-18400) load data should rename files consistent with insert statements (bucketed tables only) Part2

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318829#comment-16318829 ] Eugene Koifman commented on HIVE-18400: --- this has a test failure. Is it related? >

[jira] [Updated] (HIVE-18412) FileSinkOperator thows NullPointerException

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18412: -- Description: Hi, while executing a query (DELETE with a join) on an ACID table, I get a NullPoi

[jira] [Reopened] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reopened HIVE-18399: --- The output has changed in some files, eg. auto_sortmerge_join_16.q.out, auto_sortmerge_join_16 pe

[jira] [Assigned] (HIVE-18419) CliDriver loads different hive-site.xml into HiveConf and MetastoreConf

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18419: - > CliDriver loads different hive-site.xml into HiveConf and MetastoreConf > -

[jira] [Updated] (HIVE-18419) CliDriver loads different hive-site.xml into HiveConf and MetastoreConf

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18419: -- Component/s: Standalone Metastore > CliDriver loads different hive-site.xml into HiveConf and Me

[jira] [Updated] (HIVE-18419) CliDriver loads different hive-site.xml into HiveConf and MetastoreConf

2018-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18419: -- Attachment: HIVE-18419.01.patch [~alangates] could you review please > CliDriver loads differen

[jira] [Updated] (HIVE-18424) insert overwrite with union all get incorrect result when execution is tez

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18424: -- Component/s: Query Processor > insert overwrite with union all get incorrect result when executi

[jira] [Commented] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16320678#comment-16320678 ] Eugene Koifman commented on HIVE-18399: --- patch 2 is only 7k vs patch 1 which is 367K

[jira] [Commented] (HIVE-18408) load data should rename files consistent with insert statements (bucketed tables only) Part10

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16320682#comment-16320682 ] Eugene Koifman commented on HIVE-18408: --- +1 pending tests > load data should rename

[jira] [Updated] (HIVE-18419) CliDriver loads different hive-site.xml into HiveConf and MetastoreConf

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18419: -- Status: Patch Available (was: Open) > CliDriver loads different hive-site.xml into HiveConf and

[jira] [Commented] (HIVE-18409) load data should rename files consistent with insert statements (bucketed tables only) Part11

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16320706#comment-16320706 ] Eugene Koifman commented on HIVE-18409: --- +1 pending tests > load data should rename

[jira] [Assigned] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18429: - > Compaction should handle a case when it produces no output > --

[jira] [Commented] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321094#comment-16321094 ] Eugene Koifman commented on HIVE-18399: --- +1 could you update the Description field

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- Description: Suppose we start with empty delta_8_8 and delta_9_9 and compaction runs. It will cu

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- Description: Suppose we start with empty delta_8_8 and delta_9_9 and compaction runs. It will cu

[jira] [Assigned] (HIVE-18432) make TestTxnNoBuckets run with metastore.create.as.acid

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18432: - > make TestTxnNoBuckets run with metastore.create.as.acid > -

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- Attachment: HIVE-18429.01.patch > Compaction should handle a case when it produces no output > -

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- Status: Patch Available (was: Open) > Compaction should handle a case when it produces no outpu

[jira] [Commented] (HIVE-18400) load data should rename files consistent with insert statements (bucketed tables only) Part2

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321333#comment-16321333 ] Eugene Koifman commented on HIVE-18400: --- +1 > load data should rename files consist

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- > Compaction should handle a case when it produces no output > -

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- Status: Open (was: Patch Available) > Compaction should handle a case when it produces no outpu

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- Attachment: HIVE-18429.02.patch > Compaction should handle a case when it produces no output > -

[jira] [Commented] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322674#comment-16322674 ] Eugene Koifman commented on HIVE-18429: --- no related failures [~prasanth_j] could you

[jira] [Commented] (HIVE-18419) CliDriver loads different hive-site.xml into HiveConf and MetastoreConf

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322856#comment-16322856 ] Eugene Koifman commented on HIVE-18419: --- looks related {noformat} java.lang.Assertio

[jira] [Updated] (HIVE-18444) when creating transactional table make sure location has no data

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18444: -- Description: if a user creates a new transactional table but sets a location to some place that

[jira] [Commented] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322932#comment-16322932 ] Eugene Koifman commented on HIVE-18379: --- +1 for patch 5 > ALTER TABLE authorization

[jira] [Commented] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322934#comment-16322934 ] Eugene Koifman commented on HIVE-18429: --- failures are not related > Compaction shou

[jira] [Updated] (HIVE-18377) avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUnit tests

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18377: -- Status: Open (was: Patch Available) > avoid explicitly setting HIVE_SUPPORT_CONCURRENCY in JUni

[jira] [Commented] (HIVE-18403) load data should rename files consistent with insert statements (bucketed tables only) Part5

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322953#comment-16322953 ] Eugene Koifman commented on HIVE-18403: --- it seems you renamed smbbucket_1.rc -> sm

[jira] [Updated] (HIVE-18190) Consider looking at ORC file schema rather than using _metadata_acid file

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18190: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18379: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323027#comment-16323027 ] Eugene Koifman commented on HIVE-18429: --- the idea is that a new delta_x_y is created

[jira] [Updated] (HIVE-18419) CliDriver loads different hive-site.xml into HiveConf and MetastoreConf

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18419: -- Attachment: HIVE-18419.02.patch > CliDriver loads different hive-site.xml into HiveConf and Meta

[jira] [Updated] (HIVE-18429) Compaction should handle a case when it produces no output

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18429: -- Attachment: HIVE-18429.03.patch > Compaction should handle a case when it produces no output > -

[jira] [Commented] (HIVE-18403) load data should rename files consistent with insert statements (bucketed tables only) Part5

2018-01-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323466#comment-16323466 ] Eugene Koifman commented on HIVE-18403: --- +1 > load data should rename files consist

<    6   7   8   9   10   11   12   13   14   15   >