[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-13 Thread Todd Lipcon (Code Review)
Todd Lipcon has submitted this change and it was merged. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..

IMPALA-8369 : Fix for tests failing with incompatible column changes

In Hive-3 the configuration for allowing users to make incompatible
column type changes was disabled by default. In Hive-2 this was allowed.
Some of the tests like data_errors/test_data_errors.py and
metadata/test_compute_stats.py make changes to column types which are
disallowed by HMS-3 by default. This change adds a configuration option
in hive-site.xml to allow making incompatible changes to column types so
that we can run the existing tests with HMS-3.

Also, in HMS-3 there are certain new event types (OPEN_TXN, COMMIT_TXN,
etc) which may not have dbname set. This breaks the assumption in the
code in EventProcessor which expects dbName_ to be not null at all
times. This patch also makes changes in the EventProcessor so that such
Ignored events do not fail precondition checks during event processing.

Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Reviewed-on: http://gerrit.cloudera.org:8080/13254
Reviewed-by: Todd Lipcon 
Tested-by: Impala Public Jenkins 
---
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M fe/src/test/resources/hive-site.xml.py
2 files changed, 9 insertions(+), 2 deletions(-)

Approvals:
  Todd Lipcon: Looks good to me, approved
  Impala Public Jenkins: Verified

--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 7
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-13 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 6: Verified+1


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 6
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Mon, 13 May 2019 22:42:37 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-13 Thread Todd Lipcon (Code Review)
Todd Lipcon has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 6: Code-Review+2


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 6
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Mon, 13 May 2019 17:05:08 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-13 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 6:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/4236/ 
DRY_RUN=true


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 6
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Mon, 13 May 2019 17:05:45 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-10 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 6:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/3183/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 6
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Fri, 10 May 2019 22:52:15 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-10 Thread Vihang Karajgaonkar (Code Review)
Vihang Karajgaonkar has uploaded a new patch set (#6). ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..

IMPALA-8369 : Fix for tests failing with incompatible column changes

In Hive-3 the configuration for allowing users to make incompatible
column type changes was disabled by default. In Hive-2 this was allowed.
Some of the tests like data_errors/test_data_errors.py and
metadata/test_compute_stats.py make changes to column types which are
disallowed by HMS-3 by default. This change adds a configuration option
in hive-site.xml to allow making incompatible changes to column types so
that we can run the existing tests with HMS-3.

Also, in HMS-3 there are certain new event types (OPEN_TXN, COMMIT_TXN,
etc) which may not have dbname set. This breaks the assumption in the
code in EventProcessor which expects dbName_ to be not null at all
times. This patch also makes changes in the EventProcessor so that such
Ignored events do not fail precondition checks during event processing.

Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
---
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M fe/src/test/resources/hive-site.xml.py
2 files changed, 9 insertions(+), 2 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/54/13254/6
--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 6
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-10 Thread Vihang Karajgaonkar (Code Review)
Vihang Karajgaonkar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 5:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/13254/5/fe/src/test/resources/hive-site.xml.py
File fe/src/test/resources/hive-site.xml.py:

http://gerrit.cloudera.org:8080/#/c/13254/5/fe/src/test/resources/hive-site.xml.py@91
PS5, Line 91: })
:   })
> Closing parens twice
thanks for catching this. Fixed.



--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 5
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Fri, 10 May 2019 21:06:33 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-10 Thread Joe McDonnell (Code Review)
Joe McDonnell has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 5:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/13254/5/fe/src/test/resources/hive-site.xml.py
File fe/src/test/resources/hive-site.xml.py:

http://gerrit.cloudera.org:8080/#/c/13254/5/fe/src/test/resources/hive-site.xml.py@91
PS5, Line 91: })
:   })
Closing parens twice



--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 5
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Fri, 10 May 2019 20:00:05 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-10 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 5:

Build Failed

https://jenkins.impala.io/job/gerrit-code-review-checks/3175/ : Initial code 
review checks failed. See linked job for details on the failure.


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 5
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Fri, 10 May 2019 19:40:38 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-10 Thread Vihang Karajgaonkar (Code Review)
Vihang Karajgaonkar has uploaded a new patch set (#5). ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..

IMPALA-8369 : Fix for tests failing with incompatible column changes

In Hive-3 the configuration for allowing users to make incompatible
column type changes was disabled by default. In Hive-2 this was allowed.
Some of the tests like data_errors/test_data_errors.py and
metadata/test_compute_stats.py make changes to column types which are
disallowed by HMS-3 by default. This change adds a configuration option
in hive-site.xml to allow making incompatible changes to column types so
that we can run the existing tests with HMS-3.

Also, in HMS-3 there are certain new event types (OPEN_TXN, COMMIT_TXN,
etc) which may not have dbname set. This breaks the assumption in the
code in EventProcessor which expects dbName_ to be not null at all
times. This patch also makes changes in the EventProcessor so that such
Ignored events do not fail precondition checks during event processing.

Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
---
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M fe/src/test/resources/hive-site.xml.py
2 files changed, 9 insertions(+), 2 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/54/13254/5
--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 5
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-10 Thread Vihang Karajgaonkar (Code Review)
Vihang Karajgaonkar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 4:

> Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/4171/

Not sure if this related to recent maven issues on the builds. The job says the 
following

ERROR: There were some failed jobs: 
[https://jenkins.impala.io/job/ubuntu-16.04-build-only/6887/]

but I am not able to access that link anymore. I will rebase the patch and 
retrigger the GVO


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 4
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Fri, 10 May 2019 18:44:19 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-07 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 3: Verified-1

Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/4171/


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 3
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Wed, 08 May 2019 00:15:29 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-07 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 3:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/3104/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 3
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Tue, 07 May 2019 18:54:05 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-07 Thread Todd Lipcon (Code Review)
Todd Lipcon has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 3: Code-Review+2


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 3
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Tue, 07 May 2019 18:11:53 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-07 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 3:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/4171/ 
DRY_RUN=false


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 3
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Tue, 07 May 2019 18:12:16 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-07 Thread Vihang Karajgaonkar (Code Review)
Vihang Karajgaonkar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 3:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/13254/2/fe/src/test/resources/hive-site.xml.py
File fe/src/test/resources/hive-site.xml.py:

http://gerrit.cloudera.org:8080/#/c/13254/2/fe/src/test/resources/hive-site.xml.py@85
PS2, Line 85:
> flake8: E501 line too long (92 > 90 characters)
Done



--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 3
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Reviewer: Vihang Karajgaonkar 
Gerrit-Comment-Date: Tue, 07 May 2019 18:06:41 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-07 Thread Vihang Karajgaonkar (Code Review)
Vihang Karajgaonkar has uploaded a new patch set (#3). ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..

IMPALA-8369 : Fix for tests failing with incompatible column changes

In Hive-3 the configuration for allowing users to make incompatible
column type changes was disabled by default. In Hive-2 this was allowed.
Some of the tests like data_errors/test_data_errors.py and
metadata/test_compute_stats.py make changes to column types which are
disallowed by HMS-3 by default. This change adds a configuration option
in hive-site.xml to allow making incompatible changes to column types so
that we can run the existing tests with HMS-3.

Also, in HMS-3 there are certain new event types (OPEN_TXN, COMMIT_TXN,
etc) which may not have dbname set. This breaks the assumption in the
code in EventProcessor which expects dbName_ to be not null at all
times. This patch also makes changes in the EventProcessor so that such
Ignored events do not fail precondition checks during event processing.

Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
---
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M fe/src/test/resources/hive-site.xml.py
2 files changed, 10 insertions(+), 3 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/54/13254/3
--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 3
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-07 Thread Todd Lipcon (Code Review)
Todd Lipcon has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 2: Code-Review+2


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 2
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Comment-Date: Tue, 07 May 2019 07:51:54 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-06 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 2:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/3095/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 2
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Comment-Date: Tue, 07 May 2019 01:37:26 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-06 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13254 )

Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/13254/2/fe/src/test/resources/hive-site.xml.py
File fe/src/test/resources/hive-site.xml.py:

http://gerrit.cloudera.org:8080/#/c/13254/2/fe/src/test/resources/hive-site.xml.py@85
PS2, Line 85: p
flake8: E501 line too long (92 > 90 characters)



--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 2
Gerrit-Owner: Vihang Karajgaonkar 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Todd Lipcon 
Gerrit-Comment-Date: Tue, 07 May 2019 00:52:48 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-8369 : Fix for tests failing with incompatible column changes

2019-05-06 Thread Vihang Karajgaonkar (Code Review)
Vihang Karajgaonkar has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/13254


Change subject: IMPALA-8369 : Fix for tests failing with incompatible column 
changes
..

IMPALA-8369 : Fix for tests failing with incompatible column changes

In Hive-3 the configuration for allowing users to make incompatible
column type changes was disabled by default. In Hive-2 this was allowed.
Some of the tests like data_errors/test_data_errors.py and
metadata/test_compute_stats.py make changes to column types which are
disallowed by HMS-3 by default. This change adds a configuration option
in hive-site.xml to allow making incompatible changes to column types so
that we can run the existing tests with HMS-3.

Also, in HMS-3 there are certain new event types (OPEN_TXN, COMMIT_TXN,
etc) which may not have dbname set. This breaks the assumption in the
code in EventProcessor which expects dbName_ to be not null at all
times. This patch also makes changes in the EventProcessor so that such
Ignored events do not fail precondition checks during event processing.

Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
---
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M fe/src/test/resources/hive-site.xml.py
2 files changed, 8 insertions(+), 3 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/54/13254/2
--
To view, visit http://gerrit.cloudera.org:8080/13254
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I488121f21d9b35d33dd003b2670bc0bbe1fee4b6
Gerrit-Change-Number: 13254
Gerrit-PatchSet: 2
Gerrit-Owner: Vihang Karajgaonkar