[Impala-ASF-CR] IMPALA-12869: Shorten argument list to enable local catalog mode

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21443 )

Change subject: IMPALA-12869: Shorten argument list to enable local catalog mode
..


Patch Set 1:

(3 comments)

http://gerrit.cloudera.org:8080/#/c/21443/1/bin/start-impala-cluster.py
File bin/start-impala-cluster.py:

http://gerrit.cloudera.org:8080/#/c/21443/1/bin/start-impala-cluster.py@190
PS1, Line 190:
flake8: W291 trailing whitespace


http://gerrit.cloudera.org:8080/#/c/21443/1/bin/start-impala-cluster.py@190
PS1, Line 190: parser.add_option("--use_local_catalog", 
dest="use_local_catalog",
line has trailing whitespace


http://gerrit.cloudera.org:8080/#/c/21443/1/bin/start-impala-cluster.py@644
PS1, Line 644: )
flake8: E501 line too long (91 > 90 characters)



--
To view, visit http://gerrit.cloudera.org:8080/21443
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iab5f3613b39a8473ba1f6ab7cb2634d87b808142
Gerrit-Change-Number: 21443
Gerrit-PatchSet: 1
Gerrit-Owner: Anshula Jain 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Comment-Date: Mon, 20 May 2024 17:26:50 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-12869: Shorten argument list to enable local catalog mode

2024-05-20 Thread Anshula Jain (Code Review)
Anshula Jain has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/21443


Change subject: IMPALA-12869: Shorten argument list to enable local catalog mode
..

IMPALA-12869: Shorten argument list to enable local catalog mode

Currently, a longer command is used to enable local catalog mode
bin/start-impala-cluster.py --catalogd_args=--catalog_topic_mode=minimal 
--impalad_args=--use_local_catalog

With this JIRA we shorten the command to
bin/start-impala-cluster.py --use_local_catalog

Change-Id: Iab5f3613b39a8473ba1f6ab7cb2634d87b808142
---
M bin/start-impala-cluster.py
1 file changed, 27 insertions(+), 1 deletion(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/43/21443/1
--
To view, visit http://gerrit.cloudera.org:8080/21443
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Iab5f3613b39a8473ba1f6ab7cb2634d87b808142
Gerrit-Change-Number: 21443
Gerrit-PatchSet: 1
Gerrit-Owner: Anshula Jain 


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Sai Hemanth Gantasala (Code Review)
Hello Riza Suminto, Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/21437

to look at the new patch set (#2).

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..

IMPALA-12277: Fix NullPointerException for partitioned inserts when
EP is turned off

When event processor is turned off, inserting values into partitioned
table can lead to NullPointerException if the partition is deleted
outside impala (eg: HMS). Since event processor is turned off, impala
is unaware of the metadata changes to the table.

Currently in impala, we always reuse the metadata when reloading a
table. This can lead to data inconsistency issue especially in the case
of event processor being turned off. This patch address this issue by
reusing metadata only when event processor state is active. If it is
not, we should always fetch the latest metadata from HMS.

Testing:
- Verified manually that NullPointerException is avoided with this patch
- Added end-to-end tests to verify the above scenario.

Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
---
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
M fe/src/main/java/org/apache/impala/util/AcidUtils.java
M tests/custom_cluster/test_events_custom_configs.py
4 files changed, 26 insertions(+), 6 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/37/21437/2
--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 2
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 


[Impala-ASF-CR] IMPALA-12869: Shorten argument list to enable local catalog mode

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21443 )

Change subject: IMPALA-12869: Shorten argument list to enable local catalog mode
..


Patch Set 1:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/16188/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/21443
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iab5f3613b39a8473ba1f6ab7cb2634d87b808142
Gerrit-Change-Number: 21443
Gerrit-PatchSet: 1
Gerrit-Owner: Anshula Jain 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Comment-Date: Mon, 20 May 2024 17:49:40 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Sai Hemanth Gantasala (Code Review)
Hello Riza Suminto, Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/21437

to look at the new patch set (#3).

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..

IMPALA-12277: Fix NullPointerException for partitioned inserts when
EP is turned off

When event processor is turned off, inserting values into partitioned
table can lead to NullPointerException if the partition is deleted
outside impala (eg: HMS). Since event processor is turned off, impala
is unaware of the metadata changes to the table.

Currently in impala, we always reuse the metadata when reloading a
table. This can lead to data inconsistency issue especially in the case
of event processor being turned off. This patch address this issue by
reusing metadata only when event processor state is active. If it is
not, we should always fetch the latest metadata from HMS.

Testing:
- Verified manually that NullPointerException is avoided with this patch
- Added end-to-end tests to verify the above scenario.

Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
---
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
M fe/src/main/java/org/apache/impala/util/AcidUtils.java
M tests/custom_cluster/test_events_custom_configs.py
4 files changed, 23 insertions(+), 5 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/37/21437/3
--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 3
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Sai Hemanth Gantasala (Code Review)
Hello Riza Suminto, Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/21437

to look at the new patch set (#4).

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..

IMPALA-12277: Fix NullPointerException for partitioned inserts when
EP is turned off

When event processor is turned off, inserting values into partitioned
table can lead to NullPointerException if the partition is deleted
outside impala (eg: HMS). Since event processor is turned off, impala
is unaware of the metadata changes to the table.

Currently in impala, we always reuse the metadata when reloading a
table. This can lead to data inconsistency issue especially in the case
of event processor being turned off. This patch address this issue by
reusing metadata only when event processor state is active. If it is
not, we should always fetch the latest metadata from HMS.

Testing:
- Verified manually that NullPointerException is avoided with this patch
- Added end-to-end tests to verify the above scenario.

Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
---
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/util/AcidUtils.java
M tests/custom_cluster/test_events_custom_configs.py
3 files changed, 21 insertions(+), 4 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/37/21437/4
--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 4
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Sai Hemanth Gantasala (Code Review)
Sai Hemanth Gantasala has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 4:

(3 comments)

http://gerrit.cloudera.org:8080/#/c/21437/1//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/21437/1//COMMIT_MSG@11
PS1, Line 11: NullPointerException
> What is the source of NPE? Where does it hit / manifest problem?
Jira has more details about this. But to explain this in simple terms, with the 
event processor turned off, create a partitioned table from Impala and add 
partition (p=1) by inserting some values, at this point drop the partition 
(p=1) from the hive and insert some values into a partition(p=1), then we would 
hit NULL pointer exception because,

we are reusing metadata while reloading the table, catalogd first removes it 
since it doesn't exist in HMS (fetch partitions from HMS) and then it validates 
each partition in the cache against the partitions from HMS, we would then hit 
precondition check for non-null partition names here: 
https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java#L1777


http://gerrit.cloudera.org:8080/#/c/21437/1/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
File fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java:

http://gerrit.cloudera.org:8080/#/c/21437/1/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java@1748
PS1, Line 1748:
> Do you mean "not active or not healthy." ?
Discard this change. This is not completely addressing the concern.
I have uploaded a new patchset.


http://gerrit.cloudera.org:8080/#/c/21437/1/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java@1751
PS1, Line 1751:debugAction, partitionToEventId, reason, catalogTimeline);
> This line remains unchanged for a long time since Fri Dec 18 14:31:24 (IMPA
Same as above



--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 4
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Mon, 20 May 2024 17:53:20 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-12637: Processing CREATE TABLE event for an unloaded db shouldn't put EP into error state

2024-05-20 Thread Sai Hemanth Gantasala (Code Review)
Sai Hemanth Gantasala has abandoned this change. ( 
http://gerrit.cloudera.org:8080/21428 )

Change subject: IMPALA-12637: Processing CREATE_TABLE event for an unloaded db 
shouldn't put EP into error state
..


Abandoned

This issue is fully addressed via IMPALA-11735
--
To view, visit http://gerrit.cloudera.org:8080/21428
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: abandon
Gerrit-Change-Id: I7d2f92a8d8c464cac64c7e132e276ba17105b3ea
Gerrit-Change-Number: 21428
Gerrit-PatchSet: 1
Gerrit-Owner: Sai Hemanth Gantasala 


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 2:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/16189/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 2
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Mon, 20 May 2024 18:00:26 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 3:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/16190/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 3
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Mon, 20 May 2024 18:18:50 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 4:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/16191/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 4
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Mon, 20 May 2024 18:19:26 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-13091: query test.test iceberg.TestIcebergV2Table.test metadata tables fails on an expected constant

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21440 )

Change subject: IMPALA-13091: 
query_test.test_iceberg.TestIcebergV2Table.test_metadata_tables fails on an 
expected constant
..


Patch Set 1:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/10651/ 
DRY_RUN=true


--
To view, visit http://gerrit.cloudera.org:8080/21440
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ic056079eed87a68afa95cd111ce2037314cd9620
Gerrit-Change-Number: 21440
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Becker 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Laszlo Gaal 
Gerrit-Reviewer: Peter Rozsa 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 18:42:02 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Riza Suminto (Code Review)
Riza Suminto has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 4:

(6 comments)

http://gerrit.cloudera.org:8080/#/c/21437/1//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/21437/1//COMMIT_MSG@11
PS1, Line 11: NullPointerException
> Jira has more details about this. But to explain this in simple terms, with
Thanks for your explanation.

Please describe those scenario in this commit message as short bullet points. I 
think the transactional property should also be highlighted?


http://gerrit.cloudera.org:8080/#/c/21437/4/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
File fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java:

http://gerrit.cloudera.org:8080/#/c/21437/4/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java@2472
PS4, Line 2472: 
!AcidUtils.isTransactionalTable(tbl.getMetaStoreTable().getParameters( &&
  :   isEventProcessingActive()
nit: I think checking isEventProcessingActive() first is better here.


http://gerrit.cloudera.org:8080/#/c/21437/1/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
File fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java:

http://gerrit.cloudera.org:8080/#/c/21437/1/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java@1748
PS1, Line 1748:
> Discard this change. This is not completely addressing the concern.
Done


http://gerrit.cloudera.org:8080/#/c/21437/1/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java@1751
PS1, Line 1751:debugAction, partitionToEventId, reason, catalogTimeline);
> Same as above
Done


http://gerrit.cloudera.org:8080/#/c/21437/4/fe/src/main/java/org/apache/impala/util/AcidUtils.java
File fe/src/main/java/org/apache/impala/util/AcidUtils.java:

http://gerrit.cloudera.org:8080/#/c/21437/4/fe/src/main/java/org/apache/impala/util/AcidUtils.java@679
PS4, Line 679: If the tbl metadata is a
 :* superset of the metadata view represented by the given 
validWriteIdList this
 :* method returns a value greater than 0. If they are an exact 
match of each other,
 :* it returns 0 and if the table ValidWriteIdList is behind 
the provided
 :* validWriteIdList this return -1.
nit: update this comment with the new transactional property check.


http://gerrit.cloudera.org:8080/#/c/21437/4/tests/custom_cluster/test_events_custom_configs.py
File tests/custom_cluster/test_events_custom_configs.py:

http://gerrit.cloudera.org:8080/#/c/21437/4/tests/custom_cluster/test_events_custom_configs.py@1266
PS4, Line 1266: test_no_ep_metadata_reload_for_insert
Can you test the same scenario over transactional table? Or is there an 
existing test that already does that?



--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 4
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Mon, 20 May 2024 18:38:33 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-13076 Add pstack and jstack to Impala Redhat docker images

2024-05-20 Thread Joe McDonnell (Code Review)
Joe McDonnell has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21433 )

Change subject: IMPALA-13076 Add pstack and jstack to Impala Redhat docker 
images
..


Patch Set 1:

It makes sense to include gdb/jstack for debugging.

I can live with always including them. A more configurable approach would be to 
have them included with the section about debug tools. We could provide a 
configuration to specify that release docker images should include debug tools. 
We could file a follow-up JIRA for that (and one for doing something similar 
for Ubuntu).


--
To view, visit http://gerrit.cloudera.org:8080/21433
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I25e6827b86564a9c0fc25678e4a194ee8e0be0e9
Gerrit-Change-Number: 21433
Gerrit-PatchSet: 1
Gerrit-Owner: Andrew Sherman 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Mon, 20 May 2024 20:43:28 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for release builds

2024-05-20 Thread Riza Suminto (Code Review)
Riza Suminto has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21444 )

Change subject: IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for 
release builds
..


Patch Set 1:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/21444/1/fe/src/main/java/org/apache/impala/analysis/ExprSubstitutionMap.java
File fe/src/main/java/org/apache/impala/analysis/ExprSubstitutionMap.java:

http://gerrit.cloudera.org:8080/#/c/21444/1/fe/src/main/java/org/apache/impala/analysis/ExprSubstitutionMap.java@178
PS1, Line 178: private void verify() {
What if we move the check inside the verify() method?

if (!BackendConfig.INSTANCE.isReleaseBuild()) return;



--
To view, visit http://gerrit.cloudera.org:8080/21444
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ieeacfec6a5b487076ce5b19747319630616411f0
Gerrit-Change-Number: 21444
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 21:53:03 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-13083: Clarify REASON MEM LIMIT TOO LOW FOR RESERVATION

2024-05-20 Thread Riza Suminto (Code Review)
Hello Andrew Sherman, Abhishek Rawat, Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/21436

to look at the new patch set (#2).

Change subject: IMPALA-13083: Clarify REASON_MEM_LIMIT_TOO_LOW_FOR_RESERVATION
..

IMPALA-13083: Clarify REASON_MEM_LIMIT_TOO_LOW_FOR_RESERVATION

This patch improves REASON_MEM_LIMIT_TOO_LOW_FOR_RESERVATION error
message by saying the specific configuration that must be adjusted such
that the query can pass the Admission Control. New fields
'per_backend_mem_to_admit_source' and
'coord_backend_mem_to_admit_source' of type MemLimitSourcePB are added
into QuerySchedulePB. These fields explain what limiting factor drives
final numbers at 'per_backend_mem_to_admit' and
'coord_backend_mem_to_admit' respectively. In turn, Admission Control
will use this information to compose a more informative error message
that the user can act upon. The new error message pattern also
explicitly mentions "Per Host Min Memory Reservation" as a place to look
at to investigate memory reservations scheduled for each backend node.

Updated documentation with examples of query rejection by Admission
Control and how to read the error message.

Testing:
- Add BE tests at admission-controller-test.cc
- Adjust and pass affected EE tests

Change-Id: I1ef7fb7e7a194b2036c2948639a06c392590bf66
---
M be/src/scheduling/admission-controller-test.cc
M be/src/scheduling/admission-controller.cc
M be/src/scheduling/schedule-state.cc
M be/src/scheduling/schedule-state.h
M be/src/scheduling/scheduler.cc
M be/src/scheduling/scheduler.h
M common/protobuf/admission_control_service.proto
M docs/topics/impala_admission.xml
M docs/topics/impala_mem_limit.xml
M 
testdata/workloads/functional-query/queries/QueryTest/admission-max-min-mem-limits.test
M 
testdata/workloads/functional-query/queries/QueryTest/admission-reject-min-reservation.test
M 
testdata/workloads/functional-query/queries/QueryTest/runtime_row_filter_reservations.test
12 files changed, 689 insertions(+), 127 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/36/21436/2
-- 
To view, visit http://gerrit.cloudera.org:8080/21436
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1ef7fb7e7a194b2036c2948639a06c392590bf66
Gerrit-Change-Number: 21436
Gerrit-PatchSet: 2
Gerrit-Owner: Riza Suminto 
Gerrit-Reviewer: Abhishek Rawat 
Gerrit-Reviewer: Andrew Sherman 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 


[Impala-ASF-CR] IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for release builds

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21444 )

Change subject: IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for 
release builds
..


Patch Set 1:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/16192/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/21444
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ieeacfec6a5b487076ce5b19747319630616411f0
Gerrit-Change-Number: 21444
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 22:06:35 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-13083: Clarify REASON MEM LIMIT TOO LOW FOR RESERVATION

2024-05-20 Thread Riza Suminto (Code Review)
Riza Suminto has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21436 )

Change subject: IMPALA-13083: Clarify REASON_MEM_LIMIT_TOO_LOW_FOR_RESERVATION
..


Patch Set 2:

(15 comments)

http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller-test.cc
File be/src/scheduling/admission-controller-test.cc:

http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller-test.cc@422
PS1, Line 422: an
> Nit: and
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller-test.cc@443
PS1, Line 443: no
> Nit: nor
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller-test.cc@1281
PS1, Line 1281:
> Is this comment right as we don't call __set_clamp_mem_limit_query_option()
clamp_mem_limit_query_option actually default to True. I removed all 
pool_config.__set_clamp_mem_limit_query_option(true); and add test 
DedicatedCoordAdmissionDisabledPoolMemLimit and 
DedicatedCoordAdmissionIgnoreMemClamp where 
pool_config.__set_clamp_mem_limit_query_option(false).


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller-test.cc@1357
PS1, Line 1357:   string not_admitted_reason = "--not set--";
> Nit: add ASSERT_NE(nullptr, schedule_state);
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller-test.cc@1386
PS1, Line 1386:   pool_config.__set_min_query_mem_limit(MEGABYTE);
> Nit: add ASSERT_NE(nullptr, schedule_state);
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller.cc
File be/src/scheduling/admission-controller.cc:

http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller.cc@206
PS1, Line 206: in
> "in the" might be clearer
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller.cc@211
PS1, Line 211: in
> "in the" might be clearer
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/admission-controller.cc@220
PS1, Line 220: in
> "in the" might be clearer
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/schedule-state.h
File be/src/scheduling/schedule-state.h:

http://gerrit.cloudera.org:8080/#/c/21436/1/be/src/scheduling/schedule-state.h@375
PS1, Line 375:   /// Helper functions to update either
> Maybe have short comments for these functions.
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/common/protobuf/admission_control_service.proto
File common/protobuf/admission_control_service.proto:

http://gerrit.cloudera.org:8080/#/c/21436/1/common/protobuf/admission_control_service.proto@207
PS1, Line 207: coord_backend_mem_to_ad
> coord_backend_mem_to_admit?
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/docs/topics/impala_admission.xml
File docs/topics/impala_admission.xml:

http://gerrit.cloudera.org:8080/#/c/21436/1/docs/topics/impala_admission.xml@286
PS1, Line 286: is se
> Nit: "is set to"
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/docs/topics/impala_admission.xml@309
PS1, Line 309: recommend
> Nit: can you fix this to "recommend" while you are here?
Done


http://gerrit.cloudera.org:8080/#/c/21436/1/docs/topics/impala_admission.xml@336
PS1, Line 336: E
> There is some weird character between "MEM_LIMIT" and "query option"
Should be fixed.


http://gerrit.cloudera.org:8080/#/c/21436/1/docs/topics/impala_admission.xml@353
PS1, Line 353:
> Nit: another weird character here
Should be fixed.


http://gerrit.cloudera.org:8080/#/c/21436/1/docs/topics/impala_admission.xml@357
PS1, Line 357:  nodes.
> Nit: contains
Done.



--
To view, visit http://gerrit.cloudera.org:8080/21436
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I1ef7fb7e7a194b2036c2948639a06c392590bf66
Gerrit-Change-Number: 21436
Gerrit-PatchSet: 2
Gerrit-Owner: Riza Suminto 
Gerrit-Reviewer: Abhishek Rawat 
Gerrit-Reviewer: Andrew Sherman 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 22:12:19 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for release builds

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21444 )

Change subject: IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for 
release builds
..


Patch Set 2:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/10652/ 
DRY_RUN=true


--
To view, visit http://gerrit.cloudera.org:8080/21444
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ieeacfec6a5b487076ce5b19747319630616411f0
Gerrit-Change-Number: 21444
Gerrit-PatchSet: 2
Gerrit-Owner: Joe McDonnell 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 22:18:01 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for release builds

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21444 )

Change subject: IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for 
release builds
..


Patch Set 2:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/16193/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/21444
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ieeacfec6a5b487076ce5b19747319630616411f0
Gerrit-Change-Number: 21444
Gerrit-PatchSet: 2
Gerrit-Owner: Joe McDonnell 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 22:29:39 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-13091: query test.test iceberg.TestIcebergV2Table.test metadata tables fails on an expected constant

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21440 )

Change subject: IMPALA-13091: 
query_test.test_iceberg.TestIcebergV2Table.test_metadata_tables fails on an 
expected constant
..


Patch Set 1: Verified+1


--
To view, visit http://gerrit.cloudera.org:8080/21440
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ic056079eed87a68afa95cd111ce2037314cd9620
Gerrit-Change-Number: 21440
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Becker 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Laszlo Gaal 
Gerrit-Reviewer: Peter Rozsa 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 23:52:40 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-13091: query test.test iceberg.TestIcebergV2Table.test metadata tables fails on an expected constant

2024-05-20 Thread Riza Suminto (Code Review)
Riza Suminto has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21440 )

Change subject: IMPALA-13091: 
query_test.test_iceberg.TestIcebergV2Table.test_metadata_tables fails on an 
expected constant
..


Patch Set 1: Code-Review+2

(1 comment)

http://gerrit.cloudera.org:8080/#/c/21440/1//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/21440/1//COMMIT_MSG@16
PS1, Line 16: problematic values
> Specifically mention which values are problematic. Is it just "column_size"
It seems to be the case. Marked this as Resolved.



--
To view, visit http://gerrit.cloudera.org:8080/21440
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ic056079eed87a68afa95cd111ce2037314cd9620
Gerrit-Change-Number: 21440
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Becker 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Laszlo Gaal 
Gerrit-Reviewer: Peter Rozsa 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Mon, 20 May 2024 23:59:11 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Sai Hemanth Gantasala (Code Review)
Sai Hemanth Gantasala has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 4:

(3 comments)

http://gerrit.cloudera.org:8080/#/c/21437/1//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/21437/1//COMMIT_MSG@11
PS1, Line 11: NullPointerException
> Thanks for your explanation.
Ack. The issue happens with transactional tables as well.


http://gerrit.cloudera.org:8080/#/c/21437/4/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
File fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java:

http://gerrit.cloudera.org:8080/#/c/21437/4/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java@2472
PS4, Line 2472: 
!AcidUtils.isTransactionalTable(tbl.getMetaStoreTable().getParameters( &&
  :   isEventProcessingActive()
> nit: I think checking isEventProcessingActive() first is better here.
Ack


http://gerrit.cloudera.org:8080/#/c/21437/4/tests/custom_cluster/test_events_custom_configs.py
File tests/custom_cluster/test_events_custom_configs.py:

http://gerrit.cloudera.org:8080/#/c/21437/4/tests/custom_cluster/test_events_custom_configs.py@1266
PS4, Line 1266: test_no_ep_metadata_reload_for_insert
> Can you test the same scenario over transactional table? Or is there an exi
Good catch!! The issue happens with transactional tables as well.
Addressed it and modified the test to cover the transactional table scenario as 
well.



--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 4
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Tue, 21 May 2024 00:10:25 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Sai Hemanth Gantasala (Code Review)
Hello Riza Suminto, Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/21437

to look at the new patch set (#5).

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..

IMPALA-12277: Fix NullPointerException for partitioned inserts when
EP is turned off

When event processor is turned off, inserting values into partitioned
table can lead to NullPointerException if the partition is deleted
outside impala (eg: HMS). Since event processor is turned off, impala
is unaware of the metadata changes to the table.

Currently in impala, we always reuse the metadata when reloading a
table. This can lead to data inconsistency issue especially in the case
of event processor being turned off. This patch address this issue by
reusing metadata only when event processor state is active. If it is
not, we should always fetch the latest metadata from HMS.

The issue can be seen with the following steps:
- Turn off the event processor
- create a partitioned table and add a partition from impala
- drop the same partition from hive
- from impala, insert values into the partition (expectation is that
if the partition didn't exist, it will create a new one).

Testing:
- Verified manually that NullPointerException is avoided with this patch
- Added end-to-end tests to verify the above scenario for external and
manged tables.

Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
---
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/util/AcidUtils.java
M tests/custom_cluster/test_events_custom_configs.py
3 files changed, 26 insertions(+), 5 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/37/21437/5
--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 5
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 5:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/21437/5/tests/custom_cluster/test_events_custom_configs.py
File tests/custom_cluster/test_events_custom_configs.py:

http://gerrit.cloudera.org:8080/#/c/21437/5/tests/custom_cluster/test_events_custom_configs.py@1268
PS5, Line 1268: d
flake8: E306 expected 1 blank line before a nested definition, found 0



--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 5
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Tue, 21 May 2024 00:11:51 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-12277: Fix NullPointerException for partitioned inserts when EP is turned off

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21437 )

Change subject: IMPALA-12277: Fix NullPointerException for partitioned inserts 
when EP is turned off
..


Patch Set 5:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/16194/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/21437
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ide8f1f6bf017e9a040b53bb5d5291ff2ea3e0d18
Gerrit-Change-Number: 21437
Gerrit-PatchSet: 5
Gerrit-Owner: Sai Hemanth Gantasala 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Reviewer: Sai Hemanth Gantasala 
Gerrit-Comment-Date: Tue, 21 May 2024 00:35:32 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-12705: Add /catalog-ha-info page on Starstore to show catalog HA information

2024-05-20 Thread Wenzhe Zhou (Code Review)
Wenzhe Zhou has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21418 )

Change subject: IMPALA-12705: Add /catalog-ha-info page on Starstore to show 
catalog HA information
..


Patch Set 6:

(7 comments)

Thanks to add this enhancement for catalog HA.

http://gerrit.cloudera.org:8080/#/c/21418/6//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/21418/6//COMMIT_MSG@7
PS6, Line 7: Starstore
nit: typo statestore


http://gerrit.cloudera.org:8080/#/c/21418/6//COMMIT_MSG@9
PS6, Line 9: Starstor
typo statestore


http://gerrit.cloudera.org:8080/#/c/21418/6//COMMIT_MSG@11
PS6, Line 11: Subscribers
nit: wrap up long line


http://gerrit.cloudera.org:8080/#/c/21418/6//COMMIT_MSG@20
PS6, Line 20:
Should we add unit-test for this new page?


http://gerrit.cloudera.org:8080/#/c/21418/6/be/src/statestore/statestore.cc
File be/src/statestore/statestore.cc:

http://gerrit.cloudera.org:8080/#/c/21418/6/be/src/statestore/statestore.cc@652
PS6, Line 652:   catalogd_version_ = catalogd_version;
need to acquire lock before updating.


http://gerrit.cloudera.org:8080/#/c/21418/6/be/src/statestore/statestore.cc@2245
PS6, Line 2245: subscriber.second->subscriber_type() == 
TStatestoreSubscriberType::CATALOGD
  : || subscriber.second->IsCoordinator()
can replace with subscriber.second->IsSubscribedCatalogdChange()


http://gerrit.cloudera.org:8080/#/c/21418/6/common/thrift/StatestoreService.thrift
File common/thrift/StatestoreService.thrift:

http://gerrit.cloudera.org:8080/#/c/21418/6/common/thrift/StatestoreService.thrift@222
PS6, Line 222: registration_time_ms
This is timestamp, not time period. Name with appendix '_ms' sounds like 
period, i.e. 'time in milliseconds'.



--
To view, visit http://gerrit.cloudera.org:8080/21418
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: If85f6a827ae8180d13caac588b92af0511ac35e3
Gerrit-Change-Number: 21418
Gerrit-PatchSet: 6
Gerrit-Owner: ttz <2433038...@qq.com>
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Wenzhe Zhou 
Gerrit-Comment-Date: Tue, 21 May 2024 01:14:09 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for release builds

2024-05-20 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21444 )

Change subject: IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for 
release builds
..


Patch Set 2: Verified-1

Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/10652/


--
To view, visit http://gerrit.cloudera.org:8080/21444
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ieeacfec6a5b487076ce5b19747319630616411f0
Gerrit-Change-Number: 21444
Gerrit-PatchSet: 2
Gerrit-Owner: Joe McDonnell 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Reviewer: Riza Suminto 
Gerrit-Comment-Date: Tue, 21 May 2024 03:27:27 +
Gerrit-HasComments: No


[Impala-ASF-CR](branch-3.4.2) IMPALA-12362: (part-4/4) Refactor linux packaging related cmake files.

2024-05-20 Thread Zihao Ye (Code Review)
Zihao Ye has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21410 )

Change subject: IMPALA-12362: (part-4/4) Refactor linux packaging related cmake 
files.
..


Patch Set 1: Code-Review+2


--
To view, visit http://gerrit.cloudera.org:8080/21410
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: branch-3.4.2
Gerrit-MessageType: comment
Gerrit-Change-Id: If3914dcda69f81a735cdf70d76c59fa09454777b
Gerrit-Change-Number: 21410
Gerrit-PatchSet: 1
Gerrit-Owner: Quanlong Huang 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Quanlong Huang 
Gerrit-Reviewer: Xiang Yang 
Gerrit-Reviewer: Zihao Ye 
Gerrit-Comment-Date: Tue, 21 May 2024 06:12:45 +
Gerrit-HasComments: No