[
https://issues.apache.org/jira/browse/IMPALA-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722481#comment-17722481
]
Zhi Tang edited comment on IMPALA-12131 at 6/21/23 8:34 AM:
------------------------------------------------------------
For non-partitioned tables, if a write operation fails, all subsequent write
operations will also fail, and only invalidating the metadata of the table can
restore normal operation. When we perform concurrent writes on non-partitioned
tables, it is easy to trigger an exception as this:
"java.util.concurrent.ExecutionException: java.io.FileNotFoundException: File
does not exist ...”. As shown below:
!image-2023-06-21-15-46-07-774.png|width=592,height=307!
After the write fails, the partitionMap size of the non-partitioned table is 0.
This causes subsequent write operations to fail due to NoSuchElementException
when executing CatalogOpExecutor#updateCatalog() method.
was (Author: tangzhi):
For non-partitioned tables, if a write operation fails, all subsequent write
operations will also fail, and only invalidating the metadata of the table can
restore normal operation. When we perform concurrent writes on non-partitioned
tables, it is easy to trigger an exception as this:
"java.util.concurrent.ExecutionException: java.io.FileNotFoundException: File
does not exist ...”. As shown below:
!image-2023-06-21-15-46-07-774.png|width=592,height=307!
After the write fails, the partitionMap size of the non-partitioned table is 0.
This causes subsequent write operations to fail due to NoSuchElementException.
> Execute update catalog request failed cased by
> Exception:java.util.NoSuchElementException
> -----------------------------------------------------------------------------------------
>
> Key: IMPALA-12131
> URL: https://issues.apache.org/jira/browse/IMPALA-12131
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 4.1.2
> Reporter: Zhi Tang
> Assignee: Zhi Tang
> Priority: Major
> Attachments: image-2023-05-10-20-42-08-571.png,
> image-2023-06-21-15-46-07-774.png
>
>
> The overwrite query of non-partition table failed due to a failure to update
> catalog. This is the stack trace of the thread:
> !image-2023-05-10-20-42-08-571.png|width=568,height=175!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
