[ 
https://issues.apache.org/jira/browse/IGNITE-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505850#comment-16505850
 ] 

ASF GitHub Bot commented on IGNITE-8661:
----------------------------------------

GitHub user DmitriyGovorukhin opened a pull request:

    https://github.com/apache/ignite/pull/4155

    IGNITE-8661 WALItreater is not stopped if can not deserialize record

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gridgain/apache-ignite ignite-8661

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/ignite/pull/4155.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4155
    
----
commit e57074824be2e114c8d8607f43f66c028a06d860
Author: Dmitriy Govorukhin <dmitriy.govorukhin@...>
Date:   2018-06-01T11:53:48Z

    IGNITE-8661 add IteratorParametersBuilder + refactoring

commit fc63c038e15dd49e7114fad0083af2c0e90e2b98
Author: Dmitriy Govorukhin <dmitriy.govorukhin@...>
Date:   2018-06-01T13:13:57Z

    IGNITE-8661  refactoring

commit 667fea64a99c2dcc4ad9c173a96f2d345fafffc2
Author: Dmitriy Govorukhin <dmitriy.govorukhin@...>
Date:   2018-06-07T11:10:27Z

    IGNITE-8661

commit d64289500c21db130416de2e094a06a44486f2d1
Author: Dmitriy Govorukhin <dmitriy.govorukhin@...>
Date:   2018-06-07T16:51:51Z

    IGNITE-8661 wip

commit 2706b2bc6cb008c3f921c2b1ba33a9aca18ab412
Author: Dmitriy Govorukhin <dmitriy.govorukhin@...>
Date:   2018-06-08T09:18:02Z

    Merge branch 'master' into ignite-8661

----


> WALItreater is not stopped if can not deserialize record 
> ---------------------------------------------------------
>
>                 Key: IGNITE-8661
>                 URL: https://issues.apache.org/jira/browse/IGNITE-8661
>             Project: Ignite
>          Issue Type: Bug
>            Reporter: Dmitriy Govorukhin
>            Assignee: Dmitriy Govorukhin
>            Priority: Major
>             Fix For: 2.6
>
>
> Currently, we have the following code in RecordV1Serializer.readWithCrc:
> {code:java}
> static WALRecord readWithCrc(.....) throws EOFException, 
> IgniteCheckedException {
>   
>     try (FileInput.Crc32CheckingFileInput in = in0.startRead(skipCrc)) {
>       ..... 
>     }
>     catch (EOFException | SegmentEofException | 
> WalSegmentTailReachedException e) {
>         throw e;
>     }
>     catch (Exception e) {
>         throw new IgniteCheckedException("Failed to read WAL record at 
> position: " + startPos, e);
>     }
> }
> {code}
> So, any runtime error will be remapped to IgniteCheckedException, which will 
> lead to iterator stop due to the following code:
> AbstractWalRecordsIterator.advanceRecord:
> {code}
>    try {
>          ......
>         }
>         catch (IOException | IgniteCheckedException e) {
>             if (e instanceof WalSegmentTailReachedException)
>                 throw (WalSegmentTailReachedException)e;
>             if (!(e instanceof SegmentEofException))
>                 handleRecordException(e, actualFilePtr);
>             return null;
>         }
> {code}
> Any IgniteCheckedException will be ignored and iterator goes ahead to the 
> next segment. 
> I suggest to make the following changes:
> 1) It is unexpected behavior, need to fix it. We should only stop iteration 
> on known exceptions
> 2) Also, need to provide ability skip records by type or some pointer for the 
> StandaloneWalRecordsIterator



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to