[ 
https://issues.apache.org/jira/browse/OAK-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589757#comment-14589757
 ] 

Davide Giannella edited comment on OAK-2961 at 6/17/15 1:36 PM:
----------------------------------------------------------------

Applied the patch and the /:async conflict goes away. Anyway still
there're warnings which as of now don't know if they are something to
worry about or not.

{noformat}
14:21:53.983 [main] INFO  o.a.j.oak.jcr.AsyncConflictsIT - adding 10000 nodes
14:21:59.104 [oak-scheduled-executor-5] INFO  
o.a.j.o.p.i.l.LuceneIndexEditorContext - Loaded default Tika Config from 
classpath 
file:/Users/dgiannel/work/sources/apache/jackrabbit-oak/oak-lucene/target/classes/org/apache/jackrabbit/oak/plugins/index/lucene/tika-config.xml
14:21:59.661 [main] INFO  o.a.j.oak.jcr.AsyncConflictsIT - Nodes added.
14:21:59.662 [main] INFO  o.a.j.oak.jcr.AsyncConflictsIT - issuing re-index and 
wait for finish
14:21:59.974 [oak-scheduled-executor-5] DEBUG o.a.j.o.p.i.l.L.perf - Created 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 
83ms]
14:21:59.980 [oak-scheduled-executor-5] DEBUG o.a.j.o.p.i.l.L.perf - Closed 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 6ms]
14:21:59.980 [oak-scheduled-executor-5] DEBUG 
o.a.j.o.p.i.l.LuceneIndexEditorContext - Text extraction stats  0 (0 min, 0 
sec, 0 B)
14:22:05.387 [oak-scheduled-executor-3] DEBUG o.a.j.o.p.i.l.L.perf - Created 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 0ms]
14:22:05.389 [oak-scheduled-executor-3] DEBUG o.a.j.o.p.i.l.L.perf - Closed 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 1ms]
14:22:05.389 [oak-scheduled-executor-3] DEBUG 
o.a.j.o.p.i.l.LuceneIndexEditorContext - Text extraction stats  0 (0 min, 0 
sec, 0 B)
14:22:06.082 [oak-scheduled-executor-7] WARN  o.a.j.o.p.index.AsyncIndexUpdate 
- [async] Failed to retrieve previously indexed checkpoint r14e01aef4dd-0-1; 
re-running the initial index update
14:22:06.259 [oak-scheduled-executor-7] WARN  o.a.j.o.p.index.AsyncIndexUpdate 
- [async] Failed to retrieve previously indexed checkpoint r14e01aef4dd-0-1; 
re-running the initial index update
{noformat}

WARNs are not systematically. They happen something like 2 times over 5 runs.

[~alexparvulescu], [~chetanm] thoughts?

PS: created
https://github.com/davidegiannella/jackrabbit-oak/tree/OAK-2961 for
experimenting in case.





was (Author: edivad):
Applied the patch and the /:async conflict goes away. Anyway still
there're warnings which as of now don't know if they are something to
worry about or not.

{noformat}
14:21:53.983 [main] INFO  o.a.j.oak.jcr.AsyncConflictsIT - adding 10000 nodes
14:21:59.104 [oak-scheduled-executor-5] INFO  
o.a.j.o.p.i.l.LuceneIndexEditorContext - Loaded default Tika Config from 
classpath 
file:/Users/dgiannel/work/sources/apache/jackrabbit-oak/oak-lucene/target/classes/org/apache/jackrabbit/oak/plugins/index/lucene/tika-config.xml
14:21:59.661 [main] INFO  o.a.j.oak.jcr.AsyncConflictsIT - Nodes added.
14:21:59.662 [main] INFO  o.a.j.oak.jcr.AsyncConflictsIT - issuing re-index and 
wait for finish
14:21:59.974 [oak-scheduled-executor-5] DEBUG o.a.j.o.p.i.l.L.perf - Created 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 
83ms]
14:21:59.980 [oak-scheduled-executor-5] DEBUG o.a.j.o.p.i.l.L.perf - Closed 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 6ms]
14:21:59.980 [oak-scheduled-executor-5] DEBUG 
o.a.j.o.p.i.l.LuceneIndexEditorContext - Text extraction stats  0 (0 min, 0 
sec, 0 B)
14:22:05.387 [oak-scheduled-executor-3] DEBUG o.a.j.o.p.i.l.L.perf - Created 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 0ms]
14:22:05.389 [oak-scheduled-executor-3] DEBUG o.a.j.o.p.i.l.L.perf - Closed 
IndexWriter for directory Lucene Index : <No 'name' property defined> [took 1ms]
14:22:05.389 [oak-scheduled-executor-3] DEBUG 
o.a.j.o.p.i.l.LuceneIndexEditorContext - Text extraction stats  0 (0 min, 0 
sec, 0 B)
14:22:06.082 [oak-scheduled-executor-7] WARN  o.a.j.o.p.index.AsyncIndexUpdate 
- [async] Failed to retrieve previously indexed checkpoint r14e01aef4dd-0-1; 
re-running the initial index update
14:22:06.259 [oak-scheduled-executor-7] WARN  o.a.j.o.p.index.AsyncIndexUpdate 
- [async] Failed to retrieve previously indexed checkpoint r14e01aef4dd-0-1; 
re-running the initial index update
{noformat}

[~alexparvulescu], [~chetanm] thoughts?

PS: created
https://github.com/davidegiannella/jackrabbit-oak/tree/OAK-2961 for
experimenting in case.




> Async index fails with OakState0001: Unresolved conflicts in /:async
> --------------------------------------------------------------------
>
>                 Key: OAK-2961
>                 URL: https://issues.apache.org/jira/browse/OAK-2961
>             Project: Jackrabbit Oak
>          Issue Type: Bug
>          Components: mongomk, query
>    Affects Versions: 1.2.2, 1.0.14, 1.4
>            Reporter: Davide Giannella
>            Assignee: Davide Giannella
>              Labels: resilience
>             Fix For: 1.3.1, 1.2.3
>
>         Attachments: OAK-2961.patch
>
>
> When running on a mongo cluster, in case of high activity the async index 
> could fail with the following exception.
> Reproduced with LucenePropertyIndex.
> {noformat}
> 10:55:13.069 [oak-scheduled-executor-5] WARN  
> o.a.j.o.p.index.AsyncIndexUpdate - [async] The index update failed
> org.apache.jackrabbit.oak.api.CommitFailedException: OakState0001: Unresolved 
> conflicts in /:async
>       at 
> org.apache.jackrabbit.oak.plugins.commit.ConflictValidator.failOnMergeConflict(ConflictValidator.java:84)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.commit.ConflictValidator.propertyAdded(ConflictValidator.java:54)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.spi.commit.EditorDiff.propertyAdded(EditorDiff.java:82)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.memory.ModifiedNodeState.compareAgainstBaseState(ModifiedNodeState.java:378)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.memory.ModifiedNodeState.compareAgainstBaseState(ModifiedNodeState.java:400)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52) 
> ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.spi.commit.EditorHook.processCommit(EditorHook.java:55)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.spi.commit.CompositeHook.processCommit(CompositeHook.java:61)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$InMemory.merge(DocumentNodeStoreBranch.java:528)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.merge0(DocumentNodeStoreBranch.java:219)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.merge(DocumentNodeStoreBranch.java:171)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.document.DocumentRootBuilder.merge(DocumentRootBuilder.java:158)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.document.DocumentNodeStore.merge(DocumentNodeStore.java:1466)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.mergeWithConcurrencyCheck(AsyncIndexUpdate.java:467)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.access$4(AsyncIndexUpdate.java:445)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate$AsyncUpdateCallback.<init>(AsyncIndexUpdate.java:201)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.updateIndex(AsyncIndexUpdate.java:372)
>  ~[classes/:na]
>       at 
> org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:320)
>  ~[classes/:na]
>       at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 
> [na:1.7.0_60]
>       at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) 
> [na:1.7.0_60]
>       at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
>  [na:1.7.0_60]
>       at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>  [na:1.7.0_60]
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>  [na:1.7.0_60]
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>  [na:1.7.0_60]
>       at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to