[ https://issues.apache.org/jira/browse/OAK-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827545#comment-13827545 ]
Chetan Mehrotra edited comment on OAK-1204 at 11/28/13 5:55 AM: ---------------------------------------------------------------- *Exception - E4* Occurs frequently. Being tracked with OAK-1233 {noformat} 2013-11-20 15:08:53,546 INFO NA [MongoNodeStore background thread] o.a.j.o.p.m.MongoNodeStore - Split operation on 1:/oak:index. Size before: 102794, after: 73686 2013-11-20 15:08:57,646 ERROR NA [pool-10-thread-4] o.a.s.c.s.impl.QuartzScheduler - Exception during job execution of org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate@5f4519b9 : com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na] at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diff(MongoMK.java:162) ~[na:na] at org.apache.jackrabbit.oak.kernel.KernelNodeState.compareAgainstBaseState(KernelNodeState.java:480) ~[na:na] at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52) ~[na:na] at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:103) ~[na:na] at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105) ~[org.apache.sling.commons.scheduler:2.4.2] at org.quartz.core.JobRunShell.run(JobRunShell.java:207) [org.apache.sling.commons.scheduler:2.4.2] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_40] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_40] at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40] Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na] at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.getNode(MongoNodeStore.java:484) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffFewChildren(MongoMK.java:308) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffImpl(MongoMK.java:224) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:165) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:162) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na] at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na] ... 11 common frames omitted Caused by: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.fetchNextIterator(MergeSortedIterators.java:96) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.next(MergeSortedIterators.java:78) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getLatestValue(NodeDocument.java:1028) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getNodeAtRevision(NodeDocument.java:450) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.readNode(MongoNodeStore.java:630) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.access$000(MongoNodeStore.java:76) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:487) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:484) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na] at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na] ... 23 common frames omitted {noformat} was (Author: chetanm): *Exception - E4* Only once {noformat} 2013-11-20 15:08:53,546 INFO NA [MongoNodeStore background thread] o.a.j.o.p.m.MongoNodeStore - Split operation on 1:/oak:index. Size before: 102794, after: 73686 2013-11-20 15:08:57,646 ERROR NA [pool-10-thread-4] o.a.s.c.s.impl.QuartzScheduler - Exception during job execution of org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate@5f4519b9 : com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na] at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diff(MongoMK.java:162) ~[na:na] at org.apache.jackrabbit.oak.kernel.KernelNodeState.compareAgainstBaseState(KernelNodeState.java:480) ~[na:na] at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52) ~[na:na] at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:103) ~[na:na] at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105) ~[org.apache.sling.commons.scheduler:2.4.2] at org.quartz.core.JobRunShell.run(JobRunShell.java:207) [org.apache.sling.commons.scheduler:2.4.2] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_40] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_40] at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40] Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na] at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.getNode(MongoNodeStore.java:484) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffFewChildren(MongoMK.java:308) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffImpl(MongoMK.java:224) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:165) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:162) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na] at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na] ... 11 common frames omitted Caused by: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.fetchNextIterator(MergeSortedIterators.java:96) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.next(MergeSortedIterators.java:78) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getLatestValue(NodeDocument.java:1028) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getNodeAtRevision(NodeDocument.java:450) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.readNode(MongoNodeStore.java:630) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.access$000(MongoNodeStore.java:76) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:487) ~[na:na] at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:484) ~[na:na] at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na] at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na] ... 23 common frames omitted {noformat} > Analyze behaviour while running Oak cluster on Mongo > ---------------------------------------------------- > > Key: OAK-1204 > URL: https://issues.apache.org/jira/browse/OAK-1204 > Project: Jackrabbit Oak > Issue Type: Task > Components: mongomk > Reporter: Chetan Mehrotra > Assignee: Chetan Mehrotra > Attachments: mongo-mk-cluster.tar.gz > > > To checkout the cluster support we should run two Sling based systems running > on Oak in a cluster using Mongo. Post that analyse if any exception is > reported and identify issues related to those -- This message was sent by Atlassian JIRA (v6.1#6144)