[jira] [Updated] (OAK-7132) SNFE after full compaction

2018-01-12 Thread JIRA 

 [ 
https://issues.apache.org/jira/browse/OAK-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Dürig updated OAK-7132:
---
Attachment: size.png

I ran 
[{{SCIT}}|https://github.com/mduerig/jackrabbit-oak/commit/07d25fcc0762a940c507df4d45d41baee16b4dca]
 through some 30 gc cycles with 3 tail compaction followed by a full compaction 
to compare a patched system to an unpatched one. No {{SNFE}} in either run. 
Compaction times and number of retry cycles are comparable. However, as 
expected the post cleanup sizes differ as cleanup of the compaction tail is 
deferred to the next gc run with the patch:

!size.png|width=400!



> SNFE after full compaction
> --
>
> Key: OAK-7132
> URL: https://issues.apache.org/jira/browse/OAK-7132
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: segment-tar
>Affects Versions: 1.8.0
>Reporter: Michael Dürig
>Assignee: Michael Dürig
>Priority: Blocker
>  Labels: compaction
> Fix For: 1.9.0, 1.10, 1.8.1
>
> Attachments: size.png
>
>
> In some cases we observed a {{SNFE}} right after a the cleanup following a 
> full compaction:
> {noformat}
> 31.12.2017 04:25:19.816 *ERROR* [pool-17-thread-22] 
> org.apache.jackrabbit.oak.segment.SegmentNotFoundExceptionListener Segment 
> not found: a82a99a3-f1e9-49b7-a1e0-55e7fec80c41. SegmentId 
> age=609487478ms,segment-generation=GCGeneration{generation=4,fullGeneration=2,isCompacted=true}
> org.apache.jackrabbit.oak.segment.SegmentNotFoundException: Segment 
> a82a99a3-f1e9-49b7-a1e0-55e7fec80c41 not found
> at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.readSegmentUncached(AbstractFileStore.java:276)
> at 
> org.apache.jackrabbit.oak.segment.file.FileStore.lambda$readSegment$5(FileStore.java:478)
> at 
> org.apache.jackrabbit.oak.segment.SegmentCache.lambda$getSegment$0(SegmentCache.java:116)
> at 
> com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724)
> at 
> com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522)
> at 
> com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315)
> at 
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278)
> at 
> com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193)
> at com.google.common.cache.LocalCache.get(LocalCache.java:3932)
> at 
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721)
> at 
> org.apache.jackrabbit.oak.segment.SegmentCache.getSegment(SegmentCache.java:113)
> at 
> org.apache.jackrabbit.oak.segment.file.FileStore.readSegment(FileStore.java:478)
> at 
> org.apache.jackrabbit.oak.segment.SegmentId.getSegment(SegmentId.java:154)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader$1.apply(CachingSegmentReader.java:94)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader$1.apply(CachingSegmentReader.java:90)
> at 
> org.apache.jackrabbit.oak.segment.ReaderCache.get(ReaderCache.java:118)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader.readString(CachingSegmentReader.java:90)
> at 
> org.apache.jackrabbit.oak.segment.MapRecord.getEntry(MapRecord.java:220)
> at 
> org.apache.jackrabbit.oak.segment.MapRecord.getEntry(MapRecord.java:173)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeState.getChildNode(SegmentNodeState.java:423)
> at 
> org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.(MemoryNodeBuilder.java:143)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeBuilder.(SegmentNodeBuilder.java:93)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeBuilder.createChildBuilder(SegmentNodeBuilder.java:148)
> at 
> org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.getChildNode(MemoryNodeBuilder.java:331)
> at 
> org.apache.jackrabbit.oak.core.SecureNodeBuilder.(SecureNodeBuilder.java:112)
> at 
> org.apache.jackrabbit.oak.core.SecureNodeBuilder.getChildNode(SecureNodeBuilder.java:329)
> at 
> org.apache.jackrabbit.oak.core.MutableTree.getTree(MutableTree.java:290)
> at 
> org.apache.jackrabbit.oak.core.MutableRoot.getTree(MutableRoot.java:220)
> at 
> org.apache.jackrabbit.oak.core.MutableRoot.getTree(MutableRoot.java:69)
> at 
> org.apache.jackrabbit.oak.jcr.delegate.SessionDelegate.getItem(SessionDelegate.java:442)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.getItemInternal(SessionImpl.java:167)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.access$400(SessionImpl.java:82)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl$3.performNullable(SessionIm

[jira] [Updated] (OAK-7132) SNFE after full compaction

2018-01-16 Thread JIRA 

 [ 
https://issues.apache.org/jira/browse/OAK-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Dürig updated OAK-7132:
---
Labels: candidate_oak_1_8 compaction  (was: compaction)

> SNFE after full compaction
> --
>
> Key: OAK-7132
> URL: https://issues.apache.org/jira/browse/OAK-7132
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: segment-tar
>Affects Versions: 1.8.0
>Reporter: Michael Dürig
>Assignee: Michael Dürig
>Priority: Blocker
>  Labels: candidate_oak_1_8, compaction
> Fix For: 1.9.0, 1.10, 1.8.1
>
> Attachments: size.png
>
>
> In some cases we observed a {{SNFE}} right after a the cleanup following a 
> full compaction:
> {noformat}
> 31.12.2017 04:25:19.816 *ERROR* [pool-17-thread-22] 
> org.apache.jackrabbit.oak.segment.SegmentNotFoundExceptionListener Segment 
> not found: a82a99a3-f1e9-49b7-a1e0-55e7fec80c41. SegmentId 
> age=609487478ms,segment-generation=GCGeneration{generation=4,fullGeneration=2,isCompacted=true}
> org.apache.jackrabbit.oak.segment.SegmentNotFoundException: Segment 
> a82a99a3-f1e9-49b7-a1e0-55e7fec80c41 not found
> at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.readSegmentUncached(AbstractFileStore.java:276)
> at 
> org.apache.jackrabbit.oak.segment.file.FileStore.lambda$readSegment$5(FileStore.java:478)
> at 
> org.apache.jackrabbit.oak.segment.SegmentCache.lambda$getSegment$0(SegmentCache.java:116)
> at 
> com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724)
> at 
> com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522)
> at 
> com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315)
> at 
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278)
> at 
> com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193)
> at com.google.common.cache.LocalCache.get(LocalCache.java:3932)
> at 
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721)
> at 
> org.apache.jackrabbit.oak.segment.SegmentCache.getSegment(SegmentCache.java:113)
> at 
> org.apache.jackrabbit.oak.segment.file.FileStore.readSegment(FileStore.java:478)
> at 
> org.apache.jackrabbit.oak.segment.SegmentId.getSegment(SegmentId.java:154)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader$1.apply(CachingSegmentReader.java:94)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader$1.apply(CachingSegmentReader.java:90)
> at 
> org.apache.jackrabbit.oak.segment.ReaderCache.get(ReaderCache.java:118)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader.readString(CachingSegmentReader.java:90)
> at 
> org.apache.jackrabbit.oak.segment.MapRecord.getEntry(MapRecord.java:220)
> at 
> org.apache.jackrabbit.oak.segment.MapRecord.getEntry(MapRecord.java:173)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeState.getChildNode(SegmentNodeState.java:423)
> at 
> org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.(MemoryNodeBuilder.java:143)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeBuilder.(SegmentNodeBuilder.java:93)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeBuilder.createChildBuilder(SegmentNodeBuilder.java:148)
> at 
> org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.getChildNode(MemoryNodeBuilder.java:331)
> at 
> org.apache.jackrabbit.oak.core.SecureNodeBuilder.(SecureNodeBuilder.java:112)
> at 
> org.apache.jackrabbit.oak.core.SecureNodeBuilder.getChildNode(SecureNodeBuilder.java:329)
> at 
> org.apache.jackrabbit.oak.core.MutableTree.getTree(MutableTree.java:290)
> at 
> org.apache.jackrabbit.oak.core.MutableRoot.getTree(MutableRoot.java:220)
> at 
> org.apache.jackrabbit.oak.core.MutableRoot.getTree(MutableRoot.java:69)
> at 
> org.apache.jackrabbit.oak.jcr.delegate.SessionDelegate.getItem(SessionDelegate.java:442)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.getItemInternal(SessionImpl.java:167)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.access$400(SessionImpl.java:82)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl$3.performNullable(SessionImpl.java:229)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl$3.performNullable(SessionImpl.java:226)
> at 
> org.apache.jackrabbit.oak.jcr.delegate.SessionDelegate.performNullable(SessionDelegate.java:243)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.getItemOrNull(SessionImpl.java:226)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OAK-7132) SNFE after full compaction

2019-06-24 Thread Julian Reschke (JIRA) 


 [ 
https://issues.apache.org/jira/browse/OAK-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julian Reschke updated OAK-7132:

Labels: compaction  (was: candidate_oak_1_8 compaction)

> SNFE after full compaction
> --
>
> Key: OAK-7132
> URL: https://issues.apache.org/jira/browse/OAK-7132
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: segment-tar
>Affects Versions: 1.8.0
>Reporter: Michael Dürig
>Assignee: Michael Dürig
>Priority: Blocker
>  Labels: compaction
> Fix For: 1.9.0, 1.10.0, 1.8.1
>
> Attachments: size.png
>
>
> In some cases we observed a {{SNFE}} right after a the cleanup following a 
> full compaction:
> {noformat}
> 31.12.2017 04:25:19.816 *ERROR* [pool-17-thread-22] 
> org.apache.jackrabbit.oak.segment.SegmentNotFoundExceptionListener Segment 
> not found: a82a99a3-f1e9-49b7-a1e0-55e7fec80c41. SegmentId 
> age=609487478ms,segment-generation=GCGeneration{generation=4,fullGeneration=2,isCompacted=true}
> org.apache.jackrabbit.oak.segment.SegmentNotFoundException: Segment 
> a82a99a3-f1e9-49b7-a1e0-55e7fec80c41 not found
> at 
> org.apache.jackrabbit.oak.segment.file.AbstractFileStore.readSegmentUncached(AbstractFileStore.java:276)
> at 
> org.apache.jackrabbit.oak.segment.file.FileStore.lambda$readSegment$5(FileStore.java:478)
> at 
> org.apache.jackrabbit.oak.segment.SegmentCache.lambda$getSegment$0(SegmentCache.java:116)
> at 
> com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724)
> at 
> com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522)
> at 
> com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315)
> at 
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278)
> at 
> com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193)
> at com.google.common.cache.LocalCache.get(LocalCache.java:3932)
> at 
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721)
> at 
> org.apache.jackrabbit.oak.segment.SegmentCache.getSegment(SegmentCache.java:113)
> at 
> org.apache.jackrabbit.oak.segment.file.FileStore.readSegment(FileStore.java:478)
> at 
> org.apache.jackrabbit.oak.segment.SegmentId.getSegment(SegmentId.java:154)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader$1.apply(CachingSegmentReader.java:94)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader$1.apply(CachingSegmentReader.java:90)
> at 
> org.apache.jackrabbit.oak.segment.ReaderCache.get(ReaderCache.java:118)
> at 
> org.apache.jackrabbit.oak.segment.CachingSegmentReader.readString(CachingSegmentReader.java:90)
> at 
> org.apache.jackrabbit.oak.segment.MapRecord.getEntry(MapRecord.java:220)
> at 
> org.apache.jackrabbit.oak.segment.MapRecord.getEntry(MapRecord.java:173)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeState.getChildNode(SegmentNodeState.java:423)
> at 
> org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.(MemoryNodeBuilder.java:143)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeBuilder.(SegmentNodeBuilder.java:93)
> at 
> org.apache.jackrabbit.oak.segment.SegmentNodeBuilder.createChildBuilder(SegmentNodeBuilder.java:148)
> at 
> org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.getChildNode(MemoryNodeBuilder.java:331)
> at 
> org.apache.jackrabbit.oak.core.SecureNodeBuilder.(SecureNodeBuilder.java:112)
> at 
> org.apache.jackrabbit.oak.core.SecureNodeBuilder.getChildNode(SecureNodeBuilder.java:329)
> at 
> org.apache.jackrabbit.oak.core.MutableTree.getTree(MutableTree.java:290)
> at 
> org.apache.jackrabbit.oak.core.MutableRoot.getTree(MutableRoot.java:220)
> at 
> org.apache.jackrabbit.oak.core.MutableRoot.getTree(MutableRoot.java:69)
> at 
> org.apache.jackrabbit.oak.jcr.delegate.SessionDelegate.getItem(SessionDelegate.java:442)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.getItemInternal(SessionImpl.java:167)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.access$400(SessionImpl.java:82)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl$3.performNullable(SessionImpl.java:229)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl$3.performNullable(SessionImpl.java:226)
> at 
> org.apache.jackrabbit.oak.jcr.delegate.SessionDelegate.performNullable(SessionDelegate.java:243)
> at 
> org.apache.jackrabbit.oak.jcr.session.SessionImpl.getItemOrNull(SessionImpl.java:226)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)