[jira] [Commented] (OAK-7182) Make it possible to update Guava

2022-11-07 Thread Angela Schreiber (Jira)


[ 
https://issues.apache.org/jira/browse/OAK-7182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630254#comment-17630254
 ] 

Angela Schreiber commented on OAK-7182:
---

[~reschke], sounds like a reasonable plan to me.

one more thing: is there anything we can do to prevent introducing new leakages 
as it happened again in the segment-tar code?
also: is the segment team aware of this ([~miroslav])?

> Make it possible to update Guava
> 
>
> Key: OAK-7182
> URL: https://issues.apache.org/jira/browse/OAK-7182
> Project: Jackrabbit Oak
>  Issue Type: Wish
>Reporter: Julian Reschke
>Priority: Minor
> Attachments: GuavaTests.java, OAK-7182-guava-21-3.diff, 
> OAK-7182-guava-21-4.diff, OAK-7182-guava-21.diff, OAK-7182-guava-23.6.1.diff, 
> guava.diff
>
>
> We currently rely on Guava 15, and this affects all users of Oak because they 
> essentially need to use the same version.
> This is an overall issue to investigate what would need to be done in Oak in 
> order to make updates possible.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (OAK-9842) Error in cluster node recovery: OutOfMemoryError GC overhead limit exceeded

2022-11-07 Thread Mohammad (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mohammad resolved OAK-9842.
---
Resolution: Not A Bug

> Error in cluster node recovery: OutOfMemoryError GC overhead limit exceeded
> ---
>
> Key: OAK-9842
> URL: https://issues.apache.org/jira/browse/OAK-9842
> Project: Jackrabbit Oak
>  Issue Type: Bug
>Affects Versions: 1.36.0
>Reporter: Mohammad
>Priority: Blocker
> Attachments: dominator-tree.jpg, dominator-tree.zip, histogram.zip, 
> not yet visible - stacktrace.txt, recovery detailed - log.txt
>
>
> I have used jackrabbit oak on a large scale as a CMS module. In some write 
> operation I got the OakMerge0004 (not yet visible) error. I have done some 
> investigation before and found out this error will be solved with performing 
> recovery on crashed clusterId. In all cases except the current state I have 
> run the recovery and the problem was solved. But  now I got
> {code:java}
> java.lang.OutOfMemoryError: GC overhead limit exceeded
> {code}
> Also I increased the Xmx to about 27GB but again I got the same error. I 
> attached the report of the heap dump and detailed log. If any other 
> information is needed please let me know.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (OAK-9985) DataStoreCopyCommandTest#destinationFromBlobId fails on windows

2022-11-07 Thread Amit Jain (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amit Jain updated OAK-9985:
---
Fix Version/s: 1.46.0

> DataStoreCopyCommandTest#destinationFromBlobId fails on windows
> ---
>
> Key: OAK-9985
> URL: https://issues.apache.org/jira/browse/OAK-9985
> Project: Jackrabbit Oak
>  Issue Type: Improvement
>  Components: oak-run
>Reporter: Amit Jain
>Assignee: Amit Jain
>Priority: Major
> Fix For: 1.46.0
>
>
> org.apache.jackrabbit.oak.run.DataStoreCopyCommandTest#destinationFromBlobId 
> fails at 
> https://github.com/apache/jackrabbit-oak/blob/trunk/oak-run/src/test/java/org/apache/jackrabbit/oak/run/DataStoreCopyCommandTest.java#L213



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (OAK-9984) FlatFileSplitterTest reliably failing

2022-11-07 Thread Amit Jain (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amit Jain resolved OAK-9984.

Resolution: Fixed

Created https://issues.apache.org/jira/browse/OAK-9986 to check any open file 
handles.

On trunk with commit - 
[https://github.com/apache/jackrabbit-oak/commit/003aa698363c1c35c66a9dd0028744f4c67179fa|003aa698363c1c35c66a9dd0028744f4c67179fa]

> FlatFileSplitterTest reliably failing
> -
>
> Key: OAK-9984
> URL: https://issues.apache.org/jira/browse/OAK-9984
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: run
>Reporter: Julian Reschke
>Assignee: Amit Jain
>Priority: Major
>
> (on Windows)
> {noformat}
> [ERROR] Failures:
> [ERROR]   FlatFileSplitterTest.deleteAfterSplit:128 expected:<105> but 
> was:<108>
> [ERROR]   FlatFileSplitterTest.multipleNodeTypeSplitWithNestedParent:228 
> expected:<353> but was:<362>
> [ERROR]   FlatFileSplitterTest.multipleNodeTypeSplitWithParent:204 
> expected:<226> but was:<232>
> [ERROR]   FlatFileSplitterTest.simpleSplit:146 expected:<105> but was:<108>
> [ERROR]   FlatFileSplitterTest.simpleSplitWithNestedParent:184 expected:<345> 
> but was:<354>
> [ERROR]   FlatFileSplitterTest.simpleSplitWithParent:163 expected:<298> but 
> was:<306>
> [ERROR]   FlatFileSplitterTest.splitAsset:244 expected:<1059678> but 
> was:<1067609>
> [ERROR]   FlatFileSplitterTest.splitFolder:273 expected:<1059678> but 
> was:<1067609>
> [ERROR]   FlatFileSplitterTest.splitFolderWithCompression:310 
> expected:<1059678> but was:<1067609>
> [ERROR]   FlatFileSplitterTest.unknownTypeNoSplit:114 expected:<114> but 
> was:<117>
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (OAK-9984) FlatFileSplitterTest reliably failing

2022-11-07 Thread Amit Jain (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amit Jain updated OAK-9984:
---
Fix Version/s: 1.46.0

> FlatFileSplitterTest reliably failing
> -
>
> Key: OAK-9984
> URL: https://issues.apache.org/jira/browse/OAK-9984
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: run
>Reporter: Julian Reschke
>Assignee: Amit Jain
>Priority: Major
> Fix For: 1.46.0
>
>
> (on Windows)
> {noformat}
> [ERROR] Failures:
> [ERROR]   FlatFileSplitterTest.deleteAfterSplit:128 expected:<105> but 
> was:<108>
> [ERROR]   FlatFileSplitterTest.multipleNodeTypeSplitWithNestedParent:228 
> expected:<353> but was:<362>
> [ERROR]   FlatFileSplitterTest.multipleNodeTypeSplitWithParent:204 
> expected:<226> but was:<232>
> [ERROR]   FlatFileSplitterTest.simpleSplit:146 expected:<105> but was:<108>
> [ERROR]   FlatFileSplitterTest.simpleSplitWithNestedParent:184 expected:<345> 
> but was:<354>
> [ERROR]   FlatFileSplitterTest.simpleSplitWithParent:163 expected:<298> but 
> was:<306>
> [ERROR]   FlatFileSplitterTest.splitAsset:244 expected:<1059678> but 
> was:<1067609>
> [ERROR]   FlatFileSplitterTest.splitFolder:273 expected:<1059678> but 
> was:<1067609>
> [ERROR]   FlatFileSplitterTest.splitFolderWithCompression:310 
> expected:<1059678> but was:<1067609>
> [ERROR]   FlatFileSplitterTest.unknownTypeNoSplit:114 expected:<114> but 
> was:<117>
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (OAK-9986) Check unclosed file handles in the parallel indexing flow

2022-11-07 Thread Amit Jain (Jira)
Amit Jain created OAK-9986:
--

 Summary: Check unclosed file handles in the parallel indexing flow
 Key: OAK-9986
 URL: https://issues.apache.org/jira/browse/OAK-9986
 Project: Jackrabbit Oak
  Issue Type: Task
  Components: oak-run
Reporter: Amit Jain


Some temporary files were observed to be created & left undeleted in the tmp 
folder after running tests. Check the flow to conform no file handles left open.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (OAK-9985) DataStoreCopyCommandTest#destinationFromBlobId fails on windows

2022-11-07 Thread Amit Jain (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amit Jain resolved OAK-9985.

Resolution: Fixed

On trunk with commit - 
[d576b7015e61d112a3145a259a05e9761d4bb9fc|https://github.com/apache/jackrabbit-oak/commit/d576b7015e61d112a3145a259a05e9761d4bb9fc]

> DataStoreCopyCommandTest#destinationFromBlobId fails on windows
> ---
>
> Key: OAK-9985
> URL: https://issues.apache.org/jira/browse/OAK-9985
> Project: Jackrabbit Oak
>  Issue Type: Improvement
>  Components: oak-run
>Reporter: Amit Jain
>Assignee: Amit Jain
>Priority: Major
>
> org.apache.jackrabbit.oak.run.DataStoreCopyCommandTest#destinationFromBlobId 
> fails at 
> https://github.com/apache/jackrabbit-oak/blob/trunk/oak-run/src/test/java/org/apache/jackrabbit/oak/run/DataStoreCopyCommandTest.java#L213



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (OAK-9985) DataStoreCopyCommandTest#destinationFromBlobId fails on windows

2022-11-07 Thread Amit Jain (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amit Jain reassigned OAK-9985:
--

Assignee: Amit Jain

> DataStoreCopyCommandTest#destinationFromBlobId fails on windows
> ---
>
> Key: OAK-9985
> URL: https://issues.apache.org/jira/browse/OAK-9985
> Project: Jackrabbit Oak
>  Issue Type: Improvement
>  Components: oak-run
>Reporter: Amit Jain
>Assignee: Amit Jain
>Priority: Major
>
> org.apache.jackrabbit.oak.run.DataStoreCopyCommandTest#destinationFromBlobId 
> fails at 
> https://github.com/apache/jackrabbit-oak/blob/trunk/oak-run/src/test/java/org/apache/jackrabbit/oak/run/DataStoreCopyCommandTest.java#L213



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (OAK-9983) Mention alternatives to large MVP

2022-11-07 Thread Stefan Egli (Jira)


 [ 
https://issues.apache.org/jira/browse/OAK-9983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefan Egli resolved OAK-9983.
--
Resolution: Done

PR merged

> Mention alternatives to large MVP
> -
>
> Key: OAK-9983
> URL: https://issues.apache.org/jira/browse/OAK-9983
> Project: Jackrabbit Oak
>  Issue Type: Documentation
>  Components: docs
>Reporter: Stefan Egli
>Assignee: Stefan Egli
>Priority: Minor
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OAK-7182) Make it possible to update Guava

2022-11-07 Thread Julian Reschke (Jira)


[ 
https://issues.apache.org/jira/browse/OAK-7182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629845#comment-17629845
 ] 

Julian Reschke commented on OAK-7182:
-

Well; progress is on this issue proves to be hard.

We sort-of had settled to first deprecating and then removing APIs that expose 
Guava objects. We were done with the deprecations, but a certain downstream 
project hasn't been updated yet, and doing so will take time.

OTOH, we planned to revise Oak's code to use newer versions of Gauva in any 
case (be it directly or shadowed - both will require code changes).

So my proposal is to - while we're waiting on progress on the 
deprecation/removal front - we actually start upgrading Guava step by step. For 
now that would mean moving to 19.0, which would allow us to update our code not 
to use those APIs that have been removed ib Guava >= 20.0.

Feedback appreciated.


> Make it possible to update Guava
> 
>
> Key: OAK-7182
> URL: https://issues.apache.org/jira/browse/OAK-7182
> Project: Jackrabbit Oak
>  Issue Type: Wish
>Reporter: Julian Reschke
>Priority: Minor
> Attachments: GuavaTests.java, OAK-7182-guava-21-3.diff, 
> OAK-7182-guava-21-4.diff, OAK-7182-guava-21.diff, OAK-7182-guava-23.6.1.diff, 
> guava.diff
>
>
> We currently rely on Guava 15, and this affects all users of Oak because they 
> essentially need to use the same version.
> This is an overall issue to investigate what would need to be done in Oak in 
> order to make updates possible.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (OAK-9985) DataStoreCopyCommandTest#destinationFromBlobId fails on windows

2022-11-07 Thread Amit Jain (Jira)
Amit Jain created OAK-9985:
--

 Summary: DataStoreCopyCommandTest#destinationFromBlobId fails on 
windows
 Key: OAK-9985
 URL: https://issues.apache.org/jira/browse/OAK-9985
 Project: Jackrabbit Oak
  Issue Type: Improvement
  Components: oak-run
Reporter: Amit Jain


org.apache.jackrabbit.oak.run.DataStoreCopyCommandTest#destinationFromBlobId 
fails at 
https://github.com/apache/jackrabbit-oak/blob/trunk/oak-run/src/test/java/org/apache/jackrabbit/oak/run/DataStoreCopyCommandTest.java#L213



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OAK-9984) FlatFileSplitterTest reliably failing

2022-11-07 Thread Julian Reschke (Jira)


[ 
https://issues.apache.org/jira/browse/OAK-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629701#comment-17629701
 ] 

Julian Reschke commented on OAK-9984:
-

Found in temp folder:

1. liblz4-java-3689381487369455399.so
2. Subfolder containing files like merge and sorted-file.json



> FlatFileSplitterTest reliably failing
> -
>
> Key: OAK-9984
> URL: https://issues.apache.org/jira/browse/OAK-9984
> Project: Jackrabbit Oak
>  Issue Type: Bug
>  Components: run
>Reporter: Julian Reschke
>Assignee: Amit Jain
>Priority: Major
>
> (on Windows)
> {noformat}
> [ERROR] Failures:
> [ERROR]   FlatFileSplitterTest.deleteAfterSplit:128 expected:<105> but 
> was:<108>
> [ERROR]   FlatFileSplitterTest.multipleNodeTypeSplitWithNestedParent:228 
> expected:<353> but was:<362>
> [ERROR]   FlatFileSplitterTest.multipleNodeTypeSplitWithParent:204 
> expected:<226> but was:<232>
> [ERROR]   FlatFileSplitterTest.simpleSplit:146 expected:<105> but was:<108>
> [ERROR]   FlatFileSplitterTest.simpleSplitWithNestedParent:184 expected:<345> 
> but was:<354>
> [ERROR]   FlatFileSplitterTest.simpleSplitWithParent:163 expected:<298> but 
> was:<306>
> [ERROR]   FlatFileSplitterTest.splitAsset:244 expected:<1059678> but 
> was:<1067609>
> [ERROR]   FlatFileSplitterTest.splitFolder:273 expected:<1059678> but 
> was:<1067609>
> [ERROR]   FlatFileSplitterTest.splitFolderWithCompression:310 
> expected:<1059678> but was:<1067609>
> [ERROR]   FlatFileSplitterTest.unknownTypeNoSplit:114 expected:<114> but 
> was:<117>
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)