Re: RFR: 8320215: HeapDumper can use DumpWriter buffer during merge

2024-05-29 Thread Yi Yang
On Fri, 19 Apr 2024 00:10:12 GMT, Alex Menkov wrote: > The fix updates HeapMerger to use writer buffer (no need to copy memory, also > writer buffer is 1MB instead of 4KB). > Additionally fixed small issue in FileWriter (looks like `ssize_t` instead of > `size_t` is a typo, the argument should

Re: RFR: 8320215: HeapDumper can use DumpWriter buffer during merge

2024-05-28 Thread Yi Yang
On Fri, 19 Apr 2024 00:10:12 GMT, Alex Menkov wrote: > The fix updates HeapMerger to use writer buffer (no need to copy memory, also > writer buffer is 1MB instead of 4KB). > Additionally fixed small issue in FileWriter (looks like `ssize_t` instead of > `size_t` is a typo, the argument should

Re: RFR: 8330066: HeapDumpPath and HeapDumpGzipLevel VM options do not mention HeapDumpBeforeFullGC and HeapDumpAfterFullGC [v2]

2024-05-14 Thread Yi Yang
On Tue, 14 May 2024 01:53:20 GMT, Alex Menkov wrote: >> The fix updates descriptions of `HeapDumpPath`/`HeapDumpGzipLevel` and >> `HeapDumpBeforeFullGC`/`HeapDumpAfterFullGC`/`HeapDumpOnOutOfMemoryError` VM >> options > > Alex Menkov has updated the pull request incrementally with one

Re: RFR: 8322043: HeapDumper should use parallel dump by default [v3]

2024-04-15 Thread Yi Yang
On Mon, 15 Apr 2024 23:18:54 GMT, Alex Menkov wrote: >> The fix makes VM heap dumping parallel by default. >> `jcmd GC.heap_dump` and `jmap -dump` had parallel dumping by default, the >> fix affects `HotSpotDiagnosticMXBean.dumpHeap()`, >> `-XX:+HeapDumpBeforeFullGC`,

Re: RFR: JDK-8322042: HeapDumper should perform merge on the current thread instead of VMThread

2024-04-01 Thread Yi Yang
On Tue, 2 Apr 2024 00:40:37 GMT, Alex Menkov wrote: > The fix updated HeapDumper to always perform merge on the current thread. > > Testing: tier1-5, all HeapDump-related tests > Covered heap dumping scenarios: > - `jcmd GC.heap_dump` command; > - `HotSpotDiagnosticMXBean.dumpHeap()`;

Withdrawn: 8327864: Support segmented heap dump for HotSpotDiagnosticMXBean

2024-03-25 Thread Yi Yang
On Tue, 12 Mar 2024 07:59:12 GMT, Yi Yang wrote: > We've received feedback from users of cloud APM platform wanting the new > version of the JDK to allow the HotSpotDiagnosticMXBean.dumpHeap > underpinnings to reduce STW time using sgemented heapdump. Supporting > segmen

Re: RFR: JDK-8327769: jcmd GC.heap_dump without options should write to location given by -XX:HeapDumpPath, if set [v2]

2024-03-15 Thread Yi Yang
On Thu, 14 Mar 2024 08:49:45 GMT, Matthias Baesken wrote: > > Looks reasonable, this is a harmless change, but the name > > `dump_to_heapdump_path` looks too details(and somewhat strange) to me > > Do you maybe have a good suggestion for a new name ? Maybe `dump` and `dump_to` -

Re: RFR: JDK-8327769: jcmd GC.heap_dump without options should write to location given by -XX:HeapDumpPath, if set [v2]

2024-03-13 Thread Yi Yang
On Tue, 12 Mar 2024 12:22:41 GMT, Matthias Baesken wrote: >> Currently jcmd command GC.heap_dump only works with an additionally provided >> file name. >> Syntax : GC.heap_dump [options] >> >> In case the JVM has the XX - flag HeapDumpPath set, we should support an >> additional mode where

Re: RFR: 8327864: Support segmented heap dump for HotSpotDiagnosticMXBean

2024-03-13 Thread Yi Yang
On Wed, 13 Mar 2024 20:01:22 GMT, Kevin Walls wrote: >> We've received feedback from users of cloud APM platform wanting the new >> version of the JDK to allow the HotSpotDiagnosticMXBean.dumpHeap >> underpinnings to reduce STW time using sgemented heapdump. Supporting >> segmented heapdump

RFR: 8327864: Support segmented heap dump for HotSpotDiagnosticMXBean

2024-03-12 Thread Yi Yang
We've received feedback from users of cloud APM platform wanting the new version of the JDK to allow the HotSpotDiagnosticMXBean.dumpHeap underpinnings to reduce STW time using sgemented heapdump. Supporting segmented heapdump for mxbean is a reasonable requirement and adds little additional

Re: RFR: 8318026: jcmd should provide access to low-level JVM debug information

2024-02-05 Thread Yi Yang
On Wed, 31 Jan 2024 14:22:44 GMT, Kevin Walls wrote: > Introduce the jcmd "VM.debug" to implement access to a useful set of the > established debug.cpp utilities, with "jcmd PID VM.debug subcommand ...". > > Not recommended for live production use. Calling these "debug" utilities, > and not

Re: RFR: JDK-8321565: [REDO] Heap dump does not contain virtual Thread stack references

2023-12-11 Thread Yi Yang
On Fri, 8 Dec 2023 22:29:12 GMT, Alex Menkov wrote: > Original fix for JDK-8299426 (Heap dump does not contain virtual Thread stack > references, #16665) caused failures of new test (added while #16665 was under > review): > test/hotspot/jtreg/compiler/c2/TestReduceAllocationAndHeapDump.java

Re: RFR: 8299426: Heap dump does not contain virtual Thread stack references

2023-11-15 Thread Yi Yang
On Tue, 14 Nov 2023 21:54:06 GMT, Alex Menkov wrote: > The change impelements dumping of unmounted virtual threads data (stack > traces and stack references). > Unmounted vthreads can be detected only by iterating over the heap, but hprof > stack trace records (HPROF_FRAME/HPROF_TRACE) should

Re: RFR: JDK-8319053: Segment dump files remain after parallel heap dump on Windows [v2]

2023-11-02 Thread Yi Yang
On Thu, 2 Nov 2023 20:44:14 GMT, Alex Menkov wrote: >> Segment file is closed from DumpWriter dtor. >> On Unix systems `remove` can delete an opened file, on Windows it fails with >> "access denied". >> The fix destroys DumpWriter objects for segment files after all data are >> dumped > > Alex

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase [v2]

2023-10-11 Thread Yi Yang
On Thu, 21 Sep 2023 02:12:06 GMT, Yi Yang wrote: > I had not noticed this PR sorry. I do not like the fact we have Linux-only > functionality being added with no intent to supply similar functionality on > other platforms. I also do not like the fact we had to ifdef the L

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase [v2]

2023-09-20 Thread Yi Yang
On Thu, 21 Sep 2023 01:18:19 GMT, David Holmes wrote: > I had not noticed this PR sorry. I do not like the fact we have Linux-only > functionality being added with no intent to supply similar functionality on > other platforms. I also do not like the fact we had to ifdef the Linux code > into

Integrated: 8314021: HeapDump: Optimize segmented heap file merging phase

2023-09-18 Thread Yi Yang
On Fri, 11 Aug 2023 09:31:56 GMT, Yi Yang wrote: > This patch reduce ~16%(24s->20s) pahse 2 merge time during dumping 32g heap > with 96threads and fixes a memory leak of compressor > > You might argue why this is Linux-only optimization, because sendfile > requires

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase [v2]

2023-09-18 Thread Yi Yang
On Mon, 18 Sep 2023 11:09:36 GMT, Kevin Walls wrote: > Apologies for delay, had looked at this previously but not come back for > final review. Never mind:) Thanks @alexmenkov and @kevinjwalls for the reviews. - PR Comment:

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase [v2]

2023-09-17 Thread Yi Yang
On Thu, 7 Sep 2023 02:19:10 GMT, Yi Yang wrote: >> This patch reduce ~16%(24s->20s) pahse 2 merge time during dumping 32g heap >> with 96threads and fixes a memory leak of compressor >> >> You might argue why this is Linux-only optimization, because sendfile >

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase

2023-09-10 Thread Yi Yang
On Thu, 7 Sep 2023 00:56:40 GMT, Alex Menkov wrote: >> This patch reduce ~16%(24s->20s) pahse 2 merge time during dumping 32g heap >> with 96threads and fixes a memory leak of compressor >> >> You might argue why this is Linux-only optimization, because sendfile >> requires at least socket fd

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase

2023-09-06 Thread Yi Yang
On Thu, 7 Sep 2023 00:56:40 GMT, Alex Menkov wrote: > The fix looks good to me in general, but I'm not sure about code > organization. src/hotspot/share/runtime/os.hpp describes rules for os* files. > It states: // Platform-independent source files should not include these > header files //

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase [v2]

2023-09-06 Thread Yi Yang
i/mswsock/nf-mswsock-transmitfile)), > while [only Linux](https://man7.org/linux/man-pages/man2/sendfile.2.html) > supports both two file descriptors. Yi Yang has updated the pull request incrementally with one additional commit since the last revision: one merge_file for all

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase

2023-09-06 Thread Yi Yang
On Fri, 11 Aug 2023 09:31:56 GMT, Yi Yang wrote: > This patch reduce ~16%(24s->20s) pahse 2 merge time during dumping 32g heap > with 96threads and fixes a memory leak of compressor > > You might argue why this is Linux-only optimization, because sendfile > requires

Integrated: 8311775: [TEST] duplicate verifyHeapDump in several tests

2023-09-03 Thread Yi Yang
On Wed, 9 Aug 2023 07:02:34 GMT, Yi Yang wrote: > This is a follow-up patch of #13667. verifyHeapDump is duplicated in several > tests, this patch tries to consolidate them into one method. This pull request has now been integrated. Changeset: 75d4ac26 Author: Yi Yang URL:

Re: RFR: 8311775: [TEST] duplicate verifyHeapDump in several tests [v4]

2023-08-30 Thread Yi Yang
> This is a follow-up patch of #13667. verifyHeapDump is duplicated in several > tests, this patch tries to consolidate them into one method. Yi Yang has updated the pull request incrementally with one additional commit since the last revision: Update HeapDumpTes

Re: RFR: 8314021: HeapDump: Optimize segmented heap file merging phase

2023-08-23 Thread Yi Yang
On Fri, 11 Aug 2023 09:31:56 GMT, Yi Yang wrote: > This patch reduce ~16%(24s->20s) pahse 2 merge time during dumping 32g heap > with 96threads and fixes a memory leak of compressor > > You might argue why this is Linux-only optimization, because sendfile > requires

Re: RFR: 8311775: [TEST] duplicate verifyHeapDump in several tests [v2]

2023-08-10 Thread Yi Yang
On Thu, 10 Aug 2023 19:29:27 GMT, Alex Menkov wrote: >> Yi Yang has updated the pull request incrementally with one additional >> commit since the last revision: >> >> fix TestHeapDumpForInvokDynamic > > test/hotspot/jtreg/serviceability/sa/TestHeapDumpFo

Re: RFR: 8311775: [TEST] duplicate verifyHeapDump in several tests [v3]

2023-08-10 Thread Yi Yang
> This is a follow-up patch of #13667. verifyHeapDump is duplicated in several > tests, this patch tries to consolidate them into one method. Yi Yang has updated the pull request incrementally with one additional commit since the last revision: review from Alex - C

Re: RFR: 8311775: [TEST] duplicate verifyHeapDump in several tests [v2]

2023-08-10 Thread Yi Yang
On Thu, 10 Aug 2023 09:41:29 GMT, Yi Yang wrote: >> This is a follow-up patch of #13667. verifyHeapDump is duplicated in several >> tests, this patch tries to consolidate them into one method. > > Yi Yang has updated the pull request incrementally with one additional commit

Re: RFR: 8311775: [TEST] duplicate verifyHeapDump in several tests [v2]

2023-08-10 Thread Yi Yang
> This is a follow-up patch of #13667. verifyHeapDump is duplicated in several > tests, this patch tries to consolidate them into one method. Yi Yang has updated the pull request incrementally with one additional commit since the last revision: fix TestHeapDumpForInvokD

RFR: 8311775: [TEST] duplicate verifyHeapDump in several tests

2023-08-09 Thread Yi Yang
This is a follow-up patch of #13667. verifyHeapDump is duplicated in several tests, this patch tries to consolidate them into one method. - Commit messages: - 8311775: [TEST] duplicate verifyHeapDump in several tests Changes: https://git.openjdk.org/jdk/pull/15202/files Webrev:

Integrated: JDK-8306441: Two phase segmented heap dump

2023-08-08 Thread Yi Yang
On Wed, 26 Apr 2023 09:37:46 GMT, Yi Yang wrote: > ### Motivation and proposal > Hi, heap dump brings about pauses for application's execution(STW), this is a > well-known pain. JDK-8252842 have added parallel support to heapdump in an > attempt to alleviate this issue. However, al

Re: RFR: JDK-8306441: Two phase segmented heap dump [v28]

2023-08-08 Thread Yi Yang
On Tue, 8 Aug 2023 13:09:58 GMT, Kevin Walls wrote: >> Yi Yang has updated the pull request incrementally with one additional >> commit since the last revision: >> >> aware of serialgc and epsilongc > > Great, thanks for your patience with all of this!

Re: RFR: JDK-8306441: Two phase segmented heap dump [v28]

2023-08-08 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g | 9

Re: RFR: JDK-8306441: Two phase segmented heap dump [v27]

2023-08-08 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g |

Re: RFR: JDK-8306441: Two phase segmented heap dump [v26]

2023-08-08 Thread Yi Yang
On Tue, 8 Aug 2023 07:41:23 GMT, Kevin Walls wrote: > It's not too bad to change the test to launch a LingeredApp and test the > output, I made an attempt at that. I'll share a testcase suggestion here, see > what you think. Thank you for the share! It makes sense to me. This test will start

Re: RFR: JDK-8306441: Two phase segmented heap dump [v26]

2023-08-04 Thread Yi Yang
On Fri, 4 Aug 2023 16:31:28 GMT, Kevin Walls wrote: >> Yi Yang has updated the pull request incrementally with one additional >> commit since the last revision: >> >> new can_parallel_dump > > test/hotspot/jtreg/serviceability/dcmd/gc/HeapDumpParal

Re: RFR: JDK-8306441: Two phase segmented heap dump [v26]

2023-08-04 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g |

Re: RFR: JDK-8306441: Two phase segmented heap dump [v25]

2023-08-03 Thread Yi Yang
On Thu, 3 Aug 2023 13:24:19 GMT, Kevin Walls wrote: > Also the variable num_requested_dump_thread is not needed? It's just a copy > of _num_dumper_threads which we don't change. This is needed because _num_dumper_threads will change later, the requested dump thread may not equal to actual

Re: RFR: JDK-8306441: Two phase segmented heap dump [v23]

2023-08-02 Thread Yi Yang
On Wed, 2 Aug 2023 13:11:51 GMT, Kevin Walls wrote: > > > > Yes, dividing testing by feature so we have HeapDumpTest, > HeapDumpCompressedTest, HeapDumpParallelTest... that sounds good. > > Currently the HeapDumpTest does more parallel testing than > IntegrityHeapDumpTest, so I didn't

Re: RFR: JDK-8306441: Two phase segmented heap dump [v21]

2023-08-02 Thread Yi Yang
On Wed, 2 Aug 2023 18:02:22 GMT, Chris Plummer wrote: > so I'm still wondering how this use of SATestUtils.createProcessBuilder() > got in this new test in the first place I simply grep existing tests and found this snippet to create java process. There is no special intention, it is an

Re: RFR: JDK-8306441: Two phase segmented heap dump [v25]

2023-08-02 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | >

Re: RFR: JDK-8306441: Two phase segmented heap dump [v24]

2023-08-02 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | >

Re: RFR: JDK-8306441: Two phase segmented heap dump [v23]

2023-08-02 Thread Yi Yang
On Wed, 2 Aug 2023 11:33:17 GMT, Yi Yang wrote: >> ### Motivation and proposal >> Hi, heap dump brings about pauses for application's execution(STW), this is >> a well-known pain. JDK-8252842 have added parallel support to heapdump in an >> attempt to alleviate

Re: RFR: JDK-8306441: Two phase segmented heap dump [v23]

2023-08-02 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g |

Re: RFR: JDK-8306441: Two phase segmented heap dump [v21]

2023-08-02 Thread Yi Yang
On Tue, 1 Aug 2023 17:48:30 GMT, Chris Plummer wrote: >> test/hotspot/jtreg/serviceability/HeapDump/IntegrityHeapDumpTest.java line >> 84: >> >>> 82: .addToolArg(heapDumpFile.getAbsolutePath()); >>> 83: >>> 84: ProcessBuilder processBuilder = new >>>

Re: RFR: JDK-8306441: Two phase segmented heap dump [v22]

2023-08-02 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g | 96

Re: RFR: JDK-8306441: Two phase segmented heap dump [v21]

2023-08-02 Thread Yi Yang
On Tue, 1 Aug 2023 14:41:53 GMT, Kevin Walls wrote: > I just saw a run with no -parallel option which got num_active_workers = 2, > so it did a parallel dump, so the default is being set as intended, but the > availability of worker threads is not always predictable! Yes, now I've added new

Re: RFR: JDK-8306441: Two phase segmented heap dump [v20]

2023-07-31 Thread Yi Yang
On Wed, 19 Jul 2023 12:42:27 GMT, Yi Yang wrote: >> ### Motivation and proposal >> Hi, heap dump brings about pauses for application's execution(STW), this is >> a well-known pain. JDK-8252842 have added parallel support to heapdump in an >> attempt to alleviate

Re: RFR: JDK-8306441: Two phase segmented heap dump [v21]

2023-07-31 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g |

Re: RFR: JDK-8306441: Two phase segmented heap dump [v20]

2023-07-28 Thread Yi Yang
On Fri, 28 Jul 2023 17:18:05 GMT, Kevin Walls wrote: > I think we might be best off leaving the long dump as you have it in the > AttachListener for now. 8-) Consideing a very large heap size, the VM used to pause all threads and spend 1 hour to execute a heap dump, during which time

Re: RFR: JDK-8306441: Two phase segmented heap dump [v16]

2023-07-28 Thread Yi Yang
On Tue, 11 Jul 2023 20:49:35 GMT, Chris Plummer wrote: >> Yi Yang has updated the pull request incrementally with two additional >> commits since the last revision: >> >> - whitespace >> - add test > > BTW, `serviceability/dcmd/gc/HeapDumpAllTest.java`

Re: RFR: JDK-8306441: Two phase segmented heap dump [v20]

2023-07-19 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g |

Re: RFR: JDK-8306441: Two phase segmented heap dump [v19]

2023-07-18 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g | 96

Re: RFR: JDK-8306441: Two phase segmented heap dump [v18]

2023-07-17 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g | 9

Re: RFR: JDK-8306441: Two phase segmented heap dump [v17]

2023-07-17 Thread Yi Yang
On Mon, 17 Jul 2023 04:11:54 GMT, David Holmes wrote: > > Because I need the overloaded check is_AttachListener_thread(), which can > > avoid using the VM thread to execute the dump file merge as much as > > possible. > > I'm unclear what the set of candidate threads is for executing the code

Re: RFR: JDK-8306441: Two phase segmented heap dump [v17]

2023-07-16 Thread Yi Yang
On Wed, 12 Jul 2023 07:58:47 GMT, Yi Yang wrote: >> ### Motivation and proposal >> Hi, heap dump brings about pauses for application's execution(STW), this is >> a well-known pain. JDK-8252842 have added parallel support to heapdump in an >> attempt to alleviate

Re: RFR: JDK-8306441: Two phase segmented heap dump [v17]

2023-07-12 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | > | 64g |

Re: RFR: JDK-8306441: Two phase segmented heap dump [v16]

2023-07-10 Thread Yi Yang
.574 | > | 64g | 1 T | N | 100.583 | 100.583 | > | 64g | 32 T | N | 20.9233744 | 134.701 | > | 64g | 32 T | C1 | 18.5023784 | 19.358 | > | 64g | 32 T | C2 | 86.4748377 | 172.707 | > | 64g | 96 T | N | 26.7374116 | 126.08 | > | 64g | 96 T | C1 | 16.8101551 | 17.938 | >

Re: RFR: JDK-8306441: Two phase segmented heap dump [v14]

2023-07-10 Thread Yi Yang
On Wed, 5 Jul 2023 21:10:56 GMT, Alex Menkov wrote: >> I think commit "use HandshakeClosure instead of VMOperation" is a wrong way >> to go. >> It restricts use of parallel dumping only to attach case. >> I have pending changes in heap dumper to support virtual threads and I'm >> going switch

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v15]

2023-07-06 Thread Yi Yang
> | 32g | 32 thread | 10.7734677 secs | 61.643 secs | N | > | 32g | 32 thread | 10.1642097 secs | 10.903 secs | Compress1 | > | 32g | 32 thread | 43.8407607 secs | 88.152 secs | Compress2 | > | 32g | 96 thread | 13.1522042 secs | 61.432 secs | N | > | 32g | 96 thread | 9.0954641 secs |

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v14]

2023-07-02 Thread Yi Yang
On Fri, 30 Jun 2023 22:23:19 GMT, Alex Menkov wrote: >> Yi Yang has updated the pull request incrementally with one additional >> commit since the last revision: >> >> memory leak > > I think commit "use HandshakeClosure instead of VMOperation" is

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v5]

2023-06-28 Thread Yi Yang
On Tue, 16 May 2023 18:41:26 GMT, Chris Plummer wrote: >> Hi, can I have a review for this patch? > > @y1yang0 Sorry no one has been able to review this so far. The serviceability > team is very busy for the next few weeks finishing up JDK 21 changes before > RDP1. It's unlikely we'll find

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v14]

2023-06-28 Thread Yi Yang
> | 32g | 32 thread | 10.7734677 secs | 61.643 secs | N | > | 32g | 32 thread | 10.1642097 secs | 10.903 secs | Compress1 | > | 32g | 32 thread | 43.8407607 secs | 88.152 secs | Compress2 | > | 32g | 96 thread | 13.1522042 secs | 61.432 secs | N | > | 32g | 96 thread | 9.09546

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v13]

2023-06-19 Thread Yi Yang
> | 32g | 32 thread | 10.7734677 secs | 61.643 secs | N | > | 32g | 32 thread | 10.1642097 secs | 10.903 secs | Compress1 | > | 32g | 32 thread | 43.8407607 secs | 88.152 secs | Compress2 | > | 32g | 96 thread | 13.1522042 secs | 61.432 secs | N | > | 32g | 96 thread | 9.0954641 secs |

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v12]

2023-06-19 Thread Yi Yang
> | 32g | 32 thread | 10.7734677 secs | 61.643 secs | N | > | 32g | 32 thread | 10.1642097 secs | 10.903 secs | Compress1 | > | 32g | 32 thread | 43.8407607 secs | 88.152 secs | Compress2 | > | 32g | 96 thread | 13.1522042 secs | 61.432 secs | N | > | 32g | 96 thread | 9.0954641 secs | 9

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v11]

2023-06-19 Thread Yi Yang
> | 32g | 32 thread | 10.7734677 secs | 61.643 secs | N | > | 32g | 32 thread | 10.1642097 secs | 10.903 secs | Compress1 | > | 32g | 32 thread | 43.8407607 secs | 88.152 secs | Compress2 | > | 32g | 96 thread | 13.1522042 secs | 61.432 secs | N | > | 32g | 96 thread | 9.0954641 s

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v10]

2023-06-19 Thread Yi Yang
On Sat, 17 Jun 2023 01:20:21 GMT, Alex Menkov wrote: >> Yi Yang has updated the pull request incrementally with one additional >> commit since the last revision: >> >> whitespace > > Could you please add info about what testing have been done Hi @alexmenkov

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v10]

2023-06-18 Thread Yi Yang
On Sat, 17 Jun 2023 01:22:54 GMT, Alex Menkov wrote: > This change adds new option. most likely this requires CSR Hi @alexmenkov, it seems that adding new parameters to jcmd does not require a CSR, only changes like those to jmap do. - PR Review Comment:

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v10]

2023-06-14 Thread Yi Yang
> | 32g | 32 thread | 10.7734677 secs | 61.643 secs | N | > | 32g | 32 thread | 10.1642097 secs | 10.903 secs | Compress1 | > | 32g | 32 thread | 43.8407607 secs | 88.152 secs | Compress2 | > | 32g | 96 thread | 13.1522042 secs | 61.432 secs | N | > | 32g | 96 thread | 9.0954

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v9]

2023-06-14 Thread Yi Yang
> | 32g | 32 thread | 10.7734677 secs | 61.643 secs | N | > | 32g | 32 thread | 10.1642097 secs | 10.903 secs | Compress1 | > | 32g | 32 thread | 43.8407607 secs | 88.152 secs | Compress2 | > | 32g | 96 thread | 13.1522042 secs | 61.432 secs | N | > | 32g | 96 thread | 9.0954641 se

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v5]

2023-06-12 Thread Yi Yang
On Tue, 16 May 2023 18:41:26 GMT, Chris Plummer wrote: >> Hi, can I have a review for this patch? > > @y1yang0 Sorry no one has been able to review this so far. The serviceability > team is very busy for the next few weeks finishing up JDK 21 changes before > RDP1. It's unlikely we'll find

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v8]

2023-06-05 Thread Yi Yang
s | 9.885 secs | Compress1 | > | 32g | 96 thread | 38.9900931 secs | 80.574 secs | Compress2 | > | 64g | 1 thread | 100.583 secs | 100.583 secs | N | > | 64g | 32 thread | 20.9233744 secs | 134.701 secs | N | > | 64g | 32 thread | 18.5023784 secs | 19.358 secs | Compress1 | > | 64g | 32 t

Re: RFR: JDK-8306441: Two-stage Segmented Heap Dump [v7]

2023-06-05 Thread Yi Yang
s | 9.885 secs | Compress1 | > | 32g | 96 thread | 38.9900931 secs | 80.574 secs | Compress2 | > | 64g | 1 thread | 100.583 secs | 100.583 secs | N | > | 64g | 32 thread | 20.9233744 secs | 134.701 secs | N | > | 64g | 32 thread | 18.5023784 secs | 19.358 secs | Compress1 | > | 64g | 32 t

Re: RFR: JDK-8306441: Enhance parallel heap dump [v6]

2023-06-05 Thread Yi Yang
On Mon, 5 Jun 2023 23:44:04 GMT, Alex Menkov wrote: > A lot of code movement is caused by moving AbstractDumpWriter class from > heapDumper.cpp to heapDumpCompression.hpp/cpp > I'm not happy with huge heapDumper.cpp file, but this refactoring does not > look good to me. > Currently all logic

Re: RFR: JDK-8306441: Enhance parallel heap dump [v6]

2023-05-21 Thread Yi Yang
On Thu, 18 May 2023 11:02:21 GMT, Yi Yang wrote: > I'm interested in if it is faster in STW time with the parallel write to use > compression or not? (Does not compressing take time, or does compressing mean > we write fewer bytes, so ends up being faster.) I updated the benchmark

Re: RFR: JDK-8306441: Enhance parallel heap dump [v6]

2023-05-18 Thread Yi Yang
On Thu, 18 May 2023 09:35:36 GMT, Kevin Walls wrote: > I'm interested in if it is faster in STW time with the parallel write to use > compression or not? (Does not compressing take time, or does compressing mean > we write fewer bytes, so ends up being faster.) Hi @kevinjwalls, so far all

Re: RFR: JDK-8306441: Segmented heap dump [v6]

2023-05-17 Thread Yi Yang
verall > time for heapdump(See table above). However, considering the reduction of STW > time, I think it is an acceptable trade-off. Furthermore, there is still room > for optimization in the second merge stage(e.g. > sendfile/splice/copy_file_range instead of read+write combination)

Re: RFR: JDK-8306441: Segmented heap dump [v5]

2023-05-17 Thread Yi Yang
On Mon, 15 May 2023 02:16:43 GMT, Yi Yang wrote: >> Yi Yang has updated the pull request incrementally with one additional >> commit since the last revision: >> >> execute VM_HeapDumper directly > > Hi, can I have a review for this patch? > @y1yang0 Sor

Re: RFR: JDK-8306441: Segmented heap dump [v5]

2023-05-14 Thread Yi Yang
On Wed, 10 May 2023 08:29:43 GMT, Yi Yang wrote: >> Hi, heap dump brings about pauses for application's execution(STW), this is >> a well-known pain. JDK-8252842 have added parallel support to heapdump in an >> attempt to alleviate this issue. However, all concurrent threads

Re: RFR: JDK-8306441: Segmented heap dump [v5]

2023-05-10 Thread Yi Yang
to > hearing comments and discussions about this solution. > > - Client parser support for segmented heap dump > This patch provides a possibility that whether heap dump needs to be complete > or not, can the VM directly generate segmented heapdump, and let the client > parser com

Re: RFR: JDK-8306441: Segmented heap dump [v4]

2023-05-07 Thread Yi Yang
On Thu, 4 May 2023 08:40:10 GMT, Yi Yang wrote: >> Hi, heap dump brings about pauses for application's execution(STW), this is >> a well-known pain. JDK-8252842 have added parallel support to heapdump in an >> attempt to alleviate this issue. However, all concurrent threads

Re: RFR: JDK-8306441: Segmented heap dump [v4]

2023-05-04 Thread Yi Yang
to > hearing comments and discussions about this solution. > > - Client parser support for segmented heap dump > This patch provides a possibility that whether heap dump needs to be complete > or not, can the VM directly generate segmented heapdump, and let the client > parser co

Re: RFR: JDK-8306441: Segmented heap dump [v3]

2023-04-28 Thread Yi Yang
to > hearing comments and discussions about this solution. > > - Client parser support for segmented heap dump > This patch provides a possibility that whether heap dump needs to be complete > or not, can the VM directly generate segmented heapdump, and let the client > parser comp

Re: RFR: JDK-8306441: Segmented heap dump [v2]

2023-04-26 Thread Yi Yang
to > hearing comments and discussions about this solution. > > - Client parser support for segmented heap dump > This patch provides a possibility that whether heap dump needs to be complete > or not, can the VM directly generate segmented heapdump, and let the client >

RFR: JDK-8306441: Segmented heap dump

2023-04-26 Thread Yi Yang
Hi, heap dump brings about pauses for application's execution(STW), this is a well-known pain. JDK-8252842 have added parallel support to heapdump in an attempt to alleviate this issue. However, all concurrent threads competitively write heap data to the same file, and more memory is required

Re: RFR: 8303151: DCmd framework cleanups [v3]

2023-03-05 Thread Yi Yang
The message from this sender included one or more files which could not be scanned for virus detection; do not open these files unless you are certain of the sender's intent. -- On Sun, 5 Mar 2023 05:46:37 GMT, David Holmes

Integrated: 8299518: HotSpotVirtualMachine shared code across different platforms

2023-03-05 Thread Yi Yang
On Tue, 3 Jan 2023 09:34:55 GMT, Yi Yang wrote: > harmless refactor to share code across different platforms of > VirtualMachineImpl: > 1. Shared code to process command response after requesting a command > execution > 2. Read functionality in SocketInputStream can be re

Re: RFR: 8303151: DCmd framework cleanups

2023-03-02 Thread Yi Yang
On Fri, 3 Mar 2023 04:59:44 GMT, David Holmes wrote: > Whilst working on the DCmd code I noticed two items that could be cleaned up: > > 1. The `NMTDCmd` is registered after the call to `register_dcmds()` instead > of inside it. > > 2. The "extension" mechanism to define external DCmds (as

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v8]

2023-03-02 Thread Yi Yang
> harmless refactor to share code across different platforms of > VirtualMachineImpl: > 1. Shared code to process command response after requesting a command > execution > 2. Read functionality in SocketInputStream can be reused Yi Yang has updated the pull request increme

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v2]

2023-03-02 Thread Yi Yang
On Thu, 5 Jan 2023 03:01:22 GMT, Serguei Spitsyn wrote: >> Yi Yang has refreshed the contents of this pull request, and previous >> commits have been removed. The incremental views will show differences >> compared to the previous content of the PR. The pull request co

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v7]

2023-02-27 Thread Yi Yang
> harmless refactor to share code across different platforms of > VirtualMachineImpl: > 1. Shared code to process command response after requesting a command > execution > 2. Read functionality in SocketInputStream can be reused Yi Yang has updated the pull request increme

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v6]

2023-02-26 Thread Yi Yang
On Tue, 10 Jan 2023 10:49:52 GMT, Yi Yang wrote: >> harmless refactor to share code across different platforms of >> VirtualMachineImpl: >> 1. Shared code to process command response after requesting a command >> execution >> 2. Read functionality in SocketInputSt

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v6]

2023-02-14 Thread Yi Yang
On Wed, 11 Jan 2023 19:13:20 GMT, Chris Plummer wrote: >> Yi Yang has updated the pull request incrementally with three additional >> commits since the last revision: >> >> - format >> - Merge branch 'jdk_virtualmachienimpl' of github.com:y1yang0/jdk into >

Re: RFC: regarding metaspace(metadata?) dump

2023-01-11 Thread Yi Yang
ility Agent can also be used to analyze the contents of the class metadata. Dd you look at the existing tools and see how they match up with your requirements? I'd be interested in seeing your implementation and compare it with the existing tools. On 1/11/2023 4:56 AM, Yi Yang wrote: Hi, Internally, w

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v6]

2023-01-10 Thread Yi Yang
> harmless refactor to share code across different platforms of > VirtualMachineImpl: > 1. Shared code to process command response after requesting a command > execution > 2. Read functionality in SocketInputStream can be reused Yi Yang has updated the pull request increment

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v5]

2023-01-09 Thread Yi Yang
> harmless refactor to share code across different platforms of > VirtualMachineImpl: > 1. Shared code to process command response after requesting a command > execution > 2. Read functionality in SocketInputStream can be reused Yi Yang has updated the pull request increme

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v4]

2023-01-08 Thread Yi Yang
On Thu, 5 Jan 2023 04:28:46 GMT, David Holmes wrote: > I was thinking more about describing what the parameters are - in particular > it is unclear why the actual IOE can be replaced by a passed in one. If we > wanted a custom message then I would at least expect to chain the actual IOE > to

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v4]

2023-01-08 Thread Yi Yang
> harmless refactor to share code across different platforms of > VirtualMachineImpl: > 1. Shared code to process command response after requesting a command > execution > 2. Read functionality in SocketInputStream can be reused Yi Yang has updated the pull request increme

Re: RFR: 8299518: HotSpotVirtualMachine shared code across different platforms [v3]

2023-01-08 Thread Yi Yang
On Fri, 6 Jan 2023 22:01:45 GMT, Chris Plummer wrote: > I would also like to request that the variable renames be omitted from this > PR. They create too much noise and would best left to a PR that focuses on > just the renames and possibly other style changes. Okay, reverted. -

  1   2   >