Re: Very poor code indexing performances

2022-05-25 Thread Eric Bresie
Since talking performance…Just curious…is it conceivable to add some 
performance test for use during build time testing and gather metrics during a 
given build so with each build/release to get performance historical over time?

Get Outlook for iOS

From: Michael Bien 
Sent: Wednesday, May 25, 2022 6:41:57 PM
To: dev@netbeans.apache.org ; John Neffenger 

Subject: Re: Very poor code indexing performances

On 26.05.22 01:18, John Neffenger wrote:
> On 5/25/22 10:27 AM, Michael Bien wrote:
>> async-profiler[1] combined with flame graphs can be helpful to find
>> bottlenecks of long running tasks (> few seconds).
>
> +1 for async-profiler! It can let you get a much bigger picture than
> is possible with most other profilers, and it often shows you
> immediately what's wrong. For example:
>
> JDK 13 Performance
> https://jgneff.github.io/framebufferY8/2020-05/#jdk-13-performance
>
> It would be a nice addition to the NetBeans profiler. :-)

there is an issue for that (for flame graphs specifically)

https://github.com/apache/netbeans/issues/3849

I suppose it would be nice to have an async-profiler plugin for
discoverabiity reasons, but I personally would keep using it's CLI since
it doesn't require any setup anyway.

-mbien

>
> John
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
> For additional commands, e-mail: dev-h...@netbeans.apache.org
>
> For further information about the NetBeans mailing lists, visit:
> https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
>
>
>


-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Re: Very poor code indexing performances

2022-05-25 Thread Michael Bien

On 26.05.22 01:18, John Neffenger wrote:

On 5/25/22 10:27 AM, Michael Bien wrote:
async-profiler[1] combined with flame graphs can be helpful to find 
bottlenecks of long running tasks (> few seconds).


+1 for async-profiler! It can let you get a much bigger picture than 
is possible with most other profilers, and it often shows you 
immediately what's wrong. For example:


JDK 13 Performance
https://jgneff.github.io/framebufferY8/2020-05/#jdk-13-performance

It would be a nice addition to the NetBeans profiler. :-)


there is an issue for that (for flame graphs specifically)

https://github.com/apache/netbeans/issues/3849

I suppose it would be nice to have an async-profiler plugin for 
discoverabiity reasons, but I personally would keep using it's CLI since 
it doesn't require any setup anyway.


-mbien



John

-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists






-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Re: Very poor code indexing performances

2022-05-25 Thread John Neffenger

On 5/25/22 10:27 AM, Michael Bien wrote:
async-profiler[1] combined with flame graphs can be helpful to find 
bottlenecks of long running tasks (> few seconds).


+1 for async-profiler! It can let you get a much bigger picture than is 
possible with most other profilers, and it often shows you immediately 
what's wrong. For example:


JDK 13 Performance
https://jgneff.github.io/framebufferY8/2020-05/#jdk-13-performance

It would be a nice addition to the NetBeans profiler. :-)

John

-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Re: [RELEASES] 14 remaining issues

2022-05-25 Thread Matthias Bläsing
Hi,

Am Mittwoch, dem 25.05.2022 um 21:54 +0200 schrieb Eric Barboni:
> I see the thread of Jean-Marc on the indexing perf. Matthias do you want to 
> try to revert on NB14 or on NB 15 ?

no. This won't be quick and surely nothing to be rushed in.

Greetings

Matthias

-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Re: [RELEASES] 14 remaining issues

2022-05-25 Thread Laszlo Kishalmi

I'd vote for NB15 and more analysis on that one.

This NB14 starts to feel like a never ending story.

On 5/25/22 12:54, Eric Barboni wrote:

Hil,
Release build is back. I may change it after this release to use more standard 
github orga instead of ASF special plugin (waiting for infra on this point)

We have 2 PR merged for rc6 (rc5 is lost in space bug fixe + performance).

I see the thread of Jean-Marc on the indexing perf. Matthias do you want to try 
to revert on NB14 or on NB 15 ?

Best Regards
Eric


-Message d'origine-
De : Michael Bien <>
Envoyé : mercredi 25 mai 2022 11:57
À : dev@netbeans.apache.org; Neil C Smith 
Objet : Re: [RELEASES] 14 remaining issues

On 25.05.22 10:06, Neil C Smith wrote:

I finally have the internet connection set up in the new place! :-)

oh. quick, everyone behave! :)

congrats on your new place (and internet)

-michael


-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





RE: [RELEASES] 14 remaining issues

2022-05-25 Thread Eric Barboni
Hil, 
Release build is back. I may change it after this release to use more standard 
github orga instead of ASF special plugin (waiting for infra on this point)

We have 2 PR merged for rc6 (rc5 is lost in space bug fixe + performance).

I see the thread of Jean-Marc on the indexing perf. Matthias do you want to try 
to revert on NB14 or on NB 15 ?

Best Regards
Eric


-Message d'origine-
De : Michael Bien <> 
Envoyé : mercredi 25 mai 2022 11:57
À : dev@netbeans.apache.org; Neil C Smith 
Objet : Re: [RELEASES] 14 remaining issues

On 25.05.22 10:06, Neil C Smith wrote:
> I finally have the internet connection set up in the new place! :-)

oh. quick, everyone behave! :)

congrats on your new place (and internet)

-michael


-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Re: Very poor code indexing performances

2022-05-25 Thread Michael Bien

I fear benchmarking this will be annoying

async-profiler[1] combined with flame graphs can be helpful to find 
bottlenecks of long running tasks (> few seconds).


very easy to use, low overhead, can be attached at runtime

$ ./profiler.sh -d 30 -f ./flamegraph.html 52218
Profiling for 30 seconds
Done

(might require setting some kernel flags and sometimes JVM flags to 
improve the output but the default is often useable)


its usually the first thing I do when I have to optimize something - 
before even looking at the code.


-mbien

[1] https://github.com/jvm-profiling-tools/async-profiler


On 25.05.22 18:01, Matthias Bläsing wrote:

Hi,

this might be related:

https://github.com/apache/netbeans/pull/3516

I also had the feeling, that performance suffered from it, but Dusan
neither reacted to a direct fix for things, that were broken by that
PR, nor to later requests for other performance fixes.

Might be worth trying to revert that and see if performance improves
(this might need revert too as it was the followup fix:
https://github.com/apache/netbeans/pull/3583)

If reverting the PR helps, we should consider that.

Greetings

Matthias

Am Mittwoch, dem 25.05.2022 um 15:25 + schrieb Jean-Marc Borer:

Hello,

Since NB 13 and Java 17, I am experiencing again poor code indexing
performances as it used to be with older version of NB. 12.4 was running
fine.

I checked the IDE logs and see only entries like:
INFO [null]: Last record repeated again.
WARNING [org.netbeans.modules.maven.nodes.DependenciesNode]: Could not
determine module name for artifact null
WARNING [null]: Last record repeated 2 more times.
INFO [org.netbeans.ui.metrics.debugger]: Debugger session
crystal-position-application-acc-nimbus started at localhost for Java
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [null]: Last record repeated again.
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
WARNING [org.netbeans.modules.java.source.parsing.VanillaPartialReparser]:
Javac returned startpos: 17?726 > endpos: -1
I
I have not idea what happens. Indeed I have a bunch of small JAXB generated
files with my projects, but I used not to be an issue.

I am running on a SSD disk.

*Product Version:* Apache NetBeans IDE 13

*Java:* 17.0.2; OpenJDK 64-Bit Server VM 17.0.2+8-LTS

*Runtime:* OpenJDK Runtime Environment 17.0.2+8-LTS

*System:* Windows 10 version 10.0 running on amd64; Cp1252; en_US (nb)

*User directory:* C:\Users\borerjc\AppData\Roaming\NetBeans\13

*Cache directory:* C:\projects\.netbeans\cache\13


Any help would be appreciated.


Cheers,


JMB


-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists






-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Re: Very poor code indexing performances

2022-05-25 Thread Matthias Bläsing
Hi,

this might be related:

https://github.com/apache/netbeans/pull/3516

I also had the feeling, that performance suffered from it, but Dusan
neither reacted to a direct fix for things, that were broken by that
PR, nor to later requests for other performance fixes.

Might be worth trying to revert that and see if performance improves
(this might need revert too as it was the followup fix:
https://github.com/apache/netbeans/pull/3583)

If reverting the PR helps, we should consider that.

Greetings

Matthias

Am Mittwoch, dem 25.05.2022 um 15:25 + schrieb Jean-Marc Borer:
> Hello,
> 
> Since NB 13 and Java 17, I am experiencing again poor code indexing
> performances as it used to be with older version of NB. 12.4 was running
> fine.
> 
> I checked the IDE logs and see only entries like:
> INFO [null]: Last record repeated again.
> WARNING [org.netbeans.modules.maven.nodes.DependenciesNode]: Could not
> determine module name for artifact null
> WARNING [null]: Last record repeated 2 more times.
> INFO [org.netbeans.ui.metrics.debugger]: Debugger session
> crystal-position-application-acc-nimbus started at localhost for Java
> INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
> Scanning in progress, trying again in 10?000ms
> INFO [null]: Last record repeated again.
> INFO [org.netbeans.modules.subversion.FileStatusCache]:
> FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
> INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
> Scanning in progress, trying again in 10?000ms
> INFO [org.netbeans.modules.subversion.FileStatusCache]:
> FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
> INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
> Scanning in progress, trying again in 10?000ms
> INFO [org.netbeans.modules.subversion.FileStatusCache]:
> FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
> INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
> Scanning in progress, trying again in 10?000ms
> INFO [org.netbeans.modules.subversion.FileStatusCache]:
> FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
> INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
> Scanning in progress, trying again in 10?000ms
> WARNING [org.netbeans.modules.java.source.parsing.VanillaPartialReparser]:
> Javac returned startpos: 17?726 > endpos: -1
> I
> I have not idea what happens. Indeed I have a bunch of small JAXB generated
> files with my projects, but I used not to be an issue.
> 
> I am running on a SSD disk.
> 
> *Product Version:* Apache NetBeans IDE 13
> 
> *Java:* 17.0.2; OpenJDK 64-Bit Server VM 17.0.2+8-LTS
> 
> *Runtime:* OpenJDK Runtime Environment 17.0.2+8-LTS
> 
> *System:* Windows 10 version 10.0 running on amd64; Cp1252; en_US (nb)
> 
> *User directory:* C:\Users\borerjc\AppData\Roaming\NetBeans\13
> 
> *Cache directory:* C:\projects\.netbeans\cache\13
> 
> 
> Any help would be appreciated.
> 
> 
> Cheers,
> 
> 
> JMB


-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Very poor code indexing performances

2022-05-25 Thread Jean-Marc Borer
Hello,

Since NB 13 and Java 17, I am experiencing again poor code indexing
performances as it used to be with older version of NB. 12.4 was running
fine.

I checked the IDE logs and see only entries like:
INFO [null]: Last record repeated again.
WARNING [org.netbeans.modules.maven.nodes.DependenciesNode]: Could not
determine module name for artifact null
WARNING [null]: Last record repeated 2 more times.
INFO [org.netbeans.ui.metrics.debugger]: Debugger session
crystal-position-application-acc-nimbus started at localhost for Java
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [null]: Last record repeated again.
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.subversion.FileStatusCache]:
FileStatusCache.refreshTask: Scanning in progress, trying again in 10?000ms
INFO [org.netbeans.modules.git.status]: GitInterceptor.refreshTask:
Scanning in progress, trying again in 10?000ms
WARNING [org.netbeans.modules.java.source.parsing.VanillaPartialReparser]:
Javac returned startpos: 17?726 > endpos: -1
I
I have not idea what happens. Indeed I have a bunch of small JAXB generated
files with my projects, but I used not to be an issue.

I am running on a SSD disk.

*Product Version:* Apache NetBeans IDE 13

*Java:* 17.0.2; OpenJDK 64-Bit Server VM 17.0.2+8-LTS

*Runtime:* OpenJDK Runtime Environment 17.0.2+8-LTS

*System:* Windows 10 version 10.0 running on amd64; Cp1252; en_US (nb)

*User directory:* C:\Users\borerjc\AppData\Roaming\NetBeans\13

*Cache directory:* C:\projects\.netbeans\cache\13


Any help would be appreciated.


Cheers,


JMB


Re: [RELEASES] 14 remaining issues

2022-05-25 Thread Michael Bien

On 25.05.22 10:06, Neil C Smith wrote:

I finally have the internet connection set up in the new place! :-)


oh. quick, everyone behave! :)

congrats on your new place (and internet)

-michael


-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





RE: [RELEASES] 14 remaining issues

2022-05-25 Thread Eric Barboni
Hi Neil,
 Congrats for your new home

 I had no follow up to the ticket yet. I tried to rerun yesterday with the same 
timeout issue (I have no clue others similar job are ok maybe our gitbox is too 
huge). As I used rc5 we could go for rc6.
 We could merge PR meanwhile.

Regards
Eric
-Message d'origine-
De : Neil C Smith <> 
Envoyé : mercredi 25 mai 2022 10:06
À : dev@netbeans.apache.org
Objet : Re: [RELEASES] 14 remaining issues

On Tue, 24 May 2022 at 11:36, Michael Bien  wrote:
> if this PR would cause another RC and another week delay i think we 
> should leave it out.

Well, we haven't been able to build RC5 yet as far as I know?!  So, shouldn't 
delay further and might be good to have.

I might also add https://github.com/apache/netbeans/pull/4147 if we are, 
although it would need rebasing on delivery.

On Mon, 23 May 2022 at 18:30, Eric Barboni  wrote:
> Except if it save the world do not expect me to merge on delivery 
> until release150 (😝)

I finally have the internet connection set up in the new place! :-) So, if you 
want to stick to that and/or need me to pick up any tasks, give me a shout.

Best wishes,

Neil

-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





Re: [RELEASES] 14 remaining issues

2022-05-25 Thread Neil C Smith
On Tue, 24 May 2022 at 11:36, Michael Bien  wrote:
> if this PR would cause another RC and another week delay i think we
> should leave it out.

Well, we haven't been able to build RC5 yet as far as I know?!  So,
shouldn't delay further and might be good to have.

I might also add https://github.com/apache/netbeans/pull/4147 if we
are, although it would need rebasing on delivery.

On Mon, 23 May 2022 at 18:30, Eric Barboni  wrote:
> Except if it save the world do not expect me to merge on delivery until 
> release150 (😝)

I finally have the internet connection set up in the new place! :-)
So, if you want to stick to that and/or need me to pick up any tasks,
give me a shout.

Best wishes,

Neil

-
To unsubscribe, e-mail: dev-unsubscr...@netbeans.apache.org
For additional commands, e-mail: dev-h...@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists