Re: Profiling DMD's Compilation Time with dmdprof

2018-11-18 Thread Nicholas Wilson via Digitalmars-d-announce
On Sunday, 18 November 2018 at 04:38:57 UTC, Basile B. wrote: Damn, you're right. Actually i didn't try your stuff at all and instead used callgrind intuitively. Bad advice was here: https://github.com/dlang/dmd/pull/8945#issuecomment-439388332. Also along the thread there was discussion about

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-17 Thread Basile B. via Digitalmars-d-announce
On Sunday, 18 November 2018 at 01:12:04 UTC, Vladimir Panteleev wrote: On Saturday, 17 November 2018 at 23:01:23 UTC, Basile B. wrote: I put a start to the project then today i remembered callgrind... What are the pros and cons in comparison with callgrind ? By coincidence i had to callgrind

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-17 Thread Vladimir Panteleev via Digitalmars-d-announce
On Saturday, 17 November 2018 at 23:01:23 UTC, Basile B. wrote: I put a start to the project then today i remembered callgrind... What are the pros and cons in comparison with callgrind ? By coincidence i had to callgrind dmd today and got answers to a performance issue in a very straight

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-17 Thread Basile B. via Digitalmars-d-announce
On Tuesday, 6 November 2018 at 18:00:22 UTC, Vladimir Panteleev wrote: This is a tool + article I wrote in February, but never got around to finishing / publishing until today. https://blog.thecybershadow.net/2018/02/07/dmdprof/ Hopefully someone will find it useful. I put a start to the

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-17 Thread welkam via Digitalmars-d-announce
On Saturday, 17 November 2018 at 12:36:30 UTC, rikki cattermole wrote: Just in case, did you disable your anti-virus first? Had to edit registry to turn that thing off and it still some times popup. Microsoft is so annoying. https://imgur.com/a/x3cKjZm

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-17 Thread rikki cattermole via Digitalmars-d-announce
On 18/11/2018 1:29 AM, welkam wrote: I just updated DMD on my windows and tried to compile hello world. It took 7.4 sec. Something is not right. Can anyone reproduce? On the same mashine running linux it compiles and runs in 0.1 sec PS C:\Users\Welkam\Desktop\Projects> Measure-Command {dmd

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-17 Thread welkam via Digitalmars-d-announce
I just updated DMD on my windows and tried to compile hello world. It took 7.4 sec. Something is not right. Can anyone reproduce? On the same mashine running linux it compiles and runs in 0.1 sec PS C:\Users\Welkam\Desktop\Projects> Measure-Command {dmd -run main.d} Days : 0

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-17 Thread Vladimir Panteleev via Digitalmars-d-announce
On Saturday, 17 November 2018 at 06:21:20 UTC, Manu wrote: What was the batch size for module grouping? I just use dmd -i, which compiles everything at once (except Phobos/Druntime).

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-16 Thread Manu via Digitalmars-d-announce
On Thu, Nov 15, 2018 at 8:00 PM Vladimir Panteleev via Digitalmars-d-announce wrote: > > On Thursday, 15 November 2018 at 19:18:27 UTC, Manu wrote: > > I'm not sure how VisualStudio (read: MSBuild) should behave > > differently than make? > > It's not like the build script is taking a long time,

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-15 Thread Vladimir Panteleev via Digitalmars-d-announce
On Thursday, 15 November 2018 at 19:18:27 UTC, Manu wrote: I'm not sure how VisualStudio (read: MSBuild) should behave differently than make? It's not like the build script is taking a long time, it's the invocation of DMD that takes 100% of that time. That seems to take about half the time

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-15 Thread Manu via Digitalmars-d-announce
Wed, Nov 14, 2018 at 12:25 AM Vladimir Panteleev via Digitalmars-d-announce wrote: > > On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: > > And all builds are release builds... what good is a debug > > build? DMD > > is unbelievably slow in debug. If it wasn't already slow > > enough...

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-14 Thread Vladimir Panteleev via Digitalmars-d-announce
On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: And all builds are release builds... what good is a debug build? DMD is unbelievably slow in debug. If it wasn't already slow enough... if I try and build with a debug build, it takes closer to 5 minutes. I just got to try a

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Rainer Schuetze via Digitalmars-d-announce
On 09/11/2018 00:12, kinke wrote: > On Thursday, 8 November 2018 at 20:19:47 UTC, Vladimir Panteleev wrote: >> Sounds like we're narrowing it down to the Visual Studio solution. > > Mildly interested, I gave DMD master a shot with my 5-years old i5-3550 > (@4 GHz) in VS 2017 (+ a recent Visual

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread kinke via Digitalmars-d-announce
On Thursday, 8 November 2018 at 20:19:47 UTC, Vladimir Panteleev wrote: Sounds like we're narrowing it down to the Visual Studio solution. Mildly interested, I gave DMD master a shot with my 5-years old i5-3550 (@4 GHz) in VS 2017 (+ a recent Visual D beta): DMD v2.083.0-beta1 host compiler

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread John Chapman via Digitalmars-d-announce
On Thursday, 8 November 2018 at 20:19:47 UTC, Vladimir Panteleev wrote: On Thursday, 8 November 2018 at 19:07:32 UTC, Jacob Carlborg wrote: 21 seconds on a Windows 10 virtual machine compiling using the win32.mak file. Sounds like we're narrowing it down to the Visual Studio solution.

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Vladimir Panteleev via Digitalmars-d-announce
On Thursday, 8 November 2018 at 19:07:32 UTC, Jacob Carlborg wrote: 21 seconds on a Windows 10 virtual machine compiling using the win32.mak file. Sounds like we're narrowing it down to the Visual Studio solution.

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Jacob Carlborg via Digitalmars-d-announce
On 2018-11-08 18:25, Jacob Carlborg wrote: This is my result on macOS: $ $ make -f posix.mak clean $ time make -f posix.mak -j 16 real    0m3.127s user    0m5.478s sys    0m1.686s 21 seconds on a Windows 10 virtual machine compiling using the win32.mak file. -- /Jacob Carlborg

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread H. S. Teoh via Digitalmars-d-announce
On Thu, Nov 08, 2018 at 06:25:06PM +0100, Jacob Carlborg via Digitalmars-d-announce wrote: > On 2018-11-08 05:16, Manu wrote: > > > 4 seconds? That's just untrue. D is actually kinda slow these > > days... In my experience it's slower than modern C++ compilers by > > quite a lot. > > This is

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Jacob Carlborg via Digitalmars-d-announce
On 2018-11-08 05:16, Manu wrote: 4 seconds? That's just untrue. D is actually kinda slow these days... In my experience it's slower than modern C++ compilers by quite a lot. This is my result on macOS: $ $ make -f posix.mak clean $ time make -f posix.mak -j 16 real0m3.127s user

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Vladimir Panteleev via Digitalmars-d-announce
On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: https://youtu.be/msWuRlD3zy0 DMD only builds with one core, since it builds altogether. And all builds are release builds... what good is a debug build? DMD is unbelievably slow in debug. If it wasn't already slow enough... if I try

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Petar via Digitalmars-d-announce
On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: On Wed, Nov 7, 2018 at 10:30 PM Vladimir Panteleev via Digitalmars-d-announce wrote: On Thursday, 8 November 2018 at 06:08:20 UTC, Vladimir Panteleev wrote: > It was definitely about 4 seconds not too long ago, a few > years at

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread welkam via Digitalmars-d-announce
On Tuesday, 6 November 2018 at 19:01:58 UTC, H. S. Teoh wrote: It looks like it would be really useful one day when I try to tackle the dmd-on-lowmem-system problem again. Based on my profiling it seems that most memory is allocated in void importAll(Scope* sc) found in attrib.d . A person

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Atila Neves via Digitalmars-d-announce
On Thursday, 8 November 2018 at 04:16:44 UTC, Manu wrote: On Tue, Nov 6, 2018 at 10:05 AM Vladimir Panteleev via Digitalmars-d-announce wrote: This is a tool + article I wrote in February, but never got around to finishing / publishing until today.

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Manu via Digitalmars-d-announce
On Thu, Nov 8, 2018 at 12:55 AM Joakim via Digitalmars-d-announce wrote: > > On Thursday, 8 November 2018 at 08:29:28 UTC, Manu wrote: > > On Thu, Nov 8, 2018 at 12:10 AM Joakim via > > Digitalmars-d-announce > > wrote: > >> > >> On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: > > > >

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Joakim via Digitalmars-d-announce
On Thursday, 8 November 2018 at 08:29:28 UTC, Manu wrote: On Thu, Nov 8, 2018 at 12:10 AM Joakim via Digitalmars-d-announce wrote: On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: > On Wed, Nov 7, 2018 at 10:30 PM Vladimir Panteleev via > Digitalmars-d-announce > wrote: >> >> On

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Manu via Digitalmars-d-announce
On Thu, Nov 8, 2018 at 12:10 AM Walter Bright via Digitalmars-d-announce wrote: > > On 11/7/2018 11:41 PM, Manu wrote: > > I'm on an i7 with 8 threads and plenty of ram... although threads are > > useless, since DMD only uses one ;) > > So does every other compiler. > > To do a multicore build,

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Manu via Digitalmars-d-announce
On Thu, Nov 8, 2018 at 12:10 AM Joakim via Digitalmars-d-announce wrote: > > On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: > > On Wed, Nov 7, 2018 at 10:30 PM Vladimir Panteleev via > > Digitalmars-d-announce > > wrote: > >> > >> On Thursday, 8 November 2018 at 06:08:20 UTC, Vladimir

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Joakim via Digitalmars-d-announce
On Thursday, 8 November 2018 at 07:54:56 UTC, Manu wrote: On Wed, Nov 7, 2018 at 10:30 PM Vladimir Panteleev via Digitalmars-d-announce wrote: On Thursday, 8 November 2018 at 06:08:20 UTC, Vladimir Panteleev wrote: > It was definitely about 4 seconds not too long ago, a few > years at

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Walter Bright via Digitalmars-d-announce
On 11/7/2018 11:41 PM, Manu wrote: I'm on an i7 with 8 threads and plenty of ram... although threads are useless, since DMD only uses one ;) So does every other compiler. To do a multicore build, you'll need to use a makefile that supports -j.

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Walter Bright via Digitalmars-d-announce
On 11/7/2018 10:08 PM, Vladimir Panteleev wrote: It does seem to take more time now; I wonder why. That's easy. It's because nobody has profiled it for years. Another reason is the backend being in D now, it is being compiled with DMD rather than gcc/clang.

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-08 Thread Manu via Digitalmars-d-announce
On Wed, Nov 7, 2018 at 11:55 PM Joakim via Digitalmars-d-announce wrote: > > On Thursday, 8 November 2018 at 07:41:58 UTC, Manu wrote: > > On Wed, Nov 7, 2018 at 10:30 PM Joakim via > > Digitalmars-d-announce > > wrote: > >> > >> On Thursday, 8 November 2018 at 04:16:44 UTC, Manu wrote: > >> >

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Manu via Digitalmars-d-announce
On Wed, Nov 7, 2018 at 10:30 PM Vladimir Panteleev via Digitalmars-d-announce wrote: > > On Thursday, 8 November 2018 at 06:08:20 UTC, Vladimir Panteleev > wrote: > > It was definitely about 4 seconds not too long ago, a few years > > at most. > > No, it's still 4 seconds. > > digger --offline

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Joakim via Digitalmars-d-announce
On Thursday, 8 November 2018 at 07:41:58 UTC, Manu wrote: On Wed, Nov 7, 2018 at 10:30 PM Joakim via Digitalmars-d-announce wrote: On Thursday, 8 November 2018 at 04:16:44 UTC, Manu wrote: > On Tue, Nov 6, 2018 at 10:05 AM Vladimir Panteleev via > Digitalmars-d-announce > wrote: >> [...]

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Manu via Digitalmars-d-announce
On Wed, Nov 7, 2018 at 10:30 PM Joakim via Digitalmars-d-announce wrote: > > On Thursday, 8 November 2018 at 04:16:44 UTC, Manu wrote: > > On Tue, Nov 6, 2018 at 10:05 AM Vladimir Panteleev via > > Digitalmars-d-announce > > wrote: > >> [...] > > > > "Indeed, a clean build of DMD itself (about

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Manu via Digitalmars-d-announce
On Wed, Nov 7, 2018 at 10:10 PM Vladimir Panteleev via Digitalmars-d-announce wrote: > > On Thursday, 8 November 2018 at 04:16:44 UTC, Manu wrote: > > ...what!? DMD takes me... (compiling) ... 1 minute 40 seconds > > to build! And because DMD does all-files-at-once compilation, > > rather than

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Joakim via Digitalmars-d-announce
On Thursday, 8 November 2018 at 04:16:44 UTC, Manu wrote: On Tue, Nov 6, 2018 at 10:05 AM Vladimir Panteleev via Digitalmars-d-announce wrote: [...] "Indeed, a clean build of DMD itself (about 170’000 lines of D and 120’000 lines of C/C++) takes no longer than 4 seconds to build on a

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Vladimir Panteleev via Digitalmars-d-announce
On Thursday, 8 November 2018 at 06:08:20 UTC, Vladimir Panteleev wrote: It was definitely about 4 seconds not too long ago, a few years at most. No, it's still 4 seconds. digger --offline --config-file=/dev/null -j auto -c local.cache=none build 7.31s user 1.51s system 203% cpu 4.340

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Vladimir Panteleev via Digitalmars-d-announce
On Thursday, 8 November 2018 at 04:16:44 UTC, Manu wrote: ...what!? DMD takes me... (compiling) ... 1 minute 40 seconds to build! And because DMD does all-files-at-once compilation, rather than separate compilation for each source file, whenever you change just one line in one file, you incur

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Manu via Digitalmars-d-announce
On Tue, Nov 6, 2018 at 10:05 AM Vladimir Panteleev via Digitalmars-d-announce wrote: > > This is a tool + article I wrote in February, but never got > around to finishing / publishing until today. > > https://blog.thecybershadow.net/2018/02/07/dmdprof/ > > Hopefully someone will find it useful.

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Manu via Digitalmars-d-announce
On Wed, Nov 7, 2018 at 8:18 PM Manu wrote: > > On Wed, Nov 7, 2018 at 8:16 PM Manu wrote: > > > > On Tue, Nov 6, 2018 at 10:05 AM Vladimir Panteleev via > > Digitalmars-d-announce wrote: > > > > > > This is a tool + article I wrote in February, but never got > > > around to finishing /

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Manu via Digitalmars-d-announce
On Wed, Nov 7, 2018 at 8:16 PM Manu wrote: > > On Tue, Nov 6, 2018 at 10:05 AM Vladimir Panteleev via > Digitalmars-d-announce wrote: > > > > This is a tool + article I wrote in February, but never got > > around to finishing / publishing until today. > > > >

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Neia Neutuladh via Digitalmars-d-announce
On Thu, 08 Nov 2018 14:35:29 +1300, rikki cattermole wrote: > Its a symptom of a larger set of problems. The frontend is not quite > ready to have the GC turned on full time. > > Based upon my testing, that little memory leak prevents pretty much > *all* memory allocated by the GC to not be

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread rikki cattermole via Digitalmars-d-announce
On 08/11/2018 4:17 AM, Neia Neutuladh wrote: On Thu, 08 Nov 2018 01:49:49 +1300, rikki cattermole wrote: On 08/11/2018 1:46 AM, Patrick Schluter wrote: Now that the compiler is completely in D, wouldn't it be a good idea to activate the GC in the compiler. I know that it requires some care for

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Neia Neutuladh via Digitalmars-d-announce
On Thu, 08 Nov 2018 01:49:49 +1300, rikki cattermole wrote: > On 08/11/2018 1:46 AM, Patrick Schluter wrote: >> Now that the compiler is completely in D, wouldn't it be a good idea to >> activate the GC in the compiler. I know that it requires some care for >> bootstrapping the compiler when there

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread rikki cattermole via Digitalmars-d-announce
On 08/11/2018 1:46 AM, Patrick Schluter wrote: Now that the compiler is completely in D, wouldn't it be a good idea to activate the GC in the compiler. I know that it requires some care for bootstrapping the compiler when there are dependencies to the D runtime, but the compiler would be an

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-07 Thread Patrick Schluter via Digitalmars-d-announce
On Tuesday, 6 November 2018 at 21:52:30 UTC, H. S. Teoh wrote: On Tue, Nov 06, 2018 at 07:44:41PM +, Atila Neves via Digitalmars-d-announce wrote: On Tuesday, 6 November 2018 at 18:00:22 UTC, Vladimir Panteleev wrote: > This is a tool + article I wrote in February, but never got > around

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-06 Thread H. S. Teoh via Digitalmars-d-announce
On Tue, Nov 06, 2018 at 07:44:41PM +, Atila Neves via Digitalmars-d-announce wrote: > On Tuesday, 6 November 2018 at 18:00:22 UTC, Vladimir Panteleev wrote: > > This is a tool + article I wrote in February, but never got around > > to finishing / publishing until today. > > > >

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-06 Thread Atila Neves via Digitalmars-d-announce
On Tuesday, 6 November 2018 at 18:00:22 UTC, Vladimir Panteleev wrote: This is a tool + article I wrote in February, but never got around to finishing / publishing until today. https://blog.thecybershadow.net/2018/02/07/dmdprof/ Hopefully someone will find it useful. Awesome, great work! I

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-06 Thread Vladimir Panteleev via Digitalmars-d-announce
On Tuesday, 6 November 2018 at 19:01:58 UTC, H. S. Teoh wrote: I don't have the time to look into this right now, but at a cursory glance, WOW. This is awesome! It looks like it would be really useful one day when I try to tackle the dmd-on-lowmem-system problem again. This will greatly help

Re: Profiling DMD's Compilation Time with dmdprof

2018-11-06 Thread H. S. Teoh via Digitalmars-d-announce
On Tue, Nov 06, 2018 at 06:00:22PM +, Vladimir Panteleev via Digitalmars-d-announce wrote: > This is a tool + article I wrote in February, but never got around to > finishing / publishing until today. > > https://blog.thecybershadow.net/2018/02/07/dmdprof/ > > Hopefully someone will find it

Profiling DMD's Compilation Time with dmdprof

2018-11-06 Thread Vladimir Panteleev via Digitalmars-d-announce
This is a tool + article I wrote in February, but never got around to finishing / publishing until today. https://blog.thecybershadow.net/2018/02/07/dmdprof/ Hopefully someone will find it useful.