[Issue 14641] Use SIMD to accelerate comment lexing

https://issues.dlang.org/show_bug.cgi?id=14641 Iain Buclaw changed: What|Removed |Added Priority|P1 |P4 --

[Issue 14641] Use SIMD to accelerate comment lexing

https://issues.dlang.org/show_bug.cgi?id=14641 Walter Bright changed: What|Removed |Added Keywords||SIMD --

Re: Use SIMD to accelerate comment lexing

On Friday, 5 June 2015 at 00:30:44 UTC, Walter Bright wrote: It's an interesting approach. I generally shoot for making the debug builds the fastest, because that's when people are in the edit-compile-debug loop. And the debug output needs line numbers :-) In C++, you would not need line

Re: Use SIMD to accelerate comment lexing

On 6/4/2015 2:44 PM, deadalnix wrote: On Thursday, 4 June 2015 at 18:39:02 UTC, Walter Bright wrote: On 6/3/2015 7:05 PM, deadalnix wrote: On Wednesday, 3 June 2015 at 22:50:52 UTC, Walter Bright wrote: On 6/2/2015 5:45 PM, deadalnix wrote: You go though character and look for a '/'. When

Re: Use SIMD to accelerate comment lexing

On Thursday, 4 June 2015 at 18:39:02 UTC, Walter Bright wrote: Hmm. There's no way to get the line number without counting LFs, and that means searching for them. It would be nice if it was that simple. EndOfLine: \u000D \u000A \u000D \u000A \u2028 \u2029 EndOfFile

Re: Use SIMD to accelerate comment lexing

On Thursday, 4 June 2015 at 18:39:02 UTC, Walter Bright wrote: On 6/3/2015 7:05 PM, deadalnix wrote: On Wednesday, 3 June 2015 at 22:50:52 UTC, Walter Bright wrote: On 6/2/2015 5:45 PM, deadalnix wrote: You go though character and look for a '/'. When you hit one, you check if the character

Re: Use SIMD to accelerate comment lexing

On 6/4/2015 1:44 PM, Brian Schott wrote: It would be nice if it was that simple. EndOfLine: \u000D \u000A \u000D \u000A \u2028 \u2029 EndOfFile Yeah, you're right

Re: Use SIMD to accelerate comment lexing

On 6/3/2015 7:05 PM, deadalnix wrote: On Wednesday, 3 June 2015 at 22:50:52 UTC, Walter Bright wrote: On 6/2/2015 5:45 PM, deadalnix wrote: You go though character and look for a '/'. When you hit one, you check if the character before it is a *, and if so, you have the end of the comment.

Re: Use SIMD to accelerate comment lexing

On 6/2/2015 4:08 PM, Manu via Digitalmars-d wrote: I'll wear responsibility for this, but std.simd is proving really hard for me to finish. I think in order to get something in there to start with, I need to reduce the scope to the simplest bits, get them in, then build outwards. It's fairly

Re: Use SIMD to accelerate comment lexing

On 6/2/2015 5:45 PM, deadalnix wrote: Well, I discussed that with clang people a while ago and here are how they do it and their measurement : You go though character and look for a '/'. When you hit one, you check if the character before it is a *, and if so, you have the end of the comment.

Re: Use SIMD to accelerate comment lexing

Am Wed, 3 Jun 2015 09:08:52 +1000 schrieb Manu via Digitalmars-d digitalmars-d@puremagic.com: As an aside, I need a test environment for each compiler, targetting x86, x64 and arm at least, where I can submit some code, and have it run the unittests on a matrix of appropriate targets. (ideally

Re: Use SIMD to accelerate comment lexing

On 2015-06-03 01:08, Manu via Digitalmars-d wrote: It's fairly large to cover everything I think is important, and there's a few tools missing still; I can't finish without some way to know the SIMD flags fed to the compiler from the command line (some standard versions?), and it's also

Re: Use SIMD to accelerate comment lexing

On 3 June 2015 at 17:50, Jacob Carlborg via Digitalmars-d digitalmars-d@puremagic.com wrote: On 2015-06-03 01:08, Manu via Digitalmars-d wrote: It's fairly large to cover everything I think is important, and there's a few tools missing still; I can't finish without some way to know the SIMD

Re: Use SIMD to accelerate comment lexing

On 3 June 2015 at 11:28, Manu via Digitalmars-d digitalmars-d@puremagic.com wrote: On 3 June 2015 at 17:50, Jacob Carlborg via Digitalmars-d digitalmars-d@puremagic.com wrote: On 2015-06-03 01:08, Manu via Digitalmars-d wrote: It's fairly large to cover everything I think is important,

Re: Use SIMD to accelerate comment lexing

On Wednesday, 3 June 2015 at 22:50:52 UTC, Walter Bright wrote: On 6/2/2015 5:45 PM, deadalnix wrote: Well, I discussed that with clang people a while ago and here are how they do it and their measurement : You go though character and look for a '/'. When you hit one, you check if the

Re: Use SIMD to accelerate comment lexing

On 2 June 2015 at 19:25, Jonathan M Davis via Digitalmars-d digitalmars-d@puremagic.com wrote: On Tuesday, 2 June 2015 at 17:24:09 UTC, Iain Buclaw wrote: On 2 June 2015 at 19:11, Jonathan M Davis via Digitalmars-d digitalmars-d@puremagic.com wrote: On Tuesday, 2 June 2015 at 15:08:07

Re: Use SIMD to accelerate comment lexing

On Tuesday, 2 June 2015 at 17:54:38 UTC, Iain Buclaw wrote: I was being deliberately quizzical because there are different takes on what you would call simd in the language, what set of types are available to you, what intrinsics are exposed (and how they are exposed), etc. Well, Manu would

Re: Use SIMD to accelerate comment lexing

On 6/2/15 5:27 AM, Manu via Digitalmars-d wrote: On 2 June 2015 at 05:39, Walter Bright via Digitalmars-d digitalmars-d@puremagic.com wrote: https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on? How do you measure this? Is

Re: Use SIMD to accelerate comment lexing

On Tuesday, 2 June 2015 at 12:27:38 UTC, Manu wrote: On 2 June 2015 at 05:39, Walter Bright via Digitalmars-d digitalmars-d@puremagic.com wrote: https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on? How do you measure

Re: Use SIMD to accelerate comment lexing

On Tuesday, 2 June 2015 at 18:20:51 UTC, Jonathan M Davis wrote: On Tuesday, 2 June 2015 at 17:54:38 UTC, Iain Buclaw wrote: I was being deliberately quizzical because there are different takes on what you would call simd in the language, what set of types are available to you, what intrinsics

Re: Use SIMD to accelerate comment lexing

On 3 June 2015 at 07:18, weaselcat via Digitalmars-d digitalmars-d@puremagic.com wrote: On Tuesday, 2 June 2015 at 18:20:51 UTC, Jonathan M Davis wrote: On Tuesday, 2 June 2015 at 17:54:38 UTC, Iain Buclaw wrote: I was being deliberately quizzical because there are different takes on what

Re: Use SIMD to accelerate comment lexing

On 2 June 2015 at 05:39, Walter Bright via Digitalmars-d digitalmars-d@puremagic.com wrote: https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on? How do you measure this? Is there a convenient setup that will produce a

Re: Use SIMD to accelerate comment lexing

On 6/2/2015 5:27 AM, Manu via Digitalmars-d wrote: On 2 June 2015 at 05:39, Walter Bright via Digitalmars-d digitalmars-d@puremagic.com wrote: https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on? How do you measure this?

Re: Use SIMD to accelerate comment lexing

On Tuesday, 2 June 2015 at 15:08:07 UTC, Walter Bright wrote: Just make it work with one compiler on one platform, the most convenient one. We can extend it to others later. Plus, within a few months, we may have switched over to ddmd (hopefully), in which case, you can just do it the D way.

Re: Use SIMD to accelerate comment lexing

On 2 June 2015 at 19:11, Jonathan M Davis via Digitalmars-d digitalmars-d@puremagic.com wrote: On Tuesday, 2 June 2015 at 15:08:07 UTC, Walter Bright wrote: Just make it work with one compiler on one platform, the most convenient one. We can extend it to others later. Plus, within a few

Re: Use SIMD to accelerate comment lexing

On Tuesday, 2 June 2015 at 17:24:09 UTC, Iain Buclaw wrote: On 2 June 2015 at 19:11, Jonathan M Davis via Digitalmars-d digitalmars-d@puremagic.com wrote: On Tuesday, 2 June 2015 at 15:08:07 UTC, Walter Bright wrote: Just make it work with one compiler on one platform, the most convenient

Use SIMD to accelerate comment lexing

https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on?

[Issue 14641] New: Use SIMD to accelerate comment lexing

https://issues.dlang.org/show_bug.cgi?id=14641 Issue ID: 14641 Summary: Use SIMD to accelerate comment lexing Product: D Version: D2 Hardware: All OS: All Status: NEW Severity: enhancement

[Issue 14641] Use SIMD to accelerate comment lexing

https://issues.dlang.org/show_bug.cgi?id=14641 briancsch...@gmail.com changed: What|Removed |Added CC||briancsch...@gmail.com --- Comment

Re: Use SIMD to accelerate comment lexing

On Monday, 1 June 2015 at 19:38:59 UTC, Walter Bright wrote: https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on? libdparse does this already. I added some information to that bug report that may be useful.

Re: Use SIMD to accelerate comment lexing

On 6/1/2015 1:18 PM, Brian Schott wrote: libdparse does this already. I added some information to that bug report that may be useful. Thank you!

Re: Use SIMD to accelerate comment lexing

On Monday, 1 June 2015 at 20:18:19 UTC, Brian Schott wrote: On Monday, 1 June 2015 at 19:38:59 UTC, Walter Bright wrote: https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on? libdparse does this already. I added some

Re: Use SIMD to accelerate comment lexing

On Monday, 1 June 2015 at 19:38:59 UTC, Walter Bright wrote: https://issues.dlang.org/show_bug.cgi?id=14641 Manu, our resident god of vector instructions, do you want to take this on? Looking at that code, I would think that some well placed prefetch and Non Temporal move intrinsic's,