lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread jbv
Hi list, Please excuse the remark, but I'd like to share something I just noticed and that surprised me a bit... I have a file loaded into a variable, which is about 8 Mb and consists in about 4 lines of 3 items each (itemdel is tab). I need to know which line contains a certain value as 3r

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread Mark Schonewille
Hi JB, Repeat for each has proven to be surprisingly fast, before. So, I wouldn't be surprised if it beats the offset function, although I do wonder why the offset function would be that slow. Best, Mark -- Best regards, Mark Schonewille Economy-x-Talk Consulting and Software Engineerin

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread Jim Ault
I would be curious to know how the filter command works with your particular data set. One of the speed difference factors I find is the exact configuration of the data. The filter command works fastest if the 'target' string in the first part of a the line, and repeat for each seems to be much m

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread jbv
Jim, > I would be curious to know how the filter command works with your particular > data set. One of the speed difference factors I find is the exact > configuration of the data. > > The filter command works fastest if the 'target' string in the first part of > a the line, and repeat for each

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread Richard Gaskin
jbv wrote: actually I guess that lineoffset and filter, once compiled, use rather complex routines, while "repeat for each line" remains much closer to raw and efficient C code... Yes, that's my understanding, at least for the filter command which drops into a rather complex regex subsystem, s

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread Ken Ray
> Surprisingly, this takes only 106 ms !!! > If anyone asked me beforehand, I would have sweared that a built-in Rev > function would run faster than a bunch of transcript lines of code... BTW, a very good set of script performance tips by Wil Djykstra are located here: Increasing Script Perform

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread jbv
Richard, > I don't understand why lineoffset is slower, however, and have submitted > a request to have it reviewed for potential optimization: > I'm wondering if lineoffset could get slower when the wholematches are set to false... I m

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread Richard Gaskin
Ken Ray wrote: BTW, a very good set of script performance tips by Wil Djykstra are located here: Increasing Script Performance, Parts I-III: http://www.sonsothunder.com/devres/revolution/tips/scrp005.htm http://www.sonsothunder.com/devres/revolution/tips/scrp006.htm http://www.sonsothunder.com/d

Re: lineoffset slower than "repeat for each line j" ?

2008-05-29 Thread Ken Ray
>> BTW, a very good set of script performance tips by Wil Djykstra are located Wil, if you're seeing this, I just want to apologize for mangling your last name - I just realized it should have been "Dijkstra". (Hey, at least I got the "j" in there! :-) Ken Ray Sons of Thunder Software, Inc. Email