Paul,
Interesting and no I can't say that I have looked into it. I would think the drawback to this approach would be that while this very well might work as you say, in an intelligent optimization the work being done by each IO / AB / (CPU / Core) combination cannot really be cooperative per se. This is because unlike an exhaustive search there is no way to logically split an intelligent optimization except on a generation by generation basis which implies there would have to be communication and/or control between each generation i.e. in order for it to be cooperative I would think there would need to be a higher level piece of software controlling what was happening with each IO / AB combination . or . there would need to be an IOServer like program running for each CPU / Core beyond the first one that gets treated like a sort of local server to the client. _____ From: [email protected] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Ho Sent: Friday, May 23, 2008 2:37 AM To: [email protected] Subject: [amibroker] Re: Quad-core test results --- In [EMAIL PROTECTED] <mailto:amibroker%40yahoogroups.com> ps.com, Fred Tonetti <[EMAIL PROTECTED]> wrote: > > PS . > > > > I have noticed basically the same thing on dual core and core 2 duo type > machines i.e. the same optimization on a single symbol can be run > simultaneously on both cores with no increase in run time . > > > > This seems to apply as well to optimizations on hundreds of symbols . > > I think it all boils down to L2 Cache size, certainly the more symbols + the longer the data series, the larger L2 cache size has to be. Certainly I notice a marked increase in run time with both cores running when the machine is loaded up with symbols and/or with long data series vs few symbols and truncated data series. > > While the tests that TJ performed seemed to imply otherwise, the implication > of the above would seem to be that it would be beneficial for AB to do the > heavy lifting in terms of getting multiple cpu's/cores involved in an > optimization when they exist so that results could be combined in one place. > > I have been able to run multiple instances of IO, one on each cores for about 2 years. All I need to do is to create a separate user login per instance. I always thought that it was possible for IO to treat multiple users on a single machine as multiple machines and use TCP/IP services to communicate. Have you looked into this possibility? > > If this were the case then IO would also take advantage of this on > individual machines as well as on multiple machines simultaneously. > > > > _____ > > From: [EMAIL PROTECTED] <mailto:amibroker%40yahoogroups.com> ps.com [mailto:[EMAIL PROTECTED] <mailto:amibroker%40yahoogroups.com> ps.com] On Behalf > Of Steve Dugas > Sent: Thursday, May 22, 2008 8:50 PM > To: Yahoo - AmiBroker > Subject: [amibroker] Quad-core test results > > > > Hi All, > > > > I finished setting up the new quad-core machine and ran my first tests > today, so am posting the promised test results. All I can say is Wow! > Really nice improvements, even better than I expected to see in my highest > hopes. I am happy as a pig in sh*t !! 8 - ) > > > > For background, the test was an optimization run on a single ticker, which > is how I will be running all my other tests ( ticker was QID, 468 EOD data > bars ). All tests used the same code with different param settings, all > tests had about 46,000 opt steps. > > > > To put things in perspective and show why I am so happy, the original code > was about 2,400 lines. The first time I ran it, on my old backup computer > which I was using as a dedicated optimization machine, it took 7 1/2 hours > to run. So then I copied the code and created a shorter version, removing > everything which wasn't absolutley necessary for the optimizer, and that > reduced the run time to 2 1/2 hours. Then I ran this short version on my > faster primary machine and that took 1 1/4 hours, which is about what I was > expecting to see on the new machine. > > > > So today I started by running just ran one instance on the quad- core - that > took only 30 mins and Task Manager showed it was using just 25% of the total > processing power! Well to make a long story short, I kept adding one > instance at a time, all instances ran in 30 mins and each used up an > additional 25% of the CPU power. In the end, I was easily running 4 > simultaneous instances. This pretty much kept the CPU tached at 100% but all > instances ran fine, all finished in 30 mins and I didn't experience any > problems at all. I was even saving the first ones to spreadsheets while the > final ones were still finishing, wow everything just worked flawlessly! So, > the quad-core can run 4 seperate opts simultaneously in 30 mins, which > averages out to 7 1/2 minutes per opt, which = > > > > 10X improvement over running the short code on the fast machine... > > 20X improvement over running the short code on the old dedicated > optimization machine... > > 60X improvement over running the original code on the old optimization > machine... Awesome !!! > > > > To those who were wondering what is the best machine to get for running AB, > it looks to me like quad is the way to go. ( My machine has an Intel > processor, which TJ mentioned should probably work better than AMD for this > stuff ).... > > > > Steve > > > > > _____ > > I am using the free version of SPAMfighter for private users. > It has removed 459 spam emails to date. > Paying users do not have this message in their emails. > Try SPAMfighter <http://www.spamfigh <http://www.spamfighter.com/len> ter.com/len> for free now! > _____ I am using the free version of SPAMfighter for private users. It has removed 459 spam emails to date. Paying users do not have this message in their emails. Try SPAMfighter <http://www.spamfighter.com/len> for free now!
