Re: [symfony-users] Doctrine Batch procesing

2010-11-17 Thread Luciano A. Andrade
I am using as I understand the doctrine equivalet of doSelectStmt (or doSelectRS) witch is much more elegant in doctrine, but i get memory leaks or memory that is not retorned to the OS, and not reused by PHP, aparently this is corrected on Doctrine 2 http://www.doctrine-project.org/blog/doctrine2-

Re: [symfony-users] Doctrine Batch procesing

2010-11-16 Thread Gareth McCumskey
This is ridiculous. You mean Doctrine has no resultset function? Using Propel you normally build your criteria for a query and then run a doSelect call which returns your hydrated array. BUT. There is a more memory efficient call (doSelectRS for Propel 1.2 and doSelectStmt for Propel 1.3 and above)

Re: [symfony-users] Doctrine Batch procesing

2010-11-16 Thread Luciano A. Andrade
Thanks Daniel for the response, i am using PHP 5.3.2-1ubuntu4.5 with Suhosin-Patch (cli) (built: Sep 17 2010 13:41:55), read some bug reports related to circula reference and the garbage colector, but they suld be fixed for 5.3. OnDemand hydration did't help, i am currently doing it, i am procesin

Re: [symfony-users] Doctrine Batch procesing

2010-11-16 Thread Rich Sage
I've been there too :-) I've accomplished #3/#4 below by having a parent task which is what's run as your cronjob/batch process. This parent task then spawns subtasks which actually do the work, using some flag/indicator/PK lookup to determine which records to process. So you could do something l

Re: [symfony-users] Doctrine Batch procesing

2010-11-16 Thread Daniel Lohse
That's unfortunate because you really have few options — I know because I've been there just this week. So, array hydration is out of the question, fine, let's see what other options you have: 1. Increase memory of the server (sorry, but it's one option) 2. Use the latest PHP 5.3.x and try to

Re: [symfony-users] Doctrine Batch procesing

2010-11-16 Thread Gareth McCumskey
I don't know doctrine very well, but with propel you can a function to return a resultset instead of an array of objects. My suggestion is go take a look at the Doctrine documentation on the Doctrine site for more info. On 16 Nov 2010 9:48 PM, "Luciano A. Andrade" wrote: I am tyring to make a ba

[symfony-users] Doctrine Batch procesing

2010-11-16 Thread Luciano A. Andrade
I am tyring to make a batch processing for synchronization of two databases, and i am running on limitation of the memory usage. I like to be able to process 3 objects, i can't use arrays for the hydration, since i have some logic i need to execute. I only need one of this object at any time, b