Thanks Ron/Semerau. I am doing some repeated but temp work for pre-processing documents for which I found XQuery helpful. Splitting/merging documents which needs to use xpath etc. to create proper documents; in turn those are the documents that I will load using Information Studio. As this is something temporary for me, I am exploring to run this by changing timeout limits.
Thanks, Mehul. From: [email protected] [mailto:[email protected]] On Behalf Of [email protected] Sent: Monday, March 12, 2012 6:53 PM To: [email protected] Subject: Re: [MarkLogic Dev General] Time limit exceeded Came to say what Ron said. You don't want a single process running for 6 hours. You'd have to have extremely long timeout settings (which is dangerous in case something else runs for too long and for locking resources), and if something errored at any time then the entire transaction would be rolled back. You are going to want to break the task into smaller jobs and put each job on the task server. This will also give you much better performance than a single process. If you are loading documents, you can use tools like Information Studio which comes with MarkLogic, or some of the other tools like what Ron mentioned. Using the task server isn't too hard so I'd suggest looking at that regardless and then picking what looks best for your situation/ > From: [email protected] > Date: Mon, 12 Mar 2012 22:39:26 +0000 > To: [email protected] > Subject: Re: [MarkLogic Dev General] Time limit exceeded > > > You set the time limit on the appserver page in > the Admin UI: max time limit and default time limit. > > But if you're trying to do lots of updates, in the 100s > of thousands or millions, in a single transaction, it may > still blow up. Your code will need to acquire locks and > other resources as the transaction progresses. > > You're better off using a batch processing tool like > CORB that makes updates in reasonably sized chunks. > > On Mar 12, 2012, at 9:47 PM, Shah, Mehul (LNG-NPV) wrote: > > > I keep getting "Time limit exceeded" message for long running script. > > > > I have a Xquery script that processes documents, and I want to make sure it > > does not timeout for say 6 hours, is there a way to set it? > > > > Thanks. > > > > _______________________________________________ > > General mailing list > > [email protected]<mailto:[email protected]> > > http://developer.marklogic.com/mailman/listinfo/general > > --- > Ron Hitchens {mailto:[email protected]} Ronsoft Technologies > +44 7879 358 212 (voice) http://www.ronsoft.com > +1 707 924 3878 (fax) Bit Twiddling At Its Finest > "No amount of belief establishes any fact." -Unknown > > > > > _______________________________________________ > General mailing list > [email protected]<mailto:[email protected]> > http://developer.marklogic.com/mailman/listinfo/general
_______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
