Hi David, Perhaps you are opening many documents in one batch? How many files are there in $files?
Kind regards, Geert > Drs. G.P.H. Josten Consultant http://www.daidalos.nl/ Daidalos BV Source of Innovation Hoekeindsehof 1-4 2665 JZ Bleiswijk Tel.: +31 (0) 10 850 1200 Fax: +31 (0) 10 850 1199 http://www.daidalos.nl/ KvK 27164984 De informatie - verzonden in of met dit emailbericht - is afkomstig van Daidalos BV en is uitsluitend bestemd voor de geadresseerde. Indien u dit bericht onbedoeld hebt ontvangen, verzoeken wij u het te verwijderen. Aan dit bericht kunnen geen rechten worden ontleend. > From: general-boun...@developer.marklogic.com > [mailto:general-boun...@developer.marklogic.com] On Behalf Of > Lee, David > Sent: donderdag 21 januari 2010 23:07 > To: General@developer.marklogic.com > Subject: [MarkLogic Dev General] "Too many open files" in ML > Server 4.1.4 / XP > > > > I'm experimenting with bulk-loading XML files by spawning > background tasks to load a set of files. I ran into this just now .. > > > > > > 2010-01-21 16:42:15.718 Notice: TaskServer: SVC-FILOPN: > xdmp:document-load("H:\MarkLogic\NDC/249106.xml", <options > xmlns="xdmp:document-load"><uri>/NDC/249106.xml</uri><repair>n > one</repair></options>) -- File open error: open > 'H:\MarkLogic\NDC/249106.xml': Too many open files > > > > > > Is there any setting in the ML server to increase the # of > file handles ? > Even if so, this is strange, because it seems to imply a file > handle leak. There are only 4 task server threads, surely 4 > files isnt too many. The conclusion must be that this code > doesnt close the file handes. > > > > Here's the xquery which is being spawned. > > > > Its being passed a list of 100 or 1000 files to iteratively load. > > > > ============================= > > > > declare variable $files external; > > > for $f in $files/file > return > if( fn:ends-with( $f/@uri , "/" ) ) then > () (: Create directory :) > else > xdmp:document-load($f/@file/fn:string(), > <options xmlns="xdmp:document-load"> > <uri>{$f/@uri/fn:string()}</uri> > <repair>none</repair> > </options>) > > > > > > > > > > > > > > > > > > ---------------------------------------- > > David A. Lee > > Senior Principal Software Engineer > > Epocrates, Inc. > > d...@epocrates.com > > 812-482-5224 > > > > _______________________________________________ General mailing list General@developer.marklogic.com http://xqzone.com/mailman/listinfo/general
