Thanks again for everyone's expertise. This is vey helpful.
Gary From: [email protected] [mailto:[email protected]] On Behalf Of Geert Josten Sent: Friday, July 20, 2012 2:13 PM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] query external files? Hi Gary, As David sais, you can't use CTS functions nor search library on these files, but you can quite easily access documents that remain on the server, provided you know the location, and apply normal XPath/XQuery on them. You can use xdmp:document-get, or xdmp:filesystem-file to read individual files. You can even use xdmp:filesystem-directory to get a file listing. You could of course combine these various functions to search through the contents of these file one by one to find appropriate ones, but that would be a performance killer. You want to do such things within a MarkLogic database. An Express license can store about 40 Gb in total. That is not enough for your use case? Note: there are some tricks to exclude certain documents in a database from indexes. Kind regards, Geert Van: [email protected] [mailto:[email protected]] Namens Gary Larsen Verzonden: vrijdag 20 juli 2012 19:30 Aan: 'MarkLogic Developer Discussion' Onderwerp: Re: [MarkLogic Dev General] query external files? HI David, Thanks for the info. The external files are report specifications from a BI product. The application was built using eXist and the volume of data was too much for it to handle and this data was not being queried. With MarkLogic this is not a concern and will be in the database at some point. This is a one off project I'm working on and hoping I could combine external and db data. How would a hybrid of Saxon and ML work? The files have no relative location to ML so absolute locations will need to be used. It's a single ML server. Thanks, Gary From: [email protected] [mailto:[email protected]] On Behalf Of David Lee Sent: Friday, July 20, 2012 1:10 PM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] query external files? Simple answer: "no" XML must be loaded into the database to be queried. Complex answer: "it depends" Using various tools you can bring XML into marklogic then query it. For example using XCC (say with a tool like xmlsh (www.xmlsh.org)) you can bring XML into ML as a string then convert it to XML and query it. Similarly from within XQuery you can access files from the file system, load them into ML and query . Question: Where are your files compared to your marklogic server ? Question: Do you have a cluster or a single ML server ? Question: Do you need ML to query the files or are you willing to use a hybrid like Saxon to query local files then ML to query DB files ? Why or why not ? Question: Why are your XML files not in MarkLogic ? Similar if you had an RDBMS like Oracle or MySQL would you expect it to query data not in the database ? Why or why not ? ---------------------------------------------------------------------------- - David Lee Lead Engineer MarkLogic Corporation [email protected] Phone: +1 650-287-2531 Cell: +1 812-630-7622 www.marklogic.com <http://www.marklogic.com/> This e-mail and any accompanying attachments are confidential. The information is intended solely for the use of the individual to whom it is addressed. Any review, disclosure, copying, distribution, or use of this e-mail communication by others is strictly prohibited. If you are not the intended recipient, please notify us immediately by returning this message to the sender and delete all copies. Thank you for your cooperation. From: [email protected] [mailto:[email protected]] On Behalf Of Gary Larsen Sent: Friday, July 20, 2012 1:05 PM To: 'MarkLogic Developer Discussion' Subject: [MarkLogic Dev General] query external files? Hi, Is it possible to query XML data in external files in a CTS query? (similar to Saxon) This sounds stupid, but before a conversion to MarkLogic I had to minimize the database size and kept XML data that wasn't queried on the file system. This data will eventually be loaded, but now would like retrieve some elements from these files. Thanks, Gary Larsen Envisn Inc. 978-779-0400 x202 508-259-6465 (cell)
_______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
