Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-24 Thread Mark Shanks
t: Re: [MarkLogic Dev General] How to pull data out of marklogic quickly? Hi Mark, For the moment it would be better to avoid the rest api for this. It would cancel the streaming effect of the code currently. Just drop this in an xqy, and hit that directly. E.g. if you have an /export/export-csv.x

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-11 Thread Geert Josten
ber 11, 2016 at 10:27 PM To: MarkLogic Developer Discussion mailto:general@developer.marklogic.com>> Subject: Re: [MarkLogic Dev General] How to pull data out of marklogic quickly? I previously tried not wrapping the output in the element. Running the following code: for $x in cts:searc

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-11 Thread Sam Mefford
va that does not involve the iterator but returns all of the documents? From: general-boun...@developer.marklogic.com<mailto:general-boun...@developer.marklogic.com> <mailto:general-boun...@developer.marklogic.com> on behalf of Geert Josten <mailto:geert.jo

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-11 Thread David Lee
ailto:general-boun...@developer.marklogic.com] On Behalf Of Mark Shanks Sent: Tuesday, October 11, 2016 4:27 PM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] How to pull data out of marklogic quickly? I previously tried not wrapping the output in the element. Running the followi

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-11 Thread Mark Shanks
ause you have so much back and forth between java and the server. Is there another way to get the results into java that does not involve the iterator but returns all of the documents? From: general-boun...@developer.marklogic.com on behalf of Geert Josten Sent

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-11 Thread Phil Barber
ed tools like Hadoop. Apache Camel might allow parallel > processing too.. > > Cheers, > Geert > > From: on behalf of Mark Shanks < > markshanks...@hotmail.com> > Reply-To: MarkLogic Developer Discussion > Date: Tuesday, October 11, 2016 at 12:27 AM > To: Mark

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-11 Thread Geert Josten
ogic.com>> Subject: Re: [MarkLogic Dev General] How to pull data out of marklogic quickly? MLCP isn't an option as it doesn't provide text-delimited output. Text-delimited is a useful format as it allows the data to be pulled into practically any other application and with little o

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-10 Thread Mark Shanks
., fastest)? From: general-boun...@developer.marklogic.com on behalf of Sekhon, Navdeep Sent: Tuesday, 11 October 2016 6:22:44 AM To: general@developer.marklogic.com Subject: Re: [MarkLogic Dev General] How to pull data out of marklogic quickly? Have you looked

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-10 Thread sai shanker
Hello Mark, please try using corb tool.the link to the documentation is belowCorb2 — MarkLogic Developer Community uIn the selector xquery you can use cts:uris() with your custom and query and then each transform xquery will work on one uriyou can retrieve the document and write all your xpath

Re: [MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-10 Thread Sekhon, Navdeep
gic quickly? (Mark Shanks) -- Message: 1 Date: Mon, 10 Oct 2016 18:43:52 + From: Mark Shanks Subject: [MarkLogic Dev General] How to pull data out of marklogic quickly? To: "General@developer.mark

[MarkLogic Dev General] How to pull data out of marklogic quickly?

2016-10-10 Thread Mark Shanks
Hi, We have a need to pull large amounts of data out of marklogic as quickly as possible. I found that doing xquery searches like query-by-example were very slow. Using the cts functions led to a big speed increase. However, it isn't clear whether my current approach is the optimum, or whether