Re: [MarkLogic Dev General] mlcp option for tranforming documents during export?

[Steiner, David J. (LNG-DAY)]

Justin,

Yes, as far as I've explored;  I know I can do any XQuery with the code at 
"INPUT_MODULE_URI" as long as the transform returns a "node()*", because the 
last statement in the module  is "document {local:transform($URI)}".
Off the top of my head, thinking about the ones I've done, usually I want to 
cull through certain documents (they have certain characteristics that I 
specify in INPUT_QUERY) and pick out things that help me make a totally new 
node - some of these involve taking a piece of information from the document 
and doing lookups in other databases (xdmp:eval) to get bits of information 
from them, then incorporate that information into my new node.  Then, I either 
write the document to a file system or insert into an altogether different DB.

If I needed to make multiple documents from a single document, I suppose I 
might write them out to a file system in a single doc, then ingest them in the 
new DB and break them out during the ingestion transformation.

David

p.s.  If you want a couple of examples (one simple, one more complex), I can 
e-mail them to you - just let me know...




From: general-boun...@developer.marklogic.com 
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Justin Makeig
Sent: Friday, April 26, 2013 5:22 PM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] mlcp option for tranforming documents 
during export?

David,
Nope, you're not missing anything. Currently there is no explicit hook to 
provide custom transformation logic on outbound or inbound data movement. We're 
looking at ways to better support this. Can you tell me more about the types of 
processing you'd like to do? For example, is XQSync's 1 document in-1 document 
out the right granularity? Any details would be much appreciated.

Justin



Justin Makeig
Director, Product Management
MarkLogic Corporation
justin.mak...@marklogic.com<mailto:justin.mak...@marklogic.com>
www.marklogic.com<http://www.marklogic.com/>




On Apr 26, 2013, at 1:10 PM, "Steiner, David J. (LNG-DAY)" 
mailto:david.j.stei...@elsevier.com>> wrote:


When I need to export a portion of a document, or manipulate it in some way, I 
generally use XQSync to and put some XQuery at INPUT_MODULE_URI, then run 
XQSync.

In looking at mlcp, I don't really see an option to transform the data when 
exporting it to a file system.  Am I missing something?

Thanks,
David
___
General mailing list
General@developer.marklogic.com<mailto:General@developer.marklogic.com>
http://developer.marklogic.com/mailman/listinfo/general

___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] mlcp option for tranforming documents during export?

[Justin Makeig]

David,
Nope, you’re not missing anything. Currently there is no explicit hook to 
provide custom transformation logic on outbound or inbound data movement. We’re 
looking at ways to better support this. Can you tell me more about the types of 
processing you’d like to do? For example, is XQSync’s 1 document in-1 document 
out the right granularity? Any details would be much appreciated.

Justin



Justin Makeig
Director, Product Management
MarkLogic Corporation
justin.mak...@marklogic.com
www.marklogic.com



On Apr 26, 2013, at 1:10 PM, "Steiner, David J. (LNG-DAY)" 
mailto:david.j.stei...@elsevier.com>> wrote:

When I need to export a portion of a document, or manipulate it in some way, I 
generally use XQSync to and put some XQuery at INPUT_MODULE_URI, then run 
XQSync.

In looking at mlcp, I don’t really see an option to transform the data when 
exporting it to a file system.  Am I missing something?

Thanks,
David
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

[MarkLogic Dev General] mlcp option for tranforming documents during export?

[Steiner, David J. (LNG-DAY)]

When I need to export a portion of a document, or manipulate it in some way, I 
generally use XQSync to and put some XQuery at INPUT_MODULE_URI, then run 
XQSync.

In looking at mlcp, I don't really see an option to transform the data when 
exporting it to a file system.  Am I missing something?

Thanks,
David
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general