Hi Vijay

Parse the string query using search:parse and then pass it to the 
additional-query option of search:search OR search:resolve API. 
Additionally Can you check the page-size of returned result?

Regards
Abhishek Srivastav
Tata Consultancy Services
Cell:- +91-9883389968
Mailto: abhishek5...@tcs.com
Website: http://www.tcs.com
____________________________________________
Experience certainty.   IT Services
                        Business Solutions
                        Outsourcing
____________________________________________



From:
Vijayasekar Padmanaban <vijayaseka...@infosys.com>
To:
"General@developer.marklogic.com" <General@developer.marklogic.com>
Date:
07/20/2011 11:16 AM
Subject:
[MarkLogic Dev General] Search using 100k terms
Sent by:
general-boun...@developer.marklogic.com



Hi All,
 
We have a use case to perform search based on the contents uploaded as a 
file. The file would have a max of 100,000 terms in it. We need to 
validate the contents of the file with our repository contents and produce 
results. Our repository contains 10 million contents. Each term in the 
file need to be validated with an element in the enhanced xml. 
 
Below are the two approached I had tried:
1.       Using search constraints
a.       Each search term would be concatenated with the constraint and 
would be joined using ?OR? delimiter as shown below:
For e.g., ?const:<term1> OR const:<term2> OR const:<term3> OR 
const:<term3> OR ?..?
                                This ended in stack overflow error when 
the number of search terms exceeded 1000
2.       Using element value query
a.       All the search terms would be passed as text to the 
cts:element-value-query as shown below:
cts:element-value-query(<Qualifier-Name>, text as xs:string*)
                                This worked well when DB contains less 
number of contents say 300,000. But when used with DB that has 10 million 
contents it failed saying ?Time limit exceeded?
 
Could you suggest me the best possible approach to resolve this issue?
 
Thanks,
Vijay
 

**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended 
solely 
for the use of the addressee(s). If you are not the intended recipient, 
please 
notify the sender by e-mail and delete the original message. Further, you 
are not 
to copy, disclose, or distribute this e-mail or its contents to any other 
person and 
any such actions are unlawful. This e-mail may contain viruses. Infosys 
has taken 
every reasonable precaution to minimize this risk, but is not liable for 
any damage 
you may sustain as a result of any virus in this e-mail. You should carry 
out your 
own virus checks before opening the e-mail or attachment. Infosys reserves 
the 
right to monitor and review the content of all messages sent to or from 
this e-mail 
address. Messages sent to or from this e-mail address may be stored on the 

Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***
_______________________________________________
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general


=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


_______________________________________________
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Reply via email to