Re: [MarkLogic Dev General] Fragment root configuration

2015-05-02 Thread David Lee
If I am reading this right, a search of 2000 docs with a result set page size of 10 is still slow. ? by ‘small set of 2000 docs’ do you mean that is all you have in the database total ? or does that mean it’s the total result set size from a total DB size of 5mil docs ? Either way This is ve

[MarkLogic Dev General] Basic search question

2015-05-02 Thread Shashidhar Rao
Hi, I have finished indexing on Fast case sensitive character searches but others such as word searches have not finished but have finished around 81% and wild card searches around 90%. Since case sensitive character searches indexes are done I presume I should be able to search case sensitive ch

Re: [MarkLogic Dev General] Fragment root configuration

2015-05-02 Thread Shashidhar Rao
Hi David, The size of each document varies but it ranges from 30 kb to 225kb max all XML. I would certainly look into the profile and with small set of documents roughly 2000 it gives me the same result. Only 10 docs I am showing maybe the code to get the snippets is the culprit. Let me check the

Re: [MarkLogic Dev General] Fragment root configuration

2015-05-02 Thread David Lee
If I understand you correctly, you have 5067188 docs - what is an approx size of each ? Parsing occurs only during document ingest so parse time will not affect search time. If you added fragmentation on that basis it is likely to hurt rather than help ( in general you should not use fragmentat

Re: [MarkLogic Dev General] Fragment root configuration

2015-05-02 Thread Shashidhar Rao
Thanks for your reply Christopher and David. Content is xml . The search app is taking rough 5.6 secs to show the contents snippets , facets etc with about 5 million records. Query used is JAVA API using QueryManager search function. Read that fragment root keeps each document as one so I thought

Re: [MarkLogic Dev General] Document not visible in WebDAV listing

2015-05-02 Thread Danny Sinang
Correct. I thought RCC06032011.xml was in the root directory since it didn't have any parent directory prefix. Turns out root items should have a / prefix. On Sat, May 2, 2015 at 4:35 PM, Christopher Hamlin wrote: > On Sat, May 2, 2015 at 11:45 AM, Danny Sinang wrote: > > Thanks Mary. > > > >

Re: [MarkLogic Dev General] Document not visible in WebDAV listing

2015-05-02 Thread Christopher Hamlin
On Sat, May 2, 2015 at 11:45 AM, Danny Sinang wrote: > Thanks Mary. > > The URI is RCC06032011.xml . > > I guess that explains why I can't see the doc in WebDAV. > > > I'm guessing because it's not in a directory, so to speak. ___ General mailing list G

Re: [MarkLogic Dev General] Fragment root configuration

2015-05-02 Thread David Gorbet
Again, not sure what type of data/content you have, but it's very rare that fragmentation is the right thing to do. Fragmentation is designed for large content containers like books, to fragment them into smaller containers like chapters. It's usually better just to structure your data so that y

Re: [MarkLogic Dev General] Document not visible in WebDAV listing

2015-05-02 Thread Danny Sinang
Thanks Mary. The URI is RCC06032011.xml . I guess that explains why I can't see the doc in WebDAV. On Sat, May 2, 2015 at 10:44 AM, Mary Holstege wrote: > > Is the URI "RCC06032011.xml" or "/RCC06032011.xml"? WebDAV needs rooted > paths to work. > > //Mary > > On 05/02/2015 05:42 AM, Danny Si

Re: [MarkLogic Dev General] Document not visible in WebDAV listing

2015-05-02 Thread Mary Holstege
Is the URI "RCC06032011.xml" or "/RCC06032011.xml"? WebDAV needs rooted paths to work. //Mary On 05/02/2015 05:42 AM, Danny Sinang wrote: We have a database that ML reports as having 31,000+ documents which appear to be mostly in the root directory of that database. When I try to open the sai

[MarkLogic Dev General] Analyze-data.xqy with JSON data

2015-05-02 Thread Yinyan guy
Hi All,I am exploring the use of the analyze-data for index suggestion on my data. I am using ML8 and my data is JSON. On running analyze-data using the REST API, I got 400: Bad Request with message "XDMP-UNEXPECTED: (err:XPST0003) Unexpected token syntax error, unexpected Rpar_, expecting Funct

Re: [MarkLogic Dev General] Document not visible in WebDAV listing

2015-05-02 Thread David Lee
That's a huge number of documents in one directory. I recall having problems on WebDAV on pure windows to windows connection with > 500 files ... Webdav is a very inefficient protocol, you may be timing out before getting through the whole list. Or there may be documents which don't have the rig

Re: [MarkLogic Dev General] Document not visible in WebDAV listing

2015-05-02 Thread Christopher Hamlin
Hi Danny, I guess some obvious things only, but worth checking: The document permissions may not allow you to access the xml file if you don't log in with the same account. Also, webdav requires directories, those are also documents, and those also have permissions: https://docs.marklogic.com/g

[MarkLogic Dev General] Document not visible in WebDAV listing

2015-05-02 Thread Danny Sinang
We have a database that ML reports as having 31,000+ documents which appear to be mostly in the root directory of that database. When I try to open the said document via my WebDAV client (Oxygen or Transmit Panic), I only see around 7000+ of them. Query console confirms to be the existence of a d

Re: [MarkLogic Dev General] Fragment root configuration

2015-05-02 Thread Christopher Hamlin
Hi, I'm not sure what you are referring to when you mention a compressed binary document to speed up search. MarkLogic does store XML internally in a compressed binary format anyway. MarkLogic documentation on fragmentation is here: https://docs.marklogic.com/guide/admin/fragments Fragmentatio