Re: sharepoint crawler documents limit

2020-01-27 Thread Karl Wright
I'm glad you got by this. Thanks for letting us know what the issue was. Karl On Mon, Jan 27, 2020 at 4:05 AM Jorge Alonso Garcia wrote: > Hi, > We had change timeout on sharepoint IIS and now the process is able to > crall all documents. > Thanks for your help > > > > El lun., 30 dic. 2019 a

Re: sharepoint crawler documents limit

2020-01-27 Thread Jorge Alonso Garcia
Hi, We had change timeout on sharepoint IIS and now the process is able to crall all documents. Thanks for your help El lun., 30 dic. 2019 a las 12:18, Gaurav G () escribió: > We had faced a similar issue, wherein our repo had 100,000 documents but > our crawler stopped after 5 documents.

Re: sharepoint crawler documents limit

2019-12-30 Thread Gaurav G
We had faced a similar issue, wherein our repo had 100,000 documents but our crawler stopped after 5 documents. The issue turned out to be that the Sharepoint query that was fired by the Sharepoint web service gets progressively slower and eventually the connection starts timing out before the

Re: sharepoint crawler documents limit

2019-12-20 Thread Karl Wright
Hi Priya, This has nothing to do with anything in ManifoldCF. Karl On Fri, Dec 20, 2019 at 7:56 AM Priya Arora wrote: > Hi All, > > Is this issue something to have with below value/parameters set in > properties.xml. > [image: image.png] > > > On Fri, Dec 20, 2019 at 5:21 PM Jorge Alonso

Re: sharepoint crawler documents limit

2019-12-20 Thread Priya Arora
Hi All, Is this issue something to have with below value/parameters set in properties.xml. [image: image.png] On Fri, Dec 20, 2019 at 5:21 PM Jorge Alonso Garcia wrote: > And what other sharepoint parameter I could check? > > Jorge Alonso Garcia > > > > El vie., 20 dic. 2019 a las 12:47, Karl

Re: sharepoint crawler documents limit

2019-12-20 Thread Jorge Alonso Garcia
And what other sharepoint parameter I could check? Jorge Alonso Garcia El vie., 20 dic. 2019 a las 12:47, Karl Wright () escribió: > The code seems correct and many people are using it without encountering > this problem. There may be another SharePoint configuration parameter you > also

Re: sharepoint crawler documents limit

2019-12-20 Thread Karl Wright
The code seems correct and many people are using it without encountering this problem. There may be another SharePoint configuration parameter you also need to look at somewhere. Karl On Fri, Dec 20, 2019 at 6:38 AM Jorge Alonso Garcia wrote: > > Hi Karl, > On sharepoint the list view

Re: sharepoint crawler documents limit

2019-12-20 Thread Jorge Alonso Garcia
Hi Karl, On sharepoint the list view threshold is 150,000 but we only receipt 20,000 from mcf [image: image.png] Jorge Alonso Garcia El jue., 19 dic. 2019 a las 19:19, Karl Wright () escribió: > If the job finished without error it implies that the number of documents > returned from this

Re: sharepoint crawler documents limit

2019-12-19 Thread Jorge Alonso Garcia
Hi, The job finnish ok (several times) but always with this 2 documents, for some reason the loop only execute twice Jorge Alonso Garcia El jue., 19 dic. 2019 a las 18:14, Karl Wright () escribió: > If the are all in one document, then you'd be running this code: > > >> > int

Re: sharepoint crawler documents limit

2019-12-19 Thread Karl Wright
If the are all in one document, then you'd be running this code: >> int startingIndex = 0; int amtToRequest = 1; while (true) { com.microsoft.sharepoint.webpartpages.GetListItemsResponseGetListItemsResult itemsResult =

Re: sharepoint crawler documents limit

2019-12-19 Thread Karl Wright
If you are using the MCF plugin, and selecting the appropriate version of Sharepoint in the connection configuration, there is no hard limit I'm aware of for any Sharepoint job. We have lots of other people using SharePoint and nobody has reported this ever before. If your SharePoint connection

Re: sharepoint crawler documents limit

2019-12-19 Thread Jorge Alonso Garcia
Hi, On UI shows 20,002 documents (on a firts phase show 10,001,and after sometime of process raise to 20,002) . It looks like a hard limit, there is more files on sharepoint with the used criteria Jorge Alonso Garcia El jue., 19 dic. 2019 a las 16:05, Karl Wright () escribió: > Hi Jorge, > >

Re: sharepoint crawler documents limit

2019-12-19 Thread Karl Wright
Hi Jorge, When you run the job, do you see more than 20,000 documents as part of it? Do you see *exactly* 20,000 documents as part of it? Unless you are seeing a hard number like that in the UI for that job on the job status page, I doubt very much that the problem is a numerical limitation in

Re: sharepoint crawler documents limit

2019-12-19 Thread Jorge Alonso Garcia
Hi Karl, We had installed the shaterpoint plugin, and access properly http:/server/ _vti_bin/MCPermissions.asmx [image: image.png] Sharepoint has more than 20,000 documents, but when execute the jon only extract these 20,000. How Can I check where is the issue? Regards Jorge Alonso Garcia

Re: sharepoint crawler documents limit

2019-12-19 Thread Karl Wright
By "stop at 20,000" do you mean that it finds more than 20,000 but stops crawling at that time? Or what exactly do you mean here? FWIW, the behavior you describe sounds like you may not have installed the SharePoint plugin and may have selected a version of SharePoint that is inappropriate. All