RE: Indexation Not OK

2020-12-31 Thread Michael Cizmar
Ritika – We have had some discussions regarding docker and etc. The public one that is out there builds a single node and does not use an RDBM. I would not recommend using that to index billions of documents. You can turn on debugging in the connector and look at the logs to see if that

Re: Indexation Not OK

2020-12-31 Thread Karl Wright
Sorry, I couldn't quite understand everything in your email, but it sounds like the problem is in the ES connection. It is possible that ES expires your connection and the indexing fails after that happens. If that is happening, however, I would expect to see a much more detailed error message

Re: Indexation Not OK

2020-12-31 Thread ritika jain
Elastic search output connector with some custom changes for some fields On Thursday, December 31, 2020, Karl Wright wrote: > Hi, > Can you let us know what you are using for the output connector? > Thanks, > Karl > > > On Thu, Dec 31, 2020 at 8:24 AM ritika jain > wrote: > >> Hi, >> >> I am

Re: Indexation Not OK

2020-12-31 Thread Karl Wright
Hi, Can you let us know what you are using for the output connector? Thanks, Karl On Thu, Dec 31, 2020 at 8:24 AM ritika jain wrote: > Hi, > > I am using Manifoldcf 2.14 and JCIFS connector, to ingest some billions of > records into elastic search > I am facing an issue in which when Job is

Indexation Not OK

2020-12-31 Thread ritika jain
Hi, I am using Manifoldcf 2.14 and JCIFS connector, to ingest some billions of records into elastic search I am facing an issue in which when Job is run some time, successful indexation happens but after sometime , manifoldcf loops the records and Indexation is not getting OK. [image: image.png]