Re: ManifoldCF database model

2018-10-29 Thread Karl Wright
You can enable repository connector debug logging by adding this to your properties.xml: Having said that, the cleanup phase for all connectors is executed by the framework. We know the framework works because we have numerous integration tests that exercise it. But it's up to the ES

Re: ManifoldCF database model

2018-10-29 Thread Gustavo Beneitez
Hi, we made a new test, job created several documents that never where removed from Elastic Search after job deletion, and the Simple History never showed them as deleted. I also looked for an error on logs without luck. I think it could be 2) case, can I increase log detail for web repository?

Re: ManifoldCF database model

2018-10-29 Thread Karl Wright
It is only possible if: (1) You run a job in a "minimal" configuration, or (2) There is a bug in either the repository connector that doesn't properly signal the status of a deleted document to the pipeline, or (3) There is a bug in the output connector so that deletion of a document silently

Re: ManifoldCF database model

2018-10-29 Thread Gustavo Beneitez
Hi Karl, after several tests I did manage to create, run and delete a job with Elastic output connector, and all its documents where also deleted from database while they were not deleted from repository. Under which cases is this possible? Maybe if they share repo? Thanks in advance! El

Re: ManifoldCF database model

2018-10-17 Thread Gustavo Beneitez
Ok thanks! El mié., 17 oct. 2018 a las 14:27, Karl Wright () escribió: > Ok, the schema is described in ManifoldCF In Action. > > https://github.com/DaddyWri/manifoldcfinaction/tree/master/pdfs > > Karl > > > On Wed, Oct 17, 2018 at 7:41 AM Gustavo Beneitez < > gustavo.benei...@gmail.com> >

Re: ManifoldCF database model

2018-10-17 Thread Karl Wright
Ok, the schema is described in ManifoldCF In Action. https://github.com/DaddyWri/manifoldcfinaction/tree/master/pdfs Karl On Wed, Oct 17, 2018 at 7:41 AM Gustavo Beneitez wrote: > Hi Karl, > > as far as I was able to gather information from history records, I could > see MCF is behaving as

Re: ManifoldCF database model

2018-10-17 Thread Gustavo Beneitez
Hi Karl, as far as I was able to gather information from history records, I could see MCF is behaving as expected. The "problem" shows when ElasticSearch is down or performing bad, MCF says it was requested to be deleted, but while it has been erased from database, it is alive on ElasticSearch

Re: ManifoldCF database model

2018-10-16 Thread Karl Wright
Hi, you can look at ManifoldCF In Action. There's a link to it on the manifoldcf page. However, you should be aware that we consider it a severe bug if ManifoldCF doesn't clean up after itself. The only time that is not expected is when people write buggy connectors or mess with database tables

ManifoldCF database model

2018-10-16 Thread Gustavo Beneitez
Hi all, how do you do? I was wandering if there is any technical document about what is the meaning of each table in database, the relationship between documents, repositories, jobs and any other output connector (some kind of a database model). We are facing some "garbage issues", jobs are