Re: Status of Elastic Search integration tests

2020-04-29 Thread Karl Wright
Can you suggest what components I need to download and configure for the test, then? Step-by-step directions would be very helpful, e.g. "download es version x, and this component from this maven repo URL, and then unpack here, and create this config file..." The mapper attachment I download

Re: Status of Elastic Search integration tests

2020-04-29 Thread Michael Cizmar
Right. On my radar is refactoring of this to use the Elastic Java SDK. If we use that then, in my view, the encoding of the document would be the responsibility of the SDK and one less thing to test. (The Java SDK is somewhat complicated as well because they tend to rewrite underlying

Re: Status of Elastic Search integration tests

2020-04-29 Thread Karl Wright
The connector itself encodes binary documents and sends them to ES, purportedly for the mapper attachment to process and convert to text. The test used to exercise that. Perhaps it's worth reviewing the connector code itself to see what is outdated/legacy, and only test the parts that are not

Re: Status of Elastic Search integration tests

2020-04-29 Thread Michael Cizmar
There's been some changes to Elasticsearch like reducing the document types and ingestion/mapper. The mapper attachment I believe has been deprecated in favor of: https://www.elastic.co/guide/en/elasticsearch/plugins/master/ingest-attachment.html This should be incorporated into a pipeline. Do

Status of Elastic Search integration tests

2020-04-29 Thread Karl Wright
Hello all, I set up a branch (branches/CONNECTORS-1639) to work on the elasticsearch test problem for JDK 11. The branch downloads an ES and a mapper attachment but it turns out that the mapper attachment is apparently incompatible with the current (7.x) version of ES. Does anyone know whether