[jira] [Comment Edited] (CONNECTORS-1639) Upgrade Elastic Search Version
[
https://issues.apache.org/jira/browse/CONNECTORS-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087245#comment-17087245
]
Karl Wright edited comment on CONNECTORS-1639 at 4/19/20, 11:09 PM:
Since this is firing off a java task, we could use the Ant Java task, described
here:
https://ant.apache.org/manual/Tasks/java.html
However, this will not work for maven so I'd steer away from that.
We can do something similar to this instead, which would invoke the same Java
again, although we'd want ES's classpath obviously:
{code}
public final class JavaProcess {
private JavaProcess() {}
public static int exec(Class klass, List args) throws IOException,
InterruptedException {
String javaHome = System.getProperty("java.home");
String javaBin = javaHome +
File.separator + "bin" +
File.separator + "java";
String classpath = System.getProperty("java.class.path");
String className = klass.getName();
List command = new LinkedList();
command.add(javaBin);
command.add("-cp");
command.add(classpath);
command.add(className);
if (args != null) {
command.addAll(args);
}
ProcessBuilder builder = new ProcessBuilder(command);
Process process = builder.inheritIO().start();
process.waitFor();
return process.exitValue();
}
}
{code}
There are, however, the following problems to be addressed: (1) waiting for the
instance to start, and (2) stopping the instance.
was (Author: kwri...@metacarta.com):
Since this is firing off a java task, we could use the Ant Java task, described
here:
https://ant.apache.org/manual/Tasks/java.html
However, this will not work for maven so I'd steer away from that.
We can do something similar to this instead, which would invoke the same Java
again, although we'd want ES's classpath obviously:
{code}
> Upgrade Elastic Search Version
> --
>
> Key: CONNECTORS-1639
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1639
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Elastic Search connector
>Reporter: Cihad Guzel
>Assignee: Karl Wright
>Priority: Major
> Fix For: ManifoldCF 2.16
>
> Attachments: CONNECTORS-1639.diff,
> elastic-search-1.0.1-java11-build-error.log
>
>
> Current Elastic Search version is 1.0.1 . According to [this
> matrix|https://www.elastic.co/support/matrix#matrix_jvm], Java 11 is not
> supported by any ES version below 6.5.
> Besides, ES 1.x is no longer supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (CONNECTORS-1639) Upgrade Elastic Search Version
[
https://issues.apache.org/jira/browse/CONNECTORS-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086926#comment-17086926
]
Karl Wright edited comment on CONNECTORS-1639 at 4/19/20, 11:31 AM:
Unfortunately the dependencies for ElasticSearch Cluster Runner are huge. See:
https://mvnrepository.com/artifact/org.codelibs/elasticsearch-cluster-runner/7.6.2.0
This is a problem because we'd need to download all these dependencies and
their dependencies. But it may be that the cluster runner does not actually
use all these.
It may not even be the right thing to use. It doesn't seem like it would be
hard to write something that starts up a cluster based on a specific image.
[~michaelcizmar], if you were starting a cluster from a downloaded, unpacked
image, what steps would you take?
FWIW, if you want to try this, svn checkout
https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-1639, and then
do: the following:
{code}
ant make-core-deps
ant build
cd connectors/elasticsearch
ant download-dependencies
{code}
The unpacked ES download, and the mapper attachments plugin, should live in
test-materials at that point.
was (Author: kwri...@metacarta.com):
Unfortunately the dependencies for ElasticSearch Cluster Runner are huge. See:
https://mvnrepository.com/artifact/org.codelibs/elasticsearch-cluster-runner/7.6.2.0
This is a problem because we'd need to download all these dependencies and
their dependencies. But it may be that the cluster runner does not actually
use all these.
It may not even be the right thing to use. It doesn't seem like it would be
hard to write something that starts up a cluster based on a specific image.
[~michaelcizmar], if you were starting a cluster from a downloaded, unpacked
image, what steps would you take?
(FWIW, if you want to try this, svn checkout
https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-1639, and then
do: the following:
{code}
ant make-core-deps
ant build
cd connectors/elasticsearch
ant download-dependencies
{code}
The unpacked ES download, and the mapper attachments plugin, should live in
test-materials at that point.
> Upgrade Elastic Search Version
> --
>
> Key: CONNECTORS-1639
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1639
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Elastic Search connector
>Reporter: Cihad Guzel
>Assignee: Karl Wright
>Priority: Major
> Fix For: ManifoldCF 2.16
>
> Attachments: CONNECTORS-1639.diff,
> elastic-search-1.0.1-java11-build-error.log
>
>
> Current Elastic Search version is 1.0.1 . According to [this
> matrix|https://www.elastic.co/support/matrix#matrix_jvm], Java 11 is not
> supported by any ES version below 6.5.
> Besides, ES 1.x is no longer supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (CONNECTORS-1639) Upgrade Elastic Search Version
[
https://issues.apache.org/jira/browse/CONNECTORS-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086926#comment-17086926
]
Karl Wright edited comment on CONNECTORS-1639 at 4/19/20, 11:31 AM:
Unfortunately the dependencies for ElasticSearch Cluster Runner are huge. See:
https://mvnrepository.com/artifact/org.codelibs/elasticsearch-cluster-runner/7.6.2.0
This is a problem because we'd need to download all these dependencies and
their dependencies. But it may be that the cluster runner does not actually
use all these.
It may not even be the right thing to use. It doesn't seem like it would be
hard to write something that starts up a cluster based on a specific image.
[~michaelcizmar], if you were starting a cluster from a downloaded, unpacked
image, what steps would you take?
(FWIW, if you want to try this, svn checkout
https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-1639, and then
do: the following:
{code}
ant make-core-deps
ant build
cd connectors/elasticsearch
ant download-dependencies
{code}
The unpacked ES download, and the mapper attachments plugin, should live in
test-materials at that point.
was (Author: kwri...@metacarta.com):
Unfortunately the dependencies for ElasticSearch Cluster Runner are huge. See:
https://mvnrepository.com/artifact/org.codelibs/elasticsearch-cluster-runner/7.6.2.0
> Upgrade Elastic Search Version
> --
>
> Key: CONNECTORS-1639
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1639
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Elastic Search connector
>Reporter: Cihad Guzel
>Assignee: Karl Wright
>Priority: Major
> Fix For: ManifoldCF 2.16
>
> Attachments: CONNECTORS-1639.diff,
> elastic-search-1.0.1-java11-build-error.log
>
>
> Current Elastic Search version is 1.0.1 . According to [this
> matrix|https://www.elastic.co/support/matrix#matrix_jvm], Java 11 is not
> supported by any ES version below 6.5.
> Besides, ES 1.x is no longer supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (CONNECTORS-1639) Upgrade Elastic Search Version
[ https://issues.apache.org/jira/browse/CONNECTORS-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064416#comment-17064416 ] Michael Cizmar edited comment on CONNECTORS-1639 at 3/22/20, 8:53 PM: -- The output connector uses is 1.0.1 for an integration test. In the actual connector, it uses more or less raw rest calls to interact with Elasticsearch and there is no dependency between the test case and the version of Elastic that is supported as the error that is being thrown is related to the integration test trying to start an Elastic node. We should upgrade this to a more recent version perhaps. [~kwri...@metacarta.com] manifoldcf does not support Java 11 yet, correct? was (Author: michaelcizmar): The output connector uses is 1.0.1 for an integration test. In the actual connector, it uses more or less raw rest calls to interact with Elasticsearch and there is no depency between the test case and the version of Elastic that is supported as the error that is being thrown is related to the integration test trying to start an Elastic node. We should upgrade this to a more recent version perhaps. [~kwri...@metacarta.com] manifoldcf does not support Java 11 yet, correct? > Upgrade Elastic Search Version > -- > > Key: CONNECTORS-1639 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1639 > Project: ManifoldCF > Issue Type: Improvement > Components: Elastic Search connector >Reporter: Cihad Guzel >Assignee: Karl Wright >Priority: Major > Fix For: ManifoldCF 2.16 > > Attachments: elastic-search-1.0.1-java11-build-error.log > > > Current Elastic Search version is 1.0.1 . According to [this > matrix|https://www.elastic.co/support/matrix#matrix_jvm], Java 11 is not > supported by any ES version below 6.5. > Besides, ES 1.x is no longer supported. -- This message was sent by Atlassian Jira (v8.3.4#803005)
