[ https://issues.apache.org/jira/browse/CONNECTORS-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17188216#comment-17188216 ]
Piergiorgio Lucidi commented on CONNECTORS-1651: ------------------------------------------------ Trying to manually start the ES Server from bash, it is returning an error about XPack, maybe we should try to disable the machine learning plugin, I see this suggestion in the log message: xpack.ml.enabled: false : {noformat} [2020-09-01T09:22:33,873][INFO ][o.e.n.Node ] [iPj-MacBookPro.local] JVM home [/Library/Java/JavaVirtualMachines/jdk1.8.0_191.jdk/Contents/Home/jre] [2020-09-01T09:22:33,873][INFO ][o.e.n.Node ] [iPj-MacBookPro.local] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=COMPAT, -Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/var/folders/dq/ws51_rdd2_7bb5fz193yf6ww0000gn/T/elasticsearch-19371416977155157, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/Users/piergiorgiolucidi/Documents/workspaces/manifoldNew/trunk/connectors/elasticsearch/test-materials/unix/elasticsearch-7.6.2, -Des.path.conf=/Users/piergiorgiolucidi/Documents/workspaces/manifoldNew/trunk/connectors/elasticsearch/test-materials/unix/elasticsearch-7.6.2/config, -Des.distribution.flavor=default, -Des.distribution.type=tar, -Des.bundled_jdk=true] [2020-09-01T09:22:35,946][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [aggs-matrix-stats] [2020-09-01T09:22:35,947][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [analysis-common] [2020-09-01T09:22:35,947][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [flattened] [2020-09-01T09:22:35,947][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [frozen-indices] [2020-09-01T09:22:35,947][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [ingest-common] [2020-09-01T09:22:35,947][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [ingest-geoip] [2020-09-01T09:22:35,947][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [ingest-user-agent] [2020-09-01T09:22:35,948][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [lang-expression] [2020-09-01T09:22:35,948][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [lang-mustache] [2020-09-01T09:22:35,948][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [lang-painless] [2020-09-01T09:22:35,949][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [mapper-extras] [2020-09-01T09:22:35,949][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [parent-join] [2020-09-01T09:22:35,949][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [percolator] [2020-09-01T09:22:35,949][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [rank-eval] [2020-09-01T09:22:35,949][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [reindex] [2020-09-01T09:22:35,949][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [repository-url] [2020-09-01T09:22:35,949][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [search-business-rules] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [spatial] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [transform] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [transport-netty4] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [vectors] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-analytics] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-ccr] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-core] [2020-09-01T09:22:35,950][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-deprecation] [2020-09-01T09:22:35,951][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-enrich] [2020-09-01T09:22:35,951][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-graph] [2020-09-01T09:22:35,951][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-ilm] [2020-09-01T09:22:35,951][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-logstash] [2020-09-01T09:22:35,951][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-ml] [2020-09-01T09:22:35,951][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-monitoring] [2020-09-01T09:22:35,952][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-rollup] [2020-09-01T09:22:35,952][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-security] [2020-09-01T09:22:35,952][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-sql] [2020-09-01T09:22:35,952][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-voting-only-node] [2020-09-01T09:22:35,952][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] loaded module [x-pack-watcher] [2020-09-01T09:22:35,952][INFO ][o.e.p.PluginsService ] [iPj-MacBookPro.local] no plugins loaded [2020-09-01T09:22:39,561][INFO ][o.e.x.s.a.s.FileRolesStore] [iPj-MacBookPro.local] parsed [0] roles from file [/Users/piergiorgiolucidi/Documents/workspaces/manifoldNew/trunk/connectors/elasticsearch/test-materials/unix/elasticsearch-7.6.2/config/roles.yml] [2020-09-01T09:22:51,523][ERROR][o.e.b.Bootstrap ] [iPj-MacBookPro.local] Exception org.elasticsearch.ElasticsearchException: Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without machine learning functionality set [xpack.ml.enabled: false]. at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:587) ~[?:?] at org.elasticsearch.node.Node.lambda$new$9(Node.java:456) ~[elasticsearch-7.6.2.jar:7.6.2] at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267) ~[?:1.8.0_191] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) ~[?:1.8.0_191] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_191] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_191] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_191] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_191] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_191] at org.elasticsearch.node.Node.<init>(Node.java:459) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) [elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) [elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) [elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) [elasticsearch-cli-7.6.2.jar:7.6.2] at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) [elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) [elasticsearch-7.6.2.jar:7.6.2] [2020-09-01T09:22:51,531][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [iPj-MacBookPro.local] uncaught exception in thread [main] org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without machine learning functionality set [xpack.ml.enabled: false].] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:174) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.6.2.jar:7.6.2] at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.6.2.jar:7.6.2] Caused by: org.elasticsearch.ElasticsearchException: Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without machine learning functionality set [xpack.ml.enabled: false]. at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:587) ~[?:?] at org.elasticsearch.node.Node.lambda$new$9(Node.java:456) ~[elasticsearch-7.6.2.jar:7.6.2] at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267) ~[?:1.8.0_191] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) ~[?:1.8.0_191] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_191] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_191] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_191] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_191] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_191] at org.elasticsearch.node.Node.<init>(Node.java:459) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.6.2.jar:7.6.2] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.6.2.jar:7.6.2] ... 6 more {noformat} > ElasticSearch server is not starting during integration test > ------------------------------------------------------------ > > Key: CONNECTORS-1651 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1651 > Project: ManifoldCF > Issue Type: Bug > Components: Elastic Search connector > Reporter: Piergiorgio Lucidi > Assignee: Piergiorgio Lucidi > Priority: Major > > Trying to run the test suite on my Mac (with JDK 1.8 but also with JDK 11), > ElasticSearch server is not starting properly: > {noformat} > [INFO] ---------< org.apache.manifoldcf:mcf-elasticsearch-connector > >---------- > [INFO] Building ManifoldCF - Connectors - ElasticSearch 2.17 > [39/64] > [INFO] --------------------------------[ jar > ]--------------------------------- > [INFO] > [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ > mcf-elasticsearch-connector --- > [INFO] > [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ > mcf-elasticsearch-connector --- > [INFO] > [INFO] --- maven-dependency-plugin:2.8:copy (copy-war) @ > mcf-elasticsearch-connector --- > [INFO] Configured Artifact: org.apache.manifoldcf:mcf-api-service:2.17:war > [INFO] Configured Artifact: > org.apache.manifoldcf:mcf-authority-service:2.17:war > [INFO] Configured Artifact: org.apache.manifoldcf:mcf-crawler-ui:2.17:war > [INFO] Copying mcf-api-service-2.17.war to > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/dependency/mcf-api-service.war > [INFO] Copying mcf-authority-service-2.17.war to > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/dependency/mcf-authority-service.war > [INFO] Copying mcf-crawler-ui-2.17.war to > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/dependency/mcf-crawler-ui.war > [INFO] > [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ > mcf-elasticsearch-connector --- > [debug] execute contextualize > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] Copying 5 resources > [INFO] Copying 4 resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ > mcf-elasticsearch-connector --- > [INFO] Compiling 8 source files to > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes > [INFO] > [INFO] --- native2ascii-maven-plugin:1.0-beta-1:native2ascii > (native2ascii-utf8) @ mcf-elasticsearch-connector --- > [INFO] Includes: [**/*.properties] > [INFO] Excludes: [] > [INFO] Processing > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_en_US.properties > [INFO] Processing > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_ja_JP.properties > [INFO] Processing > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_zh_CN.properties > [INFO] Processing > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_fr_FR.properties > [INFO] Processing > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_es_ES.properties > [INFO] > [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ > mcf-elasticsearch-connector --- > [debug] execute contextualize > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/connector/src/test/resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ > mcf-elasticsearch-connector --- > [INFO] Compiling 6 source files to > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/test-classes > [INFO] > [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ > mcf-elasticsearch-connector --- > [INFO] > [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ > mcf-elasticsearch-connector --- > [INFO] Building jar: > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/mcf-elasticsearch-connector-2.17.jar > [INFO] > [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ > mcf-elasticsearch-connector --- > [INFO] > [INFO] >>> maven-source-plugin:2.4:jar (attach-sources) > generate-sources @ > mcf-elasticsearch-connector >>> > [INFO] > [INFO] <<< maven-source-plugin:2.4:jar (attach-sources) < generate-sources @ > mcf-elasticsearch-connector <<< > [INFO] > [INFO] > [INFO] --- maven-source-plugin:2.4:jar (attach-sources) @ > mcf-elasticsearch-connector --- > [INFO] Building jar: > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/mcf-elasticsearch-connector-2.17-sources.jar > [INFO] > [INFO] --- maven-failsafe-plugin:2.18.1:integration-test (integration-test) @ > mcf-elasticsearch-connector --- > [INFO] Failsafe report directory: > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/failsafe-reports > ------------------------------------------------------- > T E S T S > ------------------------------------------------------- > Running > org.apache.manifoldcf.agents.output.elasticsearch.tests.APISanityHSQLDBIT > Configuration file successfully read > [main] INFO org.eclipse.jetty.util.log - Logging initialized @6244ms > [main] INFO org.eclipse.jetty.server.Server - jetty-9.2.3.v20140905 > [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started > o.e.j.w.WebAppContext@68746f22{/mcf-crawler-ui,file:/private/var/folders/dq/ws51_rdd2_7bb5fz193yf6ww0000gn/T/jetty-0.0.0.0-8346-mcf-crawler-ui.war-_mcf-crawler-ui-any-159154925795368875.dir/webapp/,AVAILABLE}{../dependency/mcf-crawler-ui.war} > [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started > o.e.j.w.WebAppContext@2f01783a{/mcf-authority-service,file:/private/var/folders/dq/ws51_rdd2_7bb5fz193yf6ww0000gn/T/jetty-0.0.0.0-8346-mcf-authority-service.war-_mcf-authority-service-any-3008687721846728890.dir/webapp/,AVAILABLE}{../dependency/mcf-authority-service.war} > [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started > o.e.j.w.WebAppContext@68878f6d{/mcf-api-service,file:/private/var/folders/dq/ws51_rdd2_7bb5fz193yf6ww0000gn/T/jetty-0.0.0.0-8346-mcf-api-service.war-_mcf-api-service-any-2775887620010876436.dir/webapp/,AVAILABLE}{../dependency/mcf-api-service.war} > [main] INFO org.eclipse.jetty.server.ServerConnector - Started > ServerConnector@7b205dbd{HTTP/1.1}{0.0.0.0:8346} > [main] INFO org.eclipse.jetty.server.Server - Started @7933ms > ES working directory is > '/Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/test-output/.' > Unix process > ElasticSearch is starting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting... > Didn't reach ES; waiting...{noformat} > -- This message was sent by Atlassian Jira (v8.3.4#803005)