Piergiorgio Lucidi created CONNECTORS-1708: ----------------------------------------------
Summary: MongoDB Connector - Integration tests broken Key: CONNECTORS-1708 URL: https://issues.apache.org/jira/browse/CONNECTORS-1708 Project: ManifoldCF Issue Type: Bug Components: MongoDB Output Connector Reporter: Piergiorgio Lucidi Trying to execute integration tests with both Ant and Maven, it returns the following error. We are probably using old dependencies of mongodb and de.flapdoodle.embed. Updating both of these dependencies should solve the problem. {code:java} I ran ant test command and now I have a problem with MongoDBOutputConnector: [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz Maybe MongoDB has changed this URL?I'm investigating... Below all the exception returned by Ant run-IT-HSQLDB: [junit] Testsuite: org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT [junit] Configuration file successfully read [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized @941ms to org.eclipse.jetty.util.log.Slf4jLog [junit] [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.25.v20191220; built: 2019-12-20T17:00:00.294Z; git: a9729c7e7f33a459d2616a8f9e9ba8a90f432e95; jvm 11.0.13+8-LTS [junit] [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0 [junit] [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 660000ms [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-2356674270627149959.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-11820210731741565141.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-6023197707410686222.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war} [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346} [junit] [main] INFO org.eclipse.jetty.server.Server - Started @1817ms [junit] Download Version{2.6.8}:OS_X:B32 START [junit] [main] ERROR de.flapdoodle.embed.process.runtime.Starter - prepare executable [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:131) [junit] at de.flapdoodle.embed.process.store.Downloader.download(Downloader.java:69) [junit] at de.flapdoodle.embed.process.store.ArtifactStore.checkDistribution(ArtifactStore.java:66) [junit] at de.flapdoodle.embed.process.store.ExtractedArtifactStore.checkDistribution(ExtractedArtifactStore.java:60) [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:56) [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:49) [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:69) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit] at java.base/java.lang.reflect.Method.invoke(Method.java:566) [junit] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit] at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:535) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1197) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:1042) [junit] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924) [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520) [junit] at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250) [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:127) [junit] ... 28 more [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346} [junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped scavenging [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war} [junit] Tests run: 1, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 6,805 sec [junit] [junit] ------------- Standard Output --------------- [junit] Download Version{2.6.8}:OS_X:B32 START [junit] ------------- ---------------- --------------- [junit] ------------- Standard Error ----------------- [junit] Configuration file successfully read [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized @941ms to org.eclipse.jetty.util.log.Slf4jLog [junit] [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.25.v20191220; built: 2019-12-20T17:00:00.294Z; git: a9729c7e7f33a459d2616a8f9e9ba8a90f432e95; jvm 11.0.13+8-LTS [junit] [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0 [junit] [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 660000ms [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-2356674270627149959.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-11820210731741565141.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-6023197707410686222.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war} [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346} [junit] [main] INFO org.eclipse.jetty.server.Server - Started @1817ms [junit] [main] ERROR de.flapdoodle.embed.process.runtime.Starter - prepare executable [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:131) [junit] at de.flapdoodle.embed.process.store.Downloader.download(Downloader.java:69) [junit] at de.flapdoodle.embed.process.store.ArtifactStore.checkDistribution(ArtifactStore.java:66) [junit] at de.flapdoodle.embed.process.store.ExtractedArtifactStore.checkDistribution(ExtractedArtifactStore.java:60) [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:56) [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:49) [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:69) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit] at java.base/java.lang.reflect.Method.invoke(Method.java:566) [junit] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit] at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:535) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1197) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:1042) [junit] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924) [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520) [junit] at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250) [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:127) [junit] ... 28 more [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346} [junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped scavenging [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war} [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war} [junit] ------------- ---------------- --------------- [junit] Testcase: sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT): Caused an ERROR [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] de.flapdoodle.embed.process.exceptions.DistributionException: java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:69) [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:49) [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:69) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit] Caused by: java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:131) [junit] at de.flapdoodle.embed.process.store.Downloader.download(Downloader.java:69) [junit] at de.flapdoodle.embed.process.store.ArtifactStore.checkDistribution(ArtifactStore.java:66) [junit] at de.flapdoodle.embed.process.store.ExtractedArtifactStore.checkDistribution(ExtractedArtifactStore.java:60) [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:56) [junit] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924) [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520) [junit] at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250) [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:127) [junit] [junit] [junit] Testcase: sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT): Caused an ERROR [junit] null [junit] java.lang.NullPointerException [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT.removeTestArea(APISanityHSQLDBIT.java:109) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit] [junit] BUILD FAILED /Users/pjlucidi/Downloads/apache-manifoldcf-2.22/build.xml:516: The following error occurred while executing this line: /Users/pjlucidi/Downloads/apache-manifoldcf-2.22/build.xml:470: The following error occurred while executing this line: /Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/connector-build.xml:1102: Test org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT failed {code} -- This message was sent by Atlassian Jira (v8.20.7#820007)