Apparently, the problem does not occur when I don't run multiple mlcp processes in parallel. Even though that is certainly a possibility, I still wonder how I can make sure that if there is a load related problem, mlcp does not silently ignore some of the files that I ask it to load. Ideas, anyone?
Thanks! -Hans On Sun, Jul 3, 2016 at 8:31 PM, Hans Hübner <hans.hueb...@lambdawerk.com> wrote: > Hi Indy, > > thank you for the suggestion. When I switched to -thread_count 1, things > did not work at all anymore (see below). Again, there is nothing in the > error log. Is there any other place that I could look at for diagnostics? > > -Hans > > 16/07/03 20:22:42 INFO contentpump.LocalJobRunner: Content type: XML > 16/07/03 20:22:42 INFO contentpump.FileAndDirectoryInputFormat: Total > input paths to process : 329 > 16/07/03 20:22:44 INFO contentpump.LocalJobRunner: completed 0% > 16/07/03 20:23:24 INFO contentpump.LocalJobRunner: completed 1% > 16/07/03 20:24:49 INFO contentpump.LocalJobRunner: completed 2% > 2016-07-03 20:25:19.446 WARNING [1] > (AbstractRequestController.runRequest): Cannot obtain connection: > Connection refused > java.net.ConnectException: Connection refused > sun.nio.ch.Net.connect0(Native Method) > sun.nio.ch.Net.connect(Net.java:458) > sun.nio.ch.Net.connect(Net.java:450) > sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:648) > java.nio.channels.SocketChannel.open(SocketChannel.java:189) > > com.marklogic.xcc.impl.SocketPoolProvider.obtainConnection(SocketPoolProvider.java:93) > > com.marklogic.xcc.impl.handlers.AbstractRequestController.runRequest(AbstractRequestController.java:85) > > com.marklogic.xcc.impl.SessionImpl.submitRequestInternal(SessionImpl.java:437) > com.marklogic.xcc.impl.SessionImpl.rollback(SessionImpl.java:188) > com.marklogic.xcc.impl.SessionImpl.close(SessionImpl.java:201) > > com.marklogic.contentpump.TransformWriter.write(TransformWriter.java:115) > > com.marklogic.contentpump.TransformWriter.write(TransformWriter.java:46) > > org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89) > > org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112) > > com.marklogic.contentpump.ImportDocumentMapper.map(ImportDocumentMapper.java:50) > > com.marklogic.contentpump.ImportDocumentMapper.map(ImportDocumentMapper.java:35) > org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) > > com.marklogic.contentpump.LocalJobRunner.run(LocalJobRunner.java:231) > > com.marklogic.contentpump.ContentPump.runJobLocally(ContentPump.java:308) > > com.marklogic.contentpump.ContentPump.runCommand(ContentPump.java:205) > com.marklogic.contentpump.ContentPump.main(ContentPump.java:62) > 2016-07-03 20:25:19.448 WARNING [1] (SessionImpl.close): Exception rolling > back during Session.close() > com.marklogic.xcc.exceptions.ServerConnectionException: Connection refused > [Session: user=restuser, cb=tx-claims [ContentSource: user=restuser, > cb=tx-claims [provider: address=marklogic/172.16.0.15:8884, pool=0/64]]] > [Client: XCC/8.0-5, Server: XDBC/8.0-5] > > com.marklogic.xcc.impl.handlers.AbstractRequestController.runRequest(AbstractRequestController.java:149) > > com.marklogic.xcc.impl.SessionImpl.submitRequestInternal(SessionImpl.java:437) > com.marklogic.xcc.impl.SessionImpl.rollback(SessionImpl.java:188) > com.marklogic.xcc.impl.SessionImpl.close(SessionImpl.java:201) > > > -- LambdaWerk GmbH Oranienburger Straße 87/89 10178 Berlin Phone: +49 30 555 7335 0 Fax: +49 30 555 7335 99 HRB 169991 B Amtsgericht Charlottenburg USt-ID: DE301399951 Geschäftsführer: Hans Hübner http://lambdawerk.com/
_______________________________________________ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
