Re: [dspace-tech] oai import errors
Dear Paul, I have seen done an import with the -v option (vebose). /dspace/bin/dspace oai import -c -v So I have seen which was the handle of the item before the system has gone in error (for example 1040303/230). Then in handle table I have found the item with the handle following the previous one. (for example 1040303/231) So have removed this and reinserted again and now the system works. Thanks for you suggestion Best regards Massimiliano Il giorno venerdì 1 novembre 2019 14:53:08 UTC+1, Paul Münch ha scritto: > > Hello, > > there seems to be an UTF-8 error at one item. > > > Caused by: java.io.CharConversionException: Invalid UTF-8 character > > 0x at char #7968757, byte #7974911) > > Maybe it helps debugging to log the imported item. > > cf. > > https://groups.google.com/d/msgid/dspace-tech/91087dc0-c393-4af9-854b-9dde1d7be1b2%40googlegroups.com?utm_medium=email_source=footer > > > Kind regards, > > Paul Münch > > Am 29.10.2019 um 14:37 schrieb Massimiliano CILURZO: > > Dear All, > > We have a Dspace 6.3 and tried to configure the oai harvesting. > >But after doing |[dspace]/bin/dspace oai|| ||import -c| > > |the system says:| > > |* > > Using full import. > > Full import > > 1000 items prepared so far... > > 1000 items imported so far... > > 2000 items prepared so far... > > 2000 items imported so far... > > Total: 2875 items > > org.dspace.xoai.solr.exceptions.DSpaceSolrIndexerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at org.dspace.xoai.app.XOAI.index(XOAI.java:310) > > at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:226) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:133) > > at org.dspace.xoai.app.XOAI.main(XOAI.java:578) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:498) > > at > > > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) > > > at > > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) > > Caused by: org.apache.solr.client.solrj.SolrServerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206) > > > > at > > > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) > > > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68) > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:304) > > ... 9 more > > Caused by: org.apache.http.client.ClientProtocolException > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448) > > > > ... 15 more > > Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot > > retry request with a non-repeatable request entity. The cause lists the > > reason the original request failed. > > at > > > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659) > > > > at > > > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) > > > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) > > > > ... 19 more > > Caused by: java.net.SocketException: Connection reset > > at > > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > > at > java.net.SocketOutputStream.write(SocketOutputStream.java:155) > > at > > > org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181) > > > > at > > > org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124) > > > > at > > >
Re: [dspace-tech] oai import errors
Dear Paul, I have tried this solution but it doesn't work. Do you have some suggestions? Thanks Best regards Massimiliano Il giorno venerdì 1 novembre 2019 14:53:08 UTC+1, Paul Münch ha scritto: > > Hello, > > there seems to be an UTF-8 error at one item. > > > Caused by: java.io.CharConversionException: Invalid UTF-8 character > > 0x at char #7968757, byte #7974911) > > Maybe it helps debugging to log the imported item. > > cf. > > https://groups.google.com/d/msgid/dspace-tech/91087dc0-c393-4af9-854b-9dde1d7be1b2%40googlegroups.com?utm_medium=email_source=footer > > > Kind regards, > > Paul Münch > > Am 29.10.2019 um 14:37 schrieb Massimiliano CILURZO: > > Dear All, > > We have a Dspace 6.3 and tried to configure the oai harvesting. > >But after doing |[dspace]/bin/dspace oai|| ||import -c| > > |the system says:| > > |* > > Using full import. > > Full import > > 1000 items prepared so far... > > 1000 items imported so far... > > 2000 items prepared so far... > > 2000 items imported so far... > > Total: 2875 items > > org.dspace.xoai.solr.exceptions.DSpaceSolrIndexerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at org.dspace.xoai.app.XOAI.index(XOAI.java:310) > > at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:226) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:133) > > at org.dspace.xoai.app.XOAI.main(XOAI.java:578) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:498) > > at > > > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) > > > at > > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) > > Caused by: org.apache.solr.client.solrj.SolrServerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206) > > > > at > > > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) > > > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68) > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:304) > > ... 9 more > > Caused by: org.apache.http.client.ClientProtocolException > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448) > > > > ... 15 more > > Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot > > retry request with a non-repeatable request entity. The cause lists the > > reason the original request failed. > > at > > > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659) > > > > at > > > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) > > > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) > > > > ... 19 more > > Caused by: java.net.SocketException: Connection reset > > at > > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > > at > java.net.SocketOutputStream.write(SocketOutputStream.java:155) > > at > > > org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181) > > > > at > > > org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124) > > > > at > > > org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181) > > > > at > > > org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:136) > > > at > > > org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:96) > > at > > >
Re: [dspace-tech] oai import errors
Hello, there seems to be an UTF-8 error at one item. > Caused by: java.io.CharConversionException: Invalid UTF-8 character > 0x at char #7968757, byte #7974911) Maybe it helps debugging to log the imported item. cf. https://groups.google.com/d/msgid/dspace-tech/91087dc0-c393-4af9-854b-9dde1d7be1b2%40googlegroups.com?utm_medium=email_source=footer Kind regards, Paul Münch Am 29.10.2019 um 14:37 schrieb Massimiliano CILURZO: > Dear All, > We have a Dspace 6.3 and tried to configure the oai harvesting. > But after doing |[dspace]/bin/dspace oai|| ||import -c| > |the system says:| > |* > Using full import. > Full import > 1000 items prepared so far... > 1000 items imported so far... > 2000 items prepared so far... > 2000 items imported so far... > Total: 2875 items > org.dspace.xoai.solr.exceptions.DSpaceSolrIndexerException: IOException > occured when talking to server at: http://localhost:8080/solr/oai > at org.dspace.xoai.app.XOAI.index(XOAI.java:310) > at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:226) > at org.dspace.xoai.app.XOAI.index(XOAI.java:133) > at org.dspace.xoai.app.XOAI.main(XOAI.java:578) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) > at > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) > Caused by: org.apache.solr.client.solrj.SolrServerException: IOException > occured when talking to server at: http://localhost:8080/solr/oai > at > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206) > at > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68) > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54) > at org.dspace.xoai.app.XOAI.index(XOAI.java:304) > ... 9 more > Caused by: org.apache.http.client.ClientProtocolException > at > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886) > at > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) > at > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) > at > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448) > ... 15 more > Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot > retry request with a non-repeatable request entity. The cause lists the > reason the original request failed. > at > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) > at > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) > ... 19 more > Caused by: java.net.SocketException: Connection reset > at > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > at java.net.SocketOutputStream.write(SocketOutputStream.java:155) > at > org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181) > at > org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124) > at > org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181) > at > org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:136) > at > org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:96) > at > org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:112) > at > org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:117) > at > org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265) > at > org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203) > at > org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237) > at > org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122) > at >
[dspace-tech] oai import errors
Dear All, We have a Dspace 6.3 and tried to configure the oai harvesting. But after doing [dspace]/bin/dspace oai import -c the system says: *Using full import.Full import1000 items prepared so far...1000 items imported so far...2000 items prepared so far...2000 items imported so far...Total: 2875 itemsorg.dspace.xoai.solr.exceptions.DSpaceSolrIndexerException: IOException occured when talking to server at: http://localhost:8080/solr/oaiat org.dspace.xoai.app.XOAI.index(XOAI.java:310)at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:226)at org.dspace.xoai.app.XOAI.index(XOAI.java:133)at org.dspace.xoai.app.XOAI.main(XOAI.java:578)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498)at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/oaiat org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54) at org.dspace.xoai.app.XOAI.index(XOAI.java:304)... 9 moreCaused by: org.apache.http.client.ClientProtocolExceptionat org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448) ... 15 moreCaused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) ... 19 moreCaused by: java.net.SocketException: Connection reset at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) at java.net.SocketOutputStream.write(SocketOutputStream.java:155) at org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181) at org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124) at org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181) at org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:136) at org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:96) at org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:112) at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:117) at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265) at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203) at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685) ... 21 more* we have this errors on the logs: dspace.log 2019-10-29 14:25:11,305 WARN org.dspace.xoai.util.ItemUtils @ Authorization denied for action READ on BITSTREAM:f41bf764-2910-412b-a18b-aa291fab9144 by user null org.dspace.authorize.AuthorizeException: Authorization denied for action READ on BITSTREAM:f41bf764-2910-412b-a18b-aa291fab9144 by user null at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:157) at