Hmm, this makes no sense.
The code is this:
com.microsoft.sharepoint.webpartpages.GetPermissionCollectionResponseGetPermissionCollectionResult
aclResult = aclCall.getPermissionCollection( encodedRelativePath,
"Item" );
org.apache.axis.message.MessageElement[] aclList = aclResult.get_any();
It's the second line that fails. So aclResult is coming back null
from aclCall.getPermissionCollection(). No error, nothing, just a
null result??
I can hack this, of course, but like I said it isn't making much
sense. Can you perhaps turn on wire debugging and attach the output
to the CONNECTORS-611 ticket please?
Karl
On Mon, Jan 14, 2013 at 10:17 AM, Ahmet Arslan <iori...@yahoo.com> wrote:
> Hi,
>
> If I enable security (Active Directory), job seems hang and I get this too:
>
> FATAL 2013-01-14 17:13:46,871 (Worker thread '15') - Error tossed: null
> java.lang.NullPointerException
> at
> org.apache.manifoldcf.crawler.connectors.sharepoint.SPSProxyHelper.getDocumentACLs(SPSProxyHelper.java:324)
> at
> org.apache.manifoldcf.crawler.connectors.sharepoint.SharePointRepository.getDocumentVersions(SharePointRepository.java:929)
> at
> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:321)
>
> Previous stack traces were produced with security=disabled.
>
> thanks,
> Ahmet
>
> --- On Mon, 1/14/13, Ahmet Arslan <iori...@yahoo.com> wrote:
>
>> From: Ahmet Arslan <iori...@yahoo.com>
>> Subject: Re: Repeated service interruptions - failure processing document:
>> null
>> To: dev@manifoldcf.apache.org
>> Date: Monday, January 14, 2013, 5:13 PM
>> Hi Karl,
>>
>> Thanks for quick fix.
>>
>> I am still seeing the following error after 'svn up' and
>> 'ant build'
>>
>> ERROR 2013-01-14 17:09:41,949 (Worker thread '6') -
>> Exception tossed: Repeated service interruptions - failure
>> processing document: null
>> org.apache.manifoldcf.core.interfaces.ManifoldCFException:
>> Repeated service interruptions - failure processing
>> document: null
>> at
>> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:585)
>> Caused by: org.apache.http.client.ClientProtocolException
>> at
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:909)
>> at
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
>> at
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
>> at
>> org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352)
>> at
>> org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
>> at
>> org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
>> at
>> org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:790)
>> Caused by:
>> org.apache.http.client.NonRepeatableRequestException: Cannot
>> retry request with a non-repeatable request entity.
>> The cause lists the reason the original request failed.
>> at
>> org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:692)
>> at
>> org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:523)
>> at
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
>> ... 6 more
>> Caused by: java.net.SocketException: Broken pipe
>> at
>> java.net.SocketOutputStream.socketWrite0(Native Method)
>> at
>> java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
>> at
>> java.net.SocketOutputStream.write(SocketOutputStream.java:136)
>> at
>> org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:169)
>> at
>> org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:110)
>> at
>> org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:165)
>> at
>> org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:92)
>> at
>> org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:98)
>> at
>> org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
>> at
>> org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:122)
>> at
>> org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:271)
>> at
>> org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:197)
>> at
>> org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:257)
>> at
>> org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
>> at
>> org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:718)
>> ... 8 more
>>
>>
>>
>> --- On Mon, 1/14/13, Karl Wright <daddy...@gmail.com>
>> wrote:
>>
>> > From: Karl Wright <daddy...@gmail.com>
>> > Subject: Re: Repeated service interruptions - failure
>> processing document: null
>> > To: dev@manifoldcf.apache.org
>> > Date: Monday, January 14, 2013, 3:30 PM
>> > Hi Ahmet,
>> >
>> > The exception that seems to be causing the abort is a
>> socket
>> > exception
>> > coming from a socket write:
>> >
>> > > Caused by: java.net.SocketException: Broken pipe
>> >
>> > This makes sense in light of the http code returned
>> from
>> > Solr, which
>> > was 413: http://www.checkupdown.com/status/E413.html .
>> >
>> > So there is nothing actually *wrong* with the .aspx
>> > documents, but
>> > they are just way too big, and Solr is rejecting them
>> for
>> > that reason.
>> >
>> > Clearly, though, the Solr connector should recognize
>> this
>> > code as
>> > meaning "never retry", so instead of killing the job,
>> it
>> > should just
>> > skip the document. I'll open a ticket for that now.
>> >
>> > Karl
>> >
>> >
>> > On Mon, Jan 14, 2013 at 8:22 AM, Ahmet Arslan <iori...@yahoo.com>
>> > wrote:
>> > > Hello,
>> > >
>> > > I am indexing a SharePoint 2010 instance using
>> > mcf-trunk (At revision 1432907)
>> > >
>> > > There is no problem with a Document library that
>> > contains word excel etc.
>> > >
>> > > However, I receive the following errors with a
>> Document
>> > library that has *.aspx files in it.
>> > >
>> > > Status of Jobs => Error: Repeated service
>> > interruptions - failure processing document: null
>> > >
>> > > WARN 2013-01-14 15:00:12,720 (Worker thread
>> '13')
>> > - Service interruption reported for job 1358009105156
>> > connection 'iknow': IO exception during indexing: null
>> > > ERROR 2013-01-14 15:00:12,763 (Worker thread '13')
>> -
>> > Exception tossed: Repeated service interruptions -
>> failure
>> > processing document: null
>> > >
>> >
>> org.apache.manifoldcf.core.interfaces.ManifoldCFException:
>> > Repeated service interruptions - failure processing
>> > document: null
>> > > at
>> >
>> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:585)
>> > > Caused by:
>> > org.apache.http.client.ClientProtocolException
>> > > at
>> >
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:909)
>> > > at
>> >
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
>> > > at
>> >
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
>> > > at
>> >
>> org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352)
>> > > at
>> >
>> org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
>> > > at
>> >
>> org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
>> > > at
>> >
>> org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:768)
>> > > Caused by:
>> > org.apache.http.client.NonRepeatableRequestException:
>> Cannot
>> > retry request with a non-repeatable request entity.
>> > The cause lists the reason the original request
>> failed.
>> > > at
>> >
>> org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:692)
>> > > at
>> >
>> org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:523)
>> > > at
>> >
>> org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
>> > > ... 6 more
>> > > Caused by: java.net.SocketException: Broken pipe
>> > > at
>> > java.net.SocketOutputStream.socketWrite0(Native
>> Method)
>> > > at
>> >
>> java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
>> > > at
>> >
>> java.net.SocketOutputStream.write(SocketOutputStream.java:136)
>> > > at
>> >
>> org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:169)
>> > > at
>> >
>> org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:110)
>> > > at
>> >
>> org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:165)
>> > > at
>> >
>> org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:92)
>> > > at
>> >
>> org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:98)
>> > > at
>> >
>> org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
>> > > at
>> >
>> org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:122)
>> > > at
>> >
>> org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:271)
>> > > at
>> >
>> org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:197)
>> > > at
>> >
>> org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:257)
>> > > at
>> >
>> org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
>> > > at
>> >
>> org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:718)
>> > > ... 8 more
>> > >
>> > > Status of Jobs => Error: Unhandled Solr
>> exception
>> > during indexing (0): Server at http://localhost:8983/solr/all returned non
>> > ok
>> > status:413, message:FULL head
>> > >
>> > > ERROR 2013-01-14
>> > 15:10:42,074 (Worker thread '15') - Exception tossed:
>> > Unhandled Solr exception during indexing (0): Server at
>> http://localhost:8983/solr/all returned non ok
>> > status:413, message:FULL head
>> > >
>> >
>> org.apache.manifoldcf.core.interfaces.ManifoldCFException:
>> > Unhandled Solr exception during indexing (0): Server at
>> http://localhost:8983/solr/all returned non ok
>> > status:413, message:FULL head
>> > > at
>> >
>> org.apache.manifoldcf.agents.output.solr.HttpPoster.handleSolrException(HttpPoster.java:360)
>> > > at
>> >
>> org.apache.manifoldcf.agents.output.solr.HttpPoster.indexPost(HttpPoster.java:477)
>> > > at
>> >
>> org.apache.manifoldcf.agents.output.solr.SolrConnector.addOrReplaceDocument(SolrConnector.java:594)
>> > > at
>> >
>> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.addOrReplaceDocument(IncrementalIngester.java:1579)
>> > > at
>> >
>> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.performIngestion(IncrementalIngester.java:504)
>> > > at
>> >
>> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:370)
>> > > at
>> >
>> org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocument(WorkerThread.java:1652)
>> > > at
>> >
>> org.apache.manifoldcf.crawler.connectors.sharepoint.SharePointRepository.processDocuments(SharePointRepository.java:1559)
>> > > at
>> >
>> org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:423)
>> > > at
>> >
>> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:551)
>> > >
>> > > On the solr side I see :
>> > >
>> > > INFO: Creating new http client,
>> > config:maxConnections=200&maxConnectionsPerHost=8
>> > > 2013-01-14 15:18:21.775:WARN:oejh.HttpParser:Full
>> >
>> [671412972,-1,m=5,g=6144,p=6144,c=6144]={2F736F6C722F616
>> > ...long long chars ... 2B656B6970{}
>> > >
>> > > Thanks,
>> > > Ahmet
>> >
>>
