[
https://issues.apache.org/jira/browse/CONNECTORS-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659969#comment-13659969
]
David Morana commented on CONNECTORS-689:
-----------------------------------------
ok, the good news is that it found the documents in my personal WS and added
them to the index.
the bad news is that is stopped on error: Error: Repeated service interruptions
- failure processing document: Connection reset by peer: socket write error
The document right before the failure is in a Project. IIRC, a project
workspace has slightly different permissions than other objects in Livelink.
I'll have to do more research on projects and get back to you.
I'll have to ask my sys admins if they restarted DEV while I was running a job.
Meanwhile:
here's the error from the log:
{code}
DEBUG 2013-05-16 16:02:21,217 (Worker thread '2') - Livelink: Successfully
calculated version string for object -2000:632129 :
'+5+388405+445135+615950+615950+SYSTEM+DEAD_AUTHORITY+Mon May 07 14:35:06 EDT
2012'
DEBUG 2013-05-16 16:02:21,287 (Thread-226112) - Livelink: Status retrieved for
888338:-888338: status=0
DEBUG 2013-05-16 16:02:21,287 (Worker thread '18') - Livelink: Path attribute
name is 'll_filename'for 'D888338:850841', value is
'ProjectB||New_Archive_20120410T102718||Screen shot 2012-04-09 at 4.03.48
PM.png'
DEBUG 2013-05-16 16:02:21,287 (Worker thread '18') - Livelink: Session
authenticating via http for 'D888338:850841'...
DEBUG 2013-05-16 16:02:21,287 (Worker thread '18') - Livelink: Created new
HttpGet for 'D888338:850841'; executing authentication method
WARN 2013-05-16 16:02:21,287 (Worker thread '18') - Livelink: Socket error
authenticating to the Livelink HTTP Server for 'D888338:850841': Connection
reset by peer: socket write error
java.net.SocketException: Connection reset by peer: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at sun.security.ssl.OutputRecord.writeBuffer(Unknown Source)
at sun.security.ssl.OutputRecord.write(Unknown Source)
at sun.security.ssl.SSLSocketImpl.writeRecordInternal(Unknown Source)
at sun.security.ssl.SSLSocketImpl.writeRecord(Unknown Source)
at sun.security.ssl.AppOutputStream.write(Unknown Source)
at
org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:147)
at
org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:154)
at
org.apache.http.impl.AbstractHttpClientConnection.doFlush(AbstractHttpClientConnection.java:278)
at
org.apache.http.impl.AbstractHttpClientConnection.flush(AbstractHttpClientConnection.java:283)
at
org.apache.http.impl.conn.ManagedClientConnectionImpl.flush(ManagedClientConnectionImpl.java:175)
at
org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:260)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:715)
at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:520)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at
org.apache.manifoldcf.crawler.connectors.livelink.LivelinkConnector$ExecuteMethodThread.run(LivelinkConnector.java:7333)
WARN 2013-05-16 16:02:21,287 (Worker thread '18') - Service interruption
reported for job 1364305613074 connection 'LISA SSL DEV REPO': Socket error:
Connection reset by peer: socket write error
ERROR 2013-05-16 16:02:21,297 (Worker thread '18') - Exception tossed: Repeated
service interruptions - failure processing document: Connection reset by peer:
socket write error
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Repeated service
interruptions - failure processing document: Connection reset by peer: socket
write error
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:586)
Caused by: java.net.SocketException: Connection reset by peer: socket write
error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at sun.security.ssl.OutputRecord.writeBuffer(Unknown Source)
at sun.security.ssl.OutputRecord.write(Unknown Source)
at sun.security.ssl.SSLSocketImpl.writeRecordInternal(Unknown Source)
at sun.security.ssl.SSLSocketImpl.writeRecord(Unknown Source)
at sun.security.ssl.AppOutputStream.write(Unknown Source)
at
org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:147)
at
org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:154)
at
org.apache.http.impl.AbstractHttpClientConnection.doFlush(AbstractHttpClientConnection.java:278)
at
org.apache.http.impl.AbstractHttpClientConnection.flush(AbstractHttpClientConnection.java:283)
at
org.apache.http.impl.conn.ManagedClientConnectionImpl.flush(ManagedClientConnectionImpl.java:175)
at
org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:260)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:715)
at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:520)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at
org.apache.manifoldcf.crawler.connectors.livelink.LivelinkConnector$ExecuteMethodThread.run(LivelinkConnector.java:7333)
{code}
> Add Personal Workspaces to the Livelink connector
> -------------------------------------------------
>
> Key: CONNECTORS-689
> URL: https://issues.apache.org/jira/browse/CONNECTORS-689
> Project: ManifoldCF
> Issue Type: Improvement
> Affects Versions: ManifoldCF 1.3
> Reporter: David Morana
> Assignee: Karl Wright
> Priority: Minor
> Fix For: ManifoldCF 1.3
>
>
> Currently, the Livelink connector only crawls the Enterprise workspace.
> Can we add each users personal workspace to the crawl?
> First you would have to enumerate all the users (and get the users object ID)
> and then use ListObjects to enumerate all of the files and folders.
> Initially, I was testing to see if deleted users appeared; fortunately they
> don't. You could also test to exclude login disabled users but that's
> probably not necessary.
> here's some prototype code:
> {code}
> // list all users test
> LLValue uu = new LLValue();
> LLValue children = new LLValue();
> int stat = users.ListUsers(uu);
> //add test status for errors
> LLValueEnumeration valEnum = uu.enumerateValues();
> while (valEnum.hasMoreElements())
> {
> elem = (LLValue) valEnum.nextElement();
> //int t = elem.toInteger("DELETED");
> //if (t == 1)
> //{
> System.out.println("OwnerID = " + elem.toString("ID"));
> System.out.println("Name = " + elem.toString("NAME"));
>
> System.out.println("Deleted = " + elem.toString("DELETED"));
> //}
> // exclude the Admin account - objectID 1000, 1001
> // enumerate all objects in the Users PersonalWS, see and see
> contents at the very least
> int objID = elem.toInteger("ID");
> if (objID != 1000 || objID != 1001)
> stat = documents.ListObjects(0, objID, null, null, 2 +
> 36865, children);
>
> // loop through children to get files and folders
> children.enumerateValues();
> ...
> }
> {code}
> We're really only after files and folders. There are other Livelink objects,
> like LiveReports, that you can probably exclude. Some users have the ability
> to create and use LiveReports which are stored in their PersonalWS.
> LiveReports are just glorified oracle stored procedures.
> Exclude the Admin account. You can't enumerate that in lapi.
> Thanks,
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
