Hi,
I am using Windows shares connector in manifoldcf 2.14 and ElasticSearch
connector as Output connector and Tika and Metadata adjuster as
Transformation connector
Trying to crawl the files from SMB server with 64 GB of server and Start
option file of manifoldcf is being given 32GB of memory
But many times got different errors while processing documents:-
*1) Access is denied*
*2) ... 23 more*
* WARN 2021-05-13T12:33:16,318 (Worker thread '6') - Service interruption
reported for job 1599130705168 connection 'Themas_Repo': Timeout or other
service interruption: Interrupted while acquiring credits WARN
2021-05-13T12:33:17,315 (Worker thread '6') - JCIFS: Possibly transient
exception detected on attempt 1 while getting share security: Interrupted
while acquiring creditsjcifs.smb.SmbException: Interrupted while acquiring
credits*
at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl.java:1530)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.smb.SmbSessionImpl.sessionSetupSMB2(SmbSessionImpl.java:549)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbSessionImpl.sessionSetup(SmbSessionImpl.java:483)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbSessionImpl.send(SmbSessionImpl.java:369)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbSessionImpl.send(SmbSessionImpl.java:347)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbTreeImpl.treeConnect(SmbTreeImpl.java:607)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.smb.SmbTreeConnection.connectTree(SmbTreeConnection.java:609)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.smb.SmbTreeConnection.connectHost(SmbTreeConnection.java:563)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.smb.SmbTreeConnection.connectHost(SmbTreeConnection.java:484)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbTreeConnection.connect(SmbTreeConnection.java:460)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.smb.SmbTreeConnection.connectWrapException(SmbTreeConnection.java:421)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbFile.ensureTreeConnected(SmbFile.java:551)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.smb.SmbPipeHandleImpl.ensureTreeConnected(SmbPipeHandleImpl.java:111)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.smb.SmbPipeHandleImpl.ensureOpen(SmbPipeHandleImpl.java:166)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbPipeHandleImpl.sendrecv(SmbPipeHandleImpl.java:250)
~[jcifs-ng-2.1.2.jar:?]
at
jcifs.dcerpc.DcerpcPipeHandle.doSendReceiveFragment(DcerpcPipeHandle.java:113)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.dcerpc.DcerpcHandle.sendrecv(DcerpcHandle.java:243)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.dcerpc.DcerpcHandle.bind(DcerpcHandle.java:216)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.dcerpc.DcerpcHandle.sendrecv(DcerpcHandle.java:234)
~[jcifs-ng-2.1.2.jar:?]
at jcifs.smb.SmbFile.getShareSecurity(SmbFile.java:2337)
~[jcifs-ng-2.1.2.jar:?]
at
org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getFileShareSecurity(SharedDriveConnector.java:2500)
[mcf-jcifs-connector.jar:2.14]
at
org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getFileShareSecuritySet(SharedDriveConnector.java:1261)
[mcf-jcifs-connector.jar:2.14]
at
org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.processDocuments(SharedDriveConnector.java:647)
[mcf-jcifs-connector.jar:2.14]
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:399)
[mcf-pull-agent.jar:?]
Caused by: java.io.InterruptedIOException: Interrupted while acquiring
credits
at jcifs.smb.SmbTransportImpl.sendrecv(SmbTransportImpl.java:976)
~[?:?]
at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl.java:1523)
~[?:?]
... 23 more
Caused by: java.lang.InterruptedException
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1326)
~[?:1.8.0_292]
at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:582)
~[?:1.8.0_292]
at jcifs.smb.SmbTransportImpl.sendrecv(SmbTransportImpl.java:959)
~[?:?]
at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl.java:1523)
~[?:?]
... 23 more
WARN 2021-05-13T12:33:17,314 (Worker thread '2') - JCIFS: Possibly
transient exception detected on attempt 2 while getting share security:
Interrupted while acquiring credits
jcifs.smb.SmbException: Interrupted while acquiring credits
at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl.
Do we have such functionality that in case of any error occurs like this.
That it should skip the particular record and then continue to process
further instead of aborting/stucking the job.
Also can we have some knowledge about this error.
Thanks
Ritika
