It retries for 3 times and it usually crashes the manifoldcf. Similar ticket i observed https://issues.apache.org/jira/browse/CONNECTORS-1633, does manifoldcf itself capable of skipping the file that cause issue instead of aborting the job or crashing manifold
On Fri, May 14, 2021 at 1:34 PM Karl Wright <daddy...@gmail.com> wrote: > ' > > *JCIFS: Possibly transient exception detected on attempt 1 while getting > share security'Yes, it is going to retry.* > > *Karl* > > On Fri, May 14, 2021 at 1:45 AM ritika jain <ritikajain5...@gmail.com> > wrote: > >> Hi, >> I am using Windows shares connector in manifoldcf 2.14 and ElasticSearch >> connector as Output connector and Tika and Metadata adjuster as >> Transformation connector >> >> Trying to crawl the files from SMB server with 64 GB of server and Start >> option file of manifoldcf is being given 32GB of memory >> But many times got different errors while processing documents:- >> *1) Access is denied* >> *2) ... 23 more* >> >> >> * WARN 2021-05-13T12:33:16,318 (Worker thread '6') - Service interruption >> reported for job 1599130705168 connection 'Themas_Repo': Timeout or other >> service interruption: Interrupted while acquiring credits WARN >> 2021-05-13T12:33:17,315 (Worker thread '6') - JCIFS: Possibly transient >> exception detected on attempt 1 while getting share security: Interrupted >> while acquiring creditsjcifs.smb.SmbException: Interrupted while acquiring >> credits* >> at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl.java:1530) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbSessionImpl.sessionSetupSMB2(SmbSessionImpl.java:549) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.smb.SmbSessionImpl.sessionSetup(SmbSessionImpl.java:483) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.smb.SmbSessionImpl.send(SmbSessionImpl.java:369) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.smb.SmbSessionImpl.send(SmbSessionImpl.java:347) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.smb.SmbTreeImpl.treeConnect(SmbTreeImpl.java:607) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbTreeConnection.connectTree(SmbTreeConnection.java:609) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbTreeConnection.connectHost(SmbTreeConnection.java:563) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbTreeConnection.connectHost(SmbTreeConnection.java:484) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbTreeConnection.connect(SmbTreeConnection.java:460) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbTreeConnection.connectWrapException(SmbTreeConnection.java:421) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.smb.SmbFile.ensureTreeConnected(SmbFile.java:551) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbPipeHandleImpl.ensureTreeConnected(SmbPipeHandleImpl.java:111) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbPipeHandleImpl.ensureOpen(SmbPipeHandleImpl.java:166) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.smb.SmbPipeHandleImpl.sendrecv(SmbPipeHandleImpl.java:250) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> jcifs.dcerpc.DcerpcPipeHandle.doSendReceiveFragment(DcerpcPipeHandle.java:113) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.dcerpc.DcerpcHandle.sendrecv(DcerpcHandle.java:243) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.dcerpc.DcerpcHandle.bind(DcerpcHandle.java:216) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.dcerpc.DcerpcHandle.sendrecv(DcerpcHandle.java:234) >> ~[jcifs-ng-2.1.2.jar:?] >> at jcifs.smb.SmbFile.getShareSecurity(SmbFile.java:2337) >> ~[jcifs-ng-2.1.2.jar:?] >> at >> org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getFileShareSecurity(SharedDriveConnector.java:2500) >> [mcf-jcifs-connector.jar:2.14] >> at >> org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getFileShareSecuritySet(SharedDriveConnector.java:1261) >> [mcf-jcifs-connector.jar:2.14] >> at >> org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.processDocuments(SharedDriveConnector.java:647) >> [mcf-jcifs-connector.jar:2.14] >> at >> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:399) >> [mcf-pull-agent.jar:?] >> Caused by: java.io.InterruptedIOException: Interrupted while acquiring >> credits >> at jcifs.smb.SmbTransportImpl.sendrecv(SmbTransportImpl.java:976) >> ~[?:?] >> at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl.java:1523) >> ~[?:?] >> ... 23 more >> Caused by: java.lang.InterruptedException >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1326) >> ~[?:1.8.0_292] >> at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:582) >> ~[?:1.8.0_292] >> at jcifs.smb.SmbTransportImpl.sendrecv(SmbTransportImpl.java:959) >> ~[?:?] >> at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl.java:1523) >> ~[?:?] >> ... 23 more >> WARN 2021-05-13T12:33:17,314 (Worker thread '2') - JCIFS: Possibly >> transient exception detected on attempt 2 while getting share security: >> Interrupted while acquiring credits >> jcifs.smb.SmbException: Interrupted while acquiring credits >> at jcifs.smb.SmbTransportImpl.send(SmbTransportImpl. >> >> Do we have such functionality that in case of any error occurs like >> this. That it should skip the particular record and then continue to >> process further instead of aborting/stucking the job. >> Also can we have some knowledge about this error. >> >> Thanks >> Ritika >> >
