Hi Lucas,
MySQL connections in "sleep" state are not an issue.
It just indicates that some threads are connected to the DB and are
currently idle (no current DB requests).
Your log indicates that robinhood and the database are not overloaded
(there is no waiting or current operation in the pipeline stats)
but it indicates the scan is blocked as the number of scanned entries
doesn't change:
** progress : 2376915 entries scanned (1877 errors)
**I think that a filesystem operation (readdir or stat) is blocking.
If this is the case, "gstack" on the process should also block, as the
process is stuck in a kernel upcall.
You can use the "crash" utility to see what in what kernel function is
it stuck.*
*Regards,
Thomas*
*
On 05/06/14 11:26, Lucas wrote:
Hello,
I have checked log of Robinhood, the following information is
repeated at regular intervals:
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS |
==================== Dumping stats at 2014/05/06 16:23:39
=====================*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | ========
General statistics =========*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | Daemon start
time: 2014/05/06 11:38:38*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | ======== FS
scan statistics =========*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | current scan
interval = 7.0h*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | scan is running:*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | started
at : 2014/05/06 11:38:39 (4.8h ago)*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | last
action: 2014/05/06 12:21:45 (4.0h ago)*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | progress
: 2376915 entries scanned (1877 errors)*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | avg.
speed : 5.43 ms/entry/thread -> 920.78 entries/sec*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | inst.
speed: 5.03 ms/entry/thread -> 994.91 entries/sec*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | nbr of scan
operations timeouts = 0*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | ====
EntryProcessor Pipeline Stats ===*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | Threads
waiting: 5*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | Id
constraints count: 0 (Hash list min: 0, max: 0, avg: 0.0)*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | 0:
STAGE_GET_FID | Wait: 0 | Curr: 0 | Done: 0 | Total:
0 | ms/op: 0.00*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | 1:
STAGE_GET_INFO_DB | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 0.37*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | 2:
STAGE_GET_INFO_FS | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 0.00*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | 3:
STAGE_REPORTING | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 0.00*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | 4:
STAGE_DB_APPLY | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 5.16*
*2014/05/06 16:23:39 robinhood@ccib001[32519/3]: STATS | 5:
STAGE_RM_OLD_ENTRIES | Wait: 0 | Curr: 0 | Done: 0 | Total:
1 | ms/op: 51049.65*
*
*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS |
==================== Dumping stats at 2014/05/06 16:38:39
=====================*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | ========
General statistics =========*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | Daemon start
time: 2014/05/06 11:38:38*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | ======== FS
scan statistics =========*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | current scan
interval = 7.0h*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | scan is running:*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | started
at : 2014/05/06 11:38:39 (5.0h ago)*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | last
action: 2014/05/06 12:21:45 (4.3h ago)*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | progress
: 2376915 entries scanned (1877 errors)*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | avg.
speed : 5.43 ms/entry/thread -> 920.78 entries/sec*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | inst.
speed: 5.03 ms/entry/thread -> 994.91 entries/sec*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | nbr of scan
operations timeouts = 0*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | ====
EntryProcessor Pipeline Stats ===*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | Threads
waiting: 5*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | Id
constraints count: 0 (Hash list min: 0, max: 0, avg: 0.0)*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | 0:
STAGE_GET_FID | Wait: 0 | Curr: 0 | Done: 0 | Total:
0 | ms/op: 0.00*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | 1:
STAGE_GET_INFO_DB | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 0.37*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | 2:
STAGE_GET_INFO_FS | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 0.00*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | 3:
STAGE_REPORTING | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 0.00*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | 4:
STAGE_DB_APPLY | Wait: 0 | Curr: 0 | Done: 0 | Total:
2375032 | ms/op: 5.16*
*2014/05/06 16:38:39 robinhood@ccib001[32519/3]: STATS | 5:
STAGE_RM_OLD_ENTRIES | Wait: 0 | Curr: 0 | Done: 0 | Total:
1 | ms/op: 51049.65*
The connection status of database is:
Those connection have been "sleep" for a long time. How can I
fix this problem? Many thanks.
Best,
Lucas
At 2014-05-06 12:35:13,"Colin Faber" <[email protected]> wrote:
You'll need to up the logging level to determine why it's not
exiting, that said the "sleep"ing processes are just idle
connections.
On Mon, May 5, 2014 at 8:31 PM, Lucas <[email protected]
<mailto:[email protected]>> wrote:
Hello,
When I used Robinhood2.4.0 for partial scan, sometimes
it would never exit. I checked MySQL database with command
"show processlist" and found there are some "sleep" connection
that would never be ended:
Can anyone give some help? Many thanks.
Lucas
------------------------------------------------------------------------------
"Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
Instantly run your Selenium tests across 300+ browser/OS combos.
Get unparalleled scalability from the best Selenium testing platform available
Simple to use. Nothing to install. Get started now for free."
http://p.sf.net/sfu/SauceLabs
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
