Okay, I decreased the size of the access group memory to 200KB and got
the error to occur in 20 minutes. Looking at the LocalBroker log,
it's pretty obvious what the problem is -- not enough file handles!
Hypertable.RangeServer.AccessGroup.MaxMemory=200000
Here are the logs:
/var/log/syslog:
[1304068.497627] Hypertable.Rang[5344]: segfault at 0 ip
0000000000607912 sp 000000004e563a30 error 6 in Hypertable.RangeServer
[400000+41f000]
DfsBroker LocalBroker Log
---------------------------------------
1229281766 ERROR localBroker : (/tmp/hypertable/hypertable-0.9.1.0-
alpha/src/cc/DfsBroker/local/LocalBroker.cc:135) open failed: file='/
usr/hypertable/0.9.1.0/fs/local/hypertable/tables/dtn_daily2/default
92E1B04AAD81D963A2BBB17D/cs256' - Too many open files
[... many more of these messages ]
1229281936 ERROR localBroker : (/tmp/hypertable/hypertable-0.9.1.0-
alpha/src/cc/DfsBroker/Lib/OpenFileMap.h:88) Removing handle 14 from
open file map because of lost owning client connection
229281936 ERROR localBroker : (/tmp/hypertable/hypertable-0.9.1.0-
alpha/src/cc/DfsBroker/Lib/OpenFileMap.h:88) Removing handle 1023 from
open file map because of lost owning client connection
[EOF]
RangeServer Log
------------------------
1229281766 INFO Hypertable.RangeServer : (/tmp/hypertable/
hypertable-0.9.1.0-alpha/src/cc/Hypertable/RangeServer/AccessGroup.cc:
464) Finished Compaction of dtn_daily2
[KGPW_2007-04-21_2007-01-16..MDCUK_2007-09-22_2007-03-12](default)
1229281766 INFO Hypertable.RangeServer : (/tmp/hypertable/
hypertable-0.9.1.0-alpha/src/cc/Hypertable/RangeServer/AccessGroup.cc:
321) Starting Merging Compaction of dtn_daily2
[KGPW_2007-04-21_2007-01-16..MDCUK_2007-09-22_2007-03-12](default)
1229281766 ERROR Hypertable.RangeServer : (/tmp/hypertable/
hypertable-0.9.1.0-alpha/src/cc/Hypertable/RangeServer/CellStoreV0.cc:
143) Error creating cellstore: Error creating DFS file: /hypertable/
tables/dtn_daily2/default/92E1B04AAD81D963A2BBB17D/cs256
1229281766 ERROR Hypertable.RangeServer : run_compaction (/tmp/
hypertable/hypertable-0.9.1.0-alpha/src/cc/Hypertable/RangeServer/
AccessGroup.cc:469): Hypertable::Exception: Problem compacting
locality group to file '/hypertable/tables/dtn_daily2/default/
92E1B04AAD81D963A2BBB17D/cs256' - But that's unpossible!
[ many more errors ]
1229281913 ERROR Hypertable.RangeServer : run_compaction (/tmp/
hypertable/hypertable-0.9.1.0-alpha/src/cc/Hypertable/RangeServer/
AccessGroup.cc:469): Hypertable::Exception: Problem compacting
locality group to file '/hypertable/tables/dtn_daily2/default/
D92FE4A63D6AB347AB042617/cs296' - But that's unpossible!
at void Hypertable::AccessGroup::run_compaction(bool) (/tmp/
hypertable/hypertable-0.9.1.0-alpha/src/cc/Hypertable/RangeServer/
AccessGroup.cc:361)
1229281913 ERROR Hypertable.RangeServer : (/tmp/hypertable/
hypertable-0.9.1.0-alpha/src/cc/Hypertable/RangeServer/Range.cc:401)
Problem creating log directory '/hypertable/servers/192.168.1.50_38060/
log/85C793AEAC23CCADFFD53198': Error removing DFS directory: /
hypertable/servers/192.168.1.50_38060/log/85C793AEAC23CCADFFD53198
[EOF]
Is this a bug or an issue with the OS that doesn't allow as many file
handles as expected that will require some tweaking?
Thanks,
Eric
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Hypertable Development" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/hypertable-dev?hl=en
-~----------~----~----~----~------~----~------~--~---
