Peter Boncz wrote:
> Hi Stefan (the non-german .de one)
>   
> session.
>
> I also recall that in case of the Skyserver TB dataset, key checking was
> disabled to to similar problems.
>   
No. The key checking was initially turned off, because the hash table 
(32-bit) could not
well cope with the 13.000.000.000 tuples in the table, causing lengthly 
hash collisions chains.
It took a day....to handle the request.
Work is in progress to speed this up using a straightforward clustering 
on the built-in
hash. The preliminary code has been checked in.
>
> PS
> The likely cause for the problem is a shortage of swap space. Increasing
> your swap file size (with a few 10s of GB) should be a workaround for the
> problem.
>   
The swap space set aside for Skyserver was 128G
>
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Monetdb-developers mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/monetdb-developers
>   


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-developers

Reply via email to