The one thing that ANALYZE.FILE will show is MINIMUM.MODULUS. That's probably not the problem here, but it's surprising how many 500Mb files with a minimum modulus of 1 are out there.
On the sep of a static file, there are some great articles on file sizing by Mark Baldridge, in which he a) benchmarks file I/O at various seps, and b) teaches us how to do it for ourselves. You can find them in UV Tech Connect. Part I is here: http://www-128.ibm.com/developerworks/edu/dm-dw-dm-0512baldridge-i.html -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Ray Wurlod Sent: Thursday, April 19, 2007 2:44 AM To: u2-users@listserver.u2ug.org Subject: RE: [U2] Horribly Overflowed Dynamic File I expect you might find that ANALYZE.FILE reports little, if any, overflow. The reason for this is that what you have is oversized records - that is, records that are larger than the LARGE.RECORD parameter. Such records have most of their data portion stored in OVER.30, and only the key and a bit of the data (maybe none) in the group buffer. Dynamic hashed files are not really intended for records of this size, but it explains why you will be recovering little disk space. You might like to use RESIZE filename * * * USING workdirpath to recover as much free space as possible. I think you would be better to opt for a static hashed file, where the group size is much more tunable. A separation of 16, or even 32, will give you larger groups, in which you can store these large records more efficiently. The math to figure out how many groups is straightforward enough - you may even remember how to do it. Allow for some headroom - say 20%. Groups = (bytes_to_store) / (bytes_per_group * 80%) where bytes_to_store = (record_count * (average_record_size + 14)) and bytes_per_group = (separation) * 512 bytes ------- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ ------- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
