[U2] Huge Dynamic Unidata file

2012-04-25 Thread Jonathan Leckie
I have a very large file that I don't have enough free space to memresize, however howabout I create new dynamic (temporary) file and then copy all the records (in ECL) to the new file and then (unix) copy the temporary file over the top of the original. Does that seem like a sensible ide

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Dave Henderson
Hi, That will work, I have done that many times. Just make sure you check the permissions at unix level after the copy. Dave > I have a very large file that I don't have enough free space to memresize, > however howabout I create new dynamic (temporary) file and then copy all the > records (in

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread John Jenkins
We've recently added a new UniData tuneable to udtconfig "UDT_SPLIT_POLICY" which can help conserve space when an overflowed dynamic file splits. The total size of the contents are not necessarily the same as the physical file size. Always worth checking with "guide" and the latest fixes and ch

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Israel, John R.
AM To: Jonathan Leckie; U2 Users List Cc: u2-users@listserver.u2ug.org Subject: Re: [U2] Huge Dynamic Unidata file Hi, That will work, I have done that many times. Just make sure you check the permissions at unix level after the copy. Dave > I have a very large file that I don't hav

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Baakkonen, Rodney A (Rod) 46K
mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jonathan Leckie Sent: Wednesday, April 25, 2012 9:36 AM To: u2-users@listserver.u2ug.org Subject: [U2] Huge Dynamic Unidata file I have a very large file that I don't have enough free space to memresize, however howabout I create new dynamic (temp

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Dean.Armbruster
- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney A (Rod) 46K Sent: Wednesday, April 25, 2012 12:29 To: 'Jonathan Leckie'; 'U2 Users List' Subject: Re: [U2] Huge Dynamic Unidata file I resize most of m

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Wols Lists
On 25/04/12 15:46, John Jenkins wrote: > We've recently added a new UniData tuneable to udtconfig "UDT_SPLIT_POLICY" > which can help conserve space when an overflowed dynamic file splits. The > total size of the contents are not necessarily the same as the physical file > size. Always worth ch

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Baakkonen, Rodney A (Rod) 46K
Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of dean.armbrus...@ferguson.com Sent: Wednesday, April 25, 2012 3:16 PM To: u2-users@listserver.u2ug.org; jonathan.lec...@blairswindows.co.uk Subject: Re: [U2] Huge Dynamic Unidata file

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread John Jenkins
Yes, absolutely - I'm a great believer in a minimum modulo. If I have to copy large files from one to another my preferred method is to drive a load of PHANTOMs with save-lists in parallel. Also useful to drive from a SELECT not a SSELECT so you get a file-sequential order by "chunking" the inpu

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread John Jenkins
sage- > From: u2-users-boun...@listserver.u2ug.org > [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of > dean.armbrus...@ferguson.com > Sent: Wednesday, April 25, 2012 3:16 PM > To: u2-users@listserver.u2ug.org; jonathan.lec...@blairswindows.co.uk > Subject: Re: [U2

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Symeon Breen
nathan.lec...@blairswindows.co.uk Subject: Re: [U2] Huge Dynamic Unidata file I think at the time I wrote this, Unidata 6 I think, I could not even get memresize to handle overflow that was larger than 2 gigabytes. So I thought the solution by Unidata was to create an overflow file for every dat segme

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Baakkonen, Rodney A (Rod) 46K
'; jonathan.lec...@blairswindows.co.uk Subject: Re: [U2] Huge Dynamic Unidata file I think at the time I wrote this, Unidata 6 I think, I could not even get memresize to handle overflow that was larger than 2 gigabytes. So I thought the solution by Unidata was to create an overflow file for every

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Symeon Breen
g] On Behalf Of Baakkonen, Rodney A (Rod) 46K Sent: 26 April 2012 12:00 To: 'U2 Users List' Subject: Re: [U2] Huge Dynamic Unidata file Indexes and all, 91 G with about 75 million records. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserv

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Baakkonen, Rodney A (Rod) 46K
...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Thursday, April 26, 2012 6:18 AM To: 'U2 Users List' Subject: Re: [U2] Huge Dynamic Unidata file That's is pretty big, my personal experience with big files on udt was up to about 60Gig - we did use memresize no problems - but

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Symeon Breen
r.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Thursday, April 26, 2012 6:18 AM To: 'U2 Users List' Subject: Re: [U2] Huge Dynamic Unidata file That's is pretty big, my personal experience with big files on udt was up to about 60Gig - we did