You are of course right - in my defence it was a few years ago ;)


-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org 
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney A 
(Rod) 46K
Sent: 26 April 2012 12:21
To: 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file

 I thought TMPPATH was not valid for Dynamic files:

?? The TMPPATH option is invalid if any DYNAMIC options are specified (or if 
the starting file is dynamic and no file type options are specified).

-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org 
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen
Sent: Thursday, April 26, 2012 6:18 AM
To: 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file

That's is pretty big, my personal experience with big files on udt was up to 
about 60Gig - we did use memresize no problems - but had to set the TMPPATH to 
another drive.



-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney A 
(Rod) 46K
Sent: 26 April 2012 12:00
To: 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file

 Indexes and all, 91 G with about 75 million records.

-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen
Sent: Thursday, April 26, 2012 4:08 AM
To: 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file

Out of interest, how big is this file and how many records ?


-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney A 
(Rod) 46K
Sent: 25 April 2012 21:30
To: 'U2 Users List'; jonathan.lec...@blairswindows.co.uk
Subject: Re: [U2] Huge Dynamic Unidata file

 
        I think at the time I wrote this, Unidata 6 I think, I could not even 
get memresize to handle overflow that was larger than 2 gigabytes. So I thought 
the solution by Unidata was to create an overflow file for every dat segment. I 
have never specified the OVERFLOW option when using memresize.
Plus, I rarely have enough space in a file system to handle 2 copies of one of 
my big file. One work around for the file system space issue is to symbolically 
link the original file in another file system. But that is a lot of work when 
you have a lot of dat files. 



-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of 
dean.armbrus...@ferguson.com
Sent: Wednesday, April 25, 2012 3:16 PM
To: u2-users@listserver.u2ug.org; jonathan.lec...@blairswindows.co.uk
Subject: Re: [U2] Huge Dynamic Unidata file

Were you using the OVERFLOW option with memresize?  If not, memresize should 
not be creating the extra over files.  If memresize did create the extra over 
files without the OVERFLOW option, then that would be a bug in memresize. 

Dean Armbruster
System Analyst
757-989-2839

-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney A 
(Rod) 46K
Sent: Wednesday, April 25, 2012 12:29
To: 'Jonathan Leckie'; 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file


 I resize most of my Dynamic files this way. I don't like having a small 
overxxx segment for every datxxx segment that memresize creates.. By creating 
the new file my self, I don't have a lot of these small overxxx segments that 
are never used.

I also wrote a process to Select the old file and create a SAVELIST.
Without going into to much detail, the process uses PHANTOM to spawn off a 
number of Unidata copies. So there are a number of simultaneous processes 
working to build the new file. Each PHANTOM Copy knows how many total phantoms 
are working on the file and what sequence IT is within the total number of 
PHANTOMS. Each Phantom handles part of the SAVELIST. Each PHANTOM does the 
iteration below until the list is
exhausted:

1. QSELECT SAVEDLISTS listname000. (process 2 would use 001, process 3 would 
use 002 etc) 2. COPY FROM old.file TO new.file 3. Increment the list counter 
from 000 by the number of Phantoms and go back to step one to process a new 
segment of the savelist.
4. If a process cannot find the next savelist segment in SAVEDLISTS, it is done.

This process is almost as fast as memresize. You can control what file systems 
are used for space reasons and you don't get scads of overxxx segments in your 
FILE.NAME directory (one of my dynamic files has 39 dat segments and just a 
over001). 

So I don't use memresize for dynamic files anymore. 

-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jonathan Leckie
Sent: Wednesday, April 25, 2012 9:36 AM
To: u2-users@listserver.u2ug.org
Subject: [U2] Huge Dynamic Unidata file

I have a very large  file that I don't have enough free space to memresize, 
however howabout I create  new dynamic (temporary) file and then copy all the 
records (in ECL) to the new  file and then (unix) copy the temporary file over 
the top of the  original.
 
Does that seem like  a sensible idea?
 
 
Regards
Jonathan Leckie
 



**********************************************************
* This message has been scanned for viruses and dangerous content
* and is believed to be clean.            
*

* This email and any files transmitted with it are confidential and
* intended solely for the use of the individual or entity to whom they
* are addressed.
*
* If you have received this email in error please notify us at Blairs,
* details can be found on our website http://www.blairswindows.co.uk
*
* Name & Registered Office:
*
* Blairs Windows Limited
* Registered office : 9 Baker Street, Greenock, PA15 4TU
* Company No: SC393935, V.A.T. registration No: 108729111
**********************************************************
_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

------------------------------------------------------------------------
------
CONFIDENTIALITY NOTICE: If you have received this email in error, please 
immediately notify the sender by e-mail at the address shown.  
This email transmission may contain confidential information.  This information 
is intended only for the use of the individual(s) or entity to whom it is 
intended even if addressed incorrectly.  Please delete it from your files if 
you are not the intended recipient.  Thank you for your compliance.  Copyright 
(c) 2012 Cigna 
========================================================================
======

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

----------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE: If you have received this email in error, please 
immediately notify the sender by e-mail at the address shown.  
This email transmission may contain confidential information.  This information 
is intended only for the use of the individual(s) or entity to whom it is 
intended even if addressed incorrectly.  Please delete it from your files if 
you are not the intended recipient.  Thank you for your compliance.  Copyright 
(c) 2012 Cigna 
============================================================================
==

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1424 / Virus Database: 2411/4958 - Release Date: 04/25/12

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

----------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE: If you have received this email in error, please 
immediately notify the sender by e-mail at the address shown.  
This email transmission may contain confidential information.  This information 
is intended only for the use of the individual(s) or entity to whom it is 
intended even if addressed incorrectly.  Please delete it from your files if 
you are not the intended recipient.  Thank you for your compliance.  Copyright 
(c) 2012 Cigna 
============================================================================
==

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1424 / Virus Database: 2411/4960 - Release Date: 04/26/12

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

------------------------------------------------------------------------------
CONFIDENTIALITY NOTICE: If you have received this email in error, please 
immediately notify the sender by e-mail at the address shown.  
This email transmission may contain confidential information.  This information 
is intended only for the use of the individual(s) or entity to whom it is 
intended even if addressed incorrectly.  Please delete it from your files if 
you are not the intended recipient.  Thank you for your compliance.  Copyright 
(c) 2012 Cigna 
==============================================================================
_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1424 / Virus Database: 2411/4960 - Release Date: 04/26/12

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Reply via email to