Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

2011-11-16 Thread Jacques G.
Quite possibly, but I'm not going to re-write 5 years worth of API's to 
accomodate a bug in Universe 11.1.3.   :-)




From: Symeon Breen syme...@gmail.com
To: 'U2 Users List' u2-users@listserver.u2ug.org
Sent: Monday, November 14, 2011 4:26 AM
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

On unidata I have had to process many an xml file outside of the DB as the
memory just shoots right up

If you are using uniobjects then I presume you have .net or java at the
front end and it is likely that these environments are better suited to
'handling' the xml and simply passing data arrays to the universe layer to
work on.



-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G.
Sent: 11 November 2011 20:05
To: U2 Users List
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3


Hello,

In order to save connection time on Uniobjects API requests, I came up with
an Api which could contain several XML requests into one,  Process each one
in the requested order and return the answer of each request in the
resulting XML request.

On Universe 10.2.11,  the API runs anywhere from 10 to 50 requests in a
batch like this taking no more than between 45 and 59 megs of ram on a HP-UX
server.


Starting with Universe 11.1.3, doing far fewer requests  (ei from 5 to 9)
the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. 
Somewhere it looks like Universe's XML generation routines are gobbling up
memory and this memory is not getting freed. It seems that many memory
leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a
huge new one was introduced.  

I know of the memory used by the process because I have a job which produce
the output of the top command once a minute,  so the memory used by a
process extracted from the output of the top command and logged.

Has anyone else experienced anything like this ?

Jacques G.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

2011-11-16 Thread Jacques G.



The xml files are processed with the  XMAPReadNext command using a mapping file 
that is defined in XML.  Basically the Batch API does:

FOR X.JOB = 1 TO NB.JOB
   XML.PARAM = JOBX.JOB
   Parse XML.PARAM in a DYN.ARRAY (using map in XML)

   CALL @JOB.NAME(DYN.ARRAY,OUT.ARRAY)
   Build XML.OUT string from OUT.ARRAY
  Store XML.OUT in JOB.OUTX.JOB
NEXT X.JOB
Return JOB.OUT to the calling web service

  

I will try upgrading the Uniobjects dll to see what it does.

Thanks





From: Symeon Breen syme...@gmail.com
To: 'U2 Users List' u2-users@listserver.u2ug.org
Sent: Monday, November 14, 2011 11:58 AM
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

Another thing to try is process the xml files outside of uniobjects but
still in databasic and see how it goes. If it uses large amounts of memory
then it is not a uniobjects issue . You could then try using those xml files
from a *nix shell program like xmlwf / xml_pp or xsltproc. These use the
standard xmllib library that uv may be using so if those give high memory
usage it may not even be a uv issue but a *nix library issue.



-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of David Jordan
Sent: 14 November 2011 10:23
To: U2 Users List
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

That triggered a memory.  If you are using an older version of uniobjects in
the .Net you can get memory issues when you upgrade the database.   Have a
look at upgrading the uniobject .Net to the lastest release.

Regards
David Jordan

-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen
Sent: Monday, 14 November 2011 8:27 PM
To: 'U2 Users List'
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

On unidata I have had to process many an xml file outside of the DB as the
memory just shoots right up

If you are using uniobjects then I presume you have .net or java at the
front end and it is likely that these environments are better suited to
'handling' the xml and simply passing data arrays to the universe layer to
work on.



-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G.
Sent: 11 November 2011 20:05
To: U2 Users List
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3


Hello,

In order to save connection time on Uniobjects API requests, I came up with
an Api which could contain several XML requests into one,  Process each one
in the requested order and return the answer of each request in the
resulting XML request.

On Universe 10.2.11,  the API runs anywhere from 10 to 50 requests in a
batch like this taking no more than between 45 and 59 megs of ram on a HP-UX
server.


Starting with Universe 11.1.3, doing far fewer requests  (ei from 5 to 9)
the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX.
Somewhere it looks like Universe's XML generation routines are gobbling up
memory and this memory is not getting freed. It seems that many memory
leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a
huge new one was introduced.  

I know of the memory used by the process because I have a job which produce
the output of the top command once a minute,  so the memory used by a
process extracted from the output of the top command and logged.

Has anyone else experienced anything like this ?

Jacques G.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1411 / Virus Database: 2092/4015 - Release Date: 11/13/11

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

2011-11-14 Thread Symeon Breen
On unidata I have had to process many an xml file outside of the DB as the
memory just shoots right up

If you are using uniobjects then I presume you have .net or java at the
front end and it is likely that these environments are better suited to
'handling' the xml and simply passing data arrays to the universe layer to
work on.



-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G.
Sent: 11 November 2011 20:05
To: U2 Users List
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3


Hello,

In order to save connection time on Uniobjects API requests, I came up with
an Api which could contain several XML requests into one,  Process each one
in the requested order and return the answer of each request in the
resulting XML request.

On Universe 10.2.11,  the API runs anywhere from 10 to 50 requests in a
batch like this taking no more than between 45 and 59 megs of ram on a HP-UX
server.


Starting with Universe 11.1.3, doing far fewer requests  (ei from 5 to 9)
the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. 
Somewhere it looks like Universe's XML generation routines are gobbling up
memory and this memory is not getting freed. It seems that many memory
leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a
huge new one was introduced.  

I know of the memory used by the process because I have a job which produce
the output of the top command once a minute,  so the memory used by a
process extracted from the output of the top command and logged.

Has anyone else experienced anything like this ?

Jacques G.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

2011-11-14 Thread David Jordan
That triggered a memory.  If you are using an older version of uniobjects in 
the .Net you can get memory issues when you upgrade the database.   Have a look 
at upgrading the uniobject .Net to the lastest release.

Regards
David Jordan

-Original Message-
From: u2-users-boun...@listserver.u2ug.org 
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen
Sent: Monday, 14 November 2011 8:27 PM
To: 'U2 Users List'
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

On unidata I have had to process many an xml file outside of the DB as the 
memory just shoots right up

If you are using uniobjects then I presume you have .net or java at the front 
end and it is likely that these environments are better suited to 'handling' 
the xml and simply passing data arrays to the universe layer to work on.



-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G.
Sent: 11 November 2011 20:05
To: U2 Users List
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3


Hello,

In order to save connection time on Uniobjects API requests, I came up with an 
Api which could contain several XML requests into one,  Process each one in the 
requested order and return the answer of each request in the resulting XML 
request.

On Universe 10.2.11,  the API runs anywhere from 10 to 50 requests in a batch 
like this taking no more than between 45 and 59 megs of ram on a HP-UX server.


Starting with Universe 11.1.3, doing far fewer requests  (ei from 5 to 9) the 
memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. 
Somewhere it looks like Universe's XML generation routines are gobbling up 
memory and this memory is not getting freed. It seems that many memory 
leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a 
huge new one was introduced.  

I know of the memory used by the process because I have a job which produce the 
output of the top command once a minute,  so the memory used by a process 
extracted from the output of the top command and logged.

Has anyone else experienced anything like this ?

Jacques G.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

2011-11-14 Thread Symeon Breen
Another thing to try is process the xml files outside of uniobjects but
still in databasic and see how it goes. If it uses large amounts of memory
then it is not a uniobjects issue . You could then try using those xml files
from a *nix shell program like xmlwf / xml_pp or xsltproc. These use the
standard xmllib library that uv may be using so if those give high memory
usage it may not even be a uv issue but a *nix library issue.



-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of David Jordan
Sent: 14 November 2011 10:23
To: U2 Users List
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

That triggered a memory.  If you are using an older version of uniobjects in
the .Net you can get memory issues when you upgrade the database.   Have a
look at upgrading the uniobject .Net to the lastest release.

Regards
David Jordan

-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen
Sent: Monday, 14 November 2011 8:27 PM
To: 'U2 Users List'
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

On unidata I have had to process many an xml file outside of the DB as the
memory just shoots right up

If you are using uniobjects then I presume you have .net or java at the
front end and it is likely that these environments are better suited to
'handling' the xml and simply passing data arrays to the universe layer to
work on.



-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G.
Sent: 11 November 2011 20:05
To: U2 Users List
Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3


Hello,

In order to save connection time on Uniobjects API requests, I came up with
an Api which could contain several XML requests into one,  Process each one
in the requested order and return the answer of each request in the
resulting XML request.

On Universe 10.2.11,  the API runs anywhere from 10 to 50 requests in a
batch like this taking no more than between 45 and 59 megs of ram on a HP-UX
server.


Starting with Universe 11.1.3, doing far fewer requests  (ei from 5 to 9)
the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX.
Somewhere it looks like Universe's XML generation routines are gobbling up
memory and this memory is not getting freed. It seems that many memory
leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a
huge new one was introduced.  

I know of the memory used by the process because I have a job which produce
the output of the top command once a minute,  so the memory used by a
process extracted from the output of the top command and logged.

Has anyone else experienced anything like this ?

Jacques G.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1411 / Virus Database: 2092/4015 - Release Date: 11/13/11

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] [UV] uvcs Memory leak problems on 11.1.3

2011-11-11 Thread Jacques G.

Hello,

In order to save connection time on Uniobjects API requests, I came up with an 
Api which could contain several XML requests into one,  Process each one in the 
requested order and return the answer of each request in the resulting XML 
request.

On Universe 10.2.11,  the API runs anywhere from 10 to 50 requests in a batch 
like this taking no more than between 45 and 59 megs of ram on a HP-UX server.


Starting with Universe 11.1.3, doing far fewer requests  (ei from 5 to 9) the 
memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX.  
Somewhere it looks like Universe's XML generation routines are gobbling up 
memory and this memory is not getting freed. It seems that many memory 
leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a 
huge new one was introduced.  

I know of the memory used by the process because I have a job which produce the 
output of the top command once a minute,  so the memory used by a process 
extracted from the output of the top command and logged.

Has anyone else experienced anything like this ?

Jacques G.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users