Re: [U2] [UV] uvcs Memory leak problems on 11.1.3
Quite possibly, but I'm not going to re-write 5 years worth of API's to accomodate a bug in Universe 11.1.3. :-) From: Symeon Breen syme...@gmail.com To: 'U2 Users List' u2-users@listserver.u2ug.org Sent: Monday, November 14, 2011 4:26 AM Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 On unidata I have had to process many an xml file outside of the DB as the memory just shoots right up If you are using uniobjects then I presume you have .net or java at the front end and it is likely that these environments are better suited to 'handling' the xml and simply passing data arrays to the universe layer to work on. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G. Sent: 11 November 2011 20:05 To: U2 Users List Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 Hello, In order to save connection time on Uniobjects API requests, I came up with an Api which could contain several XML requests into one, Process each one in the requested order and return the answer of each request in the resulting XML request. On Universe 10.2.11, the API runs anywhere from 10 to 50 requests in a batch like this taking no more than between 45 and 59 megs of ram on a HP-UX server. Starting with Universe 11.1.3, doing far fewer requests (ei from 5 to 9) the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. Somewhere it looks like Universe's XML generation routines are gobbling up memory and this memory is not getting freed. It seems that many memory leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a huge new one was introduced. I know of the memory used by the process because I have a job which produce the output of the top command once a minute, so the memory used by a process extracted from the output of the top command and logged. Has anyone else experienced anything like this ? Jacques G. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] uvcs Memory leak problems on 11.1.3
The xml files are processed with the XMAPReadNext command using a mapping file that is defined in XML. Basically the Batch API does: FOR X.JOB = 1 TO NB.JOB XML.PARAM = JOBX.JOB Parse XML.PARAM in a DYN.ARRAY (using map in XML) CALL @JOB.NAME(DYN.ARRAY,OUT.ARRAY) Build XML.OUT string from OUT.ARRAY Store XML.OUT in JOB.OUTX.JOB NEXT X.JOB Return JOB.OUT to the calling web service I will try upgrading the Uniobjects dll to see what it does. Thanks From: Symeon Breen syme...@gmail.com To: 'U2 Users List' u2-users@listserver.u2ug.org Sent: Monday, November 14, 2011 11:58 AM Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 Another thing to try is process the xml files outside of uniobjects but still in databasic and see how it goes. If it uses large amounts of memory then it is not a uniobjects issue . You could then try using those xml files from a *nix shell program like xmlwf / xml_pp or xsltproc. These use the standard xmllib library that uv may be using so if those give high memory usage it may not even be a uv issue but a *nix library issue. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of David Jordan Sent: 14 November 2011 10:23 To: U2 Users List Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 That triggered a memory. If you are using an older version of uniobjects in the .Net you can get memory issues when you upgrade the database. Have a look at upgrading the uniobject .Net to the lastest release. Regards David Jordan -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, 14 November 2011 8:27 PM To: 'U2 Users List' Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 On unidata I have had to process many an xml file outside of the DB as the memory just shoots right up If you are using uniobjects then I presume you have .net or java at the front end and it is likely that these environments are better suited to 'handling' the xml and simply passing data arrays to the universe layer to work on. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G. Sent: 11 November 2011 20:05 To: U2 Users List Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 Hello, In order to save connection time on Uniobjects API requests, I came up with an Api which could contain several XML requests into one, Process each one in the requested order and return the answer of each request in the resulting XML request. On Universe 10.2.11, the API runs anywhere from 10 to 50 requests in a batch like this taking no more than between 45 and 59 megs of ram on a HP-UX server. Starting with Universe 11.1.3, doing far fewer requests (ei from 5 to 9) the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. Somewhere it looks like Universe's XML generation routines are gobbling up memory and this memory is not getting freed. It seems that many memory leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a huge new one was introduced. I know of the memory used by the process because I have a job which produce the output of the top command once a minute, so the memory used by a process extracted from the output of the top command and logged. Has anyone else experienced anything like this ? Jacques G. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1411 / Virus Database: 2092/4015 - Release Date: 11/13/11 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] uvcs Memory leak problems on 11.1.3
On unidata I have had to process many an xml file outside of the DB as the memory just shoots right up If you are using uniobjects then I presume you have .net or java at the front end and it is likely that these environments are better suited to 'handling' the xml and simply passing data arrays to the universe layer to work on. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G. Sent: 11 November 2011 20:05 To: U2 Users List Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 Hello, In order to save connection time on Uniobjects API requests, I came up with an Api which could contain several XML requests into one, Process each one in the requested order and return the answer of each request in the resulting XML request. On Universe 10.2.11, the API runs anywhere from 10 to 50 requests in a batch like this taking no more than between 45 and 59 megs of ram on a HP-UX server. Starting with Universe 11.1.3, doing far fewer requests (ei from 5 to 9) the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. Somewhere it looks like Universe's XML generation routines are gobbling up memory and this memory is not getting freed. It seems that many memory leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a huge new one was introduced. I know of the memory used by the process because I have a job which produce the output of the top command once a minute, so the memory used by a process extracted from the output of the top command and logged. Has anyone else experienced anything like this ? Jacques G. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] uvcs Memory leak problems on 11.1.3
That triggered a memory. If you are using an older version of uniobjects in the .Net you can get memory issues when you upgrade the database. Have a look at upgrading the uniobject .Net to the lastest release. Regards David Jordan -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, 14 November 2011 8:27 PM To: 'U2 Users List' Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 On unidata I have had to process many an xml file outside of the DB as the memory just shoots right up If you are using uniobjects then I presume you have .net or java at the front end and it is likely that these environments are better suited to 'handling' the xml and simply passing data arrays to the universe layer to work on. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G. Sent: 11 November 2011 20:05 To: U2 Users List Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 Hello, In order to save connection time on Uniobjects API requests, I came up with an Api which could contain several XML requests into one, Process each one in the requested order and return the answer of each request in the resulting XML request. On Universe 10.2.11, the API runs anywhere from 10 to 50 requests in a batch like this taking no more than between 45 and 59 megs of ram on a HP-UX server. Starting with Universe 11.1.3, doing far fewer requests (ei from 5 to 9) the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. Somewhere it looks like Universe's XML generation routines are gobbling up memory and this memory is not getting freed. It seems that many memory leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a huge new one was introduced. I know of the memory used by the process because I have a job which produce the output of the top command once a minute, so the memory used by a process extracted from the output of the top command and logged. Has anyone else experienced anything like this ? Jacques G. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] uvcs Memory leak problems on 11.1.3
Another thing to try is process the xml files outside of uniobjects but still in databasic and see how it goes. If it uses large amounts of memory then it is not a uniobjects issue . You could then try using those xml files from a *nix shell program like xmlwf / xml_pp or xsltproc. These use the standard xmllib library that uv may be using so if those give high memory usage it may not even be a uv issue but a *nix library issue. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of David Jordan Sent: 14 November 2011 10:23 To: U2 Users List Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 That triggered a memory. If you are using an older version of uniobjects in the .Net you can get memory issues when you upgrade the database. Have a look at upgrading the uniobject .Net to the lastest release. Regards David Jordan -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, 14 November 2011 8:27 PM To: 'U2 Users List' Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 On unidata I have had to process many an xml file outside of the DB as the memory just shoots right up If you are using uniobjects then I presume you have .net or java at the front end and it is likely that these environments are better suited to 'handling' the xml and simply passing data arrays to the universe layer to work on. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jacques G. Sent: 11 November 2011 20:05 To: U2 Users List Subject: Re: [U2] [UV] uvcs Memory leak problems on 11.1.3 Hello, In order to save connection time on Uniobjects API requests, I came up with an Api which could contain several XML requests into one, Process each one in the requested order and return the answer of each request in the resulting XML request. On Universe 10.2.11, the API runs anywhere from 10 to 50 requests in a batch like this taking no more than between 45 and 59 megs of ram on a HP-UX server. Starting with Universe 11.1.3, doing far fewer requests (ei from 5 to 9) the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. Somewhere it looks like Universe's XML generation routines are gobbling up memory and this memory is not getting freed. It seems that many memory leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a huge new one was introduced. I know of the memory used by the process because I have a job which produce the output of the top command once a minute, so the memory used by a process extracted from the output of the top command and logged. Has anyone else experienced anything like this ? Jacques G. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1411 / Virus Database: 2092/4010 - Release Date: 11/11/11 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1411 / Virus Database: 2092/4015 - Release Date: 11/13/11 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] uvcs Memory leak problems on 11.1.3
Hello, In order to save connection time on Uniobjects API requests, I came up with an Api which could contain several XML requests into one, Process each one in the requested order and return the answer of each request in the resulting XML request. On Universe 10.2.11, the API runs anywhere from 10 to 50 requests in a batch like this taking no more than between 45 and 59 megs of ram on a HP-UX server. Starting with Universe 11.1.3, doing far fewer requests (ei from 5 to 9) the memory requirements go up as high as 100 to 122 megs of Ram on a HP-UX. Somewhere it looks like Universe's XML generation routines are gobbling up memory and this memory is not getting freed. It seems that many memory leaks were fixed from 10.2.1 to 11.1.3 according to the release notes but a huge new one was introduced. I know of the memory used by the process because I have a job which produce the output of the top command once a minute, so the memory used by a process extracted from the output of the top command and logged. Has anyone else experienced anything like this ? Jacques G. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users