Re: [U2] [UV] Large File Operations Kill Linux
Ext3 and 132Gb ram all sounds good RHEL 5 always uses kernel 2.6.18there may be patches available as Brian says so going through redhat support is the best bet, it is after all what you pay for, otherwise you would just have centos. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists Sent: 04 February 2013 21:15 To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux On 04/02/13 21:05, Dan Fitzgerald wrote: What's the value in /proc/sys/vm/swappiness? How will that make any difference? 2.6.18-348 SOUNDS like an ancient (in linux terms) kernel. Are you on RedHat support? This is a problem with the linux kernel that was addressed recently, iirc. Large amounts of io from a single process can swamp the queue, and the latest kernels have it fixed. If you've got RH support, see if you can find out if that's been backported into your kernel. Cheers, Wol From: perry.tay...@zirmed.com To: u2-users@listserver.u2ug.org Date: Mon, 4 Feb 2013 20:53:13 + Subject: Re: [U2] [UV] Large File Operations Kill Linux We're on RHEL5 (2.6.18-348.el5), ext3 and 132GB ram. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, February 04, 2013 9:23 AM To: 'U2 Users List' Subject: Re: [U2] [UV] Large File Operations Kill Linux A few questions - What linux version/distro are you on and what type of file system, and how much ram do you have -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Perry Taylor Sent: 04 February 2013 15:57 To: U2-Users List Subject: [U2] [UV] Large File Operations Kill Linux Looking for some ideas on how to keep Linux from becoming largely unresponsive when creating large files. What happens is as the new file is being created the I/O buffer cache quickly fills up with dirty buffers. Until the kernel can flush these out to disk there is no avail buffers for I/O operations from other processes. . The most troubling manifestation of this is the transaction logging check point daemon gets *way* behind putting us as risk if we were to have a failure of some kind. I have tried using ionice and renice to slow the file creation down as much as possible. This help a little but is still a big problem. Any ideas how to get CREATE.FILE/RESIZE to play nice on Linux? Thanks. Perry Perry Taylor Senior MV Architect ZirMed 888 West Market Street, Suite 400 Louisville, KY 40202 www.zirmed.comhttp://www.zirmed.com/ ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users - No virus found in this message. Checked by AVG - www.avg.com Version: 2012.0.2238 / Virus Database: 2639/5581 - Release Date: 02/04/13 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] Large File Operations Kill Linux
Yes, sounds like it's been identified and fixed a while ago... like Dan says...kernel update will the simple way to address it... (time outage permitting) https://bugzilla.redhat.com/show_bug.cgi?id=735946 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan Fitzgerald Sent: Tuesday, 5 February 2013 9:32 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux Other users could have been hanging at malloc. With a swappiness of 100 (on some kernels) or 100 (on others) or not 0 or 100(not sure which behavior you get on 2.6.18), pages wouldn't be getting freed up quickly enough duing the creation/copying of a large file. Another thing to look at (although I prefer the support route, since you have it), is /sys/kernel/mm/transparent_hugepage/defrag. Other people who have had this problem alleviated it by setting this to never. Of course, others fixed it by updating the kernel. My aged eyes read what you have as 2.6.8.1... ** IMPORTANT MESSAGE * This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au. If you no longer wish to receive commercial electronic messages from us, please reply to this e-mail by typing Unsubscribe in the subject line. ** ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
[U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter
Hello All, I am just wondering what U2 or UniVerse specific integrated testing suites people are using out there and ideally in use today. We have the need for a UV11.x specific or capable tool for automating our existing system/unit and regression test packages. We have a our existing test suites/scripts in HP QualityCenter (HPQC) and we currently manually capture and store the results (plus track 'defects') there as well. Ideally, this tool should be able to integrate with HPQC. At minimum some means to capture results - test case number plus success/failure to a file. Our primary application interface is via a terminal interface via SSH emulating VT220 terminals. But we also use various interfaces UV Clients APIs or third-party utilities (accessed via UNIX shell scripts or the like). Ideally, testing package should be able to drive (simulate keystrokes via keyboard entry) or invoke all of these in some fashion. Hence some sort of scripting of terminal emulator or UNIX shell and/or client APIs would be ideal. Another requirement is a tool that has the ability to perform simulated end-user terminal session load testing (ie., connect X number of users via terminal emulation over SSH and perhaps client APIs too) - we would could simulate actual users interactive access and run X, Y or Z test scripts. The primarily purpose of this is to simulate database record locking contention, etc. under load, etc. Plus other stress testing under load. Your solution could be a commerical product or a perhaps some in-house tool or opensource or combination thereof...whatever it is - I'd be interested to hear about this tool or your experience of attempting to do this. Thanks in advance for any feedback. Cheers, David ** IMPORTANT MESSAGE * This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au. If you no longer wish to receive commercial electronic messages from us, please reply to this e-mail by typing Unsubscribe in the subject line. ** ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter
Hi David I've recently released a testing product called (predictably!) mvTest. This supports automated testing of U2 applications using a dedicated scripting language modelled after UniBasic for familiarity but with a number of key extensions to handle data validation, test data handling, UI scripting and assertions. You can use this to create unit tests, UI tests (currently TELNET and U2-compatible secure TELNET/SSL but with SSH to follow shortly), regression and volume tests. Here's a quick overview of how it works - - You create unit or UI tests using the scripting language. These can be run through either of a Windows client or through a server-side script runner e.g. if you want to perform CI testing through a phantom. There's a nice Windows based editor to create, organize and test these. - The tests return pass or fail information based on assertions, so you can see at a glance if anything has broken. You can save the information and run various reports against it. - The tests can run direct against the database through a UO.NET connection (e.g. for testing subroutine calls and parameters) or through a terminal-style UI. It embeds a complete terminal emulator with all the necessary functions, and this allows you to drive screens, perform spot checks, branch on different results (e.g. handling error messages raised from your screens), handle send/expect style scripting and more complex conditions (such as wait until the cursor is at this location and this message has appeared here). - It keeps a separate shared server connection open while the UI tests run so you can, for example, script an entry screen via the terminal UI that ends up saving some data like a sales order, and then immediately check what has been written to the database through the underlying connection as part of the same script. - Unit tests can be organized into batches in which the tests run in order, so you can set up sequences that match business operations. - Batches can be organized into runs, so you can test whole suites of your application. Each run can be customized, so you can feed in per-site or per-system information. Runs can optionally randomize the order in which batches are executed, and you can set up different run scenarios and iteration patterns. - You can feed in and randomize test data and from the client side runner, access local features as well as the database operations. - Volume testing can take place using the Windows client. This is a multithreaded client supporting multiple concurrent UI sessions - I've tested up to 250 concurrent connections from a single PC running against an SB+ system for one customer last year who needed to stress test their system performance coming up to the New Year sales. This first release is targeting U2 with other MVDBMS to follow. I'm also adding support for GUI testing using the Microsoft Automation APIs and WebUI testing going forward. Anyone interested can contact me for an evaluation version, or download the user guide from www.brianleach.co.uk. Regards Brian ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] U2 Test Tools for system/unit regression testing
Oh and - If anyone here is subscribed to International Spectrum magazine (and if not, why not?) I'm writing a series on automated testing with the first instalment to appear in the March/April edition. So I'd be interested to hear any user stories ... Brian -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Brian Leach Sent: 05 February 2013 11:14 To: 'U2 Users List' Subject: Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter Hi David I've recently released a testing product called (predictably!) mvTest. This supports automated testing of U2 applications using a dedicated scripting language modelled after UniBasic for familiarity but with a number of key extensions to handle data validation, test data handling, UI scripting and assertions. You can use this to create unit tests, UI tests (currently TELNET and U2-compatible secure TELNET/SSL but with SSH to follow shortly), regression and volume tests. Here's a quick overview of how it works - - You create unit or UI tests using the scripting language. These can be run through either of a Windows client or through a server-side script runner e.g. if you want to perform CI testing through a phantom. There's a nice Windows based editor to create, organize and test these. - The tests return pass or fail information based on assertions, so you can see at a glance if anything has broken. You can save the information and run various reports against it. - The tests can run direct against the database through a UO.NET connection (e.g. for testing subroutine calls and parameters) or through a terminal-style UI. It embeds a complete terminal emulator with all the necessary functions, and this allows you to drive screens, perform spot checks, branch on different results (e.g. handling error messages raised from your screens), handle send/expect style scripting and more complex conditions (such as wait until the cursor is at this location and this message has appeared here). - It keeps a separate shared server connection open while the UI tests run so you can, for example, script an entry screen via the terminal UI that ends up saving some data like a sales order, and then immediately check what has been written to the database through the underlying connection as part of the same script. - Unit tests can be organized into batches in which the tests run in order, so you can set up sequences that match business operations. - Batches can be organized into runs, so you can test whole suites of your application. Each run can be customized, so you can feed in per-site or per-system information. Runs can optionally randomize the order in which batches are executed, and you can set up different run scenarios and iteration patterns. - You can feed in and randomize test data and from the client side runner, access local features as well as the database operations. - Volume testing can take place using the Windows client. This is a multithreaded client supporting multiple concurrent UI sessions - I've tested up to 250 concurrent connections from a single PC running against an SB+ system for one customer last year who needed to stress test their system performance coming up to the New Year sales. This first release is targeting U2 with other MVDBMS to follow. I'm also adding support for GUI testing using the Microsoft Automation APIs and WebUI testing going forward. Anyone interested can contact me for an evaluation version, or download the user guide from www.brianleach.co.uk. Regards Brian ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
[U2] UV: Generating XML from Retrieve
Hi Everyone, Hoping someone can help me here or at least point me in the right direction please. I am trying to generate xml output via a retrieve sentence so that a single valued field is either a) the parent to 3 multi-valued fields, or b) nested correctly within a parent element along with multi-valued fields. The sentence is using the TOXML and ELEMENTS keywords. According to the retrieve manual due to the inclusion of the ELEMENTS keyword the output is element-centric. I think what I need to do is specify attribute-centric output for just the few dictionary items listed below. According to the manual this is called Mixed Mode. Can this be done in a mapping file? Also can I use a file other than XML to store a custom mapping file? If so how do I do this? (Why? Because some genius designed our app to use the XML file for other data as well and as a consequence it gets cleared out regularly.) Will a mapping file allow me to customise how the dictionary items are output and can this output be nested as desired below? I've already made an association called PENDING_AUTHS for the three MV'd fields AUTH_NUMBER, AUTH_DATE, AUTH_AMOUNT and these are all converted but in the element centric mode thus: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE AUTH_TOTAL99.00/AUTH_TOTAL PENDING_AUTHS_MV AUTH_NUMBER123456/AUTH_NUMBER AUTH_DATE22/01/13/AUTH_DATE AUTH_AMOUNT40.00/AUTH_AMOUNT /PENDING_AUTHS_MV PENDING_AUTHS_MV AUTH_NUMBER654321/AUTH_NUMBER AUTH_DATE23/01/13/AUTH_DATE AUTH_AMOUNT59.00/AUTH_AMOUNT /PENDING_AUTHS_MV If I change the dictionary item AUTH_TOTAL from S to M and add it to the association then I get that repeated within the PENDING_AUTHS node, the first one has the data and the remainder are empty like this: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE PENDING_AUTHS_MV AUTH_TOTAL99.00/AUTH_TOTAL AUTH_NUMBER123456/AUTH_NUMBER AUTH_DATE22/01/13/AUTH_DATE AUTH_AMOUNT40.00/AUTH_AMOUNT /PENDING_AUTHS_MV PENDING_AUTHS_MV AUTH_TOTAL/ AUTH_NUMBER654321/AUTH_NUMBER AUTH_DATE23/01/13/AUTH_DATE AUTH_AMOUNT59.00/AUTH_AMOUNT /PENDING_AUTHS_MV So I tried to wrap this a basic subroutine but I couldn't get that to work either since I couldn't work out the correct syntax of the array to return. Is there a place that documents this? Everything I tried just mangled the data. Ideally what I'd like to get is something like this: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE AUTHS TOTAL=99.00 AUTH NUMBER=123456 DATE=22/01/13 AMOUNT=40.00/AUTH AUTH_NUMBER=654321 DATE=23/01/13 AMOUNT=59.00/AUTH /AUTHS or even this would do: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE PENDING_AUTHS_MV TOTAL99.00/TOTAL AUTH AUTH_NUMBER123456/AUTH_NUMBER AUTH_DATE22/01/13/AUTH_DATE AUTH_AMOUNT40.00/AUTH_AMOUNT /AUTH AUTH AUTH_NUMBER654321/AUTH_NUMBER AUTH_DATE23/01/13/AUTH_DATE AUTH_AMOUNT59.00/AUTH_AMOUNT /AUTH /PENDING_AUTHS_MV Not really fussy about the element names. Just wondering if I can achieve the correct element structure/nesting if I employ a mapping to create a mixed mode xml document? Any tips for where to start with the mapping? Do I need to specify all map elements or can I leave out unwanted ones to their system defaults? Will this map affect all xml output in the same file or just those dictionary items specifically in the map? Many thanks in advance, Cheers Peter Dictionary items PENDING_AUTHS 2 lines long. : P 0001: PH 0002: AUTH_NUMBER AUTH_DATE AUTH_AMOUNT Bottom at line 2. : EX AUTH_TOTAL SELECTed record name = AUTH_TOTAL. This is a Type I Descriptor last compiled on 05/02/13 at 09:49. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,10,X)),1,1,1) 0003: MD2 0004: Total▒Auths. 0005: 15R 0006: S 0007: : EX AUTH_NUMBER SELECTed record name = AUTH_NUMBER. This is a Type I Descriptor last compiled on 05/02/13 at 10:24. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,11,X)),1,0,0) 0003: 0004: Auth.▒Number 0005: 10R 0006: M 0007: PENDING_AUTHS : EX AUTH_DATE SELECTed record name = AUTH_DATE. This is a Type I Descriptor last compiled on 05/02/13 at 10:24. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,12,X)),1,0,0) 0003: D2/ 0004: Auth.▒Date 0005: 8R 0006: M 0007: PENDING_AUTHS : EX AUTH_AMOUNT SELECTed record name = AUTH_AMOUNT. This is a Type I Descriptor last compiled on 05/02/13 at 10:24. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,13,X)),1,0,0) 0003: MD2 0004: Auth.▒Amount 0005: 12R 0006: M 0007: PENDING_AUTHS : EX --- Note: This
Re: [U2] U2 Test Tools for system/unit regression testing
Come to think of it - I used to get IS, but haven't received one in a long time. I wonder if my subscription got lost. Charlie On 02-05-2013 5:33 AM, Brian Leach wrote: Oh and - If anyone here is subscribed to International Spectrum magazine (and if not, why not?) I'm writing a series on automated testing with the first instalment to appear in the March/April edition. So I'd be interested to hear any user stories ... Brian -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Brian Leach Sent: 05 February 2013 11:14 To: 'U2 Users List' Subject: Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter Hi David I've recently released a testing product called (predictably!) mvTest. This supports automated testing of U2 applications using a dedicated scripting language modelled after UniBasic for familiarity but with a number of key extensions to handle data validation, test data handling, UI scripting and assertions. You can use this to create unit tests, UI tests (currently TELNET and U2-compatible secure TELNET/SSL but with SSH to follow shortly), regression and volume tests. Here's a quick overview of how it works - - You create unit or UI tests using the scripting language. These can be run through either of a Windows client or through a server-side script runner e.g. if you want to perform CI testing through a phantom. There's a nice Windows based editor to create, organize and test these. - The tests return pass or fail information based on assertions, so you can see at a glance if anything has broken. You can save the information and run various reports against it. - The tests can run direct against the database through a UO.NET connection (e.g. for testing subroutine calls and parameters) or through a terminal-style UI. It embeds a complete terminal emulator with all the necessary functions, and this allows you to drive screens, perform spot checks, branch on different results (e.g. handling error messages raised from your screens), handle send/expect style scripting and more complex conditions (such as wait until the cursor is at this location and this message has appeared here). - It keeps a separate shared server connection open while the UI tests run so you can, for example, script an entry screen via the terminal UI that ends up saving some data like a sales order, and then immediately check what has been written to the database through the underlying connection as part of the same script. - Unit tests can be organized into batches in which the tests run in order, so you can set up sequences that match business operations. - Batches can be organized into runs, so you can test whole suites of your application. Each run can be customized, so you can feed in per-site or per-system information. Runs can optionally randomize the order in which batches are executed, and you can set up different run scenarios and iteration patterns. - You can feed in and randomize test data and from the client side runner, access local features as well as the database operations. - Volume testing can take place using the Windows client. This is a multithreaded client supporting multiple concurrent UI sessions - I've tested up to 250 concurrent connections from a single PC running against an SB+ system for one customer last year who needed to stress test their system performance coming up to the New Year sales. This first release is targeting U2 with other MVDBMS to follow. I'm also adding support for GUI testing using the Microsoft Automation APIs and WebUI testing going forward. Anyone interested can contact me for an evaluation version, or download the user guide from www.brianleach.co.uk. Regards Brian ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter
Great start - Can I be really demanding and ask for SBXA (XUI) support as well? ;) Cameron -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Brian Leach Sent: Tuesday, 5 February 2013 22:14 To: 'U2 Users List' Subject: Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter Hi David I've recently released a testing product called (predictably!) mvTest. This supports automated testing of U2 applications using a dedicated scripting language modelled after UniBasic for familiarity but with a number of key extensions to handle data validation, test data handling, UI scripting and assertions. You can use this to create unit tests, UI tests (currently TELNET and U2-compatible secure TELNET/SSL but with SSH to follow shortly), regression and volume tests. Here's a quick overview of how it works - - You create unit or UI tests using the scripting language. These can be run through either of a Windows client or through a server-side script runner e.g. if you want to perform CI testing through a phantom. There's a nice Windows based editor to create, organize and test these. - The tests return pass or fail information based on assertions, so you can see at a glance if anything has broken. You can save the information and run various reports against it. - The tests can run direct against the database through a UO.NET connection (e.g. for testing subroutine calls and parameters) or through a terminal-style UI. It embeds a complete terminal emulator with all the necessary functions, and this allows you to drive screens, perform spot checks, branch on different results (e.g. handling error messages raised from your screens), handle send/expect style scripting and more complex conditions (such as wait until the cursor is at this location and this message has appeared here). - It keeps a separate shared server connection open while the UI tests run so you can, for example, script an entry screen via the terminal UI that ends up saving some data like a sales order, and then immediately check what has been written to the database through the underlying connection as part of the same script. - Unit tests can be organized into batches in which the tests run in order, so you can set up sequences that match business operations. - Batches can be organized into runs, so you can test whole suites of your application. Each run can be customized, so you can feed in per-site or per-system information. Runs can optionally randomize the order in which batches are executed, and you can set up different run scenarios and iteration patterns. - You can feed in and randomize test data and from the client side runner, access local features as well as the database operations. - Volume testing can take place using the Windows client. This is a multithreaded client supporting multiple concurrent UI sessions - I've tested up to 250 concurrent connections from a single PC running against an SB+ system for one customer last year who needed to stress test their SB+ system performance coming up to the New Year sales. This first release is targeting U2 with other MVDBMS to follow. I'm also adding support for GUI testing using the Microsoft Automation APIs and WebUI testing going forward. Anyone interested can contact me for an evaluation version, or download the user guide from www.brianleach.co.uk. Regards Brian ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users __ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com __ ** This email and any attachments may be confidential and legally privileged. Please notify the sender immediately if you received this message in error. Please do not delete or alter this notice. ** ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter
Hi Cameron IIRC SB/XA is WPF (XBAP) based - or am I misremembering? If it is, the GUI testing I'm adding should handle that - it's designed to cope with native Win32, .NET WinForm and WPF. In fact, WPF is probably the neatest as it was built with specific support for the automation UI (which in turn in built on top of the accessibility UIs). It's just that the automation UI is a complete and utter bear to program and really, really ugly... which is why I'm trying to encapsulate it in something more usable. Brian -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Brawn, Cameron Sent: 05 February 2013 13:05 To: U2 Users List Subject: Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter Great start - Can I be really demanding and ask for SBXA (XUI) support as well? ;) Cameron -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Brian Leach Sent: Tuesday, 5 February 2013 22:14 To: 'U2 Users List' Subject: Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter Hi David I've recently released a testing product called (predictably!) mvTest. This supports automated testing of U2 applications using a dedicated scripting language modelled after UniBasic for familiarity but with a number of key extensions to handle data validation, test data handling, UI scripting and assertions. You can use this to create unit tests, UI tests (currently TELNET and U2-compatible secure TELNET/SSL but with SSH to follow shortly), regression and volume tests. Here's a quick overview of how it works - - You create unit or UI tests using the scripting language. These can be run through either of a Windows client or through a server-side script runner e.g. if you want to perform CI testing through a phantom. There's a nice Windows based editor to create, organize and test these. - The tests return pass or fail information based on assertions, so you can see at a glance if anything has broken. You can save the information and run various reports against it. - The tests can run direct against the database through a UO.NET connection (e.g. for testing subroutine calls and parameters) or through a terminal-style UI. It embeds a complete terminal emulator with all the necessary functions, and this allows you to drive screens, perform spot checks, branch on different results (e.g. handling error messages raised from your screens), handle send/expect style scripting and more complex conditions (such as wait until the cursor is at this location and this message has appeared here). - It keeps a separate shared server connection open while the UI tests run so you can, for example, script an entry screen via the terminal UI that ends up saving some data like a sales order, and then immediately check what has been written to the database through the underlying connection as part of the same script. - Unit tests can be organized into batches in which the tests run in order, so you can set up sequences that match business operations. - Batches can be organized into runs, so you can test whole suites of your application. Each run can be customized, so you can feed in per-site or per-system information. Runs can optionally randomize the order in which batches are executed, and you can set up different run scenarios and iteration patterns. - You can feed in and randomize test data and from the client side runner, access local features as well as the database operations. - Volume testing can take place using the Windows client. This is a multithreaded client supporting multiple concurrent UI sessions - I've tested up to 250 concurrent connections from a single PC running against an SB+ system for one customer last year who needed to stress test their SB+ system performance coming up to the New Year sales. This first release is targeting U2 with other MVDBMS to follow. I'm also adding support for GUI testing using the Microsoft Automation APIs and WebUI testing going forward. Anyone interested can contact me for an evaluation version, or download the user guide from www.brianleach.co.uk. Regards Brian ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users __ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com __ ** This email and any attachments may be confidential and legally privileged. Please notify the sender immediately if you received this message in error. Please do not delete or
[U2] International Date Format
Is there a date conversion mask that returns -mm-dd format? Charles Shaffer Senior Analyst NTN-Bower Corporation ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] International Date Format
You could try D-YMD[4,2,2] Wyatt Buffington AMPS Support Manitoba Hydro 204- 360-4473 I wish i would have an out of body experience then i wouldn't be here. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of charles_shaf...@ntn-bower.com Sent: Tuesday, February 05, 2013 8:20 AM To: U2 Users List Subject: [U2] International Date Format Is there a date conversion mask that returns -mm-dd format? Charles Shaffer Senior Analyst NTN-Bower Corporation ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] International Date Format
I just use DYMD- , not saying below in incorrect; although it probably is more specific. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Buffington, Wyatt Sent: Tuesday, February 05, 2013 9:22 AM To: 'U2 Users List' Subject: Re: [U2] International Date Format You could try D-YMD[4,2,2] Wyatt Buffington AMPS Support Manitoba Hydro 204- 360-4473 I wish i would have an out of body experience then i wouldn't be here. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of charles_shaf...@ntn-bower.com Sent: Tuesday, February 05, 2013 8:20 AM To: U2 Users List Subject: [U2] International Date Format Is there a date conversion mask that returns -mm-dd format? Charles Shaffer Senior Analyst NTN-Bower Corporation ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] International Date Format
Wyatt, Worked perfectly. Thank you. Charles Shaffer Senior Analyst NTN-Bower Corporation From: Buffington, Wyatt wgbuffing...@hydro.mb.ca To: 'U2 Users List' u2-users@listserver.u2ug.org, Date: 02/05/2013 08:22 AM Subject:Re: [U2] International Date Format Sent by:u2-users-boun...@listserver.u2ug.org You could try D-YMD[4,2,2] Wyatt Buffington AMPS Support Manitoba Hydro 204- 360-4473 I wish i would have an out of body experience then i wouldn't be here. -Original Message- From: u2-users-boun...@listserver.u2ug.org [ mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of charles_shaf...@ntn-bower.com Sent: Tuesday, February 05, 2013 8:20 AM To: U2 Users List Subject: [U2] International Date Format Is there a date conversion mask that returns -mm-dd format? Charles Shaffer Senior Analyst NTN-Bower Corporation ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV: Generating XML from Retrieve
You might take a look at Cedarrville's DOWNLOAD utility ftp://ftp.cedarville.edu/download/download.pdf Peter Cheney wrote: Hi Everyone, Hoping someone can help me here or at least point me in the right direction please. I am trying to generate xml output via a retrieve sentence so that a single valued field is either a) the parent to 3 multi-valued fields, or b) nested correctly within a parent element along with multi-valued fields. The sentence is using the TOXML and ELEMENTS keywords. According to the retrieve manual due to the inclusion of the ELEMENTS keyword the output is element-centric. I think what I need to do is specify attribute-centric output for just the few dictionary items listed below. According to the manual this is called Mixed Mode. Can this be done in a mapping file? Also can I use a file other than XML to store a custom mapping file? If so how do I do this? (Why? Because some genius designed our app to use the XML file for other data as well and as a consequence it gets cleared out regularly.) Will a mapping file allow me to customise how the dictionary items are output and can this output be nested as desired below? I've already made an association called PENDING_AUTHS for the three MV'd fields AUTH_NUMBER, AUTH_DATE, AUTH_AMOUNT and these are all converted but in the element centric mode thus: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE AUTH_TOTAL99.00/AUTH_TOTAL PENDING_AUTHS_MV AUTH_NUMBER123456/AUTH_NUMBER AUTH_DATE22/01/13/AUTH_DATE AUTH_AMOUNT40.00/AUTH_AMOUNT /PENDING_AUTHS_MV PENDING_AUTHS_MV AUTH_NUMBER654321/AUTH_NUMBER AUTH_DATE23/01/13/AUTH_DATE AUTH_AMOUNT59.00/AUTH_AMOUNT /PENDING_AUTHS_MV If I change the dictionary item AUTH_TOTAL from S to M and add it to the association then I get that repeated within the PENDING_AUTHS node, the first one has the data and the remainder are empty like this: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE PENDING_AUTHS_MV AUTH_TOTAL99.00/AUTH_TOTAL AUTH_NUMBER123456/AUTH_NUMBER AUTH_DATE22/01/13/AUTH_DATE AUTH_AMOUNT40.00/AUTH_AMOUNT /PENDING_AUTHS_MV PENDING_AUTHS_MV AUTH_TOTAL/ AUTH_NUMBER654321/AUTH_NUMBER AUTH_DATE23/01/13/AUTH_DATE AUTH_AMOUNT59.00/AUTH_AMOUNT /PENDING_AUTHS_MV So I tried to wrap this a basic subroutine but I couldn't get that to work either since I couldn't work out the correct syntax of the array to return. Is there a place that documents this? Everything I tried just mangled the data. Ideally what I'd like to get is something like this: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE AUTHS TOTAL=99.00 AUTH NUMBER=123456 DATE=22/01/13 AMOUNT=40.00/AUTH AUTH_NUMBER=654321 DATE=23/01/13 AMOUNT=59.00/AUTH /AUTHS or even this would do: FILENAME2 _ID9/_ID REPAY_AMOUNT538.99/REPAY_AMOUNT NEXT_DUE02 SEP 2012/NEXT_DUE PENDING_AUTHS_MV TOTAL99.00/TOTAL AUTH AUTH_NUMBER123456/AUTH_NUMBER AUTH_DATE22/01/13/AUTH_DATE AUTH_AMOUNT40.00/AUTH_AMOUNT /AUTH AUTH AUTH_NUMBER654321/AUTH_NUMBER AUTH_DATE23/01/13/AUTH_DATE AUTH_AMOUNT59.00/AUTH_AMOUNT /AUTH /PENDING_AUTHS_MV Not really fussy about the element names. Just wondering if I can achieve the correct element structure/nesting if I employ a mapping to create a mixed mode xml document? Any tips for where to start with the mapping? Do I need to specify all map elements or can I leave out unwanted ones to their system defaults? Will this map affect all xml output in the same file or just those dictionary items specifically in the map? Many thanks in advance, Cheers Peter Dictionary items PENDING_AUTHS 2 lines long. : P 0001: PH 0002: AUTH_NUMBER AUTH_DATE AUTH_AMOUNT Bottom at line 2. : EX AUTH_TOTAL SELECTed record name = AUTH_TOTAL. This is a Type I Descriptor last compiled on 05/02/13 at 09:49. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,10,X)),1,1,1) 0003: MD2 0004: Total▒Auths. 0005: 15R 0006: S 0007: : EX AUTH_NUMBER SELECTed record name = AUTH_NUMBER. This is a Type I Descriptor last compiled on 05/02/13 at 10:24. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,11,X)),1,0,0) 0003: 0004: Auth.▒Number 0005: 10R 0006: M 0007: PENDING_AUTHS : EX AUTH_DATE SELECTed record name = AUTH_DATE. This is a Type I Descriptor last compiled on 05/02/13 at 10:24. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,12,X)),1,0,0) 0003: D2/ 0004: Auth.▒Date 0005: 8R 0006: M 0007: PENDING_AUTHS : EX AUTH_AMOUNT SELECTed record name = AUTH_AMOUNT. This is a Type I Descriptor last compiled on 05/02/13 at 10:24. 20 lines long. : L7 0001: I 0002: EXTRACT(RAISE(TRANS(FILENAME1,ACCOUNT,13,X)),1,0,0) 0003: MD2 0004: Auth.▒Amount 0005: 12R 0006: M
Re: [U2] U2 Test Tools for system/unit regression testing
Brian, Oh my goodness that is great news! I can't wait! I'll take an early release of that - and of course I will want to talk to you about integrating it into PRC's test framework! Can't wait to see it! Susan Joslyn Message: 11 Date: Tue, 5 Feb 2013 11:13:31 - From: Brian Leach br...@brianleach.co.uk To: 'U2 Users List' u2-users@listserver.u2ug.org Subject: Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter Message-ID: 003d01ce0391$d5284350$7f78c9f0$@co.uk Content-Type: text/plain; charset=us-ascii Hi David I've recently released a testing product called (predictably!) mvTest. This supports automated testing of U2 applications using a dedicated scripting language modelled after UniBasic for familiarity but with a number of key extensions to handle data validation, test data handling, UI scripting and assertions. You can use this to create unit tests, UI tests (currently TELNET and U2-compatible secure TELNET/SSL but with SSH to follow shortly), regression and volume tests. Here's a quick overview of how it works - - You create unit or UI tests using the scripting language. These can be run through either of a Windows client or through a server-side script runner e.g. if you want to perform CI testing through a phantom. There's a nice Windows based editor to create, organize and test these. - The tests return pass or fail information based on assertions, so you can see at a glance if anything has broken. You can save the information and run various reports against it. - The tests can run direct against the database through a UO.NET connection (e.g. for testing subroutine calls and parameters) or through a terminal-style UI. It embeds a complete terminal emulator with all the necessary functions, and this allows you to drive screens, perform spot checks, branch on different results (e.g. handling error messages raised from your screens), handle send/expect style scripting and more complex conditions (such as wait until the cursor is at this location and this message has appeared here). - It keeps a separate shared server connection open while the UI tests run so you can, for example, script an entry screen via the terminal UI that ends up saving some data like a sales order, and then immediately check what has been written to the database through the underlying connection as part of the same script. - Unit tests can be organized into batches in which the tests run in order, so you can set up sequences that match business operations. - Batches can be organized into runs, so you can test whole suites of your application. Each run can be customized, so you can feed in per-site or per-system information. Runs can optionally randomize the order in which batches are executed, and you can set up different run scenarios and iteration patterns. - You can feed in and randomize test data and from the client side runner, access local features as well as the database operations. - Volume testing can take place using the Windows client. This is a multithreaded client supporting multiple concurrent UI sessions - I've tested up to 250 concurrent connections from a single PC running against an SB+ system for one customer last year who needed to stress test their system performance coming up to the New Year sales. This first release is targeting U2 with other MVDBMS to follow. I'm also adding support for GUI testing using the Microsoft Automation APIs and WebUI testing going forward. Anyone interested can contact me for an evaluation version, or download the user guide from www.brianleach.co.uk. Regards Brian ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] U2 Test Tools for system/unit regression testing
Susan I would be honoured (honored) ! I'll contact you off list to get that sorted. Brian Sent from my iPad On 5 Feb 2013, at 20:13, Susan Joslyn sjos...@sjplus.com wrote: Brian, Oh my goodness that is great news! I can't wait! I'll take an early release of that - and of course I will want to talk to you about integrating it into PRC's test framework! Can't wait to see it! Susan Joslyn Message: 11 Date: Tue, 5 Feb 2013 11:13:31 - From: Brian Leach br...@brianleach.co.uk To: 'U2 Users List' u2-users@listserver.u2ug.org Subject: Re: [U2] U2 Test Tools for system/unit regression testing w/integration with HP QualityCenter Message-ID: 003d01ce0391$d5284350$7f78c9f0$@co.uk Content-Type: text/plain;charset=us-ascii Hi David I've recently released a testing product called (predictably!) mvTest. This supports automated testing of U2 applications using a dedicated scripting language modelled after UniBasic for familiarity but with a number of key extensions to handle data validation, test data handling, UI scripting and assertions. You can use this to create unit tests, UI tests (currently TELNET and U2-compatible secure TELNET/SSL but with SSH to follow shortly), regression and volume tests. Here's a quick overview of how it works - - You create unit or UI tests using the scripting language. These can be run through either of a Windows client or through a server-side script runner e.g. if you want to perform CI testing through a phantom. There's a nice Windows based editor to create, organize and test these. - The tests return pass or fail information based on assertions, so you can see at a glance if anything has broken. You can save the information and run various reports against it. - The tests can run direct against the database through a UO.NET connection (e.g. for testing subroutine calls and parameters) or through a terminal-style UI. It embeds a complete terminal emulator with all the necessary functions, and this allows you to drive screens, perform spot checks, branch on different results (e.g. handling error messages raised from your screens), handle send/expect style scripting and more complex conditions (such as wait until the cursor is at this location and this message has appeared here). - It keeps a separate shared server connection open while the UI tests run so you can, for example, script an entry screen via the terminal UI that ends up saving some data like a sales order, and then immediately check what has been written to the database through the underlying connection as part of the same script. - Unit tests can be organized into batches in which the tests run in order, so you can set up sequences that match business operations. - Batches can be organized into runs, so you can test whole suites of your application. Each run can be customized, so you can feed in per-site or per-system information. Runs can optionally randomize the order in which batches are executed, and you can set up different run scenarios and iteration patterns. - You can feed in and randomize test data and from the client side runner, access local features as well as the database operations. - Volume testing can take place using the Windows client. This is a multithreaded client supporting multiple concurrent UI sessions - I've tested up to 250 concurrent connections from a single PC running against an SB+ system for one customer last year who needed to stress test their system performance coming up to the New Year sales. This first release is targeting U2 with other MVDBMS to follow. I'm also adding support for GUI testing using the Microsoft Automation APIs and WebUI testing going forward. Anyone interested can contact me for an evaluation version, or download the user guide from www.brianleach.co.uk. Regards Brian ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] Large File Operations Kill Linux
I have engaged Redhat Support and it has already been escalated to their Kernel team so at least it seems I have their attention :). I'll provide updates as they become available. Perry -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan Fitzgerald Sent: Monday, February 04, 2013 3:32 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux Other users could have been hanging at malloc. With a swappiness of 100 (on some kernels) or 100 (on others) or not 0 or 100(not sure which behavior you get on 2.6.18), pages wouldn't be getting freed up quickly enough duing the creation/copying of a large file. Another thing to look at (although I prefer the support route, since you have it), is /sys/kernel/mm/transparent_hugepage/defrag. Other people who have had this problem alleviated it by setting this to never. Of course, others fixed it by updating the kernel. My aged eyes read what you have as 2.6.8.1... Date: Mon, 4 Feb 2013 21:15:25 + From: antli...@youngman.org.uk To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux On 04/02/13 21:05, Dan Fitzgerald wrote: What's the value in /proc/sys/vm/swappiness? How will that make any difference? 2.6.18-348 SOUNDS like an ancient (in linux terms) kernel. Are you on RedHat support? This is a problem with the linux kernel that was addressed recently, iirc. Large amounts of io from a single process can swamp the queue, and the latest kernels have it fixed. If you've got RH support, see if you can find out if that's been backported into your kernel. Cheers, Wol From: perry.tay...@zirmed.com To: u2-users@listserver.u2ug.org Date: Mon, 4 Feb 2013 20:53:13 + Subject: Re: [U2] [UV] Large File Operations Kill Linux We're on RHEL5 (2.6.18-348.el5), ext3 and 132GB ram. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, February 04, 2013 9:23 AM To: 'U2 Users List' Subject: Re: [U2] [UV] Large File Operations Kill Linux A few questions - What linux version/distro are you on and what type of file system, and how much ram do you have -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Perry Taylor Sent: 04 February 2013 15:57 To: U2-Users List Subject: [U2] [UV] Large File Operations Kill Linux Looking for some ideas on how to keep Linux from becoming largely unresponsive when creating large files. What happens is as the new file is being created the I/O buffer cache quickly fills up with dirty buffers. Until the kernel can flush these out to disk there is no avail buffers for I/O operations from other processes. . The most troubling manifestation of this is the transaction logging check point daemon gets *way* behind putting us as risk if we were to have a failure of some kind. I have tried using ionice and renice to slow the file creation down as much as possible. This help a little but is still a big problem. Any ideas how to get CREATE.FILE/RESIZE to play nice on Linux? Thanks. Perry Perry Taylor Senior MV Architect ZirMed 888 West Market Street, Suite 400 Louisville, KY 40202 www.zirmed.comhttp://www.zirmed.com/ ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. ZirMed, Inc. has strict policies regarding the content of e-mail communications, specifically Protected Health Information, any communications containing such material will be returned to the originating party with such advisement noted. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] Large File Operations Kill Linux
Perry I'm curious how large large is for you? Jeff Butera -- A tree falls the way it leans. Be careful which way you lean. The Lorax On Feb 5, 2013, at 5:45 PM, Perry Taylor perry.tay...@zirmed.com wrote: I have engaged Redhat Support and it has already been escalated to their Kernel team so at least it seems I have their attention :). I'll provide updates as they become available. Perry -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan Fitzgerald Sent: Monday, February 04, 2013 3:32 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux Other users could have been hanging at malloc. With a swappiness of 100 (on some kernels) or 100 (on others) or not 0 or 100(not sure which behavior you get on 2.6.18), pages wouldn't be getting freed up quickly enough duing the creation/copying of a large file. Another thing to look at (although I prefer the support route, since you have it), is /sys/kernel/mm/transparent_hugepage/defrag. Other people who have had this problem alleviated it by setting this to never. Of course, others fixed it by updating the kernel. My aged eyes read what you have as 2.6.8.1... Date: Mon, 4 Feb 2013 21:15:25 + From: antli...@youngman.org.uk To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux On 04/02/13 21:05, Dan Fitzgerald wrote: What's the value in /proc/sys/vm/swappiness? How will that make any difference? 2.6.18-348 SOUNDS like an ancient (in linux terms) kernel. Are you on RedHat support? This is a problem with the linux kernel that was addressed recently, iirc. Large amounts of io from a single process can swamp the queue, and the latest kernels have it fixed. If you've got RH support, see if you can find out if that's been backported into your kernel. Cheers, Wol From: perry.tay...@zirmed.com To: u2-users@listserver.u2ug.org Date: Mon, 4 Feb 2013 20:53:13 + Subject: Re: [U2] [UV] Large File Operations Kill Linux We're on RHEL5 (2.6.18-348.el5), ext3 and 132GB ram. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, February 04, 2013 9:23 AM To: 'U2 Users List' Subject: Re: [U2] [UV] Large File Operations Kill Linux A few questions - What linux version/distro are you on and what type of file system, and how much ram do you have -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Perry Taylor Sent: 04 February 2013 15:57 To: U2-Users List Subject: [U2] [UV] Large File Operations Kill Linux Looking for some ideas on how to keep Linux from becoming largely unresponsive when creating large files. What happens is as the new file is being created the I/O buffer cache quickly fills up with dirty buffers. Until the kernel can flush these out to disk there is no avail buffers for I/O operations from other processes. . The most troubling manifestation of this is the transaction logging check point daemon gets *way* behind putting us as risk if we were to have a failure of some kind. I have tried using ionice and renice to slow the file creation down as much as possible. This help a little but is still a big problem. Any ideas how to get CREATE.FILE/RESIZE to play nice on Linux? Thanks. Perry Perry Taylor Senior MV Architect ZirMed 888 West Market Street, Suite 400 Louisville, KY 40202 www.zirmed.comhttp://www.zirmed.com/ ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. ZirMed, Inc. has strict policies regarding the content of e-mail communications, specifically Protected Health Information, any communications containing such material will be returned to the originating party with such advisement noted. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] [UV] Large File Operations Kill Linux
Here's the one I'm using for the test... [root@qauv2 zmopsx]# ls -l /data/traxnl3/trax2011/ERA.DET -rw-rw 1 perryt trax 123736145920 Feb 5 15:53 /data/traxnl3/trax2011/ERA.DET So yeah.. they're pretty big. (There are others even bigger) Perry -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jeffrey Butera Sent: Tuesday, February 05, 2013 3:51 PM To: U2 Users List Subject: Re: [U2] [UV] Large File Operations Kill Linux Perry I'm curious how large large is for you? Jeff Butera -- A tree falls the way it leans. Be careful which way you lean. The Lorax On Feb 5, 2013, at 5:45 PM, Perry Taylor perry.tay...@zirmed.com wrote: I have engaged Redhat Support and it has already been escalated to their Kernel team so at least it seems I have their attention :). I'll provide updates as they become available. Perry -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan Fitzgerald Sent: Monday, February 04, 2013 3:32 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux Other users could have been hanging at malloc. With a swappiness of 100 (on some kernels) or 100 (on others) or not 0 or 100(not sure which behavior you get on 2.6.18), pages wouldn't be getting freed up quickly enough duing the creation/copying of a large file. Another thing to look at (although I prefer the support route, since you have it), is /sys/kernel/mm/transparent_hugepage/defrag. Other people who have had this problem alleviated it by setting this to never. Of course, others fixed it by updating the kernel. My aged eyes read what you have as 2.6.8.1... Date: Mon, 4 Feb 2013 21:15:25 + From: antli...@youngman.org.uk To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux On 04/02/13 21:05, Dan Fitzgerald wrote: What's the value in /proc/sys/vm/swappiness? How will that make any difference? 2.6.18-348 SOUNDS like an ancient (in linux terms) kernel. Are you on RedHat support? This is a problem with the linux kernel that was addressed recently, iirc. Large amounts of io from a single process can swamp the queue, and the latest kernels have it fixed. If you've got RH support, see if you can find out if that's been backported into your kernel. Cheers, Wol From: perry.tay...@zirmed.com To: u2-users@listserver.u2ug.org Date: Mon, 4 Feb 2013 20:53:13 + Subject: Re: [U2] [UV] Large File Operations Kill Linux We're on RHEL5 (2.6.18-348.el5), ext3 and 132GB ram. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, February 04, 2013 9:23 AM To: 'U2 Users List' Subject: Re: [U2] [UV] Large File Operations Kill Linux A few questions - What linux version/distro are you on and what type of file system, and how much ram do you have -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Perry Taylor Sent: 04 February 2013 15:57 To: U2-Users List Subject: [U2] [UV] Large File Operations Kill Linux Looking for some ideas on how to keep Linux from becoming largely unresponsive when creating large files. What happens is as the new file is being created the I/O buffer cache quickly fills up with dirty buffers. Until the kernel can flush these out to disk there is no avail buffers for I/O operations from other processes. . The most troubling manifestation of this is the transaction logging check point daemon gets *way* behind putting us as risk if we were to have a failure of some kind. I have tried using ionice and renice to slow the file creation down as much as possible. This help a little but is still a big problem. Any ideas how to get CREATE.FILE/RESIZE to play nice on Linux? Thanks. Perry Perry Taylor Senior MV Architect ZirMed 888 West Market Street, Suite 400 Louisville, KY 40202 www.zirmed.comhttp://www.zirmed.com/ ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. ZirMed, Inc. has strict policies regarding the content of e-mail communications, specifically Protected Health Information, any communications containing such material will be returned to the
