Memory Leak in CF10?
I posted this to the Adobe forums as well. Totally perplexed. I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. This was never a problem before on CF8. I have searched far and wide for a solution, but found only this: http://stackoverflow.com/questions/7788280/memory-leak-when-redeploying-application-in-tomcat I'm not sure what code is causing the memory balloon, or even where to look for clues. None of the logs have anything in them other than the occasional missing file due to a bad offsite link, and plenty of query timed out errors due to CF Server crashing. I'm now restarting CF every two hours. Completely flummoxed at this point. Anyone have any ideas? MM Michael Muller -- (413) 320-5336 http://MontagueWebWorks.com ** Powered by ROCKETFUSION ** Information is not knowledge Knowledge is not wisdom Eschew Obfuscation ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355145 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Impact of cross site scripting in google search appliance
All - On our websites, we use google search appliance (GSA). When a user enters a search term, and submits the form, it goes to GSA.We are using GET method hence the search term is passed as a URL variable. There is chance of tampering the search term in the URL, for example adding alert statement to the search term. When this is done, GSA just returns that no search results are available. I am not understanding what is the impact of cross site scripting with google search appliance. Does anyone have an idea on this? Thanks. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355146 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Impact of cross site scripting in google search appliance
On our websites, we use google search appliance (GSA). When a user enters a search term, and submits the form, it goes to GSA.We are using GET method hence the search term is passed as a URL variable. There is chance of tampering the search term in the URL, for example adding alert statement to the search term. When this is done, GSA just returns that no search results are available. I am not understanding what is the impact of cross site scripting with google search appliance. Does anyone have an idea on this? By default, there isn't any impact, because as you observed, the GSA isn't going to do anything with that query parameter other than use it in server-side processing. But it is possible to modify the default XSLT to make it do dangerous things with inputs. You can avoid this problem by using CF as a proxy of sorts - instead of submitting the search form directly to the appliance, you could submit it back to CF, which could either validate values then redirect you to the GSA or make a CFHTTP call on your behalf. These things will increase the complexity of your application, though. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355147 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355148 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Impact of cross site scripting in google search appliance
Dave, What do you mean when you said that it is possibe to modify default XSLT and do dangerous things with inputs? Thanks, Lavanya On Tue, Mar 26, 2013 at 1:04 PM, Dave Watts dwa...@figleaf.com wrote: On our websites, we use google search appliance (GSA). When a user enters a search term, and submits the form, it goes to GSA.We are using GET method hence the search term is passed as a URL variable. There is chance of tampering the search term in the URL, for example adding alert statement to the search term. When this is done, GSA just returns that no search results are available. I am not understanding what is the impact of cross site scripting with google search appliance. Does anyone have an idea on this? By default, there isn't any impact, because as you observed, the GSA isn't going to do anything with that query parameter other than use it in server-side processing. But it is possible to modify the default XSLT to make it do dangerous things with inputs. You can avoid this problem by using CF as a proxy of sorts - instead of submitting the search form directly to the appliance, you could submit it back to CF, which could either validate values then redirect you to the GSA or make a CFHTTP call on your behalf. These things will increase the complexity of your application, though. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355149 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Impact of cross site scripting in google search appliance
Dave, What do you mean when you said that it is possible to modify default XSLT and do dangerous things with inputs? Thanks On Tue, Mar 26, 2013 at 1:04 PM, Dave Watts dwa...@figleaf.com wrote: On our websites, we use google search appliance (GSA). When a user enters a search term, and submits the form, it goes to GSA.We are using GET method hence the search term is passed as a URL variable. There is chance of tampering the search term in the URL, for example adding alert statement to the search term. When this is done, GSA just returns that no search results are available. I am not understanding what is the impact of cross site scripting with google search appliance. Does anyone have an idea on this? By default, there isn't any impact, because as you observed, the GSA isn't going to do anything with that query parameter other than use it in server-side processing. But it is possible to modify the default XSLT to make it do dangerous things with inputs. You can avoid this problem by using CF as a proxy of sorts - instead of submitting the search form directly to the appliance, you could submit it back to CF, which could either validate values then redirect you to the GSA or make a CFHTTP call on your behalf. These things will increase the complexity of your application, though. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355150 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Impact of cross site scripting in google search appliance
What do you mean when you said that it is possibe to modify default XSLT and do dangerous things with inputs? I mean that the administrator of the GSA could log into the admin console, modify the XSLT manually, and include code to automatically execute JavaScript found in URL parameters. Just like a CF developer could do when writing a CF page. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355151 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Impact of cross site scripting in google search appliance
Ok. With existing XSLT, when I use alert statement in GSA URL, it throws an alert statement but the search results return a message No results available. but when I use the same search term in google.com, it does not throw any alert statement. Do you think I need to update XSLT to not execute any scripts? is this possible? On Tue, Mar 26, 2013 at 1:42 PM, Dave Watts dwa...@figleaf.com wrote: What do you mean when you said that it is possibe to modify default XSLT and do dangerous things with inputs? I mean that the administrator of the GSA could log into the admin console, modify the XSLT manually, and include code to automatically execute JavaScript found in URL parameters. Just like a CF developer could do when writing a CF page. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355152 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
(ot) SQL bulk inserts, ftps, and unicode special characters
Hi all, I am getting some data feeds from our SAP system (god help me). Some of the data contains unicode characters apparently like em dashes and such. For example, take the following string: AMEX ADR Box The em dash seems to come through in my text file is 3 characters when I view it in notepad++ IF I open the document in Word, it asks me for a character encoding and I say UTF 8, and it appears to show the em dash as a single character: AMEX ADR (copy paste from word) However, when the data is loaded into SQL Server, it goes in as three characters. unicode 915-199-71 In fact, it looks like pretty much all of these special characters start with unicode 915-199 and then some other character. SQL Server 2005 does not support UTF-8 apparently. Has anyone run across this problem and implemented some kind of solution? My data files are fairly large (1.3GB of data in 26 files), and they are loaded every night (full replace) Rick -- The beatings will continue until morale improves. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355153 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: (ot) SQL bulk inserts, ftps, and unicode special characters
Sorry, the em dash is 915-199-244, not 915-244-71. a unicode em dash is unicode 2015 .. I'm not sure how these numbers relate though On Tue, Mar 26, 2013 at 4:08 PM, Rick Root rick.r...@gmail.com wrote: Hi all, I am getting some data feeds from our SAP system (god help me). Some of the data contains unicode characters apparently like em dashes and such. For example, take the following string: AMEX ADR Box The em dash seems to come through in my text file is 3 characters when I view it in notepad++ IF I open the document in Word, it asks me for a character encoding and I say UTF 8, and it appears to show the em dash as a single character: AMEX ADR (copy paste from word) However, when the data is loaded into SQL Server, it goes in as three characters. unicode 915-199-71 In fact, it looks like pretty much all of these special characters start with unicode 915-199 and then some other character. SQL Server 2005 does not support UTF-8 apparently. Has anyone run across this problem and implemented some kind of solution? My data files are fairly large (1.3GB of data in 26 files), and they are loaded every night (full replace) Rick -- The beatings will continue until morale improves. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355154 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355155 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
20 minutes later and coldfusion.exe's memory usage is bouncing between 460mb and 470mb. Ugh. MM At 03:41 PM 3/26/2013, Mik Muller wrote: Well, after restarting CF I saw the memory usage in Services shoot straight up to 750mb instead of first hovering around 650mb for a while and then slowly moving up to 750mb. So I set the max heap size down to 256 and restarted CF. Now it's hovering around 400mb and not moving much. The server has 4gb of ram, btw. Should I add more ram to the machine? I'm only running CF10 and DNS on this cloud server (DB and mail are on a separate box), which is set up with three processors. I would have thought 4gb would be enough. MM At 03:24 PM 3/26/2013, Mik Muller wrote: Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355156 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
And is it still serving pages OK? I don't think the memory consumption in and of itself is a problem. -- Adam On 27 March 2013 09:01, Mik Muller ad...@montaguema.net wrote: 20 minutes later and coldfusion.exe's memory usage is bouncing between 460mb and 470mb. Ugh. MM At 03:41 PM 3/26/2013, Mik Muller wrote: Well, after restarting CF I saw the memory usage in Services shoot straight up to 750mb instead of first hovering around 650mb for a while and then slowly moving up to 750mb. So I set the max heap size down to 256 and restarted CF. Now it's hovering around 400mb and not moving much. The server has 4gb of ram, btw. Should I add more ram to the machine? I'm only running CF10 and DNS on this cloud server (DB and mail are on a separate box), which is set up with three processors. I would have thought 4gb would be enough. MM At 03:24 PM 3/26/2013, Mik Muller wrote: Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355157 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
Well, after restarting CF I saw the memory usage in Services shoot straight up to 750mb instead of first hovering around 650mb for a while and then slowly moving up to 750mb. So I set the max heap size down to 256 and restarted CF. Now it's hovering around 400mb and not moving much. The server has 4gb of ram, btw. Should I add more ram to the machine? I'm only running CF10 and DNS on this cloud server (DB and mail are on a separate box), which is set up with three processors. I would have thought 4gb would be enough. MM At 03:24 PM 3/26/2013, Mik Muller wrote: Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355158 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
having 4GB of RAM is no good if your only going to allow CF to use 256mb of it. Reserve 1GB for Windows and DNS services and whack it up to 3GB. Your memory usage is obviously going to be higher than before because your using 64bit now and were using 32bit before. This results in at least 1.5x more memory used, so you cannot use the same settings you had before. Have you taken note of how much memory CF was actually using on CF9 ? The Max heap size only applies to the heap, there is other memory usage on top of this, Apache itself plus permgen etc. You can use the built in server monitor to see what parts of your app are using what memory. On Tue, Mar 26, 2013 at 7:41 PM, Mik Muller ad...@montaguema.net wrote: Well, after restarting CF I saw the memory usage in Services shoot straight up to 750mb instead of first hovering around 650mb for a while and then slowly moving up to 750mb. So I set the max heap size down to 256 and restarted CF. Now it's hovering around 400mb and not moving much. The server has 4gb of ram, btw. Should I add more ram to the machine? I'm only running CF10 and DNS on this cloud server (DB and mail are on a separate box), which is set up with three processors. I would have thought 4gb would be enough. MM At 03:24 PM 3/26/2013, Mik Muller wrote: Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355159 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. When you switch from 32- to 64-bit, you may find you need more memory than you used to. I'd increase your max heap size to 2048 - not that you necessarily need that much, but it'll be good for testing. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355160 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
Yup. An hour later and it's still bouncing between 450mb and 460mb with an occasional spikes up to 500mb. It is a little slower, however, but it's up. I'll take that for now until I figure out the larger problem. Thanks to Dave Watts for mentioning the heap. I recall that I had to tweak that back a few years ago. MM At 05:00 PM 3/26/2013, Adam Cameron wrote: And is it still serving pages OK? I don't think the memory consumption in and of itself is a problem. -- Adam On 27 March 2013 09:01, Mik Muller ad...@montaguema.net wrote: 20 minutes later and coldfusion.exe's memory usage is bouncing between 460mb and 470mb. Ugh. MM At 03:41 PM 3/26/2013, Mik Muller wrote: Well, after restarting CF I saw the memory usage in Services shoot straight up to 750mb instead of first hovering around 650mb for a while and then slowly moving up to 750mb. So I set the max heap size down to 256 and restarted CF. Now it's hovering around 400mb and not moving much. The server has 4gb of ram, btw. Should I add more ram to the machine? I'm only running CF10 and DNS on this cloud server (DB and mail are on a separate box), which is set up with three processors. I would have thought 4gb would be enough. MM At 03:24 PM 3/26/2013, Mik Muller wrote: Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355161 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF Builder - open multiple configured files
Thanks Mark, going to give that a shot. -- Dan O'Keefe On Tue, Mar 19, 2013 at 8:18 AM, Mark Drew mark.d...@gmail.com wrote: I am sure you can use mylyn for this. They are called contexts and it remembers the arrangement and files that you have open for a specific ticket. In your case you wouldn't have to have a issue or ticket but a ticket that refers to a section. I can post screenshots once I have installed it Sincerely Mark Drew On 19 Mar 2013, at 15:11, Dan O'Keefe dan.oke...@gmail.com wrote: Working on a project which also uses backbone.js quite extensively. The app is broken out into subsections, and each subsection can have several js files. I'm looking for a way to configure into a script of some type which files belong to which section so I can single click to open them all up for the section I want to work in. These are all javascript files so I am not adverse by any means to use a different editor for the js coding if it also gives me the functionality I am looking for. Anybody know of any way or any toll that would allow me to do that? TIA -- Dan O'Keefe ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355162 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
OK, well that's OK... even 500MB ain't a huge amount of RAM for CF to be using (as the other guys alluded to). Keep an eye on your GC and perhaps have a shufti around in memory to see if there's any actual clutter in there you don't expect (a lot of stray sessions etc), but on the whole if requests are being served in a timely fashion, it's simply OK for CF to be using memory. -- Adam On 27 March 2013 10:05, Mik Muller ad...@montaguema.net wrote: Yup. An hour later and it's still bouncing between 450mb and 460mb with an occasional spikes up to 500mb. It is a little slower, however, but it's up. I'll take that for now until I figure out the larger problem. Thanks to Dave Watts for mentioning the heap. I recall that I had to tweak that back a few years ago. MM At 05:00 PM 3/26/2013, Adam Cameron wrote: And is it still serving pages OK? I don't think the memory consumption in and of itself is a problem. -- Adam On 27 March 2013 09:01, Mik Muller ad...@montaguema.net wrote: 20 minutes later and coldfusion.exe's memory usage is bouncing between 460mb and 470mb. Ugh. MM ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355163 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
So all I need to do is increase the heap? There's no magic Windows, you get 1gig, CF you get 3gig configurator, correct? Windows will use whatever is left over after CF stakes its claim? Sorry for my ignorance. I'm just a simple scripter. I don't know too much about server memory, etc, except what I picked up along the road. Thanks, MM At 05:29 PM 3/26/2013, Russ Michaels wrote: having 4GB of RAM is no good if your only going to allow CF to use 256mb of it. Reserve 1GB for Windows and DNS services and whack it up to 3GB. Your memory usage is obviously going to be higher than before because your using 64bit now and were using 32bit before. This results in at least 1.5x more memory used, so you cannot use the same settings you had before. Have you taken note of how much memory CF was actually using on CF9 ? The Max heap size only applies to the heap, there is other memory usage on top of this, Apache itself plus permgen etc. You can use the built in server monitor to see what parts of your app are using what memory. On Tue, Mar 26, 2013 at 7:41 PM, Mik Muller ad...@montaguema.net wrote: Well, after restarting CF I saw the memory usage in Services shoot straight up to 750mb instead of first hovering around 650mb for a while and then slowly moving up to 750mb. So I set the max heap size down to 256 and restarted CF. Now it's hovering around 400mb and not moving much. The server has 4gb of ram, btw. Should I add more ram to the machine? I'm only running CF10 and DNS on this cloud server (DB and mail are on a separate box), which is set up with three processors. I would have thought 4gb would be enough. MM At 03:24 PM 3/26/2013, Mik Muller wrote: Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355164 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
It's the other way around. Windows will take whatever it decides it needs, irrespective of anything else. Other settings need to fit around that. So you basically need to say whatever RAM I've got... 1GB (personally I would have maybe gone for 1.5GB) of that is lost to Windows. I can do something with the rest. So from there you can tell your JVM that it can use 3GB (or 2.5GB) safely for its heap. That said, I am hesitant to just give *all of it* over to the heap. You should tune your heap to be the right size. There *is* overhead in locating stuff in the heap, plus the bigger it is the longer GC takes, so there's a bit of a balancing act there. You should try to allocate the right amount not necessarily just everything you can throw at it. You will probably want to do some profiling to see how much Perm Gen space you are best to allocate too. Although that's a bit of a dark art (and one that I have not practised for years), so someone else is best to give you guidance there. Or google google google... every man and his dog will have different opinions on what one should do. Be warned though, because the way CF deals with its class files - a CF application consists of really a lot of them compared to a standard java app - make sure to look for specifically *CF* JVM tuning guidance. Not just standard tuning for a Java app. -- Adam On 27 March 2013 13:28, Mik Muller ad...@montaguema.net wrote: So all I need to do is increase the heap? There's no magic Windows, you get 1gig, CF you get 3gig configurator, correct? Windows will use whatever is left over after CF stakes its claim? Sorry for my ignorance. I'm just a simple scripter. I don't know too much about server memory, etc, except what I picked up along the road. Thanks, MM At 05:29 PM 3/26/2013, Russ Michaels wrote: having 4GB of RAM is no good if your only going to allow CF to use 256mb of it. Reserve 1GB for Windows and DNS services and whack it up to 3GB. Your memory usage is obviously going to be higher than before because your using 64bit now and were using 32bit before. This results in at least 1.5x more memory used, so you cannot use the same settings you had before. Have you taken note of how much memory CF was actually using on CF9 ? The Max heap size only applies to the heap, there is other memory usage on top of this, Apache itself plus permgen etc. You can use the built in server monitor to see what parts of your app are using what memory. On Tue, Mar 26, 2013 at 7:41 PM, Mik Muller ad...@montaguema.net wrote: Well, after restarting CF I saw the memory usage in Services shoot straight up to 750mb instead of first hovering around 650mb for a while and then slowly moving up to 750mb. So I set the max heap size down to 256 and restarted CF. Now it's hovering around 400mb and not moving much. The server has 4gb of ram, btw. Should I add more ram to the machine? I'm only running CF10 and DNS on this cloud server (DB and mail are on a separate box), which is set up with three processors. I would have thought 4gb would be enough. MM At 03:24 PM 3/26/2013, Mik Muller wrote: Was on 32 bit CF9 (Sorry, did I say CF8? I was on CF9 -- how did I miss that?) Am on 64 bit CF10 The old server had max heap set to 1024. The new had it set to 512. I just bumped it up to 1024. MM At 02:06 PM 3/26/2013, Dave Watts wrote: I moved all my code from a Win2003S/CF8 box to a Win2008S/CF10 box and now am having issues where CF loads blank pages after a few hours of uptime. I'm noticing that the coldfusion.exe service starts around 500mb of memory, and slowly moves up to about 780mb of memory. As it tops 700mb it begins loading blank pages which can be reloaded for intended content. Once it hit 770mb it loads ONLY blank pages, and the service can no longer be restarted. It must be killed by Task Manager. Were you using the 32-bit or 64-bit version of CF 8? Are you using the 32-bit or 64-bit version of CF 10? What is the maximum heap size allocated to CF 10? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355165 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Memory Leak in CF10?
So all I need to do is increase the heap? There's no magic Windows, you get 1gig, CF you get 3gig configurator, correct? Windows will use whatever is left over after CF stakes its claim? I'd just increase it to 2048 and see what happens. If you do that and CF's memory usage remains somewhere between where it is now and, say, 1.6 GB, that 2048 will be fine. But no, there's no magic configurator. Windows by itself doesn't really need that much memory. But you shouldn't be surprised to see CF taking up 500+ MB - hell, Chrome and Firefox are probably doing that right now on my desktop! Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355166 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: (ot) SQL bulk inserts, ftps, and unicode special characters
On 3/27/2013 3:08 AM, Rick Root wrote: AMEX � ADR Box The em dash seems to come through in my text file is 3 characters when I view it in notepad++ that's because your data is garbaged or its encoding is either missing or misidentified or i guess notepad++ doesn't understand unicode (not sure, not familiar w/it). UTF-whatever are variable width encodings of unicode. UTF encodes all of the million or so unicode code points as 1-4 bytes (8-bit). if something bad happens those encodings can blow apart look like multiple chars. However, when the data is loaded into SQL Server, it goes in as three characters. unicode 915-199-71 how are you inserting the data? is the column holding this data unicode capable (for sql server it should be one of the N datatypes). SQL Server 2005 does not support UTF-8 apparently. sure it does. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355167 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
