Re: memory issues

2007-12-20 Thread Chris Norloff
CFFILE reads the entire file into memory before acting on it. Even appending to the file requires it be read into memory first. That's where your memory usage is likely coming from -- though not sure why it's not being freed in a timely manner. Chris >On Dec 17, 2007, at 7:58 PM, "Jonathon St

RE: memory issues

2007-12-18 Thread Jonathon Stierman
PM To: CF-Talk Subject: RE: memory issues Jonathon, >And while it definitely seems to slow down the memory consumption rate, >it still doesn't appear to be freeing up any RAM. I did some test >runs, loading some of the larger files. I saw the corresponding RAM >increase, but n

RE: memory issues

2007-12-18 Thread Dan G. Switzer, II
Jonathon, >And while it definitely seems to slow down the memory consumption rate, it >still doesn't appear to be freeing up any RAM. I did some test runs, >loading some of the larger files. I saw the corresponding RAM increase, but >never seeing that memory released. > >I plan on converting it a

RE: memory issues

2007-12-18 Thread Jonathon Stierman
Anyone know the exact place to do start a garbage collection in FusionReactor? Looked at the help docs, and all the options I could find in the application -- no dice... Jonathon ~| Adobe® ColdFusion® 8 software 8 is the mos

RE: memory issues

2007-12-18 Thread Brad Wood
SeeFusion or Fusion-Reactor will allow you to force garbage collection. ~Brad I plan on converting it all to being database-driven, but I'm still confused as to why this memory isn't being released. Are the Queries being eliminated, but not removed from memory just yet? Is there a way to forc

RE: memory issues

2007-12-18 Thread Jonathon Stierman
It'd definitely be nice to get everything database-driven. That would save me some headaches. But keeping with the same train of thought here. I reduced the caching timeout from 30 minutes down to 1 minute -- I hoped to see my memory start clearing up fairly quickly: SQL Most users on the

RE: memory issues

2007-12-18 Thread Dave Watts
> I will second that, the one thing (and yes I will include me > on this one) is that even though the Garbage collection does > a good job. Under heavy load it is not smart enough to know > what we want when we want it. And it is a trap that most do > not think about. > > So in the old days of

RE: memory issues

2007-12-18 Thread Dave Watts
> I've been pondering recently is whether I ought to just > sidestep the problem caused by heavy file-reading. I would strongly recommend using your database to do this sort of thing directly. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest cali

Re: memory issues

2007-12-18 Thread Ian Skinner
"What I've been pondering recently is whether I ought to just sidestep the problem caused by heavy file-reading. Convert those text files into database records on upload, and then rely on SQL to do the heavy lifting for me." That is something I would definitely consider. Database designers hav

RE: memory issues

2007-12-18 Thread Jonathon Stierman
Thanks again Dan & Ian for keeping with me here! Much love for that Steve Brownlee link -- I've been wanting a way to see all Sessions stored on an application by application basis, and it looks like that's the object I was looking for (createObject("java","coldfusion.runtime.SessionTracker"))! I

RE: memory issues

2007-12-18 Thread Dan G. Switzer, II
>1. >User logs in and requests a file. > >2. >Application reads file, and builds a Query object out of it. Every line of >the file is saved to the Query. > >3. >A SELECT statement is performed on the Query to only get the relevant data >for that user (cached for 30 minutes) > >4. >Results of SELEC

Re: memory issues

2007-12-18 Thread Ian Skinner
Am I off my rocker, or could this be the culprit? If you are storing .2 to 5mb of data per user for an unknown period of time, yes you are using a lot of memory. You have entered the relm of serious design where trade offs between file reads versus memory versus cpu time have to be weighed and

RE: memory issues

2007-12-18 Thread Jonathon Stierman
Using 1.4.2_12-b03. Not sure if that's the default JRE or not. I'll look into Robi's blog post. A line-by-line file reader could definitely help -- The idea being I'd only save into memory one line at a time and only keep the lines I want to display to the user. I hadn't thought of that solutio

Re: memory issues

2007-12-18 Thread Ian Skinner
"but why wouldn't that memory be released after the request is complete?" Where is this data being stored? Is there code to clear the data? I.E. If the application makes use of session variables for the data, it is not going to be cleared until after the session times out. That is twenty minu

RE: memory issues

2007-12-18 Thread Jonathon Stierman
Thanks Dale, Dustin and Andrew! I'll try clearing out the variables manually and see if that helps. Jonathon -Original Message- From: Andrew Scott [mailto:[EMAIL PROTECTED] Sent: Monday, December 17, 2007 10:48 PM To: CF-Talk Subject: RE: memory issues I will second that, th

RE: memory issues

2007-12-18 Thread Dan G. Switzer, II
Jonathon, Robi Sen has some excellent information on memory issues like you're experiencing: http://www.robisen.com/index.cfm?mode=entry&entry=FD4BE2FC-55DC-F2B1-FED0717 CC1C7E0AF Are you using the default JRE? If so, you might consider upgrading to JRE SDK 1.4.2_13--which I believe is the mos

RE: memory issues

2007-12-17 Thread Jim Davis
> -Original Message- > From: Dustin M. Snell [mailto:[EMAIL PROTECTED] > Sent: Monday, December 17, 2007 11:44 PM > To: CF-Talk > Subject: Re: memory issues > > We have the same issue. Sometimes jrun freezes as well. I suspect > though that it may not be a problem

RE: memory issues

2007-12-17 Thread Andrew Scott
- From: Dale Fraser [mailto:[EMAIL PROTECTED] Sent: Tuesday, 18 December 2007 3:42 PM To: CF-Talk Subject: RE: memory issues Try destroying the variables afterwards. Ie if variable is fileContents Do a Regards Dale Fraser http://learncf.com -Original Message- From: Jonathon Stierman

Re: memory issues

2007-12-17 Thread Dustin M. Snell
We have the same issue. Sometimes jrun freezes as well. I suspect though that it may not be a problem (the memory usage) as it may just be set up to use all available memory for speed (caching etc) just like .net, SQL server and vista. But if there is a shortage they may "give back". I have

RE: memory issues

2007-12-17 Thread Dale Fraser
Try destroying the variables afterwards. Ie if variable is fileContents Do a Regards Dale Fraser http://learncf.com -Original Message- From: Jonathon Stierman [mailto:[EMAIL PROTECTED] Sent: Tuesday, 18 December 2007 2:58 PM To: CF-Talk Subject: memory issues An application of mine

RE: Memory issues with new daylight savings update?

2007-04-02 Thread Jim Curran
212.691.1134 x11 direct 212.691.3477 fax [EMAIL PROTECTED] www.nylontechnology.com -Original Message- From: Ben Nadel [mailto:[EMAIL PROTECTED] Sent: Monday, April 02, 2007 5:50 PM To: CF-Talk Subject: RE: Memory issues with new daylight savings update? Hmmm, I did not set up the server or

RE: Memory issues with new daylight savings update?

2007-04-02 Thread Ben Nadel
, April 02, 2007 5:37 PM To: CF-Talk Subject: Re: Memory issues with new daylight savings update? Well, as we all know.. 1.4.2_11 is the latest supported JVM I think? How do you mean updated it via the 7.0.2 update? ~| Upgrade to Adobe

Re: Memory issues with new daylight savings update?

2007-04-02 Thread Robertson-Ravo, Neil (RX)
Well, as we all know.. 1.4.2_11 is the latest supported JVM I think? How do you mean updated it via the 7.0.2 update? "This e-mail is from Reed Exhibitions (Gateway House, 28 The Quadrant, Richmond, Surrey, TW9 1DN, United Kingdom), a division of Reed Business, Registered in England, Number 6

Re: Memory issues in a shared environemt

2007-01-24 Thread Matthew Williams
I agree, but I didn't write it, I just administer the servers it resides on ;). I'm just looking for confirmation that I can go back to the developer with a little fodder to hold their feet under the fire with. Matthew Williams Russ wrote: > Well it might sound obvious, but you don't want to s

Re: Memory issues in a shared environemt

2007-01-24 Thread Matthew Williams
It's not really JRun's fault in this instance. Our networking group blocks multicast across subnets, so the traffic is cut off. I get the fact that it's one of the main reasons to have multiple subnets, but it's a pain. JRun will work fine, so long as the security.properties file is edited t

Re: Memory issues in a shared environemt

2007-01-24 Thread Jochem van Dieten
AJ Mercer wrote: > > could you explain to me what the issue is with multicast across subnets? http://www.adobe.com/cfusion/knowledgebase/index.cfm?id=1e8e9170 Jochem ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 & MX7 i

Re: Memory issues in a shared environemt

2007-01-24 Thread AJ Mercer
Hi Matthew, could you explain to me what the issue is with multicast across subnets? We have clustering across two servers which are on different subnets. CF lets you set up the cluster without any problems, but the instances on the server on the other subnet are not being used. Thank you. On

RE: Memory issues in a shared environemt

2007-01-23 Thread Russ
Well it might sound obvious, but you don't want to store a lot of data in a session scope. Ideally, the query should return the resultset and it should go into the request or variables scope, and be released after the request ends. If you are retrieving a large amount of information, you might wa

RE: Memory Issues

2004-08-21 Thread Hugo Ahlenius
|From: Tom Kitta [mailto:[EMAIL PROTECTED] |I have had memory problems with CF MX 6.1 running on Unix box, |while on Windows box it was running fine. I placed my findings |on my blog at http://www.tomkitta.com/blog/index.cfm |I am not 100% sure that my conclusions are right, but please |take a look

Re: Memory Issues

2004-08-20 Thread Tom Kitta
I have had memory problems with CF MX 6.1 running on Unix box, while on Windows box it was running fine. I placed my findings on my blog at http://www.tomkitta.com/blog/index.cfm I am not 100% sure that my conclusions are right, but please take a look at the symptoms of my problem. In short, CF M

Re: Memory Issues

2004-08-20 Thread Pete Freitag
Christian Watt wrote: > Pete, > So far this is what I have come up with.  Macromedia has had me > running OptimizeIt from Borland.  I do not see any classes increasing in > there memory consumption.  The only common thread I can see right now is > that when the memory jump, Old Gen GC jumps as

RE: Memory Issues

2004-08-20 Thread Christian Watt
??? -Original Message- From: Pete Freitag [mailto:[EMAIL PROTECTED] Sent: Thursday, August 19, 2004 10:53 AM To: CF-Talk Subject: Re: Memory Issues Christian Watt wrote: > What is the default setting for the -XX:ParallelGCThreads and what > increments should I try increasing

RE: Memory Issues

2004-08-20 Thread Christian Watt
stian -Original Message- From: Pete Freitag [mailto:[EMAIL PROTECTED] Sent: Thursday, August 19, 2004 10:53 AM To: CF-Talk Subject: Re: Memory Issues Christian Watt wrote: > What is the default setting for the -XX:ParallelGCThreads and what > increments should I try incre

RE: Memory Issues

2004-08-19 Thread Christian Watt
Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Thursday, August 19, 2004 11:16 AM To: CF-Talk Subject: RE: Memory Issues > I ran the load test with 150 users over a 30 minute period and > everything ran smooth. This morning I am only seeing around 10-15 > simultane

RE: Memory Issues

2004-08-19 Thread Dave Watts
> I ran the load test with 150 users over a 30 minute period and > everything ran smooth. This morning I am only seeing around 10-15 > simultaneous users and having issues. This is really getting > frustrating! Are you allowing your load test virtual users to pause between requests? Are you runnin

Re: Memory Issues

2004-08-19 Thread Pete Freitag
Christian Watt wrote: > What is the default setting for the -XX:ParallelGCThreads and what > increments should I try increasing these? Look at section 4.1 and 4.2 of http://www.petefreitag.com/articles/gctuning/ "By default the throughput collector uses the number of CPU's as its value for numbe

RE: Memory Issues

2004-08-19 Thread Christian Watt
This morning I am only seeing around 10-15 simultaneous users and having issues.  This is really getting frustrating! Christian -Original Message- From: Pete Freitag [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 18, 2004 3:11 PM To: CF-Talk Subject: Re: Memory Issues Chris

RE: Memory Issues

2004-08-19 Thread Christian Watt
What is the default setting for the -XX:ParallelGCThreads and what increments should I try increasing these? Christian -Original Message- From: Pete Freitag [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 18, 2004 3:11 PM To: CF-Talk Subject: Re: Memory Issues Christian

Re: Memory Issues

2004-08-18 Thread Pete Freitag
Christian Watt wrote: > Peter,  the Old Generation garbage collection was over 500mb.  I have a > screen shot and logs with a stack trace dump, but I don't know what to > do from here.  Will you take a look or can you tell me who can help??? > As soon as I restart the service, via command prompt r

RE: Memory Issues

2004-08-18 Thread Christian Watt
watch gc, the memory immediately explodes again.  But These logs and gc graph do show a complete lockup. Christian -Original Message- From: Peter Farrell [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 18, 2004 10:44 AM To: CF-Talk Subject: Re: Memory Issues Check this out:

RE: Memory Issues

2004-08-18 Thread Christian Watt
- From: Peter Farrell [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 18, 2004 10:44 AM To: CF-Talk Subject: Re: Memory Issues Check this out: http://www-106.ibm.com/developerworks/java/library/j-garbage-collection. html Are you running JRUN with Updater 3

RE: Memory Issues

2004-08-18 Thread Christian Watt
, 2004 10:19 AM To: CF-Talk Subject: Re: Memory Issues Christian, What's your max memory heap size?  Is it over 1.8 GB? .pjf maepub [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]

Re: Memory Issues

2004-08-18 Thread Peter Farrell
Check this out: http://www-106.ibm.com/developerworks/java/library/j-garbage-collection.html Are you running JRUN with Updater 3? [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]

Re: Memory Issues

2004-08-18 Thread Peter Farrell
Christian, What's your max memory heap size?  Is it over 1.8 GB? .pjf maepub [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]

RE: Memory Issues

2004-08-17 Thread Christian Watt
HighCon:21 Dropped:0 Handled:38 HandledMS:1571438 DelayMS:0 Christian From: Peter Farrell [mailto:[EMAIL PROTECTED] Sent: Monday, August 16, 2004 6:00 PM To: CF-Talk Subject: Re: Memory Issues Christian, Are you caching anything in cfquery?  I'm thinking

Re: Memory Issues

2004-08-16 Thread Peter Farrell
Christian, Are you caching anything in cfquery?  I'm thinking that maybe your max total cache for cfquery might be set too high... Also, are you using ODBC or JDBC drivers? I could be that the garbage collection for event scheduler isn't working here and it's piling up (as in the discussion on M

RE: Memory Issues

2004-08-16 Thread Christian Watt
[mailto:[EMAIL PROTECTED] Sent: Saturday, August 14, 2004 5:15 PM To: CF-Talk Subject: Re: Memory Issues Check this out: http://www.macromedia.com/cfusion/webforums/forum/messageview.cfm?catid= 69&threadid=806965 Looks to be something like yours.  I noticed the person is using thread

Re: Memory Issues

2004-08-14 Thread Peter Farrell
Check this out: http://www.macromedia.com/cfusion/webforums/forum/messageview.cfm?catid=69&threadid=806965 Looks to be something like yours.  I noticed the person is using thread.sleep() which ties up a JRUN tread.  Are you using that in your CF code? .peter maepub [Todays Threads] [This Messa

Re: Memory Issues

2004-08-14 Thread Peter Farrell
Christian, Try this code on your machine: http://www.petefreitag.com/item/115.cfm Although I haven't experienced anything personally like what's happening to you.  I was on a shared enviroment and noticed that sometimes JRUN had a large memory spike.  Check the Max Heap Size in the CF admin.  Se

RE: Memory Issues

2004-08-14 Thread Dave Watts
> Honestly I have not idea what to look for in the stack > traces, do you, or anyone else have any idea where I can find > some info on what to look for and how to read the stack traces? Well, to be honest, I'm not sure what you're going to look for. My advice would to be to look for anything ou

RE: Memory Issues

2004-08-13 Thread Christian Watt
5:35 PM To: CF-Talk Subject: RE: Memory Issues > Oops, I didn't include that piece, but Yes, I am running the > latest JAVA version. In that case, I'm out of easy answers. You'll have to start looking at log files and/or running stack traces. Dave Watts, CTO, Fi

RE: Memory Issues

2004-08-13 Thread Dave Watts
> Oops, I didn't include that piece, but Yes, I am running the > latest JAVA version. In that case, I'm out of easy answers. You'll have to start looking at log files and/or running stack traces. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [T

RE: Memory Issues

2004-08-13 Thread Christian Watt
Oops, I didn't include that piece, but Yes, I am running the latest JAVA version. Christian -Original Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Friday, August 13, 2004 5:21 PM To: CF-Talk Subject: RE: Memory Issues > Let me add to my last post.  

RE: Memory Issues

2004-08-13 Thread Dave Watts
> Let me add to my last post.  When the memory jumps, it stays > up for 2-3 minutes, sometimes longer.  It will usually drop > back down to around 175mb -225mb after that period, and then > take another jump down a few minutes later.  This wouldn't be > so bad if it never jumped over 750mb, but

RE: Memory Issues

2004-08-13 Thread Christian Watt
004 3:09 PM To: CF-Talk Subject: RE: Memory Issues > I have not.  I just downloaded the Microsoft JDBC Driver SQL > 2000 and the SP1 for the driver.  Is just an install enough, > or do I need to do something in JRUN as well???  Thank you > for help Dave...I greatly appreciate

RE: Memory Issues

2004-08-13 Thread Christian Watt
ECTED] Sent: Friday, August 13, 2004 3:09 PM To: CF-Talk Subject: RE: Memory Issues > I have not.  I just downloaded the Microsoft JDBC Driver SQL > 2000 and the SP1 for the driver.  Is just an install enough, > or do I need to do something in JRUN as well???  Thank you >

RE: Memory Issues

2004-08-13 Thread Dave Watts
> I have not.  I just downloaded the Microsoft JDBC Driver SQL > 2000 and the SP1 for the driver.  Is just an install enough, > or do I need to do something in JRUN as well???  Thank you > for help Dave...I greatly appreciate it. I thought the latest version of the MS SQL Server JDBC driver was

RE: Memory Issues

2004-08-13 Thread Christian Watt
] Sent: Friday, August 13, 2004 2:33 PM To: CF-Talk Subject: RE: Memory Issues > Yes, I have installed all of the hot fixes and latest drivers > as of about 2 1/2 months ago.  That is when I set everything > up as a clustered environment.  Hoping that both clustering > and ge

RE: Memory Issues

2004-08-13 Thread Dave Watts
> Yes, I have installed all of the hot fixes and latest drivers > as of about 2 1/2 months ago.  That is when I set everything > up as a clustered environment.  Hoping that both clustering > and getting all of the updates/patches installed and a clean > install would help correct this issue.  S

RE: Memory Issues

2004-08-13 Thread Christian Watt
still occurs :-( Christian -Original Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Friday, August 13, 2004 2:22 PM To: CF-Talk Subject: RE: Memory Issues > I am having a huge issue with memory right now.  I have > turned off all session and application var

RE: Memory Issues

2004-08-13 Thread Dave Watts
> I am having a huge issue with memory right now.  I have > turned off all session and application variables.  If I get > more than 50-75 simultaneous users, my memory starts to > explode rather rapidly from around 150mb to over 750mb for > the jrun service.  Two problems here, 1) even though I