subject:"RE\: memory issues"

Re: memory issues

2007-12-20 Thread Chris Norloff

CFFILE reads the entire file into memory before acting on it. Even appending to 
the file requires it be read into memory first. That's where your memory usage 
is likely coming from -- though not sure why it's not being freed in a timely 
manner.

Chris


>On Dec 17, 2007, at 7:58 PM, "Jonathon Stierman" <[EMAIL PROTECTED]>  
>wrote:
>
>> An application of mine has recently been acting up -- memory has been
>> shooting up at a fairly rapid pace this past week, and I'm at my  
>> wits end!
>> Can't seem to find any way to fix it.  Here's the symptoms:
>>
>> After rebooting the CF service, memory starts out at about 60mb for  
>> the
>> jrun.exe process.  After that all hell breaks loose ;)  It continues  
>> to
>> consume about 4 megs a minute until it plateau's at about 590mb.  At  
>> that
>> point, the server starts delivering "500 null" errors, and my
>> application/exception.log files fill up with  
>> java.lang.OutOfMemoryError
>> messages.
>>...each one has to read a text file that is between  
>> 200k and
>> 5 megs, and that seems to correlate with the memory jumps -- but why
>> wouldn't that memory be released after the request is complete?  It  
>> just
>> keeps piling up.
>>
>> Is this to be expected from high volumes of file-reading/parsing  
>> requests?


~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295184
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Jonathon Stierman

That makes sense.  Now if only it was smart enough to clean itself out
BEFORE issuing "500 null" and OutOfMemory responses ;)  Then I'd really be
happy!

Jonathon

-Original Message-
From: Dan G. Switzer, II [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, December 18, 2007 4:10 PM
To: CF-Talk
Subject: RE: memory issues

Jonathon,

>And while it definitely seems to slow down the memory consumption rate, 
>it still doesn't appear to be freeing up any RAM.  I did some test 
>runs, loading some of the larger files. I saw the corresponding RAM 
>increase, but never seeing that memory released.
>
>I plan on converting it all to being database-driven, but I'm still 
>confused as to why this memory isn't being released.
>
>Are the Queries being eliminated, but not removed from memory just yet?  
>Is there a way to force garbage collection while CF is running so that 
>I could test this theory?

Just because you're not using the memory, it doesn't mean that Java will
free it up immediately. Since Garbage Collection is an expensive CPU
operation, it tries to do the GC as infrequently as possible by default.

You can think of Java and its Garbage Collection sort of like the Windows
Recycling Bin. Just because you delete a file and put it in the Recycling
Bin, it doesn't actually free up disk space right away. The file is in the
Recycling Bin and still takes up disk space. Windows will eventually remove
the files and reclaim the disk space when it needs to based upon your
Recycling Bin settings. 

-Dan

~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295067
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Dan G. Switzer, II

Jonathon,

>And while it definitely seems to slow down the memory consumption rate, it
>still doesn't appear to be freeing up any RAM.  I did some test runs,
>loading some of the larger files. I saw the corresponding RAM increase, but
>never seeing that memory released.
>
>I plan on converting it all to being database-driven, but I'm still
>confused
>as to why this memory isn't being released.
>
>Are the Queries being eliminated, but not removed from memory just yet?  Is
>there a way to force garbage collection while CF is running so that I could
>test this theory?

Just because you're not using the memory, it doesn't mean that Java will
free it up immediately. Since Garbage Collection is an expensive CPU
operation, it tries to do the GC as infrequently as possible by default.

You can think of Java and its Garbage Collection sort of like the Windows
Recycling Bin. Just because you delete a file and put it in the Recycling
Bin, it doesn't actually free up disk space right away. The file is in the
Recycling Bin and still takes up disk space. Windows will eventually remove
the files and reclaim the disk space when it needs to based upon your
Recycling Bin settings. 

-Dan


~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295060
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

RE: memory issues

2007-12-18 Thread Jonathon Stierman

 
Anyone know the exact place to do start a garbage collection in
FusionReactor?  Looked at the help docs, and all the options I could find in
the application -- no dice...

Jonathon



~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295057
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Brad Wood

SeeFusion or Fusion-Reactor will allow you to force garbage collection.

~Brad


I plan on converting it all to being database-driven, but I'm still
confused
as to why this memory isn't being released.  

Are the Queries being eliminated, but not removed from memory just yet?
Is
there a way to force garbage collection while CF is running so that I
could
test this theory?

~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295056
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Jonathon Stierman

It'd definitely be nice to get everything database-driven.  That would save
me some headaches.  

But keeping with the same train of thought here.  I reduced the caching
timeout from 30 minutes down to 1 minute -- I hoped to see my memory start
clearing up fairly quickly:


SQL


Most users on the site don't stick around for longer than 1 minute, so I'm
not worried about users having to do another lookup.


And while it definitely seems to slow down the memory consumption rate, it
still doesn't appear to be freeing up any RAM.  I did some test runs,
loading some of the larger files. I saw the corresponding RAM increase, but
never seeing that memory released.

I plan on converting it all to being database-driven, but I'm still confused
as to why this memory isn't being released.  

Are the Queries being eliminated, but not removed from memory just yet?  Is
there a way to force garbage collection while CF is running so that I could
test this theory?

Jonathon



~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295054
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Dave Watts

> I will second that, the one thing (and yes I will include me 
> on this one) is that even though the Garbage collection does 
> a good job. Under heavy load it is not smart enough to know 
> what we want when we want it. And it is a trap that most do 
> not think about.
> 
> So in the old days of allocating memory in C/C++, it is also 
> a good idea to destroy a variable as soon as it is no longer 
> needed. I am not saying all, but at least in cases like this.

I'm not exactly sure what you're recommending here, but deleting variables
in CF doesn't cause the value to be removed from memory. It simply removes
the reference to the value from the stack, making the value available for
garbage collection. I'm not sure whether deleting a variable within a page
will allow it to be garbage collected before the page has finished, or not,
but in any event it's relatively unlikely that garbage collection will run
frequently enough to make a difference.

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/

Fig Leaf Software provides the highest caliber vendor-authorized
instruction at our training centers in Washington DC, Atlanta,
Chicago, Baltimore, Northern Virginia, or on-site at your location.
Visit http://training.figleaf.com/ for more information!


~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295039
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Dave Watts

> I've been pondering recently is whether I ought to just 
> sidestep the problem caused by heavy file-reading.

I would strongly recommend using your database to do this sort of thing
directly.

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/

Fig Leaf Software provides the highest caliber vendor-authorized
instruction at our training centers in Washington DC, Atlanta,
Chicago, Baltimore, Northern Virginia, or on-site at your location.
Visit http://training.figleaf.com/ for more information!


~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295035
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Re: memory issues

2007-12-18 Thread Ian Skinner

"What I've been pondering recently is whether I ought to just sidestep the 
problem caused by
heavy file-reading.  Convert those text files into database records on upload, 
and then rely on SQL to do the heavy lifting for me."

That is something I would definitely consider.  Database designers have spent a 
great deal of time and money over the past several decades making a tool that 
is very efficient at handling data.  A lot more effort then you or I are ever 
going to have.

Good database management systems have the capability to directly import 
structured text files.  ColdFusion would not even need to involved in this 
aspect of the application other then to upload the file into a place accessible 
to the database and maybe trigger a process in the database to start the 
conversion process.




~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295034
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Jonathon Stierman

Thanks again Dan & Ian for keeping with me here!

Much love for that Steve Brownlee link -- I've been wanting a way to see all
Sessions stored on an application by application basis, and it looks like
that's the object I was looking for
(createObject("java","coldfusion.runtime.SessionTracker"))!

Ian -- Definitely agree with you on the trade-offs.  What I've been
pondering recently is whether I ought to just sidestep the problem caused by
heavy file-reading.  Convert those text files into database records on
upload, and then rely on SQL to do the heavy lifting for me.  Sure, it'll
take a little longer for the upload to process, but after that it would be
relatively smooth sailing.  The files come in to the application, and never
need to be modified or passed out to an external application, so I've got
pretty much free reign on what I do with them.  I think an intial SQL import
on upload, and then SQL SELECTS will make my life (and hopefully the
servers') much easier.

Jonathon



~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295027
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Dan G. Switzer, II

>1.
>User logs in and requests a file.
>
>2.
>Application reads file, and builds a Query object out of it.  Every line of
>the file is saved to the Query.
>
>3.
>A SELECT statement is performed on the Query to only get the relevant data
>for that user (cached for 30 minutes)
>
>4.
>Results of SELECT shown to user
>
>The caching was added to speed up the processing on that page, but I'm
>wondering if it's causing my memory issues.  Assuming the Query object is
>probably about the same size as the file the user reads, then I'd be
>caching
>the 200kb-5mb for every user.  Sounds great for CPU/speed performance, but
>not so good for memory conservation.  Am I off my rocker, or could this be
>the culprit?

A query object of a text file I'm sure would use more memory than just the
text file stored as a string. It also depends on how much of the cached
queries contents you're keeping around (you indicated that your doing a QoQ
and caching those results.)

That caching could definitely be the cause of the problem. I'd recommend
poking around your application and session scopes to see just how much data
you're actually caching.

Check out this post by Steve Brownlee:
http://www.fusioncube.net/?p=66

The section labeled "All ColdFusion Sessions" shows you how can get to all
the sessions on the server. I believe one of the associated SessionTracker
classes has a method that will actually allow you to determine the memory
being used by a session (but that may only be in CF8.)

-Dan


~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295022
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Re: memory issues

2007-12-18 Thread Ian Skinner

Am I off my rocker, or could this be the culprit?

If you are storing .2 to 5mb of data per user for an unknown period of time, 
yes you are using a lot of memory.

You have entered the relm of serious design where trade offs between file reads 
versus memory versus cpu time have to be weighed and considered.  For a lot of 
sites there is more computing power in a modern server then the application 
will ever need.  But when you are dealing with one as larger as yours this is 
not true and you the developer now have to consider the ramifications of code 
design.




~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295012
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-18 Thread Jonathon Stierman

Using 1.4.2_12-b03.  Not sure if that's the default JRE or not.  I'll look
into Robi's blog post.

A line-by-line file reader could definitely help -- The idea being I'd only
save into memory one line at a time and only keep the lines I want to
display to the user.  I hadn't thought of that solution!

As far as caching -- after I left the office last night, I had the idea that
might be part of the problem rather than the solution.  I didn't remember
the caching part until last night, but here's the jist of how it works:

1.
User logs in and requests a file.

2.
Application reads file, and builds a Query object out of it.  Every line of
the file is saved to the Query.

3.
A SELECT statement is performed on the Query to only get the relevant data
for that user (cached for 30 minutes)

4.
Results of SELECT shown to user

The caching was added to speed up the processing on that page, but I'm
wondering if it's causing my memory issues.  Assuming the Query object is
probably about the same size as the file the user reads, then I'd be caching
the 200kb-5mb for every user.  Sounds great for CPU/speed performance, but
not so good for memory conservation.  Am I off my rocker, or could this be
the culprit?

Jonathon



~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295006
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

Re: memory issues

2007-12-18 Thread Ian Skinner

"but why wouldn't that memory be released after the request is complete?"

Where is this data being stored?  Is there code to clear the data?  I.E. If the 
application makes use of session variables for the data, it is not going to be 
cleared until after the session times out.  That is twenty minutes by default 
but is often defined to be longer.  If one is getting two hits a second 
averaging 2 megs a hit that is ~4,800 megs or 4.8 gigs of accumulated memory in 
even twenty minutes before the first request start timing out to be cleared.

At this point, I think an investigation of the application and how it uses and 
releases memory is in order.




~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:295004
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

RE: memory issues

2007-12-18 Thread Jonathon Stierman

Thanks Dale, Dustin and Andrew!  I'll try clearing out the variables
manually and see if that helps.

Jonathon

-Original Message-
From: Andrew Scott [mailto:[EMAIL PROTECTED] 
Sent: Monday, December 17, 2007 10:48 PM
To: CF-Talk
Subject: RE: memory issues

I will second that, the one thing (and yes I will include me on this one) is
that even though the Garbage collection does a good job. Under heavy load it
is not smart enough to know what we want when we want it. And it is a trap
that most do not think about.

So in the old days of allocating memory in C/C++, it is also a good idea to
destroy a variable as soon as it is no longer needed. I am not saying all,
but at least in cases like this.

Andrew Scott
Senior Coldfusion Developer
Aegeon Pty. Ltd.
www.aegeon.com.au
Phone: +613  9015 8628
Mobile: 0404 998 273

~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:294998
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

RE: memory issues

2007-12-18 Thread Dan G. Switzer, II

Jonathon,

Robi Sen has some excellent information on memory issues like you're
experiencing:

http://www.robisen.com/index.cfm?mode=entry&entry=FD4BE2FC-55DC-F2B1-FED0717
CC1C7E0AF

Are you using the default JRE? 

If so, you might consider upgrading to JRE SDK 1.4.2_13--which I believe is
the most recent version that CF "officially" supports.

Also, prior to CF8 the  implementation for reading files was
notoriously problematic when reading large files (although it should be ok
on files from the 200K to 5MB range.)

Java is just not really good with large strings--it's always been a weakness
of the language.

You might want to consider going straight to Java to read a file
line-by-line (instead of the entire file.) Here's a UDF from CFlib that
shows reading a file by line:

http://www.cflib.org/udf.cfm?id=417&enable=1

This might help you reduce the memory needed for each request.

Lastly, make sure you're caching whatever results you can. If you're
constantly parsing the same files over and over, just cache the results once
you've generated them. There's no reason to keep doing expensive CPU
operations if it's unnecessary.

-Dan

>-Original Message-
>From: Jonathon Stierman [mailto:[EMAIL PROTECTED]
>Sent: Monday, December 17, 2007 10:58 PM
>To: CF-Talk
>Subject: memory issues
>
>An application of mine has recently been acting up -- memory has been
>shooting up at a fairly rapid pace this past week, and I'm at my wits end!
>Can't seem to find any way to fix it.  Here's the symptoms:
>
>After rebooting the CF service, memory starts out at about 60mb for the
>jrun.exe process.  After that all hell breaks loose ;)  It continues to
>consume about 4 megs a minute until it plateau's at about 590mb.  At that
>point, the server starts delivering "500 null" errors, and my
>application/exception.log files fill up with java.lang.OutOfMemoryError
>messages.
>
>The site gets a couple hits a second, and  those hits are fairly heavy in
>processing.  Most involve file-reading and then parsing that file for the
>relevant data.
>
>I have downloaded a trial version of FusionReactor and got that set up on
>the system.  If I'm reading it right, it looks like every request coming in
>is consuming large amounts of memory.  I can understand why they'd take up
>lots of memory -- each one has to read a text file that is between 200k and
>5 megs, and that seems to correlate with the memory jumps -- but why
>wouldn't that memory be released after the request is complete?  It just
>keeps piling up.
>
>Is this to be expected from high volumes of file-reading/parsing requests?
>What advice can you give for getting some of that memory free and
>available?
>
>Server monitoring and tweaking is definitely not my forte -- any help and
>knowledge will be much appreciated!
>
>TIA!
>
>Oh -- incase the box info helps.  It's a Windows Server 2003 dedicated
>server, running CFMX7 Standard.
>
>Jonathon
>
>
>
>

~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:294990
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-17 Thread Jim Davis

> -Original Message-
> From: Dustin M. Snell [mailto:[EMAIL PROTECTED]
> Sent: Monday, December 17, 2007 11:44 PM
> To: CF-Talk
> Subject: Re: memory issues
> 
> We have the same issue. Sometimes jrun freezes as well. I suspect
> though that it may not be a problem (the memory usage) as it may just
> be set up to use all available memory for speed (caching etc) just
> like .net, SQL server and vista. But if there is a shortage they may
> "give back". I have no proof of this however. So give it lots of ram.
> It's cheap enough these days.

This is common of Enterprise apps - there's an unspoken assumption that
resources are there for "you" (the app) so many apps (CF included) tend to
grab resources early and hold on longer than they might (the assumption
being "I needed it once...")

As others have noted explicitly destroying variables when you're done with
them can provide much needed "hint" to virtual machine.  Remember that Java
Garbage Collection doesn't run constantly - only once in awhile (it tries to
wait for slow times -it may only run every few minutes).

Also look at your machine: does it have enough RAM?  If so is CF/Java able
to use it?  If you're getting Java "out of memory" errors on a machine
that's otherwise running fine (and has memory to spare) you might want to
try and give Java more space.

The setting you want is in the CF Admin and is "Heap Size".  Here's a decent
article that goes over the background of the issue and how to think about it
for CF apps:

http://labs.fusionlink.com/katapult/index.cfm?page=articles/jvmtuning

Considering your application - which is kind of odd in this space and
probably needs to be tuned very differently that the assumed defaults - you
wants lots of RAM (to store all those documents in memory) and you want to
increase the heap size so that Java can use the memory.

Definitely look at your app and consider ways to decrease the space needed
per session, but also make sure that you're using the resources you have -
there's no point in crashing with "out of memory" when there might be
another Gig of RAM sitting idle just because of a stupid setting in the
admin.  ;^)

Jim Davis


~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:294982
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: memory issues

2007-12-17 Thread Andrew Scott

I will second that, the one thing (and yes I will include me on this one) is
that even though the Garbage collection does a good job. Under heavy load it
is not smart enough to know what we want when we want it. And it is a trap
that most do not think about.

So in the old days of allocating memory in C/C++, it is also a good idea to
destroy a variable as soon as it is no longer needed. I am not saying all,
but at least in cases like this.



Andrew Scott
Senior Coldfusion Developer
Aegeon Pty. Ltd.
www.aegeon.com.au
Phone: +613  9015 8628
Mobile: 0404 998 273



-Original Message-
From: Dale Fraser [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, 18 December 2007 3:42 PM
To: CF-Talk
Subject: RE: memory issues

Try destroying the variables afterwards.

Ie if variable is fileContents

Do a 


Regards
Dale Fraser

http://learncf.com

-Original Message-
From: Jonathon Stierman [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, 18 December 2007 2:58 PM
To: CF-Talk
Subject: memory issues

An application of mine has recently been acting up -- memory has been
shooting up at a fairly rapid pace this past week, and I'm at my wits end!
Can't seem to find any way to fix it.  Here's the symptoms:

After rebooting the CF service, memory starts out at about 60mb for the
jrun.exe process.  After that all hell breaks loose ;)  It continues to
consume about 4 megs a minute until it plateau's at about 590mb.  At that
point, the server starts delivering "500 null" errors, and my
application/exception.log files fill up with java.lang.OutOfMemoryError
messages.

The site gets a couple hits a second, and  those hits are fairly heavy in
processing.  Most involve file-reading and then parsing that file for the
relevant data.  

I have downloaded a trial version of FusionReactor and got that set up on
the system.  If I'm reading it right, it looks like every request coming in
is consuming large amounts of memory.  I can understand why they'd take up
lots of memory -- each one has to read a text file that is between 200k and
5 megs, and that seems to correlate with the memory jumps -- but why
wouldn't that memory be released after the request is complete?  It just
keeps piling up.

Is this to be expected from high volumes of file-reading/parsing requests?
What advice can you give for getting some of that memory free and available?

Server monitoring and tweaking is definitely not my forte -- any help and
knowledge will be much appreciated!

TIA!

Oh -- incase the box info helps.  It's a Windows Server 2003 dedicated
server, running CFMX7 Standard.

Jonathon







~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:294977
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

Re: memory issues

2007-12-17 Thread Dustin M. Snell

We have the same issue. Sometimes jrun freezes as well. I suspect  
though that it may not be a problem (the memory usage) as it may just  
be set up to use all available memory for speed (caching etc) just  
like .net, SQL server and vista. But if there is a shortage they may  
"give back". I have no proof of this however. So give it lots of ram.  
It's cheap enough these days.

Composed via iPhone. Please forgive typos.

On Dec 17, 2007, at 7:58 PM, "Jonathon Stierman" <[EMAIL PROTECTED]>  
wrote:

> An application of mine has recently been acting up -- memory has been
> shooting up at a fairly rapid pace this past week, and I'm at my  
> wits end!
> Can't seem to find any way to fix it.  Here's the symptoms:
>
> After rebooting the CF service, memory starts out at about 60mb for  
> the
> jrun.exe process.  After that all hell breaks loose ;)  It continues  
> to
> consume about 4 megs a minute until it plateau's at about 590mb.  At  
> that
> point, the server starts delivering "500 null" errors, and my
> application/exception.log files fill up with  
> java.lang.OutOfMemoryError
> messages.
>
> The site gets a couple hits a second, and  those hits are fairly  
> heavy in
> processing.  Most involve file-reading and then parsing that file  
> for the
> relevant data.
>
> I have downloaded a trial version of FusionReactor and got that set  
> up on
> the system.  If I'm reading it right, it looks like every request  
> coming in
> is consuming large amounts of memory.  I can understand why they'd  
> take up
> lots of memory -- each one has to read a text file that is between  
> 200k and
> 5 megs, and that seems to correlate with the memory jumps -- but why
> wouldn't that memory be released after the request is complete?  It  
> just
> keeps piling up.
>
> Is this to be expected from high volumes of file-reading/parsing  
> requests?
> What advice can you give for getting some of that memory free and  
> available?
>
> Server monitoring and tweaking is definitely not my forte -- any  
> help and
> knowledge will be much appreciated!
>
> TIA!
>
> Oh -- incase the box info helps.  It's a Windows Server 2003 dedicated
> server, running CFMX7 Standard.
>
> Jonathon
>
>
>
> 

~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:294976
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

RE: memory issues

2007-12-17 Thread Dale Fraser

Try destroying the variables afterwards.

Ie if variable is fileContents

Do a 


Regards
Dale Fraser

http://learncf.com

-Original Message-
From: Jonathon Stierman [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, 18 December 2007 2:58 PM
To: CF-Talk
Subject: memory issues

An application of mine has recently been acting up -- memory has been
shooting up at a fairly rapid pace this past week, and I'm at my wits end!
Can't seem to find any way to fix it.  Here's the symptoms:

After rebooting the CF service, memory starts out at about 60mb for the
jrun.exe process.  After that all hell breaks loose ;)  It continues to
consume about 4 megs a minute until it plateau's at about 590mb.  At that
point, the server starts delivering "500 null" errors, and my
application/exception.log files fill up with java.lang.OutOfMemoryError
messages.

The site gets a couple hits a second, and  those hits are fairly heavy in
processing.  Most involve file-reading and then parsing that file for the
relevant data.  

I have downloaded a trial version of FusionReactor and got that set up on
the system.  If I'm reading it right, it looks like every request coming in
is consuming large amounts of memory.  I can understand why they'd take up
lots of memory -- each one has to read a text file that is between 200k and
5 megs, and that seems to correlate with the memory jumps -- but why
wouldn't that memory be released after the request is complete?  It just
keeps piling up.

Is this to be expected from high volumes of file-reading/parsing requests?
What advice can you give for getting some of that memory free and available?

Server monitoring and tweaking is definitely not my forte -- any help and
knowledge will be much appreciated!

TIA!

Oh -- incase the box info helps.  It's a Windows Server 2003 dedicated
server, running CFMX7 Standard.

Jonathon





~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:294975
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

RE: Memory issues with new daylight savings update?

2007-04-02 Thread Jim Curran

This wound up being the culprit (we think)

http://www.adobe.com/cfusion/knowledgebase/index.cfm?id=kb401239

We also rolled back to _11 as well.  Thanks everyone.

- j


Jim Curran
President
 
Nylon Technology
350 7th Avenue, 10th Floor
New York, NY 10001
 
212.691.1134 x11 direct
212.691.3477 fax
[EMAIL PROTECTED]
www.nylontechnology.com

-Original Message-
From: Ben Nadel [mailto:[EMAIL PROTECTED] 
Sent: Monday, April 02, 2007 5:50 PM
To: CF-Talk
Subject: RE: Memory issues with new daylight savings update?

Hmmm, I did not set up the server or install the patches (and do not
understand the server stuff). I will run this by my manager see if he
can make more sense of it.  

Thanks for you input. 


-Original Message-
From: Robertson-Ravo, Neil (RX)
[mailto:[EMAIL PROTECTED]
Sent: Monday, April 02, 2007 5:37 PM
To: CF-Talk
Subject: Re: Memory issues with new daylight savings update?

Well, as we all know.. 1.4.2_11 is the latest supported JVM I think?

How do you mean updated it via the 7.0.2 update?



~|
Macromedia ColdFusion MX7
Upgrade to MX7 & experience time-saving features, more productivity.
http://www.adobe.com/products/coldfusion?sdid=RVJW

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:274381
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

RE: Memory issues with new daylight savings update?

2007-04-02 Thread Ben Nadel

Hmmm, I did not set up the server or install the patches (and do not
understand the server stuff). I will run this by my manager see if he
can make more sense of it.  

Thanks for you input. 


-Original Message-
From: Robertson-Ravo, Neil (RX)
[mailto:[EMAIL PROTECTED] 
Sent: Monday, April 02, 2007 5:37 PM
To: CF-Talk
Subject: Re: Memory issues with new daylight savings update?

Well, as we all know.. 1.4.2_11 is the latest supported JVM I think?

How do you mean updated it via the 7.0.2 update?

~|
Upgrade to Adobe ColdFusion MX7
The most significant release in over 10 years. Upgrade & see new features.
http://www.adobe.com/products/coldfusion?sdid=RVJR

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:274365
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Re: Memory issues with new daylight savings update?

2007-04-02 Thread Robertson-Ravo, Neil (RX)

Well, as we all know.. 1.4.2_11 is the latest supported JVM I think?

How do you mean updated it via the 7.0.2 update?



 
"This e-mail is from Reed Exhibitions (Gateway House, 28 The Quadrant,
Richmond, Surrey, TW9 1DN, United Kingdom), a division of Reed Business,
Registered in England, Number 678540.  It contains information which is
confidential and may also be privileged.  It is for the exclusive use of the
intended recipient(s).  If you are not the intended recipient(s) please note
that any form of distribution, copying or use of this communication or the
information in it is strictly prohibited and may be unlawful.  If you have
received this communication in error please return it to the sender or call
our switchboard on +44 (0) 20 89107910.  The opinions expressed within this
communication are not necessarily those expressed by Reed Exhibitions." 
Visit our website at http://www.reedexpo.com

-Original Message-
From: Ben Nadel
To: CF-Talk
Sent: Mon Apr 02 21:45:35 2007
Subject: Memory issues with new daylight savings update?

Hey all, lately, our server has been having some serious memory issues.
We will get a lot of requests (which is normal) and the server can
handle them... then, all of a sudden, it seems to choke and the requests
start to queue up and the memory (monitoring in SeeFusion) maxes out and
will not come down even when the requests die down. We cannot figure out
what is going on as we have not done anything special lately.
 
We thought maybe it was the JVM that was updated for the Daylight
savings time. Has anyone noticed any memory issues after this update?
 
Our JVM is 1.4.2_12  and we didn't have any of these problems until we
upgraded the JVM using updater 7.02.
 
Thanks!

...
Ben Nadel
Certified Advanced ColdFusion Developer
Nylon Technology
350 7th Avenue 
Floor 10 
New York, NY 10001
212.691.1134 x 14
212.691.3477 fax
www.nylontechnology.com  




~|
Deploy Web Applications Quickly across the enterprise with ColdFusion MX7 & 
Flex 2
Free Trial 
http://www.adobe.com/products/coldfusion/flex2/?sdid=RVJU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:274363
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Re: Memory issues in a shared environemt

2007-01-24 Thread Matthew Williams

I agree, but I didn't write it, I just administer the servers it resides 
on ;).  I'm just looking for confirmation that I can go back to the 
developer with a little fodder to hold their feet under the fire with.

Matthew Williams

Russ wrote:
> Well it might sound obvious, but you don't want to store a lot of data in a
> session scope.  Ideally, the query should return the resultset and it should
> go into the request or variables scope, and be released after the request
> ends.  If you are retrieving a large amount of information, you might want
> to ask yourself if all the information is needed at a time, or if some sort
> of pagination strategy is necessary. 
>
> Russ
>
>
>
>   
>> -Original Message-
>> From: Matthew Williams [mailto:[EMAIL PROTECTED]
>> Sent: Tuesday, January 23, 2007 11:26 PM
>> To: CF-Talk
>> Subject: Memory issues in a shared environemt
>>
>> So, my environment stands as such:
>>
>> 7 servers, 7 clusters, and 17 CF instances.  Half have been migrated to
>> CF7, the other half are on CF6 (destined to be migrated shortly). The
>> clusters all use J2EE sessions for failover.
>>
>> I'm having issues in one of the CF7 clusters.  Due to limitations with our
>> networking setup (no multicast allowed across subnets), I've been limited
>> to just one clustered instance of CF for 50+ applications.  This is being
>> addressed tomorrow (yay!), but it's been delayed due to issues with
>> policy, rules, etc.
>>
>> I've finally gotten licenses and permission to install FusionReactor, and
>> I put it in place on all servers this past weekend.  I also took the
>> liberty of installing the JDBC wrapper provided by FusionReactor to get a
>> better idea of what our... uh, "intensive" apps are doing.  I noticed a
>> HUGE spike in memory usage today, and when I checked, one of our apps had
>> taken 40 seconds to complete its request, of which 21 seconds were
>> strictly database related, and used several hundred megs of memory.  The
>> result set returned was over 100k records.  I'm not sure if this got
>> loaded into a shared memory scope, but it might explain why session
>> replication is failing constantly.
>>
>> So, does anyone have a "Best Practice" for the amount of results that
>> should be returned into a shared environment?  I'm thinking at this point
>> that there is very little need to work with more than 1000 records at a
>> given time (at least within ColdFusion... if data manipulation is
>> required, that's why stored procedures and functions exist in Oracle).
>> Now, with the datasource wrapper within the FusionReactor JDBC calls, I
>> CAN limit the amount of information received by ColdFusion.  I just need
>> to get another set of eyes on this before I present it as a policy change.
>>
>> Matthew Williams
>>
>>
>> 
>
> 

~|
Upgrade to Adobe ColdFusion MX7 
Experience Flex 2 & MX7 integration & create powerful cross-platform RIAs 
http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:267452
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Re: Memory issues in a shared environemt

2007-01-24 Thread Matthew Williams

It's not really JRun's fault in this instance.  Our networking group 
blocks multicast across subnets, so the traffic is cut off.  I get the 
fact that it's one of the main reasons to have multiple subnets, but 
it's a pain.  JRun will work fine, so long as the security.properties 
file is edited to reflect the search across subnets.

Matthew Williams

 AJ Mercer wrote:
> Hi Matthew,
>
> could you explain to me what the issue is with multicast across subnets?
>
> We have clustering across two servers which are on different subnets. CF
> lets you set up the cluster without any problems, but the instances on the
> server on the other subnet are not being used.
>
> Thank you.
>
>
> On 1/24/07, Matthew Williams <[EMAIL PROTECTED]> wrote:
>   
>> So, my environment stands as such:
>>
>> 7 servers, 7 clusters, and 17 CF instances.  Half have been migrated to
>> CF7, the other half are on CF6 (destined to be migrated shortly). The
>> clusters all use J2EE sessions for failover.
>>
>> I'm having issues in one of the CF7 clusters.  Due to limitations with our
>> networking setup (no multicast allowed across subnets), I've been limited to
>> just one clustered instance of CF for 50+ applications.  This is being
>> addressed tomorrow (yay!), but it's been delayed due to issues with policy,
>> rules, etc.
>>
>> I've finally gotten licenses and permission to install FusionReactor, and
>> I put it in place on all servers this past weekend.  I also took the liberty
>> of installing the JDBC wrapper provided by FusionReactor to get a better
>> idea of what our... uh, "intensive" apps are doing.  I noticed a HUGE spike
>> in memory usage today, and when I checked, one of our apps had taken 40
>> seconds to complete its request, of which 21 seconds were strictly database
>> related, and used several hundred megs of memory.  The result set returned
>> was over 100k records.  I'm not sure if this got loaded into a shared memory
>> scope, but it might explain why session replication is failing constantly.
>>
>> So, does anyone have a "Best Practice" for the amount of results that
>> should be returned into a shared environment?  I'm thinking at this point
>> that there is very little need to work with more than 1000 records at a
>> given time (at least within ColdFusion... if data manipulation is required,
>> that's why stored procedures and functions exist in Oracle).  Now, with the
>> datasource wrapper within the FusionReactor JDBC calls, I CAN limit the
>> amount of information received by ColdFusion.  I just need to get another
>> set of eyes on this before I present it as a policy change.
>>
>> Matthew Williams
>>
>>
>> 
>
> 

~|
Upgrade to Adobe ColdFusion MX7 
Experience Flex 2 & MX7 integration & create powerful cross-platform RIAs 
http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:267451
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Re: Memory issues in a shared environemt

2007-01-24 Thread Jochem van Dieten

AJ Mercer wrote:
> 
> could you explain to me what the issue is with multicast across subnets?

http://www.adobe.com/cfusion/knowledgebase/index.cfm?id=1e8e9170

Jochem

~|
Upgrade to Adobe ColdFusion MX7 
Experience Flex 2 & MX7 integration & create powerful cross-platform RIAs 
http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:267443
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

Re: Memory issues in a shared environemt

2007-01-24 Thread AJ Mercer

Hi Matthew,

could you explain to me what the issue is with multicast across subnets?

We have clustering across two servers which are on different subnets. CF
lets you set up the cluster without any problems, but the instances on the
server on the other subnet are not being used.

Thank you.


On 1/24/07, Matthew Williams <[EMAIL PROTECTED]> wrote:
>
> So, my environment stands as such:
>
> 7 servers, 7 clusters, and 17 CF instances.  Half have been migrated to
> CF7, the other half are on CF6 (destined to be migrated shortly). The
> clusters all use J2EE sessions for failover.
>
> I'm having issues in one of the CF7 clusters.  Due to limitations with our
> networking setup (no multicast allowed across subnets), I've been limited to
> just one clustered instance of CF for 50+ applications.  This is being
> addressed tomorrow (yay!), but it's been delayed due to issues with policy,
> rules, etc.
>
> I've finally gotten licenses and permission to install FusionReactor, and
> I put it in place on all servers this past weekend.  I also took the liberty
> of installing the JDBC wrapper provided by FusionReactor to get a better
> idea of what our... uh, "intensive" apps are doing.  I noticed a HUGE spike
> in memory usage today, and when I checked, one of our apps had taken 40
> seconds to complete its request, of which 21 seconds were strictly database
> related, and used several hundred megs of memory.  The result set returned
> was over 100k records.  I'm not sure if this got loaded into a shared memory
> scope, but it might explain why session replication is failing constantly.
>
> So, does anyone have a "Best Practice" for the amount of results that
> should be returned into a shared environment?  I'm thinking at this point
> that there is very little need to work with more than 1000 records at a
> given time (at least within ColdFusion... if data manipulation is required,
> that's why stored procedures and functions exist in Oracle).  Now, with the
> datasource wrapper within the FusionReactor JDBC calls, I CAN limit the
> amount of information received by ColdFusion.  I just need to get another
> set of eyes on this before I present it as a policy change.
>
> Matthew Williams
>
> 

~|
Upgrade to Adobe ColdFusion MX7 
Experience Flex 2 & MX7 integration & create powerful cross-platform RIAs 
http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:267441
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: Memory issues in a shared environemt

2007-01-23 Thread Russ

Well it might sound obvious, but you don't want to store a lot of data in a
session scope.  Ideally, the query should return the resultset and it should
go into the request or variables scope, and be released after the request
ends.  If you are retrieving a large amount of information, you might want
to ask yourself if all the information is needed at a time, or if some sort
of pagination strategy is necessary. 

Russ



> -Original Message-
> From: Matthew Williams [mailto:[EMAIL PROTECTED]
> Sent: Tuesday, January 23, 2007 11:26 PM
> To: CF-Talk
> Subject: Memory issues in a shared environemt
> 
> So, my environment stands as such:
> 
> 7 servers, 7 clusters, and 17 CF instances.  Half have been migrated to
> CF7, the other half are on CF6 (destined to be migrated shortly). The
> clusters all use J2EE sessions for failover.
> 
> I'm having issues in one of the CF7 clusters.  Due to limitations with our
> networking setup (no multicast allowed across subnets), I've been limited
> to just one clustered instance of CF for 50+ applications.  This is being
> addressed tomorrow (yay!), but it's been delayed due to issues with
> policy, rules, etc.
> 
> I've finally gotten licenses and permission to install FusionReactor, and
> I put it in place on all servers this past weekend.  I also took the
> liberty of installing the JDBC wrapper provided by FusionReactor to get a
> better idea of what our... uh, "intensive" apps are doing.  I noticed a
> HUGE spike in memory usage today, and when I checked, one of our apps had
> taken 40 seconds to complete its request, of which 21 seconds were
> strictly database related, and used several hundred megs of memory.  The
> result set returned was over 100k records.  I'm not sure if this got
> loaded into a shared memory scope, but it might explain why session
> replication is failing constantly.
> 
> So, does anyone have a "Best Practice" for the amount of results that
> should be returned into a shared environment?  I'm thinking at this point
> that there is very little need to work with more than 1000 records at a
> given time (at least within ColdFusion... if data manipulation is
> required, that's why stored procedures and functions exist in Oracle).
> Now, with the datasource wrapper within the FusionReactor JDBC calls, I
> CAN limit the amount of information received by ColdFusion.  I just need
> to get another set of eyes on this before I present it as a policy change.
> 
> Matthew Williams
> 
> 

~|
Upgrade to Adobe ColdFusion MX7 
Experience Flex 2 & MX7 integration & create powerful cross-platform RIAs 
http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:267432
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

RE: Memory Issues

2004-08-21 Thread Hugo Ahlenius

|From: Tom Kitta [mailto:[EMAIL PROTECTED]
|I have had memory problems with CF MX 6.1 running on Unix box,
|while on Windows box it was running fine. I placed my findings
|on my blog at http://www.tomkitta.com/blog/index.cfm
|I am not 100% sure that my conclusions are right, but please
|take a look at the symptoms of my problem.

Tom, I am not able to find the info on your blog, do you have direct
link to the article?

|In short, CF MX 6.1 "leaks" memory in Unix while it collects
|it just fine in Windows. I am not skilled enough in Java to do
|too much with it, I may try some stuff that I have found on
|http://www.petefreitag.com/ and see how it goes.

Its not CFMX that is the bad, or is it -- isn't it Jrun?

/Hugo

###

This message has been scanned by F-Secure Anti-Virus for Microsoft
Exchange.
For more information, connect to http://www.F-Secure.com/
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-20 Thread Tom Kitta

I have had memory problems with CF MX 6.1 running on Unix box, while on Windows box it was running fine. I placed my findings on my blog at http://www.tomkitta.com/blog/index.cfm 
I am not 100% sure that my conclusions are right, but please take a look at the symptoms of my problem.

In short, CF MX 6.1 "leaks" memory in Unix while it collects it just fine in Windows. I am not skilled enough in Java to do too much with it, I may try some stuff that I have found on http://www.petefreitag.com/ and see how it goes.

TK
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-20 Thread Pete Freitag

Christian Watt wrote:

> Pete,
> So far this is what I have come up with.  Macromedia has had me
> running OptimizeIt from Borland.  I do not see any classes increasing in
> there memory consumption.  The only common thread I can see right now is
> that when the memory jump, Old Gen GC jumps as well.  Once the Old Gen
> returns to a normal level, the memory does not.
> Example:
> Memory : 125mb
> Old Gen: 10MB
> Spike
> Memory: 806mb
> Old Gen: 231mb
> ---Old Gen Returns
> Memory: 620mb
> Old Gen: 8mb

I think what may be going on here is that the JVM is just performing less GC's becuase it thinks it doesn't need to. What happens is the heap expands to 800mb or more during the traffic spike, then when things settle down it has all this memory avaliable, so it becomes less aggressive when it garbage collects. The garbage collector will only run when you need more memory on some GC algorithms. I would guess that it still has 800mb allocated in virtual memory space, in the third stage. 

This is where your max heap size setting comes, if you have it set to 800mb the server may hang out at around 80% of that max heap size (depending on your settings) of this after being maxed. So if your not comfortable with your server taking up that much ram, you should lower your max heap size. 

One thing you can try when you get to your third state there is to run the invoke garbage collector by hand, eg:

See if that free's the memory, if not then that means that there are references to 600mb of objects, in which case I would suggest taking a look at your application, and making sure your not doing anything that would consume a lot of ram. I don't think your doing any heavy long term caching because your old gen size is small.

I don't think its very likley that there is a bug in the JVM causing memory not to be free'd, as that would be a major bug.

__
Pete Freitag
http://www.cfdev.com/
Author of the CFMX Developers Cookbook
http://www.petefreitag.com/bookshelf/
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-20 Thread Christian Watt

Pete,
    So far this is what I have come up with.  Macromedia has had me
running OptimizeIt from Borland.  I do not see any classes increasing in
there memory consumption.  The only common thread I can see right now is
that when the memory jump, Old Gen GC jumps as well.  Once the Old Gen
returns to a normal level, the memory does not. 
Example:
Memory : 125mb
Old Gen: 10MB
Spike
Memory: 806mb
Old Gen: 231mb
---Old Gen Returns
Memory: 620mb
Old Gen: 8mb

 
This is the only common thread.  Could there be an issue with the
garbage collector not actually releasing the memory???

	-Original Message-
	From: Pete Freitag [mailto:[EMAIL PROTECTED] 
	Sent: Thursday, August 19, 2004 10:53 AM
	To: CF-Talk
	Subject: Re: Memory Issues
	
	
	Christian Watt wrote:
	
	> What is the default setting for the -XX:ParallelGCThreads and
what
	> increments should I try increasing these?
	
	Look at section 4.1 and 4.2 of
http://www.petefreitag.com/articles/gctuning/
	
	"By default the throughput collector uses the number of CPU's as
its value for number of GC threads."
	
	I would increment by 1's, keeping in mind that you may cause
more overhead than your saving by increasing this value. I probably
wouldn't go much past 2x number of CPU's
	
	__
	Pete Freitag
	http://www.cfdev.com/
	Author of the CFMX Developers Cookbook
	http://www.petefreitag.com/bookshelf/ 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-20 Thread Christian Watt

Has anybody out there used the Borland OptimizeIt???  Macromedia support
has me running this trying to figure out my memory issue, but they are
not very familiar with it, and honestly, I don't have a clue.  If
someone out there does, please contact me off list.

 
[EMAIL PROTECTED]

 
Christian 

	-Original Message-
	From: Pete Freitag [mailto:[EMAIL PROTECTED] 
	Sent: Thursday, August 19, 2004 10:53 AM
	To: CF-Talk
	Subject: Re: Memory Issues
	
	
	Christian Watt wrote:
	
	> What is the default setting for the -XX:ParallelGCThreads and
what
	> increments should I try increasing these?
	
	Look at section 4.1 and 4.2 of
http://www.petefreitag.com/articles/gctuning/
	
	"By default the throughput collector uses the number of CPU's as
its value for number of GC threads."
	
	I would increment by 1's, keeping in mind that you may cause
more overhead than your saving by increasing this value. I probably
wouldn't go much past 2x number of CPU's
	
	__
	Pete Freitag
	http://www.cfdev.com/
	Author of the CFMX Developers Cookbook
	http://www.petefreitag.com/bookshelf/ 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-19 Thread Christian Watt

Yes and Yes.  Each user is creating individual client sessions, since I
have session and application turned off, and it ramps up, sustains, and
they have a varying time of 30 seconds-2 minutes on a page.  I could go
longer, but I really wanted to push the machine.

 
Christian

	-Original Message-
	From: Dave Watts [mailto:[EMAIL PROTECTED] 
	Sent: Thursday, August 19, 2004 11:16 AM
	To: CF-Talk
	Subject: RE: Memory Issues
	
	
	> I ran the load test with 150 users over a 30 minute period and
	> everything ran smooth. This morning I am only seeing around
10-15
	> simultaneous users and having issues. This is really getting
	> frustrating!
	
	Are you allowing your load test virtual users to pause between
requests? Are
	you running your load test along the same network path used by
external
	application users?
	
	Dave Watts, CTO, Fig Leaf Software
	http://www.figleaf.com/
	phone: 202-797-5496
	fax: 202-797-5444 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-19 Thread Dave Watts

> I ran the load test with 150 users over a 30 minute period and
> everything ran smooth. This morning I am only seeing around 10-15
> simultaneous users and having issues. This is really getting
> frustrating!

Are you allowing your load test virtual users to pause between requests? Are
you running your load test along the same network path used by external
application users?

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
phone: 202-797-5496
fax: 202-797-5444
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-19 Thread Pete Freitag

Christian Watt wrote:

> What is the default setting for the -XX:ParallelGCThreads and what
> increments should I try increasing these?

Look at section 4.1 and 4.2 of http://www.petefreitag.com/articles/gctuning/

"By default the throughput collector uses the number of CPU's as its value for number of GC threads."

I would increment by 1's, keeping in mind that you may cause more overhead than your saving by increasing this value. I probably wouldn't go much past 2x number of CPU's

__
Pete Freitag
http://www.cfdev.com/
Author of the CFMX Developers Cookbook
http://www.petefreitag.com/bookshelf/
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-19 Thread Christian Watt

Peter,
    No joy on increasing the young generation.  I set it to
-XX:NewRatio=3 and I added the -XX:+AggressiveHeap on the machine that
has 2 procs with hyper-threading.  No cpu issues until the memory
exceeds the 750mb mark and the Old Gen in JVMSTAT explodes at the same
time.  I did a Load test against the machines last night after making
these changes and adding the reconditions on the Forum article:
http://www.macromedia.com/cfusion/webforums/forum/messageview.cfm?catid=
69&threadid=856745

 
I ran the load test with 150 users over a 30 minute period and
everything ran smooth.  This morning I am only seeing around 10-15
simultaneous users and having issues.  This is really getting
frustrating!

 
Christian

	-Original Message-
	From: Pete Freitag [mailto:[EMAIL PROTECTED] 
	Sent: Wednesday, August 18, 2004 3:11 PM
	To: CF-Talk
	Subject: Re: Memory Issues
	
	
	Christian Watt wrote:
	
	> Peter,  the Old Generation garbage collection was over 500mb.
I have a
	> screen shot and logs with a stack trace dump, but I don't know
what to
	> do from here.  Will you take a look or can you tell me who can
help???
	> As soon as I restart the service, via command prompt right now
so that I
	> can watch gc, the memory immediately explodes again.  But
These logs and
	> gc graph do show a complete lockup.
	>
	Christian,
	
	It sounds like your young generation is too small then. You may
want to play with increasing its size. Also if you have multiple CPU's
and they are not too busy you might want to increase
-XX:ParallelGCThreads
	
	You should also read these articles before playing so you
understand what your doing:
	http://www.petefreitag.com/articles/gctuning/
	http://www.petefreitag.com/item/139.cfm
	
	__
	Pete Freitag
	http://www.cfdev.com/
	Author of the CFMX Developers Cookbook
	http://www.petefreitag.com/bookshelf/ 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-19 Thread Christian Watt

What is the default setting for the -XX:ParallelGCThreads and what
increments should I try increasing these?

 
Christian

	-Original Message-
	From: Pete Freitag [mailto:[EMAIL PROTECTED] 
	Sent: Wednesday, August 18, 2004 3:11 PM
	To: CF-Talk
	Subject: Re: Memory Issues
	
	
	Christian Watt wrote:
	
	> Peter,  the Old Generation garbage collection was over 500mb.
I have a
	> screen shot and logs with a stack trace dump, but I don't know
what to
	> do from here.  Will you take a look or can you tell me who can
help???
	> As soon as I restart the service, via command prompt right now
so that I
	> can watch gc, the memory immediately explodes again.  But
These logs and
	> gc graph do show a complete lockup.
	>
	Christian,
	
	It sounds like your young generation is too small then. You may
want to play with increasing its size. Also if you have multiple CPU's
and they are not too busy you might want to increase
-XX:ParallelGCThreads
	
	You should also read these articles before playing so you
understand what your doing:
	http://www.petefreitag.com/articles/gctuning/
	http://www.petefreitag.com/item/139.cfm
	
	__
	Pete Freitag
	http://www.cfdev.com/
	Author of the CFMX Developers Cookbook
	http://www.petefreitag.com/bookshelf/ 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-18 Thread Pete Freitag

Christian Watt wrote:

> Peter,  the Old Generation garbage collection was over 500mb.  I have a
> screen shot and logs with a stack trace dump, but I don't know what to
> do from here.  Will you take a look or can you tell me who can help???
> As soon as I restart the service, via command prompt right now so that I
> can watch gc, the memory immediately explodes again.  But These logs and
> gc graph do show a complete lockup.
>
Christian,

It sounds like your young generation is too small then. You may want to play with increasing its size. Also if you have multiple CPU's and they are not too busy you might want to increase -XX:ParallelGCThreads

You should also read these articles before playing so you understand what your doing:
http://www.petefreitag.com/articles/gctuning/
http://www.petefreitag.com/item/139.cfm

__
Pete Freitag
http://www.cfdev.com/
Author of the CFMX Developers Cookbook
http://www.petefreitag.com/bookshelf/
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-18 Thread Christian Watt

Peter,  the Old Generation garbage collection was over 500mb.  I have a
screen shot and logs with a stack trace dump, but I don't know what to
do from here.  Will you take a look or can you tell me who can help???
As soon as I restart the service, via command prompt right now so that I
can watch gc, the memory immediately explodes again.  But These logs and
gc graph do show a complete lockup.

 
Christian

	-Original Message-
	From: Peter Farrell [mailto:[EMAIL PROTECTED] 
	Sent: Wednesday, August 18, 2004 10:44 AM
	To: CF-Talk
	Subject: Re: Memory Issues
	
	
	Check this out:
	
http://www-106.ibm.com/developerworks/java/library/j-garbage-collection.
html
	
	Are you running JRUN with Updater 3? 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-18 Thread Christian Watt

I have read articles much like this before.  With the other log I am
currently outputting, I am using JVMSTAT right now to watch garbage
collection and see if I see any similarities.  Is there anything else
you or someone else knows of that I should be looking for???

	-Original Message-
	From: Peter Farrell [mailto:[EMAIL PROTECTED] 
	Sent: Wednesday, August 18, 2004 10:44 AM
	To: CF-Talk
	Subject: Re: Memory Issues

	Check this out:

http://www-106.ibm.com/developerworks/java/library/j-garbage-collection.
html

	Are you running JRUN with Updater 3? 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-18 Thread Christian Watt

No, right now I have it set at 750mb.  Although I have had it just over
a gig, but it does not matter how high I set it, eventually it still
surpasses that limit and locks up.

 
Christian

	-Original Message-
	From: Peter Farrell [mailto:[EMAIL PROTECTED] 
	Sent: Wednesday, August 18, 2004 10:19 AM
	To: CF-Talk
	Subject: Re: Memory Issues
	
	
	Christian, What's your max memory heap size?  Is it over 1.8 GB?
	
	.pjf
	maepub 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-18 Thread Peter Farrell

Check this out:
http://www-106.ibm.com/developerworks/java/library/j-garbage-collection.html

Are you running JRUN with Updater 3?
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-18 Thread Peter Farrell

Christian, What's your max memory heap size?  Is it over 1.8 GB?

.pjf
maepub
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-17 Thread Christian Watt

Peter, thank you so much for that link.  Although that does not seem to
quite be my problem, it has pointed out some metrics that I have used,
along with some others that I have found that have a direct correlation
to my memory explosion.  I am going to include an excerpt from my
current post in the forums so that anybody here that may have seen this
before, or have any idea where to go from here can help as well.  Anyone
that helps solve the issue, I'll have a beer, or stronger, waiting for
you at DEVCON :-)

[Metrics out below]

As you can see, I am not getting the scheduler thread drop, but my
memory jumps from @150mb to over 500mb within a few seconds and then if
you look at the proxy output, the DelayHighCon (Requests delayed due to
high concurrency, {delayRq}) jumps as well. I can not see any rhyme or
reason to the numbers either. Sometimes I'll have 35 busy, and 12
delayed, sometimes 5 busy and 40 delayed, and sometimes 8 busy and 4
delayed. Is there somewhere else I should be looking???  What in the
world would cause activity like this to happen.  We obviously are not
looking at very many users here, although I will get well over 100
simultaneous users with no issue at all at times as well.

-08/17 14:55:35 metrics Web threads (busy/total): 12/14 Sessions: 0
Total Memory=651968 Free=186794 scheduler.listen=3 delay=0 idle=0 busy=5
total=8 delayed=0 dropped=0 delayedMs=0
Proxy- Threads listening:1 Idle:1 Delayed:0 Busy:12 Total:14
DelayHighCon:0 Dropped:0 Handled:6 HandledMS:62080 DelayMS:0
-08/17 14:56:45 metrics Web threads (busy/total): 25/34 Sessions: 0
Total Memory=523840 Free=177783 scheduler.listen=6 delay=0 idle=0 busy=2
total=8 delayed=0 dropped=0 delayedMs=0
Proxy- Threads listening:1 Idle:1 Delayed:7 Busy:25 Total:34
DelayHighCon:5 Dropped:0 Handled:9 HandledMS:514610 DelayMS:845
-08/17 14:57:52 metrics Web threads (busy/total): 22/38 Sessions: 0
Total Memory=542016 Free=172856 scheduler.listen=5 delay=0 idle=0 busy=3
total=8 delayed=0 dropped=0 delayedMs=0
Proxy- Threads listening:1 Idle:15 Delayed:0 Busy:22 Total:38
DelayHighCon:35 Dropped:0 Handled:31 HandledMS:1728081 DelayMS:318266
-08/17 14:58:52 metrics Web threads (busy/total): 6/38 Sessions: 0 Total
Memory=560512 Free=155782 scheduler.listen=2 delay=0 idle=0 busy=6
total=8 delayed=0 dropped=0 delayedMs=0
Proxy- Threads listening:1 Idle:31 Delayed:0 Busy:6 Total:38
DelayHighCon:21 Dropped:0 Handled:38 HandledMS:1571438 DelayMS:0

Christian



From: Peter Farrell [mailto:[EMAIL PROTECTED] 
Sent: Monday, August 16, 2004 6:00 PM
To: CF-Talk
Subject: Re: Memory Issues

Christian,

Are you caching anything in cfquery?  I'm thinking that maybe your max
total cache for cfquery might be set too high...

Also, are you using ODBC or JDBC drivers?

I could be that the garbage collection for event scheduler isn't working
here and it's piling up (as in the discussion on MM forums from my
previous post)?

.peter
maepub


 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-16 Thread Peter Farrell

Christian,

Are you caching anything in cfquery?  I'm thinking that maybe your max total cache for cfquery might be set too high...

Also, are you using ODBC or JDBC drivers?

I could be that the garbage collection for event scheduler isn't working here and it's piling up (as in the discussion on MM forums from my previous post)?

.peter
maepub
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-16 Thread Christian Watt

No.  I am not using anything, as far as I can tell, that would cause
memory to be held at all.  Although some of the logic behind my pages is
fairly extensive, there is nothing that is really that complex.
CFquery, CFStoredProc, Client variables (Which I switch from session
thinking that was the issue, unfortunately no change), arrays and
structures.  I so some WDDX wrapping now so that I can store Arrays and
Structures in Client Variables, but this is after switching from session
variables where the issue already existed.  I don't have any queries
that returns any more than maybe 50-100 records, and there really isn't
a lot of information in those record sets.  There can be a record set
that has a bit of information in it, one row, but again we are only
talking about a 2-3 page print out of text.  Hopefully this gives a
little more info.  

 
Peter, I appreciate the link, that does give me a way to see what is
going on right now through CF, but I am using performance monitor to see
this real time.  I can watch it happen, but I have no explanation for
why it is happening, which means I can't fix it.

 
Christian

	-Original Message-
	From: Peter Farrell [mailto:[EMAIL PROTECTED] 
	Sent: Saturday, August 14, 2004 5:15 PM
	To: CF-Talk
	Subject: Re: Memory Issues
	
	
	Check this out:
	
http://www.macromedia.com/cfusion/webforums/forum/messageview.cfm?catid=
69&threadid=806965
	
	Looks to be something like yours.  I noticed the person is using
thread.sleep() which ties up a JRUN tread.  Are you using that in your
CF code?
	
	.peter
	maepub 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-14 Thread Peter Farrell

Check this out:
http://www.macromedia.com/cfusion/webforums/forum/messageview.cfm?catid=69&threadid=806965

Looks to be something like yours.  I noticed the person is using thread.sleep() which ties up a JRUN tread.  Are you using that in your CF code?

.peter
maepub
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

Re: Memory Issues

2004-08-14 Thread Peter Farrell

Christian,

Try this code on your machine:
http://www.petefreitag.com/item/115.cfm 

Although I haven't experienced anything personally like what's happening to you.  I was on a shared enviroment and noticed that sometimes JRUN had a large memory spike.  Check the Max Heap Size in the CF admin.  See post below.

>From a Pete Freitag post a while ago:
"Even though objects may be "freed" by the garbage collector, it doesn't necessarily mean that a proportional amount of memory will be freed
in the OS. The JVM allocates memory for the heap which may or may not
contain any actual objects. When there is contention for space in the
heap - the heap grows until the max heap size is reached.

I have posted some info about obtaining the JVM memory usage info from
within CFMX on my blog, see: http://www.petefreitag.com/item/115.cfm
The variable maxMemory is the max heap size, totalMemory is how much heap is actually allocated in OS memory."

HTH,
.peter
maepub
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-14 Thread Dave Watts

> Honestly I have not idea what to look for in the stack 
> traces, do you, or anyone else have any idea where I can find 
> some info on what to look for and how to read the stack traces?

Well, to be honest, I'm not sure what you're going to look for. My advice
would to be to look for anything out of the ordinary, corresponding to the
times of your memory problems. I'd also recommend that you examine your web
server and CF logs around those times as well.

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
phone: 202-797-5496
fax: 202-797-5444
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Christian Watt

Honestly I have not idea what to look for in the stack traces, do you,
or anyone else have any idea where I can find some info on what to look
for and how to read the stack traces?

 
Christian

	-Original Message-
	From: Dave Watts [mailto:[EMAIL PROTECTED] 
	Sent: Friday, August 13, 2004 5:35 PM
	To: CF-Talk
	Subject: RE: Memory Issues
	
	
	> Oops, I didn't include that piece, but Yes, I am running the 
	> latest JAVA version.
	
	In that case, I'm out of easy answers. You'll have to start
looking at log
	files and/or running stack traces.
	
	Dave Watts, CTO, Fig Leaf Software
	http://www.figleaf.com/
	phone: 202-797-5496
	fax: 202-797-5444 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Dave Watts

> Oops, I didn't include that piece, but Yes, I am running the 
> latest JAVA version.

In that case, I'm out of easy answers. You'll have to start looking at log
files and/or running stack traces.

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
phone: 202-797-5496
fax: 202-797-5444
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Christian Watt

Oops, I didn't include that piece, but Yes, I am running the latest JAVA
version.

 
Christian

	-Original Message-
	From: Dave Watts [mailto:[EMAIL PROTECTED] 
	Sent: Friday, August 13, 2004 5:21 PM
	To: CF-Talk
	Subject: RE: Memory Issues
	
	
	> Let me add to my last post.  When the memory jumps, it stays 
	> up for 2-3 minutes, sometimes longer.  It will usually drop 
	> back down to around 175mb -225mb after that period, and then 
	> take another jump down a few minutes later.  This wouldn't be 
	> so bad if it never jumped over 750mb, but I can not figure 
	> out why it jumping that high in the first place.
	> Hopefully this helps.
	>  
	> I am now running CFMX 6.1 with all of the latest hot fixes 
	> (Multiple Instances, Jrun Cluster of 2) Microsoft SQL 2000 
	> JDBC Drivers SP3 All data sources are using the MS JDBC 
	> driver Windows 2003 IIS 6.0 MS SQL 2000 (Two of them on 
	> separate machines than the web servers)
	>  
	> If anyone needs additional info, please let me know. I am 
	> getting quite frustrated here as I am sure you all can 
	> understand!!!
	
	This is just a shot in the dark, but you might also try
upgrading your JVM
	to the latest stable release from Sun (1.4.2_05, I think).
	
	Dave Watts, CTO, Fig Leaf Software
	http://www.figleaf.com/
	phone: 202-797-5496
	fax: 202-797-5444 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Dave Watts

> Let me add to my last post.  When the memory jumps, it stays 
> up for 2-3 minutes, sometimes longer.  It will usually drop 
> back down to around 175mb -225mb after that period, and then 
> take another jump down a few minutes later.  This wouldn't be 
> so bad if it never jumped over 750mb, but I can not figure 
> out why it jumping that high in the first place.
> Hopefully this helps.
>  
> I am now running CFMX 6.1 with all of the latest hot fixes 
> (Multiple Instances, Jrun Cluster of 2) Microsoft SQL 2000 
> JDBC Drivers SP3 All data sources are using the MS JDBC 
> driver Windows 2003 IIS 6.0 MS SQL 2000 (Two of them on 
> separate machines than the web servers)
>  
> If anyone needs additional info, please let me know. I am 
> getting quite frustrated here as I am sure you all can 
> understand!!!

This is just a shot in the dark, but you might also try upgrading your JVM
to the latest stable release from Sun (1.4.2_05, I think).

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
phone: 202-797-5496
fax: 202-797-5444
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Christian Watt

Let me add to my last post.  When the memory jumps, it stays up for 2-3
minutes, sometimes longer.  It will usually drop back down to around
175mb -225mb after that period, and then take another jump down a few
minutes later.  This wouldn't be so bad if it never jumped over 750mb,
but I can not figure out why it jumping that high in the first place.
Hopefully this helps.

 
I am now running CFMX 6.1 with all of the latest hot fixes (Multiple
Instances, Jrun Cluster of 2)
Microsoft SQL 2000 JDBC Drivers SP3
All data sources are using the MS JDBC driver
Windows 2003
IIS 6.0
MS SQL 2000 (Two of them on separate machines than the web servers)

 
If anyone needs additional info, please let me know.  I am getting quite
frustrated here as I am sure you all can understand!!!

 
Christian

	-Original Message-
	From: Dave Watts [mailto:[EMAIL PROTECTED] 
	Sent: Friday, August 13, 2004 3:09 PM
	To: CF-Talk
	Subject: RE: Memory Issues
	
	
	> I have not.  I just downloaded the Microsoft JDBC Driver SQL 
	> 2000 and the SP1 for the driver.  Is just an install enough, 
	> or do I need to do something in JRUN as well???  Thank you 
	> for help Dave...I greatly appreciate it.
	
	I thought the latest version of the MS SQL Server JDBC driver
was SP3, so
	you might want to check that.
	
	As for using it, you'll have to install it and then either add
the JAR files
	to JRun's classpath, or copy them to the appropriate lib
directory (where
	macromedia_drivers.jar is now). You'll then have to select
"Other" when
	setting up datasources, and construct the appropriate JDBC URL
for MS SQL
	Server. I don't have any links handy to describe this in more
detail, but it
	was pretty easy to figure out.
	
	Dave Watts, CTO, Fig Leaf Software
	http://www.figleaf.com/
	phone: 202-797-5496
	fax: 202-797-5444 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Christian Watt

I just switched all of my data sources and NO CHANGE!!!  I am getting
peaks of over 500mb right now.  Not that many users and I don't have any
queries that return an extreme amount of data. arrrggg

 
Christian Watt

	-Original Message-
	From: Dave Watts [mailto:[EMAIL PROTECTED] 
	Sent: Friday, August 13, 2004 3:09 PM
	To: CF-Talk
	Subject: RE: Memory Issues
	
	
	> I have not.  I just downloaded the Microsoft JDBC Driver SQL 
	> 2000 and the SP1 for the driver.  Is just an install enough, 
	> or do I need to do something in JRUN as well???  Thank you 
	> for help Dave...I greatly appreciate it.
	
	I thought the latest version of the MS SQL Server JDBC driver
was SP3, so
	you might want to check that.
	
	As for using it, you'll have to install it and then either add
the JAR files
	to JRun's classpath, or copy them to the appropriate lib
directory (where
	macromedia_drivers.jar is now). You'll then have to select
"Other" when
	setting up datasources, and construct the appropriate JDBC URL
for MS SQL
	Server. I don't have any links handy to describe this in more
detail, but it
	was pretty easy to figure out.
	
	Dave Watts, CTO, Fig Leaf Software
	http://www.figleaf.com/
	phone: 202-797-5496
	fax: 202-797-5444 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Dave Watts

> I have not.  I just downloaded the Microsoft JDBC Driver SQL 
> 2000 and the SP1 for the driver.  Is just an install enough, 
> or do I need to do something in JRUN as well???  Thank you 
> for help Dave...I greatly appreciate it.

I thought the latest version of the MS SQL Server JDBC driver was SP3, so
you might want to check that.

As for using it, you'll have to install it and then either add the JAR files
to JRun's classpath, or copy them to the appropriate lib directory (where
macromedia_drivers.jar is now). You'll then have to select "Other" when
setting up datasources, and construct the appropriate JDBC URL for MS SQL
Server. I don't have any links handy to describe this in more detail, but it
was pretty easy to figure out.

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
phone: 202-797-5496
fax: 202-797-5444
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Christian Watt

I have not.  I just downloaded the Microsoft JDBC Driver SQL 2000 and
the SP1 for the driver.  Is just an install enough, or do I need to do
something in JRUN as well???  Thank you for help Dave...I greatly
appreciate it.

	-Original Message-
	From: Dave Watts [mailto:[EMAIL PROTECTED] 
	Sent: Friday, August 13, 2004 2:33 PM
	To: CF-Talk
	Subject: RE: Memory Issues
	
	
	> Yes, I have installed all of the hot fixes and latest drivers 
	> as of about 2 1/2 months ago.  That is when I set everything 
	> up as a clustered environment.  Hoping that both clustering 
	> and getting all of the updates/patches installed and a clean 
	> install would help correct this issue.  Same problem still
occurs :-(
	
	Have you tried using vendor-specific JDBC drivers? That's worked
for me on
	occasion to fix hard-to-track memory problems.
	
	Dave Watts, CTO, Fig Leaf Software
	http://www.figleaf.com/
	phone: 202-797-5496
	fax: 202-797-5444 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Dave Watts

> Yes, I have installed all of the hot fixes and latest drivers 
> as of about 2 1/2 months ago.  That is when I set everything 
> up as a clustered environment.  Hoping that both clustering 
> and getting all of the updates/patches installed and a clean 
> install would help correct this issue.  Same problem still occurs :-(

Have you tried using vendor-specific JDBC drivers? That's worked for me on
occasion to fix hard-to-track memory problems.

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
phone: 202-797-5496
fax: 202-797-5444
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Christian Watt

Yes, I have installed all of the hot fixes and latest drivers as of
about 2 1/2 months ago.  That is when I set everything up as a clustered
environment.  Hoping that both clustering and getting all of the
updates/patches installed and a clean install would help correct this
issue.  Same problem still occurs :-(

 
Christian

	-Original Message-
	From: Dave Watts [mailto:[EMAIL PROTECTED] 
	Sent: Friday, August 13, 2004 2:22 PM
	To: CF-Talk
	Subject: RE: Memory Issues
	
	
	> I am having a huge issue with memory right now.  I have 
	> turned off all session and application variables.  If I get 
	> more than 50-75 simultaneous users, my memory starts to 
	> explode rather rapidly from around 150mb to over 750mb for 
	> the jrun service.  Two problems here, 1) even though I have 
	> set up multiple instances, when the memory on one jrun 
	> service exceeds the assigned -Xmx value, all instances seize 
	> to work as well.  2) I can not figure out for the life of me 
	> why this is happening.  My Jrun servers are clustered and of 
	> course the memory influx does not create a fail over, and 
	> even it did, the other machine will react with the same 
	> effect.  Someone please help me figure out how I can 
	> troubleshoot this.
	
	Have you installed the latest version of database drivers from
the MM hotfix
	page?
	
	
http://www.macromedia.com/support/coldfusion/ts/documents/tn17883.htm
	
	Dave Watts, CTO, Fig Leaf Software
	http://www.figleaf.com/
	phone: 202-797-5496
	fax: 202-797-5444 

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

RE: Memory Issues

2004-08-13 Thread Dave Watts

> I am having a huge issue with memory right now.  I have 
> turned off all session and application variables.  If I get 
> more than 50-75 simultaneous users, my memory starts to 
> explode rather rapidly from around 150mb to over 750mb for 
> the jrun service.  Two problems here, 1) even though I have 
> set up multiple instances, when the memory on one jrun 
> service exceeds the assigned -Xmx value, all instances seize 
> to work as well.  2) I can not figure out for the life of me 
> why this is happening.  My Jrun servers are clustered and of 
> course the memory influx does not create a fail over, and 
> even it did, the other machine will react with the same 
> effect.  Someone please help me figure out how I can 
> troubleshoot this.

Have you installed the latest version of database drivers from the MM hotfix
page?

http://www.macromedia.com/support/coldfusion/ts/documents/tn17883.htm

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
phone: 202-797-5496
fax: 202-797-5444
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]
 [Donations and Support]

61 matches

Mail list logo