Is there a lull in the cycle of streaming data, like after business hours? With that kind of streaming data, you must have a hause of a HDD to store the data.
Do you have a core server that will be used to extract the information from the files? There is a big strategy that may need to be thought of when implementing this type of solution. You maybe able to get away from Load Balancing and go directly with a Application Server (light version) and have it do the processing (automatically) of the files in question, but based on your description that will be its only job and will most likely require you to get a snapshot copy of the file prior to extracting the information so the streaming can continue regardless of the operation being performed irregardless of the task you are performing at the time. Either way, your problem is more threading than memory management. You might want to set a certain size limit to each reading operation (in bytes) and then purge the data and wait 10-15 secs between thread operations to allow the system time to completely purge the previously stored data in memory. Or you could use a cache file on the HDD to process the information as you iterate throught he file(s). On Jul 14, 2:34 am, ankit m a cool dude with hot atitude <[email protected]> wrote: > Streaming data from 1000 or even more client simulators are coming and > making a composite file. I can not trust database connection(as it is real > time valuable data) unless I am using Load Balancing. Right now I am > thinking to develop some load balancing criteria, then only I can use data > base. -- You received this message because you are subscribed to the Google Groups "DotNetDevelopment, VB.NET, C# .NET, ADO.NET, ASP.NET, XML, XML Web Services,.NET Remoting" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/dotnetdevelopment?hl=en?hl=en or visit the group website at http://megasolutions.net
