Re: Large messages, slow consumers and java heap space

OK, I fear that what's happening is that producer flow control is kicking in, and that camel is taking messages off queues, but it can't put them on queues, so camel is holding all these messages in memory, which will eventually fill up. I don't see why producer flow control would be applied, sin

Re: Large messages, slow consumers and java heap space

On Tue, Mar 8, 2011 at 10:52 AM, Illtud Daniel wrote: > On 08/03/11 09:26, Claus Ibsen wrote: > >> Have you looked at some of the guides at FuseSource about the broker? >> http://fusesource.com/products/enterprise-activemq/#documentation > > No, I'll take a look, thanks. > >> And there is a Active

Re: Large messages, slow consumers and java heap space

On 08/03/11 09:32, Dejan Bosanac wrote: I'd suggest using blob messages for messages of that size: http://activemq.apache.org/blob-messages.html Unfortunately, we've already architected the processes around xml payload messages, so we've got camel picking some info from the messages with xpath

Re: Large messages, slow consumers and java heap space

On 08/03/11 09:26, Claus Ibsen wrote: Have you looked at some of the guides at FuseSource about the broker? http://fusesource.com/products/enterprise-activemq/#documentation No, I'll take a look, thanks. And there is a ActiveMQ in Action book to be published this month. Maybe it has some det

Re: Large messages, slow consumers and java heap space

Hi, I'd suggest using blob messages for messages of that size: http://activemq.apache.org/blob-messages.html Regards -- Dejan Bosanac - FuseSource - The experts in open source integration and messaging. Email: dej...@fusesource.com W

Re: Large messages, slow consumers and java heap space

On Tue, Mar 8, 2011 at 10:15 AM, Illtud Daniel wrote: > On 07/03/11 18:19, Illtud Daniel wrote: > >> I've attempted to read everything I can about producer flow control, >> message cursors, prefetch limits, etc. and I still can't get it >> to do what I want. I don't care about speed at all, I have

Re: Large messages, slow consumers and java heap space

On 07/03/11 18:19, Illtud Daniel wrote: I've attempted to read everything I can about producer flow control, message cursors, prefetch limits, etc. and I still can't get it to do what I want. I don't care about speed at all, I have plenty of disk space, and all messages are persistent. Anybood

Large messages, slow consumers and java heap space

I'm using stomp, java clients and camel to move messages through a 'pipeline' of activemq queues. The messages can be very big (>120MB) and unfortunately the OS is 32-bit, so I want to keep memory usage to a minimum (2GB limit). There isn't a huge number of messages, but I keep running out of heap