On Fri, 7 Dec 2012, Fabio Sangiovanni wrote:

acronym alert, what does AMQP stand for?

It's a standard protocol to communicate with message queueing systems.

"the nice thing about standards is that there are so many to choose from"

and

http://xkcd.com/927/

http://www.amqp.org/

it's vision sounds nice "To become the standard protocol for interoperability between all messaging middleware"

but it's "yet another standard" to compete with all the others

http://en.wikipedia.org/wiki/Advanced_Message_Queuing_Protocol

Message queueing system implementations that support AMQP: RabbitMQ, Apache QPid

It would not be that hard to get AMQP added to rsyslog, you would just need to have someone either write input and output modules (probably adapted from the 0mq modules to start with), or sponsor development through Adiscon professional services (e-mail Rainer directly to get a quote, it's usually surprisingly cheap)

persistent on-disk queues are already an option.

Yes, and I'd be happy to use them together with an AMQP output plugin for 
reliable massive log processing.

rsyslog already supports Reliable Event Logging Protocol (RELP), and 0MQ options for reliable massive log processing. This would just be one additional option (and there's nothing wrong with supporting lots of options)

My logging system processed 18B lines of logs in October, it's handled 93K lines of logs in a single second, and I've tested it up to 380K lines of logs per second (effectivly gig-E wire speed), and others have used rsyslog in environments where they have tested it to 1M lines of logs per second.

However, "reliable" is a relative term. reliability and performance tend to be opposed and you have to make tradeoffs between the two.

David Lang
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of 
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE 
THAT.

Reply via email to