Portland Linux/Unix Group Advanced Topics Meeting Announcement Who: Nathan Williams What: Using Mozilla's Heka project for log and event stream processing Where: Free Geek, 1731 SE 10th Avenue, Portland (Left Entrance) When: Tuesday, August 18th, 2015 at 7pm Why: The pursuit of technology freedom Stream: http://pdxlinux.org/live/
Talk: A Practical Introduction to Scalable Stream Processing with Heka and how the log and event processing system at Treehouse has evolved from a typical Elasticsearch/Logstash/Kibana setup into a Heka-based system. We will also discuss the why behind this move and where we are headed. Heka is an open source stream processing software system developed by Mozilla. Heka is a “Swiss Army Knife” type tool for data processing, useful for a wide variety of different tasks, such as: * Loading and parsing log files from a file system. * Accepting statsd type metrics data for aggregation and forwarding to upstream time series data stores such as graphite or InfluxDB. * Launching external processes to gather operational data from the local system. * Performing real time analysis, graphing, and anomaly detection on any data flowing through the Heka pipeline. * Shipping data from one location to another via the use of an external transport (such as AMQP) or directly (via TCP). * Delivering processed data to one or more persistent data stores. https://github.com/mozilla-services/heka Nathan is a sysadmin by trade who's been into Linux, automation and data for the last 10 years and is currently working at Treehouse as a systems developer. Calagator Page: http://calagator.org/events/1250468938 Many will head to the Lucky Lab at 915 SE Hawthorne Blvd. after the meeting. Rideshares Available PLUG Page with information about all PLUG events: http://pdxlinux.org/ Follow PLUG on Twitter: http://twitter.com/pdxlinux PLUG is open to everyone and does not tolerate abusive behavior on its mailing lists or at its meetings. See you there! Michael Dexter PLUG Volunteer _______________________________________________ PLUG mailing list PLUG@lists.pdxlinux.org http://lists.pdxlinux.org/mailman/listinfo/plug
