http://openpdc.codeplex.com/
The open source phasor data concentrator (openPDC) is a system that is used to manage, process and respond to dynamic changes in fast moving streaming phasor data. More specifically, the openPDC can process any kind of data that can be described as ³time-stamped measured values². These measured values are simply numeric quantities that have been acquired at a source device and are typically called points, signals, events, time-series values or measurements. Examples of measurements include temperature, voltage, vibration, location, luminosity and, of course, phasors. When a value gets measured, an exact timestamp is taken, typically using a GPS-clock for accuracy the value, along with its timestamp, is then streamed to the openPDC where it can be ³time-aligned² with other incoming measurements so that an action can then be taken on a complete slice of data that was all measured at the exact same moment in time. Although the system was specifically developed to manage real-time streaming synchrophasors and generate time-sorted concentrated data streams using standard protocols, its completely modular based design makes the system a general purpose distributed stream processing engine <http://en.wikipedia.org/wiki/Event_stream_processing> . This adaptive system design also makes it simple to integrate the openPDC with other systems that you may want to use to help manage and archive streaming event data (e.g., Microsoft's StreamInsight CEP Platform <http://www.microsoft.com/sqlserver/2008/en/us/R2-complex-event.aspx> , OSIsoft's PI Historian <http://www.osisoft.com/software-support/what-is-pi/what_is_pi_.aspx> , etc.) The openPDC will have a broad range of uses outside of synchrophasors where real-time streaming measured data needs to be processed and archived, for example: consumer energy usage (smart-grid), seismic metering, high-speed location tracking, fast changing temperature monitoring, surveillance applications, network traffic processing, etc. Below is an image that shows the openPDC modular system design used to manage streaming measurements. User defined input adapters are used to collect streaming data and assign incoming measurements an ID. Measurements are then sorted by time and passed along to custom action adapters that process the data. Finally, all measurements are sent to output adapters that are used to queue up data for archival. The high level data flow is: map, sort, queue where map is the step of assigning an ID to a measurement, sort is the step of sorting the measurements by time so that an action can be taken, and queue is the step of queuing up measurements so they can sent to different outputs. The system loads user defined ³assemblies² to perform all of these steps that is, users can develop their own input, action and output adapters to provide extensible processing of any streaming measured data. The project includes a variety of adapters to make the system operate as a ³phasor data concentrator² as well as to archive time-series measurements into files that can be processed in bulk by Hadoop <http://en.wikipedia.org/wiki/Hadoop> . The map-reduce code needed to allow Hadoop to mass process the time-series archive files is also included. ----------------------------------------------------------- John Scott Director, Open Source Software & Open Integration Mercury Federal Systems (Wash DC) Work 703-413-0781 ex: 5006 cell 240.401.6574 www.mercfed.com < [email protected] > http://powdermonkey.blogs.com < [email protected] > This message is intended only for the designated recipient(s) and may contain confidential or proprietary information of Mercury Federal Systems, Inc. It is solely intended to facilitate business discussions and does not constitute an express or implied offer to sell or purchase any products, services, or support. Any commitments must be made in writing and signed by duly authorized representatives of each party. _______________________________________________ opencpi_dev mailing list [email protected] http://lists.opencpi.org/listinfo.cgi/opencpi_dev-opencpi.org
