Openpdc for Large-Scale Real-time Data Processing

Large-scale real-time data processing requires a high level of data analysis, and the existing database is obviously difficult to cope with, and expansion will bring huge overhead. In addition, as an institution that coordinates the security and stability of multiple regional power grids, NERC plans to integrate the PMU data of each region to the unified coordination agency for an overall assessment to avoid the evaluation difficulties caused by the absence of data sharing. In this context, hadoop is suitable for large-scale and distributed data processing, and can be used to build a large distributed database. Based on the development of superpdc, TVA recently made it open-source through the openpdc (http://openpdc.codeplex.com/) project, which will facilitate large-scale Analysis and Processing of measurement data, it also provides a common platform for processing other time series data of the power grid. At present, this project has been affirmed and implemented by a number of power companies in the United States.