Cloud queues: A large-scale messaging infrastructure platform based on Hadoop

Dong Hua University history

Based on the demand of the current distributed system message communication and combining the Hadoop cloud computing platform, this paper presents an internet-scale, high-performance and highly reliable Message Queuing service platform-cloud queue (cloudqueue). By using the messaging services provided by the cloud queue platform to implement asynchronous communication, storage and forwarding, reliable transmission, and cross-internet, cloud queues can provide high-performance, reliable, high-capacity, internet-oriented messaging services for applications in the era of cloud computing. Based on the analysis of the basic knowledge of message-oriented middleware and the key technologies of Hadoop, this paper puts forward the design goal and the whole architecture of cloud queue system, and then, through analyzing relevant key technologies, puts forward the technology architecture and object model of cloud queue. Finally, this paper introduces the implementation of cloud queue and the definition of related interface in detail. Finally, through experiments and analysis, it is proved that the cloud queue system presented in this paper has higher performance, reliability and scalability than the traditional message middleware cluster system.

Keywords: cloud computing message Middleware Message Queuing Hadoop HBase Zookeeper

[Download Address]:http://bbs.chinacloud.cn/showtopic-13238.aspx