Reprinted from the message middleware Activemq, RABBITMQ, ROCKETMQ, ZeroMQ, Kafka how to choose.
Recently to the company's Message Queuing middleware selection, the market related to open source technology is very much, such as ACTIVEMQ, RABBITMQ, ZeroMQ, Kafka, as well as Alibaba's rocketmq and so on.
So much techno
Objective
Open source community has a lot of excellent queue middleware, such as RABBITMQ and Kafka, each queue seems to have its characteristics, in the project selection, often dazzled, overwhelmed. For RABBITMQ and Kafka, which one should I choose?RABBITMQ Architecture
, message sequencing, problem tracking, visual management tools, plug-in systems, communityRABBITMQ Best, Activemq second, zeromq worst.Of course zeromq can also do, but they have to manually write code implementation, the amount of code is not small. Especially in reliability: persistence, delivery Confirmation, publisher verification, and high availability .So in reliability and availability, RABBITMQ is the first choice, although Activemq also has,
RabbitMQ and Kafka A simple comparison from several angles mq (Rabbitmq,kafka) Span style= "BACKGROUND-COLOR:INHERIT;; Font-family: "The song Body" is elaborated and made a simple comparison, 1" Application scenario rabbitmq, follow AMQP agreement, by the intrinsic
Introduction
In distributed system, we widely use message middleware to exchange data between systems, and facilitate asynchronous decoupling. Now open source message middleware has a lot of time ago our own product ROCKETMQ (Metaq core) also smooth open source, get everyone's attention.
So, what is the performance of message middleware?
With this in doubt, our middleware test group performs a performance comparison of the common three types of message products (
Objective:
Activemq and RabbitMq and Kafka in the previous projects have been used in succession, of course, for the three did not have a specific comparison, the following excerpt some online about these three comparisons, I have seen after I feel
It is possible to have a clearer feedback of these three specific cases that have been used in the scene, with the following specific comparisons:
1) TPS Compari
I. Overview of Message QueuingMessage Queuing middleware is an important component in distributed system, which mainly solves the problems of application decoupling, asynchronous message, traffic cutting and so on, realizing high performance, high availability, scalable and final consistency architecture. More message queues are currently available with ACTIVEMQ,RABBITMQ,ZEROMQ,KAFKA,METAMQ,ROCKETMQ
Second,
I have studied RABBITMQ before and have installed it. the articles for the installation record are as follows:Erlang:http://www.cnblogs.com/charlesblc/p/5512380.htmlRabbitmq:http://www.cnblogs.com/charlesblc/p/5516585.htmlAs you can see, good memory is inferior to bad writing. Still have to record!In addition, the classification is particularly important, with the title search RABBITMQ is not found at all,
1. Why do we need MQ?(1) Peak and fill ValleyTake the order system and settlement system scenario, if the order system calls the billing system through the RPC framework,The amount of orders generated in the event of a peak sale can be very large, and because the order is generated very quickly,This will inevitably cause system pressure to the settlement system, the server utilization will be high, but in the peak point of time the order volume is smaller,The server utilization of the clearing s
/kafka Best, ActiveMq second, ZeroMq worst. Of course zeromq can also do, but they have to manually write code implementation, the amount of code is not small. Especially in reliability: persistence, delivery Confirmation, publisher verification, and high availability. 4. High concurrency
Undoubtedly, RabbitMQ is the highest because its implementation language is inherently highly concurrent and highly avai
goes, shop around, we look at the difference between Kafka and other messaging systems.
The LinkedIn team did an experimental study comparing the performance of Kafka with Apache ActiveMQ V5.4 and Rabbitmq V2.4. LinkedIn runs their experiments on two Linux machines, each configured with 8 cores of 2GHz, 16GB of memory, and 6 disks using RAID10. Two machines are
Apache Kafka: the next generation distributed Messaging SystemIntroduction
Apache Kafka is a distributed publish-subscribe message system. It was initially developed by LinkedIn and later became part of the Apache project. Kafka is a fast and scalable Log service that is designed internally to be distributed, partitioned, and replicated.
Compared with traditional
, built-in partitioning, redundancy, and fault tolerance, which makes Kafka a good solution for large-scale message processing applications. Generally, the throughput of a message system is relatively low, but it requires less end-to-end latency. It depends on the powerful durability guaranteed by Kafka. In this field, Kafka is comparable to traditional messaging
, built-in partitioning, redundancy, and fault tolerance, which makes Kafka a good solution for large-scale message processing applications. Generally, the throughput of a message system is relatively low, but it requires less end-to-end latency. It depends on the powerful durability guaranteed by Kafka. In this field, Kafka is comparable to traditional messaging
Brief introductionApache Kafka is a distributed publish-subscribe messaging system. It was originally developed by LinkedIn and later became part of the Apache project. Kafka is a fast, extensible, design-only, distributed, partitioned, and replicable commit log service.Apache Kafka differs from traditional messaging systems in the following ways:
It is
Brief introductionApache Kafka is a distributed publish-subscribe messaging system. It was originally developed by LinkedIn and later became part of the Apache project. Kafka is a fast, extensible, design-only, distributed, partitioned, and replicable commit log service.Apache Kafka differs from traditional messaging systems in the following ways:
It is
Recently want to test the performance of Kafka, toss a lot of genius to Kafka installed to the window. The entire process of installation is provided below, which is absolutely usable and complete, while providing complete Kafka Java client code to communicate with Kafka. Here you have to spit, most of the online artic
messages, because there is no consumer at this time, so the input messages will be blocked in the topics named Test, until a consumer will be consuming their location.
Create message Consumer , execute command: kafka-console-consumer --zookeeper localhost:2181 --topic test --from-beginning . The kafka-console-consumer command starts with the Kafka command-li
"Http://www.infoq.com/cn/articles/apache-kafka/"Distributed publish-Subscribe messaging system.Kafka is a fast, extensible, design-only, distributed, partitioned, and replicable commit log service.Apache Kafka differs from traditional messaging systems in the following ways:It is designed as a distributed system that is easy to scale out;It also provides high throughput for both publishing and subscriptions
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.