A tool for real-time data synchronization between mongodb and ElasticSearch Based on netcore (ipv2es ),

A tool for real-time data synchronization between mongodb and ElasticSearch Based on netcore (ipv2es ),

Tools for real-time data synchronization between mongodb and ElasticSearch Based on netcore

One-to-one, one-to-many, multiple-to-one, and many-to-many data transmission modes are supported.

• One-to-one-A mongodb collection corresponds to data synchronization between indexes of an elasticsearch instance.
• One-to-multiple-Data synchronization between indexes of multiple elasticsearch instances corresponding to a collection of mongodb instances
• Many-to-one-Data synchronization between indexes of an elasticsearch instance corresponding to collection of multiple mongodb instances
• Many-to-many-Data synchronization between indexes of multiple elasticsearch instances corresponding to collections of multiple mongodb instances

Environment version

elasticsearch：v6.1.2mongodb: v3.4.9netcore: v2.1.101

What is this tool?

Ipv2es is used to maintain real-time data synchronization between your mongoDB collections and your elasticsearch index. it uses mongo oplog to monitor whether your mongdb data has changed. Whether it is added, deleted, modified, and queried, it will be promptly reflected on your elasticsearch index. before using this tool, you must ensure that your mongoDB is in line with the replica structure. If not, set it correctly before using this tool.

How to Use

Download from GitHub

cd srcdotnet publish --framework netcoreapp2.0 -o ./published

How to start

dotnet Mongo2Es.dll --port {port for web manage} --mongo {mongourl for config}

Displayed result

• Page Management

• Execution Process

• Data in mongodb

• Data in elasticsearch

License

The MIT License (MIT). Please see LICENSE for more information.

Reference & Study

• Mongo-connector
• Mongo-es
• Node-mongodb-es-connector
• MongoDB Administration Commands> listCollections
• MongoDB Driver Admin Quick Tour
• MongoDB Driver Using a Tailable Cursor
• Elasticsearch Reference
• Elasticsearch. Net-Low level client
• NLog. MongoDB. NetCore