Open source set of data offsite backup system

Brief introduction

This system resolves offsite disaster preparedness for 2w+ database instances (including MYSQL,REDIS,SSDB)

About 40w+ a backup file per day (99% DB instance for hourly backup policy)

40tb+ data volume per day for offsite transfers

Supports any backup

• This system is only responsible for backup offsite transfer, not responsible for how to back up the specific backup script users write their own, as long as required to write the backup information to the corresponding log file can be

Backup script Specification 1. Each time is fully prepared (for example, Redis is fully prepared by RDB every time) 2. Full plus increments (e.g. MySQL via xtrabackup) script Log Generation specification: Backup succeeded: Back_log first behavior OK, second behavior file name Backup failed: b Ack_log first behavior wrong, second behavior error message if this is the 2nd way, when generating back_log, generate a copy of the same log information in the Last_all_log log

• Backup queue priority control, important backups take precedence over pull-off to offsite

The following alarm types are supported

• Normal backup script error (script exit code not 0)

• Not backed up beyond the specified time

• Illegal backup

A chrome plugin alert for alarms

Support for back-end cluster linear scaling

• Cluster support pull data adjustment, weight adjustment, cluster capacity can be increased by simply increasing the number of nodes

• The node automatically pauses over the reserved space according to the configuration, and the entire cluster can continue to work as long as there are still working nodes in the cluster.

Supports multi-latitude data analysis

• Metadata is stored in ES and data is analyzed as needed

One-click Recovery

• Cooperate with recovery script to implement query backup location, download, restore one go

GitHub Address:

Https://github.com/lustlost/ubackup

Gitoschina Address:

Http://git.oschina.net/lustlost/ubackup

This article is from "lustlost-Lost in Desire" blog, please be sure to keep this source http://lustlost.blog.51cto.com/2600869/1788458

Open source set of data offsite backup system