Open source set of data offsite backup system

Source: Internet
Author: User

Brief introduction

This system resolves offsite disaster preparedness for 2w+ database instances (including MYSQL,REDIS,SSDB)

About 40w+ a backup file per day (99% DB instance for hourly backup policy)

40tb+ data volume per day for offsite transfers

Supports any backup
    • This system is only responsible for backup offsite transfer, not responsible for how to back up the specific backup script users write their own, as long as required to write the backup information to the corresponding log file can be

Backup script Specification 1. Each time is fully prepared (for example, Redis is fully prepared by RDB every time) 2. Full plus increments (e.g. MySQL via xtrabackup) script Log Generation specification: Backup succeeded: Back_log first behavior OK, second behavior file name Backup failed: b Ack_log first behavior wrong, second behavior error message if this is the 2nd way, when generating back_log, generate a copy of the same log information in the Last_all_log log
    • Backup queue priority control, important backups take precedence over pull-off to offsite

The following alarm types are supported
    • Normal backup script error (script exit code not 0)

    • Not backed up beyond the specified time

    • Illegal backup

A chrome plugin alert for alarms

Support for back-end cluster linear scaling
    • Cluster support pull data adjustment, weight adjustment, cluster capacity can be increased by simply increasing the number of nodes

    • The node automatically pauses over the reserved space according to the configuration, and the entire cluster can continue to work as long as there are still working nodes in the cluster.

Supports multi-latitude data analysis
    • Metadata is stored in ES and data is analyzed as needed

One-click Recovery
    • Cooperate with recovery script to implement query backup location, download, restore one go


GitHub Address:

Https://github.com/lustlost/ubackup

Gitoschina Address:

Http://git.oschina.net/lustlost/ubackup

This article is from "lustlost-Lost in Desire" blog, please be sure to keep this source http://lustlost.blog.51cto.com/2600869/1788458

Open source set of data offsite backup system

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.