Cloud storage and cloud computing are all cloud architecture technology implementations

The concept of cloud computing began to penetrate more and more into the field of security in the past two years. The breakthrough application of cloud storage is particularly noticeable. This article will mainly on the application of cloud storage in the field of security analysis.

The popularization of network technology, making the network sharing of video resources become more and more urgent demand of many industries, the existing distributed video resources are moving towards the direction of large concentration; Safe city, Intelligent transportation and other major industries market through the point, line, face of intensive coverage, every moment are adding new video sources; 720p,1080p, 4 K, higher video resolution means greater video information ...

These growing video data bring a huge amount of video storage requirements, but also to the current video storage technology put forward a series of new challenges: How to achieve the smooth expansion of storage capacity? How to effectively reduce the resulting storage costs? How can you more reliably save, use more securely, and share this data more easily? How to solve the problem of maintenance management caused by increasingly large system?

The definition of cloud storage

Cloud storage is a technology or service that derives and develops in the cloud computing concept. The collection of various types of storage devices in the network in the cloud computing system, through the concept of cloud computing to organize work together, the external provision of data storage and business access functions and storage-related value-added applications, known as cloud storage.

Cloud storage and cloud computing are the technical implementations of the cloud architecture, and any application requires a computing model, a storage model, and a communication model. In cloud computing, the reuse of resources must be realized in order to realize the flexible utilization of resources and to create the illusion of unlimited resources for the users. The same is true of cloud storage, which maximizes the benefits of resources by virtualizing and streamlining configuration technologies.

Compared with traditional storage devices, cloud storage is not only a hardware, but a complex system consisting of a network device, storage device, server, application software, public access interface, access network and client program. Each part takes the storage device as the core, through the application software to provide the data storage and the business access service externally.

Cloud storage provides storage-related services externally. Cloud storage can provide a bare space service similar to a disk array, or it can provide a specific service based on storage.

II. system architecture of cloud storage

To understand the system architecture of cloud storage, you need to understand its application architecture first. We take Ping An city as an example to see the application architecture of cloud storage. In a safe city, cloud storage can provide storage services for multiple systems, including video surveillance, card-port Alarm, image resource base, and analysis of graph and reconnaissance. It can complete the daily video recording resources, the various cases involved in the video and pictures and other resources, the card electric police generated by the vehicle capture pictures and other resources of the unified storage.

From the perspective of application architecture, the difference between cloud storage system and traditional distributed storage system is not obvious, but the more essential difference is embodied in the internal software architecture.

Cloud storage System with large-scale distributed parallel file system, based on a large number of servers and storage equipment, build a large-scale storage cluster, providing hundreds of PB of storage capacity, and can be online capacity expansion, the overall cost of building a large-capacity storage system is far lower than the traditional storage architecture, and has good extensibility and flexibility.

The asymmetric architecture of the cloud storage system, separated by metadata and storage data, through load balancing and data concurrency access strategy, under ordinary hardware conditions to obtain up to dozens of Gbps transmission rate and the hundreds of petabytes of storage capacity, and according to user application development trend, timely online dynamic expansion. Unlike the stand-alone file system, the Distributed file system does not place the data on a single disk, which is managed by the upper operating system, but resides on a server cluster, where the servers in the cluster work together to provide services to the entire file system.

The cloud storage System has built-in object-based data management policies, it can ensure the security and reliability of the data in the system, and completely eliminate the single point of failure in the storage system, and combine the automatic fault detection and fast recovery technology to ensure the user's application keep running stably, and reduce the difficulty of deployment and management.

More intuitive understanding, the cloud storage system itself is built on a universal disk array, which manages data on disk through the operating system's APIs, except that such a system can logically be divided into metadata nodes (control nodes), data nodes (storage nodes), management nodes, and client four parts, These four sections correspond to the 4-layer structure model of the cloud storage mentioned above:

(a) Metadata node (Control node)

The metadata node, which is the control node, is used to record various attributes of the stored files, which is equivalent to the brain of the whole file system, manage each data node, collect data node information, understand the status of all data nodes, then assign tasks to them, coordinate and instruct each data node to serve the system;

(ii) Data node (storage node)

Data node is a storage node, used to manage disk and volume and store user's file data, is the storage resource provider of the whole storage system, it is also responsible for cluster construction, including node management and data slicing, and undertakes data redundancy protection and load balance of data access;

(iii) Management node

Management node Unified Management cloud Storage System cluster nodes, files, logs, alarms, gateways, while providing log management, performance monitoring, configuration management, fault management capabilities, to facilitate system management and maintenance personnel Management cloud storage system;

(iv) Client

Clients in an independent process to provide services, to provide users with file reading, directory operations and other APIs, when users need to use the Distributed File system for file reading and writing, the client installed to the server to use the system, you can use the services provided by the system.