Click to have a surprise
Architecture change, building Aiops front
Why to Aiops.
In short, because of the business development of the enterprise's system becomes more and more large and complex to the operation of the great pressure, the use of intelligent tools to replace human beings is the only way; As the carrier of enterprise data, the change of IT system is undoubtedly the precondition of intellectualization.
Take the insurance industry, the Internet has created a new marketing model and opportunities, such as the electric business of the return of insurance, flight delays and other risks to the traditional insurance industry gradually into the field of the Internet. However, these business models lead to a burst of insurance policy in a specific scenario, the huge amount of fragmented transactions to the system construction has brought great challenges, the traditional system construction model, no longer meet the performance of security and stability requirements, so the internal need for a new structure to adapt.
Bohai Insurance Face the current system of operation and development of bottlenecks and future needs, from this year on the enterprise's data standardization of the scene and the transformation of the online, and based on the distributed system to build an integrated business decision-making platform, fundamentally solve the management layer can not see the number of analysis layer to get no number of business layer to take the status quo. It provides real-time and efficient data support for decision-makers at all levels, and also takes an important step in the direction of intelligent operation and maintenance.
This system transformation mainly solves the following questions:
1, the realization of the data standardization and standardization
2, solve the problem of data communication between the system
3, the creation of intuitive system status display layer, to provide strong support for decision makers
4, the system of distributed transformation for the development of the business has laid the foundation
In the past seventh session of the data Technology Carnival, Bohai Insurance system director Lu Bin Bin shared the enterprise data architecture of the intelligent evolution of the road.
The background of system reform
In the Bohai Sea, the original it structure, supporting the new core, financial and BI and many other sets of business systems. According to the needs of the business, each business system adopts Db-link technology to realize the data exchange between business systems, and provides the data support for the business reading request. According to the analysis, the BI system regularly extracts data from key business systems every night, as the source data of BI data analysis. The BI extraction data takes the traditional etl+1 form, the efficiency is low, it is difficult to meet the real-time demand.
From the point of view of data application, the front-end underwriting system generates policy information, and then comes into the customer service claims, financial systems to deal with, complete the treatment of the policy. Because the current system is developed by different developers, have their own requirements in the management, so the data between different systems can not be fully interoperable, so that the unified management of the line across lines is difficult to achieve.
In the current business situation, the daily use of various types of reports and the number of scripts up to more than 400, because the data can not be exchanged, to a large extent affected the business.
Overall, the original IT system architecture is faced with the following issues: efficiency: BI system using the traditional ETL data extraction method, can not meet the needs of real-time
Performance: The traditional architecture adopts minicomputer + storage mode, and the IO processing ability is low. Cross-system Dblink pumping number will also bring certain performance impact, the system often appear in cotton and so on, especially in the peak period.
Scalability: Traditional High-end storage can not be flexibly expanded to meet the needs of flexible business changes.
Therefore, in order to ensure the efficient and stable operation of the business and flexible expansion, the original IT system must be reformed. Cannot see the number for current management level, analysis of the number of layers, the business layer is not a number of cases, the group decided to do the following transformation: For the business scene of the data for the transformation, according to industry standards to standardize data, at the same time to meet real-time needs, the data online, after such a transformation, Finally realize the rapid development of data products, standardized data organization and real-time and efficient data delivery. It leads to the creation of data value
Data is the core assets of the enterprise, and IT system as the carrier of data, in the enterprise's value chain in the more and more important position, through the change of IT system to create data value, drive business change, become the enterprise system operation and maintenance of the goal and strategic direction. For businesses, data can create value including: To promote business development, control operating costs, guard against various risks, through data analysis for enterprises to provide decision-making basis, real-time data query can reduce claims management system operating costs, and through the improvement of data quality to prevent injection, tax and other risks. This is also the Bohai Sea insurance system reform objectives. According to the current situation of data application, first of all, the standardization of Data transformation, for the original system, the use of standardized calibration, to meet the requirements of the data can be imported into the Data Warehouse, the inconsistent data in accordance with a certain standard to transform the processing and then import. The construction of the new system must conform to the standards and standard requirements.
In view of the current situation of data communication between systems, a complete closed loop is created between the operation system and the management system on the operational decision platform through real-time data analysis and incoming. The production system generates business and management data, financial data, etc., and is delivered to ODS systems in real time, providing simple system queries and inventory downloads on ODS. After the data concentration of ODS layer, after cleaning, induction and collation, form the data of scene class, generate the corresponding table and statistical tables, and then cluster, refine and form various express icons, to provide the basis for the decision of the management manager.
High performance, Low-cost, scalable architecture Solutions
On the basis of the above requirements, the transformation scheme for the whole platform is as follows: The data of each application system is extracted by the management decision platform, as a unified interactive platform, which avoids the performance of the data interaction between the system and so on.
In order to meet the above requirements, the need for strong hardware capabilities, especially the support of IO capabilities, after a large number of selection, and finally selected the leading team of data Services cloud and Emme Zdata distributed storage management software to build a distributed architecture. Distributed storage has the following advantages: Multidimensional dynamic expansion: compute nodes and storage nodes can be dynamically expanded on demand, capacity and performance linear growth
Resource Pooling & Cloud: Computing resources and storage resources pooling, unified management, expanding on demand
High performance: x86 server based, high processing capability and IO throughput using flash memory cards, InfiniBand switches
Security & Redundancy: All components are redundant, automatic image storage and automatic reconfiguration, without human intervention and no impact on the online business.
The Zdata distributed storage management software with high performance and low cost is becoming the first choice for the reform of the Bohai Property insurance system.
Before the formal construction, Bohai property IT team in the cloud and Emme engineers with the assistance of the high availability, performance, scene, pressure and other dimensions of the rigorous testing. The test results show that:
The management decision platform based on distributed storage technology has the ability of preventing single point Fault in computing node, storage node and InfiniBand switch level.
I/O throughput reaches the order of magnitude (50 times times) of 10gb/s, with IOPS reaching 2 million/s order of magnitude (800,000)
Table space, large table creation, index creation, full table scan performance, compared to traditional SAN storage elevation 23~37 times.
Under the pressure of 4000 sessions per second, the number of transactions is 43000/S and the transaction response time is only 30ms.
Therefore, the distributed storage architecture is not only the best solution to the dilemma of the current Bohai Sea insurance system, but also the only way for the enterprise to transform the intelligent cloud, and the Professional data service team and products will help the enterprise to go better in this road.
Through the establishment of the management decision platform, the data of each system is brought together and visualized to the user through the processing, which provides a great decision basis for the management and operation of the enterprise. The following is the Bohai Sea Insurance platform show:
Since the decision platform is on the line, the time consuming of the system to download the report is greatly reduced. And after the establishment of data quality detection mechanism, due to real-time data transmission, but also in accordance with the established data testing rules to develop automated periodic inspection, and through the Mail, SMS initiative push. The staff feedback from each line of business, the system experience is good, greatly enhance the efficiency and the use of experience.
Lu Bin Bin said that the Bohai Sea insurance Future It's evolution direction will basically be in the existing foundation stability, gradually transition to distributed as the core of the Internet architecture. Next, the Bohai Sea insurance will gradually realize the disaster preparedness based on the public cloud platform, to better protect the data security and reliability.
Lu Bin Bin said that in the premise of ensuring safety and regulatory risk, the whole industry is moving towards the internet thinking direction, now and in the future is the world of interconnection, everything is online, not only insurance industry, the whole industry, our daily necessities in this huge network. Do not do online change, will eventually be abandoned by the times.
Data for the bridge, Bohai Insurance through the transformation of the IT system, on the one hand, it solves the bottleneck of operation dimension through the system distributed transformation, and lays the foundation for the subsequent business expansion, on the other hand, it realizes the standardization of data and on-line, and it greatly excavates the value of data, provides a strong basis for decision-makers, and drives business innovation.
Thinking innovation, guiding technology change, the technology development creates the data value, along with the data in the enterprise's position is becoming more and more prominent, the operation dimension also will have the fundamental change, from the initial passive management maintenance data, through the data analysis to guide the business decision, each industry enterprise is moving from the traditional operation dimension gradually to the automation movement dimension, With the further development of technology, the future of data-oriented, reshaping the value of enterprises, intelligent operational dimension will become an irreversible trend.
Click to have a surprise