Sybase turnkey Customer Information Analysis System solutions

Project background

The strategy of Bank of communications in Informatization mainly includes two directions of development:

Business processing centralization, mainly reflected in the business system in large concentration, the abolition of the past scattered in the branches of the business system and the business processing system to focus on the headquarters, a new large centralized business system can straighten out the inconsistency of all parts of the business, thus playing a role of intensive management, reducing business costs, Improve the standardization and effectiveness of business processes.

The construction of enterprise analysis framework is mainly embodied in the bank's focus on the construction of Data Warehouse, the goal is to create the core of the data view, so as to meet the more and more diverse data analysis, and business development decision management needs. The goal is to help banks build differentiated services and special business management capabilities through data warehousing and related data mart analysis applications. In order to improve the satisfaction of bank customers, and accordingly obtain a greater market share and higher profit margins, so that the intersection can be in the fierce market competition in a more powerful situation.

The customer information system is an important part of the bank's analysis structure, and its basic position is as follows:

-Customer integrated information system is an important part of the large centralized project of data processing, and it is a system of collecting, sorting, analyzing and applying the customer information based on the customer business data information produced by three production systems in the large-data-gathering project of the bank.

-Customer integrated information system belongs to the backstage Integrated Management Information system, is an important part of the decision-making management level, the difference between the functional level and other production systems is that it focuses on the customer's Business information Analysis system, rather than on the customer business Process Control management system.

-The goal of the customer integrated information system is to establish a single view of the full line of customer information, effective pooling of customers, institutions, products, accounts, channels and other analytical elements of the basic information, to become a service at all levels of management decision makers and business analysts of the Public Information query analysis platform, so that the entire line of customer information can be shared, It serves the Business management department, the marketing department, and the Non business unit that is associated with customer information.

-Customer integrated information system is also a marketing management platform.? Establish a basic framework to prepare for subsequent in-depth development of content. The first phase of the development of content not only to solve the customer's basic information query analysis, to meet the current marketing management, evaluation assistance and other applications, but also in the system of basic framework design for the follow-up in-depth development to do some preparation, such as product cleaning, product gross analysis, the scalability of the subject analysis, etc. In order to be able to and future system development content docking.

Evaluation and process of project construction

Sybase IQ is a relational database system designed for data query and data analysis applications, with data compression, high efficiency ad hoc query analysis, and linear scalability features, Its open architecture and standard access interface are well suited for data marts with large data volumes and for analysis-oriented business applications.

Since April 2005, the bank has carried out a series of tests for Sybase IQ, which show that it is far more than normal database performance in the ordinary hardware environment. IQ compared to the OLTP database stores the original data storage ratio of 1 vs 3-8, indexed data storage ratio of 1 vs 3, IQ can be optimized index and index space is very small and the time to build the index is very short, the different query without changing the index, without human intervention; From the test to see the IQ can be high speed for complex query operations under large data, performance is 2-20 times the traditional database, and the IQ of the use of resources and traditional databases, IQ mainly improve the efficiency of the CPU, but not rely on the improvement of I/O performance; From the view of concurrent operation, IQ has a better ability to satisfy the complicated query under the condition of large user concurrency, and it is slow to reduce the query efficiency under multi-user concurrency.

Traffic bank based on IQ in the test showed: excellent data compression ratio, high-performance aggregation and query capabilities, as well as the flexibility of the storage process to select the IQ as a customer data analysis platform database.

According to the technical test, the structure of the redesigned overall system is as follows:

The system is a centrally accessed architecture, where branches centrally access the Data Analysis Mart at Headquarters. Cross-line using ETL server DataStage from the business system to extract data to ODS Server DB2 database, and then ETL processing to generate the need for IQ data files to load, in the IQ more need to do some summary processing, The branch or head Office client accesses the IQ database data directly through the application server.

Project results

Customer integrated information System, the current database data storage more than 100GB, the total number of users 12000, the average number of online users 260 people, the daily incremental load of 3GB, data processing time of 30-60 minutes, the annual new data storage about 300G.

The overall efficiency of the system has also been greatly improved, the total batch processing time from the original 3 hours reduced to 1 hours; At present, the system's largest single table data has more than 300 million, users of any period of time to query the speed of data has a large-scale improvement, of which 95% of the queries are completed in seconds, only about 5% of the complex query is the minute level.

System software and hardware platform

Server: IBM P690, 8 CPU, 32G mem

Disk Arrays: EMC Symetrix

Database services Software: Sybase IQ v12.6 for AIX 64bit

Customer integrated information System, the current database data storage more than 100GB, the total number of users 12000, the average number of online users 260 people, the daily incremental load of 3GB, data processing time of 30-60 minutes, the annual new data storage about 300GB.