Public opinion Analysis: Leading industry in large data

To extract and analyze the public opinion information implied from the unstructured data from the Internet, and to create more and more market space in the first wave of large data. And how to use from the Internet, social networks, mobile applications and other innovative fields to create a burst of growth in the mass of unstructured data to create value, is the current major data industry focus on the hot topic. Using massive data analysis tools and algorithms to extract and analyze the public opinion information implied in the unstructured data from the Internet, so as to provide decision support for the work of government and enterprise managers, and to create more and more market space in the first wave of large data.

Facing the massive information on the Internet, how to discover and analyze the Internet public opinion effectively, is the fact that all kinds of Internet Information system must face at present. In July 2013, the State Council published a number of views on speeding up the promotion of information consumption to expand domestic demand, which pointed out six aspects, one of which is to increase the supply of information consumer products. The large data public opinion belongs to the Internet Information Service industry, but also belongs to the current new generation information technology and the software domain hot field.

In the whole large data industry, the Internet public opinion monitoring industry as a first-hair is also ushering in great opportunities. Analysis data show that in China's public opinion monitoring software market will soon reach more than 1 billion, and in the next few years, the public opinion monitoring service industry will further usher in a burst of growth, the overall market size will reach about 10 billion.

Leading industry in large data market

For all IT services that are intended to make a difference in the big data industry, the huge business opportunities of the Internet public opinion monitoring service mean that all market contenders will treat it as a huge pie that cannot be overlooked. It is true that the Internet public opinion on the information acquisition of "real-time, comprehensive" have higher requirements, therefore, the Internet public opinion system must be able to support the public opinion of large data processing, in order to effectively provide users with public opinion services.

"Versatile" Requirements for ISVs

"In the whole Internet public opinion analysis industry, the public opinion software is mainly around the Internet opinion search and monitoring, although some manufacturers put forward a number of different government departments of the opinion system improved version, but it is almost still the traditional monitoring function, only the interface and other changes." has not reflected the industry Internet public opinion massive unstructured data processing characteristic. "Chen Zonghua said.

In his view, the government's different functional departments of public opinion monitoring function should be focused, for example, the government propaganda department monitoring public opinion, should be the local area of all major events to monitor, but also the function of public opinion guidance, and the fire department is concerned about local and fire related public opinion, the organization department focused on the local cadre monitoring. Only in the in-depth integration of the characteristics of the industry work on the basis of the Internet can reflect the advantages of public opinion processing.

In order to achieve these, the whole public opinion processing system must have a good structure support, such as in the collection of target management and knowledge base construction should be divided into common and industry management, but also free to expand, monitoring the topic of automatic generation needs to be combined with industry characteristics. The functions of the system should be configurable to configure different functional modules for different industries.

"Therefore, in the face of large data public opinion, the development direction of the system should be industry-oriented subdivision, such as the government version, the organization of the procuratorial version, Fire, environmental edition, education, etc., and should be closely linked with the industry's inherent work." With the popularity of mobile terminals, not only to provide users with browser or app way of mobile phone clients, but to develop a wide range of input mode search, accurate content return, personalized search experience. "Chen Zonghua said.

The development of the Internet public opinion monitoring solution requires ISVs to have a certain capability in the technical field of each frontier. In Chen Zonghua's view, ISVs in this industry must be able to combine technologies such as cloud computing, large data, social network analysis, mobile search and so on to be technically competitive. The Internet Knowledge Engineering is an intelligent information system based on knowledge. involves knowledge acquisition, knowledge representation and knowledge application techniques.

Improving existing data mining and machine learning techniques; To develop new data mining techniques such as data network mining, Special group Mining and graph mining, breakthrough data fusion technologies such as object based data connection and similarity connection, and break through the field-oriented large data mining technology such as user interest analysis, network behavior Analysis and affective semantic analysis.

The focus of social network analysis is the relationship and relationship model, which involves the correlation analysis in data mining, statistical analysis of correlation matrix or differential matrix, social network division, core character recognition, information expansion process, circle topic tendency analysis, Small World theory, six-degree spatial segmentation method and technology.

Intelligent information processing is a frontier subject in computer science and a comprehensive subject, which aims to deal with massive and complex information and to study new and advanced theories and techniques. Intelligent information processing in specific fields, which is mainly based on Internet application, includes: Large-scale text processing, multimedia information retrieval and processing, web-based knowledge mining, refining and integration.

The efficient collection of information on the Internet requires a combination of template-customized collection, and more importantly, the use of many media with built-in search function, relying on the full crawl of multiple media information technology has been difficult to meet the comprehensive needs of customers. While monitoring the subject of machine understanding, in the monitoring of Internet public opinion when Chen Zonghua, many are customized in the form of a topic, while the topic in the description of keywords, phrases, rules (keywords and and, or relationships), a paragraph, several articles, how to support a variety of forms of theme descriptions, how to automatically understand the user's description of the topic, is the public opinion subject monitoring homepage one link.

In addition, the public opinion processing system in the collection, the text extraction, row weight, participle, named entity recognition, classification, clustering, retrieval, presentation of special report generation, all kinds of public opinion statistics, storage and other links, need to face parallel processing problems. The key problem of large data processing is parallel processing and information storage, only if these links are solved, can embody the advantage of a public opinion processing system in large data processing.

Even with all the technical fields ready, the use of large data technology to build an Internet public opinion analysis system also represents a major challenge for ISVs. In Chen Zonghua's view, the combination of the user's specific work and business processes, as well as the security of public opinion processing and analysis, is the most important difficulty and challenge for ISVs in this industry.

"Industry large data public opinion system development and user work, the development of the system in the business area, work mode, workflow, functional design and other links should be closely linked with the user's work." "In addition, our company's Internet public opinion analysis uses advanced SaaS mode to provide services, while in the software service process, public opinion security, confidentiality, traceability are noteworthy." ”

And for the enterprise itself, the development team training is also to enter the market the necessary attention. Large data public opinion involves intelligence analysis, news dissemination, computational language, data mining, machine learning, natural language understanding, social network analysis, network security, knowledge Engineering, information retrieval, etc., how to set up a professional research and development team with reasonable knowledge structure and high level is a problem that the public opinion software development company must face. In addition, the business model of the enterprise also must have the unique value, can obtain the big core competitive advantage in this new industry market.

Creating Multidimensional Ecological Circle

In the internet-based public opinion analysis industry, it is not only the provider of analytical technology that has the development opportunity. In addition to its own development, IT solutions can also use the technology of other enterprises in the deployment of user solutions in a collaborative manner. Thus, a three-dimensional ecological partnership is formed between ISVs that provide core technology.

"In the field of Internet public opinion analysis, the People's network has a strong and authoritative identity, their technical team developed a full set of large data technology based on the Internet public Opinion analysis system, and in many government and large state-owned enterprises in the propaganda department, our company also established a cooperative relationship with them, Deploy their solutions in projects such as our smarter cities. "Nanjing Magic Square Technology Co., Ltd. CEO Chen Introduction."

In Chen's view, the traditional industries, including logistics and transportation and other fields are limited by the application of open degree, large data mining needs are not particularly high. And in the government and state-owned enterprises, the public opinion analysis and processing investment is huge, in the government's supervision, led by a number of large state-owned enterprises are involved in the monitoring and control project input. This aspect of unstructured data analysis and processing solutions market development prospects.

And for the competitiveness of enterprises in the field of large data, in order to enter this favored market, to take the form of cooperation with other enterprises, can also help enterprises to achieve success. As Chen Zonghua said, the Internet big Data public opinion analysis market promotion, inseparable from the industrial chain to the downstream partners sincere cooperation. In the biosphere, the most important task for ISVs is to drive the market to be more innovative, replicate applications faster, and make the whole cake bigger. Only if the application is attractive enough, the development of the future will be logical. And the application of innovative and personalized user needs, so that more governments, business units in the propaganda, marketing and sales department responsible to accept this new technology, but also close to the user's IT solution is the most important task and the core business value.