Zhong Xing Road system architect Yang: hadoop+storm+ HBase ..., to create innovative services in the transportation industry

Taxis, buses, passenger buses, heavy goods vehicles ..., operating vehicles occupy an important position in urban traffic, and people's lives and even social development has an important relationship. It has become an indispensable part of intelligent traffic construction to build an information platform, monitor and manage the operating vehicles, standardize the vehicle behavior and establish a good operation order.

"National Transportation Supervision Service Platform" is one of the important products developed by Beijing Zhong Xing Road Information Technology Co., Ltd. (hereinafter referred to as "Zhong Xing Lu"), and is committed to the monitoring, management and information interaction of the national freight vehicle, in the case of full operation, Each second will produce hundreds of thousands of average traffic and even hundreds of TB of data per day. It is by virtue of the perennial traffic in the field of concentration and industry knowledge accumulation, and continue to accept the courage of emerging technologies, the company in the industry has produced its own unique competitiveness. Recently, CSDN was fortunate to interview the Middle-road system architect Yang, please share the road to the cloud computing, large data and other new technology exploration and trial, and related project development experience.

CSDN: Please give a brief introduction to your experience, what are the key projects or products you are involved in?

Yang: I started working full-time in software research and development in 2003, and worked as an architect 2007 years later. Has participated in the Aviation Safety management Information System, CAAC Operation Management Center, China air traffic flow forecast system, the Ministry of Transport National Cargo Supervision Service platform, the Agile vehicle Networking system, wave gold full media recommendation engine, guest NET, sub-network, simple network, including government platform, SNS System and E-commerce platform development and architecture work.

CSDN: What technical areas do you focus on?

Yang: Long-term attention to emerging technologies, the current major research can be applied to traffic in the field of high concurrency, large data and data mining related technologies.

Committed to traffic informatization to the operational vehicle monitoring and management for the business purpose

CSDN: Please introduce your company's focus on the field, relative to the industry similar companies, your company's core competitiveness is what?

Yang: Our company (Beijing Zhong Xing Road Information Technology Co., Ltd.) has been committed to the field of traffic information technology research and development, solutions provided. The company's core competitiveness is the perennial traffic in the field of focus and industry knowledge accumulation, as well as the courage to continue to accept emerging technologies. At the same time, as the Ministry of Communications Research and development of intelligent transportation industry, the government's support and the help of some world-class IT companies also make our company more competitive in the industry.

CSDN: Please list your company's 1 to 2 fist products. What are the innovations in product design and technology implementation?

Yang: Our company's most important product is the National Transportation Supervision Service platform, which is a national public platform stipulated in the State Council document, and is a quasi commonweal platform. The goal of the platform is to achieve the national Freight Vehicle data aggregation, information interaction. Since the platform is fully operational, it will have a hundreds of thousands of average traffic per second and hundreds of TB of data daily, so it can be a great challenge in terms of technology implementation. In order to achieve this goal, we are now using the industry's major data technology design and development, the next step we will be the Internet mature high concurrency, large data technology in our platform for more in-depth application.

Relying on large data, open source and other technologies, more product ideas into the reality

CSDN: What is the organizational structure and division of your research and development team? What is the main focus of research and development input? Can we talk about some concrete practices?

Yang: Our research and development team is established in the Research and Development Center led by CTO. including technical research and development Department, Technical Management department and testing department three departments. Research and development inputs include normal employee remuneration, hardware procurement, vocational and technical training.

CSDN: How do you think about the impact of new technologies, represented by cloud computing, large data and mobile, on your products (technology)?

Yang: Many years ago, our colleagues in traffic data-related technology have been taking pains to solve the problem of the data source being mobile for a long time and producing a lot of data continuously. Today, cloud computing, large data and mobile Internet technologies provide a viable, reliable, and inexpensive means of implementing our previous challenges. At present, our company through the use of Hadoop, HBase, Lucene, Redis, Storm and other technologies have been resolved in the processing of mass vehicle packet data before the use of traditional database technology is difficult to solve the problem, through the use of these new technologies, we can provide a lot of transport industry new services, These services have only been in the imagination of product managers in previous years.

CSDN: What Third-party services and technologies are used by your company in the course of product development?

Yang: In addition to the technology mentioned in the previous question, we also use a lot of open source technology, such as Linux, Java, MYSQL, Tomcat, ActiveMQ, MongoDB, etc.

Attaching importance to the trend of technology development, grasping real play is the successful way of internet development

CSDN: What was the most memorable (or disgusting) project or product you handled? Can you give me a specific talk?

Yang: The most memorable project I have ever experienced is the full media recommendation engine platform at the time of the wave-panning company. This is an Internet advertising platform developed by Google China's former technology director, Zhou, at a time when it was innovative and technologically advanced. Most of the members of the team are from Baidu, Tencent, Taobao, Sina, Sogou and other large internet companies, we have provided a lot of unique creative thinking and very forward-looking technology, and later built a machine learning technology as the core of a number of technology, multiple languages, solar PV over 1 billion of the large recommended engine platform. Having a very challenging job with a group of excellent colleagues is a very enjoyable memory.

CSDN: What are the most perverted customer requirements you've encountered? Can you give me a specific talk?

Yang: The worst demand I've ever had was the incumbent Guest network project (a kind of micro-trust software developed in 2010) that began to be designed and developed in accordance with the capacity of the Tens user, forced by a number of pressures that had not been fully identified and the user base had not yet been created. Since the technology of Hadoop and HBase was not mastered at that time, the use of MySQL vertical partitioning and horizontal partitioning of the technology to develop, and then integration of geo-information technology, which led to the implementation of each function will be complex. Under this condition, each change in requirements will result in a large number of code modifications that make the developer miserable and lead to a continuous delay in the development cycle. And the demand side of the platform in the selection when the impact of the MTK platform, but ignored is in the initial stage of the Android and iOS platform, which directly led to the advent of the product soon after the impact of Android and iOS quickly eliminated. The failure of the experience in particular, I realized that the development of Internet services can not imagine skyrocketing, must be down-to-earth gradually improve. If you violate the laws of software development and disregard the trend of technological developments, you will certainly taste the bitter fruit that comes with it.

CSDN: What are the main partners of your company? Through which models to collaborate.

Yang: The company's partners, including research institutes and IT companies of technical cooperation, the main way of cooperation is the sharing of technical achievements, the purchase of technical support and other means. Business partners include many logistics companies across the country (see http://www.sinoiov.com/fwwl.html), the mode of cooperation is mainly profit-sharing.

Lack of understanding of vehicle networking in the industry, no reference model can be the main development shackles

CSDN: In your opinion, what is the pain point of developing the product in this field at this stage?

Yang: Now the pain point is mainly in the use of open source software in the transport industry there is not much available reference model, also need to continue to explore and try, in the next research and development work will certainly encounter a variety of difficult to find the existing solutions, we will invest more research and development efforts to deal with.

CSDN: What are your current difficulties in the development process? How did you solve it?

Yang: The main difficulty the research team encounters at this stage is that the technology industry does not know about car networking (in fact, we are a very close to the mobile internet industry), in attracting talent compared with the internet companies are always not dominant. We are now filling this problem by enhancing our participation in various technical exchanges and in-house training learning.