We developed the YFS (Distributed File System) in C language

Source: Internet
Author: User
Keywords We very cloud storage realization entrepreneurship

As well as the "performance and excellent guidance", the technical Circle, "the compilation and excellent entrepreneurial" senior technical people have a lot. Unlike the list on the app Store, entrepreneurs who choose an enterprise-class private cloud (a public cloud that is not intended for individual users) will most likely choose from a single level (cloud storage, cloud server, optimization tools, management platform, security design, etc.) to help customers do some of the customized development of the function, and gradually build their products, Some experience to undertake a number of projects to form the relevant program, big Delete after the establishment of industry-typical application template, and actively introduce the VC, in the region or industry dimension to strive for more profit space.

The characteristics of the business environment itself determines that such innovative enterprises are difficult to use "save a few people, find a creative point, the use of part-time time research and development, less investment, quick benefit," the "fast" business model, instead of "long route, investment, high risk" and is known. As the leader of the start-up Enterprise, the CEO of technology is facing the challenges of transformation and ability upgrading after constructing the core competence of enterprise technology.

Gungfeng: We develop YFS (Distributed File System) in C language

Cloud "Original ecology" business enterprise route

Gungfeng, the founder of the Huayun and the Internet, is one example. However, his experience of "compiling and optimizing the business" may be of great significance to the founders of the "cloud".

Gungfeng, engaged in cluster storage system development for 10 years. Open his resume, has served as the United States cluster File System Company (lustre.org), Sina, Oak Interactive and other companies. During his tenure at Sina, he participated in the expansion of Sina's mailbox from MB to GB, and was responsible for the development of the network's large-scale application infrastructure during its interactive tenure. After accumulating a lot of development experience, inspired by Google file system, he was determined to develop a distributed file system (ie YFS) similar to GFS, to promote the business environment, to solve the huge data high reliable, cost-effective storage, and germination of the idea of self-employment.

It is not difficult to see the growth route of a start-up company:

2004, the individual began to use C language to develop YFS cloud File system first edition of work; 2007, with its own savings to form a development technology team, founder of the United States, and through the Ministry of Science and Technology Investment Guarantee Project plan, access to 1 million innovative guidance fund; In 2008, the YFS cloud file system was perfected, Launched the USS cluster storage system; 2009, will be a combination of KVM and YFS, launched a high availability of data and applications WHS Cloud host program, that is, now the main product: Yee Yun-Large data cloud storage is not Hao Yun, 2010, the Beijing Science and technology-oriented SME technology innovation Fund; 2013, in many industries to open up, eventually won the favor of the wind, the main attack on the government and the military-sensitive market, the establishment of a second new company-Huayun Internet.

This has almost become the most "original ecology" cloud computing Innovation Enterprise Development footnote. Gungfeng think oneself or "luck is better, in when persist, there are always some projects and financial support come in, ups and downs come to the present." ”

In fact, in the domestic cloud computing business Circle, there are quite a number of enterprises have innovative technology, landing products, there is a successful solution, but there is no "enough" funds, more difficult to attract the weight of the wind into the entrance. The reason is also very simple. VCs prefer the middle tier where the investment is less than the relatively quick. And cloud computing, more business-to-business markets, from product development to market to achieve profitability, the 20-month cycle is still short. Into the "cloud", far less than put into mobile interconnection and game development, a few months will be able to achieve revenue projects quickly. What's more, the business-to-business market hides things like relationship marketing, industry thresholds, technical barriers and other VCs that are hard to grasp.

After many years, Gungfeng finally ushered in another stage of entrepreneurial development, but for him, also means will be far away from the technology, into another "circle."

Start with Hadoop, write YFS in C language

The research and development process of the United States can be divided into four phases: 2007-2008 is the process of technology optimization, the main cloud storage. This phase has helped the Mobile Research Institute (Sutra) and the amber Education to make courseware applications, discovering that Hadoop is unfriendly to applications and that many applications need to be developed again two times. 2009-2010, packaged into standard cloud storage. Through the encapsulation, thoroughly solves the standardization process, causes the traditional software to be able to run well, the external provides the interface service to be smoother. In different projects, found that the server running storage will have a considerable waste of CPU resources, for this reason, the company in the second half of 2010 to 2012 independent research and development of one machine, these resources focused on the realization of utilization. This is the evolution phase of the American forest products. 2013, the successful introduction of VCs, and the government and the military as a sensitive market, the special needs of the establishment of a second new company-Huayun Internet.

CSDN: What part of the independent research and development? What is the advantage?

Gungfeng: We have written in C language Yfs (a distributed File system like GFS) and other mechanisms for accessing block storage that are completely different from other cloud storage vendors that are stored through files and objects. Because block-storage based systems can run almost all applications, such as virtual machines, databases, and so on, later Aliyun used this pattern.

And then through the Linux kernel-level virtualization Technology KVM Combination, launched the Hao storage-large data cloud memory products. According to the general architecture standards, storage is at the bottom, on the server, on top of all kinds of applications (including operating systems, management software, etc.). And through our technology, the deployment of cloud storage software on the server side, the use of surplus CPU computing power to run virtual machines, virtual machine deployment of various applications, server and disk array has become a new platform, it can run a variety of applications. From the comprehensive index, the linear expansion performance is very good. All of its key technical parameters are designed to be scalable, including capacity, interface, caching, CPU processing power, and internal bandwidth. Not long ago, we worked with SAP to launch the cloud architecture Data Warehouse, and each of the installed nodes and clusters was easy to expand. Now in Guangzhou mobile more than 1000 PB project application. In addition, there are Yee Yun-large data integration machine. We are working together more enterprises, such as Ufida, Donghua Software, ZTE, CLP information and other partners, in the platform to achieve the optimization of various schemes, such as Call center, mail system, build stations and so on.

CSDN:KVM (linux+ virtualization + open source) is actually a foreign enterprise to lead the open source virtualization?

Gungfeng: Among the three virtualization camps, VMware has the highest market share and is a closed source; Hyper-V is Microsoft's and sun is supporting it, but it's also a closed source; only Xen and KVM open source. But relying on LINUX,KVM force is stronger. As part of Linux, only a portion of the kernel is required for virtualization, especially process management and memory invocation mechanisms are based on Linux and do not need to be written. The load will be very small for the CPU. And on Linux, we have more independent research and development opportunities.

CSDN: How long does it take to develop?

Gungfeng: From 2004 onwards, has been doing.

CSDN: What have you learned all these years?

Gungfeng: It can be said that over the years, we have made a lot of attempts. For example, the original hardware storage, although the market development can also, but not to make money; As for the enterprise to provide cloud disk services, a rush, but later due to the rise of micro-blog, the relevant departments of the review of the content is extremely stringent, development is not smooth; With partners to provide PAAs technology platform (for computing, storage-oriented), Partners to do data mining and other applications. Then calm down, feel that enterprises still need to revolve around the core technology-massive computing and storage, the advantages of allocating resources to develop. So focus on YFS itself, extending to industry solutions. In terms of team division, one team is responsible for YFS optimization and further development, while another team focuses on operators and sensitive industry applications. The company is now nearly 40 people, of whom more than 30 are technical personnel, sales only a few, the proportion of technical personnel in the start-up enterprise is the most high.

CSDN: Is there a growing little story to share?

Gungfeng: Last year to see Baidu's friend, he said five years down, the original business of a gang of friends only our family is still alive. There are three types of entrepreneurship: the first is a pure technology-oriented business, however, relative to the United States of the rational market (listed also no one copy you), the domestic more emphasis on relationship marketing, so make products are not necessarily sold out, so the higher mortality rate; the second is to set the threshold is not high entrepreneurial, the industry's access to open source is mostly consistent, There are alternatives to technology based on open source, the rapid upgrading of technology, not quickly open the market will also die; third, depending on the relationship of enterprises, some enterprises have a deep background, but no core technology, several projects each year, the most is not to die, but also can not achieve greater development. In addition, how to use the power of the big environment, the rapid realization of resource integration, how to do network mining and so are very interesting.

CSDN: In your opinion, what is the meaning of independent research and development?

Gungfeng: The use of domestic research and development of products to replace foreign products, is a process. But the first is that the deletion should be able to achieve the role of substitution. Innovation must start with imitation, such as the Huawei switch, even if only hundreds of yuan, but because of the existence of his (Huawei), so today Cisco's switch prices can be lowered (initially Cisco telephones are more than 4,000). But innovation and research are fundamental, and we need all of our efforts.

CSDN: Still programming? Technical team who is leading?

Gungfeng: Still programming, but more time is the resources that accumulate market expansion in different circles. Fortunately, the company just set up 1-2 months, we found our CTO Wang Jinkai. He is mainly responsible for research and development, I was the first three years of research and development, after the main focus on other issues. Over the years, our technical team is relatively stable, nearly half of them have been 3-5 years old, there are a lot of go (want to go to big enterprises to do "screws") and back. We all feel that the development of enterprise space is still very big.

"To OEM" to achieve independent research and development enterprises?

Do cloud storage enterprises more and more, including Baidu, Tencent, Huawei and other large enterprises figure. It is not easy to get out of the market where the wind is steam steam. In technology, foreign hardware manufacturers grasp the vast majority of the market, "to OEM" slogan has been called for many years, but from the database to the application software to other, the industry did not see significant changes. This road is not good to go.

CSDN: Do cloud storage enterprises more and more, including Baidu, Tencent, Huawei and other large enterprises figure. How to look at this big market?

Gungfeng: In terms of architecture, IaaS itself has private cloud and public cloud applications. Ali, Shanda, Tencent is a public cloud, is for the small and medium-sized cloud services products. And private cloud is mostly industry-oriented users and large enterprises. From the current development point of view, because of its industry attributes, government and other industries are difficult to use the public cloud. And if AWS wants to provide some of the public cloud services for large enterprises, it is still groping and trying. We are based on private cloud solutions, to provide sensitive customers with "Go OEM" services, such as KVM and YFS combination of independent research and development programs. In addition, we provide an open interface to the public cloud. It should be emphasized that we do not do cloud storage business, but do cloud storage technology. Simply put, cloud storage enterprises such as Baidu, Tencent, north China can be achieved through the technology we provide. For the time being, the United States is still the equivalent of a sales model, not a service model. Architecturally, we're exactly the same as Aliyun, basically Amazon architecture.

CSDN: Most of the private cloud is about industry companies, like banks? Is there an advantage to open source solutions?

Gungfeng: Some banks are starting to try the Hadoop program on the bi side, chasing its roots in cost and technology advantages. For example, the budget in 100 million, with a small machine + mainstream database may be only a few sets, but with hadoop+ open source scheme is enough to hundreds of sets. For many large data analysis, Hadoop is more efficient and faster. Therefore, in the real contrast, customers are also considering and judging. We are equivalent to an app on Hadoop, and the application in a particular field is more obvious.

CSDN: What are the specific needs of the sensitive market?

Gungfeng: Startups need to follow business needs. The user was originally a fragmented service and now requires tiered services. For example, many of the country's sensitive industries (high security standards) put forward "to OEM" slogan, from a certain level, is at the IaaS level to replace the Cisco switch, IBM server, EMC storage, PAAs replacement Oracle and other middleware, SaaS replaces foreign ERP and CRM software. This provides a good opportunity for the development of the domestic self-developed technology enterprises.

CSDN: What kind of change is going to happen to the cloud storage area?

Gungfeng: We have been clinging to the cloud storage area. So many years down, see now many such as platform city behind all projects need large storage, simple data storage can use more inexpensive devices such as disk array, but this data is simply storage, may be able to access, perhaps completely can not. The data is fragmented and unrelated. Wanting to do deep digging and analysis in these data is basically impossible. Now, we have seen the need to classify and secure the storage content, and we believe there will be further development in the future.

"Edit and excellent continue excellent", or "knitting and gifted"?

Many of our enterprises, whether in the open source technology improvement, or in the road of independent research and development, have accumulated and harvested, and some areas even have the potential to catch up. such as Gungfeng Senior technical staff has gone to the "knitting and excellent entrepreneurial". But is this the only home for senior programmers?

CSDN: Is it possible for these senior programmers to continue to "edit and Continue"?

CTO Wang Jinkai: For programmers, accumulation is not necessarily valuable. There is a saying that "programmers can only do 30 years old", which is very realistic. On the one hand, it is because of energy, and on the other hand, it may take only half of your salary to find a young employee with the same job. It's hard to want programmers like those who have been programming for life abroad. After all, Windows core system development has only 10 people, while there are thousands of external drivers. Even if it's Google storage, that's how many people are writing. To become such an absolute core, we need talented people.

CSDN: Is it necessary to "make up and start a business"?

Gungfeng: If I had known I was so tired, I must have continued to be a screw in a big company. Walked for so many years, my own mentality from the wave ups and downs to today's insipid, life has to go through some of the more valuable.

Interview PostScript

Frankly speaking, the industry is not very optimistic about the 2013. But Gungfeng's more prized view is that "there are more opportunities for startups when it comes to austerity." As the US economic chart and Wal-Mart's earnings show the opposite trend, the economic downturn, the financial results. The reason is that more people came to Wal-Mart to buy inexpensive products. It is also the case, especially in the open source of the road when the good technology and the advantages of products, relatively low price, will certainly be able to gain more room for growth.

With only a few sales (and Gungfeng themselves), is there a new model for innovative companies in the cloud with 35 research teams? "We are an idealist with a bunch of opportunists," Gungfeng said. "Rather thought-provoking.

In writing, coincides with "military intelligence decoding" China's large-scale transport "20" special column. There are military fans sharp point of view that "key components such as engines are imported, talk about what independent research and development?" "General Zhaozhong replied:" How is not independent research and development, from the idea to the project design and then to the drawings, are our own. If parts such as engines are now being purchased globally to reduce costs, half of all parts of the United States are sourced globally. Is it because you want to eat steamed bread and grow your own wheat? It is also appropriate to answer this question. In Gungfeng, we see more "cloud" on the dream and pursuit of start-up entrepreneurs. This is the second article in the CSDN Cloud computing channel "China Cloud Innovation Pioneer Series interview". The future, we look forward to more "cloud" on the experience of enterprises to share.

(Responsible editor: Lu Guang)

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.