Release of iveely search engine 0.1.0

I have always loved the search engine business, but it is not my job now. You may ask, what is iveely? Iveely is the abbreviation of I void everything and enjoy loving you, which expresses my love for search engines. The version 0.1.0 is currently released. It is a basic version and contains numerous buckets. You can download the source code at http://iveelyse.codeplex.com/. you can download any modified source code. However, after you download the source code, you may scold me. What is the source code? Can you understand it? It's a mess. When you have such an idea, please forgive me. These things are all developed in my spare time, and there are not many shortcomings, but I believe that one day you will also sigh, it wasn't that bad. All source code is open for knowledge sharing, if you have good ideas and suggestions, you can send an email to me: liufanping@iveely.com, if you want to participate in, contribute your code, please contact me to make a little contribution to the community and open source.

 

Iveely search engine version 0.1.0 only supports text search, and the rest of news and videos are not fully prepared yet. The Unified Storage Model is not found. The basic structure of a project is described below:

The preceding steps are divided into three parts, which correspond to the three running steps in the iveely search engine (when you download the program, the running method follows the previous steps ).

1. Find the iveelyse.spider.exe file under the folder, and enter the link you want to crawl. This is part of a's search. 2. After crawling, find the iveelyse.index.exe under the folder and run it until it is finished. Complete the index. This is Part B. 3. In this case, run the iveelyse.exe file and you will be able to perform the search. You need to deploy the website on the search page. If you do not want this, you can directly run iveely.search.exe to perform a local search without running iveelyse.exe. This is part of the C service.

The following describes the meaning of each project in the entire solution.

"Iveelyse", "iveelyse \ iveelyse. csproj", is the creation part of the search service. The search entry starts from here.

"Iveelyse. ai", "iveelyse. AI \ iveelyse. AI. csproj", AI part of search, similar to expert systems. For example, enter 101 + 90 =? It is calculated through this project.

"Iveelyse. classify", "iveelyse. classify \ iveelyse. classify. csproj" is the implementation part of text classification (clustering) in search engines.

"Iveelyse. Common", "iveelyse. Common \ iveelyse. Common. csproj" is a common part of the search engine.

"Iveelyse. config", "iveelyse. config \ iveelyse. config. csproj", is the configuration part of the search engine and is implemented in this project as much as possible.

"Iveelyse. Grammar", "iveelyse. Grammar \ iveelyse. Grammar. csproj" is the syntax analysis part of the search engine, such as site and filetype.

"Iveelyse. Index", "iveelyse. Index \ iveelyse. Index. csproj" is the index part of the search engine. the sorting of the original data is mainly implemented here, And the sorting is also done in reverse order.

"Iveelyse. liquidate", "iveelyse. liquidate \ iveelyse. liquidate. csproj", is a part of language processing, such as deprecated word filtering and sensitive word processing.

"Iveelyse. segment", "iveelyse. segment \ iveelyse. segment. csproj", Word Segmentation in Ise, including word segmentation and hidden Markov word segmentation.

"Iveelyse. Server", "iveelyse. Server \ iveelyse. server. csproj", about network communication and transmission in Ise.

"Iveelyse. Spider", "iveelyse. Spider \ iveelyse. Spider. csproj", which is a web crawler, that is, the data collection part.

"Iveelyse. IDFs", "iveelyse. IDFs \ iveelyse. IDFs. csproj", which is part of the Distributed File System. All mapreduce implementations will be here (this version is invalid ).

"Iveelyse. bigdata", "iveelyse. bigdata \ iveelyse. bigdata. csproj", this is the big data processing part (this version is invalid ).

"Iveelyse. bigdata. Common", "iveelyse. bigdata. Common \ iveelyse. bigdata. Common. csproj", common reference of big data processing (this version is invalid ).

"Iveelyse. bigdata. filesystem", "iveelyse. bigdata. filesystem \ iveelyse. bigdata. filesystem. csproj", Virtual File System for Big Data Processing (this version is invalid ).

"Iveelyse. bigdata. masternode", "iveelyse. bigdata. masternode \ iveelyse. bigdata. masternode. csproj", master node of big data storage (this version is invalid ).

"Iveelyse. bigdata. storenode", "iveelyse. bigdata. storenode \ iveelyse. bigdata. storenode. csproj", part of the subnode of big data storage (this version is invalid ).

"Iveelyse. Search", "iveelyse. Search \ iveelyse. Search. csproj", local implementation of the search, no web, as long as it is used for internal debugging.

"Iveelyse. Web", "iveelyse. web \ iveelyse. Web. csproj", is implemented on the Web end of the search. The ask interface is used.

This is a rough introduction of iveely search engine. Of course, iveelyse is definitely not as good as you think, because it is in the 0.1.0 low version stage, and countless errors or bugs will definitely cause everyone to crash, however, please rest assured that we (more people who love open source) will actively modify the bugs. Of course, the project also involves other open source projects, such: HTML analysis uses htmlagilitypack. We hope to share our happiness with more friends. Thank you! Address: http://iveelyse.codeplex.com/