Open-source: Real-time collection, real-time indexing, and real-time retrieval of video search engines are officially open-source. A single machine supports full-text indexing on 30 million web pages.

Open-source: Real-time collection, real-time indexing, and real-time retrieval of video search engines are officially open-source. A single machine supports full-text indexing on 30 million web pages.

The entire video search engine includes: website (C # + C), Chinese Word Segmentation Server 3.2 (c language), indexing kernel 2.0 (C language), Indexing Server 1.0 (C # + C language) collector 3.1 (Delphi)

Website-related indicators:
Development language: C # + C Language
Compiler: vs2008
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Data storage: either MySQL, SQL Server, SQLite, or Oracle can be used without changingCode, You only need to change the configuration file
Performance Indicator: Valid concurrency per minute: 0.1 million
Online example: http://bida.cc
:
Open source or not: Yes, with complete code comments and instructions
Free or not: Yes

Index Server 1.0 related indicators:
Development language: C # + C Language
Compiler: vs2008
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Performance Indicator: daily effective index> = 0.5 million (Real-Time: Real-time Data Index addition)
Open source or not: Yes, with complete code comments and instructions
Free or not: Yes

Index kernel 2.0 (C Language) related indicators:
Name: Full-text indexer for millions of commercial circles
Development language: C Language
Compiler: gcc
Test environment: XP, Win2000, win2003, win7, win2008, Win8, Ubuntu, Suse, centeros
Performance Indicator: uses an innovative inverted full-text index. A single machine (general PC 2G memory) supports full-text indexing on 30 million web pages, and any retrieval cannot exceed 0.2 seconds.
Function Support: New Index, update index, delete index, search merge
Open source or not: No, with complete code comments and instructions
Free or not: Yes
Index kernel 1.0 (C Language) description, including dynamic summary, highlight, and related settings

Chinese Word Segmentation Server 3.2 (c language) related indicators:
Name: Chinese Word Segmentation server for millions of business circles
Compiler: gcc
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Quality Test: Random tests with 3000 points and 10 K + casesArticle
Average performance: Single-thread splitting of articles within 50 thousand words can be completed within 1 second
Example: http://bida.cc: 888
Open source or not: No, with complete code comments and instructions
Free or not: Yes
Internal version: Single-threaded stable version
Description: http://www.cnblogs.com/bwsyq/archive/2011/12/02/2271611.html
Note: The website development framework provides three Chinese word segmentation methods, which use millions of business circles by default.

Collector 3.1 (Delphi) related indicators:
Name: Millions of commercial circle dragon spider collectors-video collectors
Compiler: Delphi 7.0
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Quality Testing: continuous operation in non-special circumstances> = one year
Average performance: collects thousands of videos per minute at a bandwidth of less than 2 MB
Open source or not: No, with complete code comments and instructions
Free or not: Yes

Additional: million commercial circle dragon spider collector 3.1-web page COLLECTOR: You can set the storage directory and collection depth,
Theoretically, an entry address can collect the entire internet.ProgramContinuous operation for one year,
There will be no errors. Every 5000 documents will automatically generate a sub-directory, and the file names are all Integers to facilitate indexing.

For a complete description, see tutorial .doc (2.66 MB)
CompleteSource codeDownload 1: package of millions of commercial circles Video Search Engine source code and complete description (37.42 MB) on Windows
Full source code download 2: All source code and all modules complete (39.58 MB) package on Linux

Note: A single machine (general PC, General hard disk, 2 GB memory) supports a maximum of 30 million full-text indexes of data or webpages, and any search cannot exceed 0.2 seconds.
For more than 30 million of the data, use the open-source programmable cluster distributed cloud platform of one million business circles.

Exchange Group: 74965947, 72133568 I QQ 99923309 MSN: bwsyq@bwsyq.com

In addition, video search is just a reference. You can develop other types of search engines based on this code.

Note: The above code and programs are completely independently created by myself, without any copyright dispute.

Copyright:Millions of business circles Http://bwsyq.comI reserve the final right to interpret all copyrights.

Open-source: Real-time collection, real-time indexing, and real-time retrieval of video search engines are officially open-source. A single machine supports full-text indexing on 30 million web pages.

The entire video search engine includes: website (C # + C), Chinese Word Segmentation Server 3.2 (c language), indexing kernel 2.0 (C language), Indexing Server 1.0 (C # + C language) collector 3.1 (Delphi)

Website-related indicators:
Development language: C # + C Language
Compiler: vs2008
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Data storage: either MySQL, SQL Server, SQLite, or Oracle can be used. You only need to change the configuration file without changing the code.
Performance Indicator: Valid concurrency per minute: 0.1 million
Online example: http://bida.cc
:
Open source or not: Yes, with complete code comments and instructions
Free or not: Yes

Index Server 1.0 related indicators:
Development language: C # + C Language
Compiler: vs2008
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Performance Indicator: daily effective index> = 0.5 million (Real-Time: Real-time Data Index addition)
Open source or not: Yes, with complete code comments and instructions
Free or not: Yes

Index kernel 2.0 (C Language) related indicators:
Name: Full-text indexer for millions of commercial circles
Development language: C Language
Compiler: gcc
Test environment: XP, Win2000, win2003, win7, win2008, Win8, Ubuntu, Suse, centeros
Performance Indicator: uses an innovative inverted full-text index. A single machine (general PC 2G memory) supports full-text indexing on 30 million web pages, and any retrieval cannot exceed 0.2 seconds.
Function Support: New Index, update index, delete index, search merge
Open source or not: No, with complete code comments and instructions
Free or not: Yes
Index kernel 1.0 (C Language) description, including dynamic summary, highlight, and related settings

Chinese Word Segmentation Server 3.2 (c language) related indicators:
Name: Chinese Word Segmentation server for millions of business circles
Compiler: gcc
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Quality Testing: Random articles with 3000 points and 10 K + cases
Average performance: Single-thread splitting of articles within 50 thousand words can be completed within 1 second
Example: http://bida.cc: 888
Open source or not: No, with complete code comments and instructions
Free or not: Yes
Internal version: Single-threaded stable version
Description: http://www.cnblogs.com/bwsyq/archive/2011/12/02/2271611.html
Note: The website development framework provides three Chinese word segmentation methods, which use millions of business circles by default.

Collector 3.1 (Delphi) related indicators:
Name: Millions of commercial circle dragon spider collectors-video collectors
Compiler: Delphi 7.0
Test environment: XP, Win2000, win2003, win7, win2008, Win8
Quality Testing: continuous operation in non-special circumstances> = one year
Average performance: collects thousands of videos per minute at a bandwidth of less than 2 MB
Open source or not: No, with complete code comments and instructions
Free or not: Yes

Additional: million commercial circle dragon spider collector 3.1-web page COLLECTOR: You can set the storage directory and collection depth,
Theoretically, an entry address can collect the entire Internet, and the program can run for one year without special circumstances,
There will be no errors. Every 5000 documents will automatically generate a sub-directory, and the file names are all Integers to facilitate indexing.

For a complete description, see tutorial .doc (2.66 MB)
Full source code download 1: Millions of commercial circles Video Search Engine source code and complete description (37.42 MB) package on Windows
Full source code download 2: All source code and all modules complete (39.58 MB) package on Linux

Note: A single machine (general PC, General hard disk, 2 GB memory) supports a maximum of 30 million full-text indexes of data or webpages, and any search cannot exceed 0.2 seconds.
For more than 30 million of the data, use the open-source programmable cluster distributed cloud platform of one million business circles.

Exchange Group: 74965947, 72133568 I QQ 99923309 MSN: bwsyq@bwsyq.com

In addition, video search is just a reference. You can develop other types of search engines based on this code.

Note: The above code and programs are completely independently created by myself, without any copyright dispute.

Copyright:Millions of business circles Http://bwsyq.comI reserve the final right to interpret all copyrights.