Alpha version test report

First, Introduction

1.1 Purpose of testing

(1) Test the functionality, efficiency and reliability of the alpha version of the AI code room team.

(2) Fix the bug that updated the alpha version of the crawler.

(3) Statistics are recorded to facilitate future comparison with the beta version.

1.2 Purpose of writing　　

(1) Summarize and test the alpha phase development tasks and analyze test results.

(2) Describe whether the system complies with the Alpha version requirements.

1.3 Test personnel

Fu Mi, Zhou Wenxiang.

1.4 Test cycle

2015/11/9-2015/11/15.

Ii. Summary of the test

2.1 Additional bugs found in function and performance tests

A) fetch page exceeds the required number.

b) Type judgment error, the URL containing the PDF is determined as a PDF type of page.

c) The crawl task for the specialized document is not responding.

d) Generic crawling recognizes only HTML and PDF types.

e) file storage location exception.

f) The number of pages downloaded differs from the number of database entries updated.

g) page information is stored in the database without downloading the file locally.

h) thread exception (not resolved)

i) database connection exception (unresolved)

2.2 Test Plan

2.2.1 Functionality

(1) The main functions of the system implementation, including the seed input according to the user's choice seed input and the number of pages that need to crawl to crawl the relevant URL.

(2) Minor features of the system implementation, including displaying the current crawl progress and displaying the URL of the current crawl Web page.

(3) The URL input field must not contain special characters.

2.2.2 Reliability

(1) Operation button to prompt information correctness, consistency, understandable.

(2) Restrictions on information correctness, consistency, and understanding of the situation.

(3) The input mode is understandable.

(4) The consistency of the data language and the interface language under the Chinese interface.

2.2.3 Usability

The system must achieve a more stable operation at the level of user requirements. At the same time, the user's operating system is compatible to ensure that users can be used stably.

2.2.4 Security

The system should ensure the security of user's information and data in the process of crawling data.

2.2.5 Performance

New versions of crawlers should crawl more efficiently and faster.

Iii. content and implementation of the test

3.1 Functional Testing

Function	Basic requirements	Whether to pass
Database connection	The ability to connect to the database via the UI interface and to perform related operations	√
URL Receive	Ability to receive seed URLs via input or file	√
General-Purpose Crawling	Be able to crawl all types of files acceptable to the system and record relevant information in the database and download the files to local	√
Specialized crawling	Crawl only specific file types and log relevant information in the database to download the files to a local	√
Quiz page Crawl	Crawl and categorize quiz pages and store them locally	√
Fixed analysis function	Ability to display analysis results with information	√
Custom Analysis Features	Ability to analyze crawled files based on custom keywords set by the user	√
Display of the progress meter	The progress meter can react to crawl status in real time	√
Crawl keyword Settings	Crawlers can filter out pages that don't contain keywords	√

3.2 Performance Testing

3.2.1 General crawl time-consuming comparison

Test number	Crawl method: URL Address	Number of pages	Old version takes time (MS)	New version takes time (MS)
1	General-Purpose Crawl: http://ask.csdn.net	100	64276	47320
2	General-Purpose Crawl: http://q.cnblogs.com	100	21170	10006
3	General-Purpose Crawl: Http://www.dewen.io	100	37152	15880

3.2.2 General Crawl Limit Web page (test data not yet handed in, to be perfected)

Test number	Url	Limit Crawl Page Count	Time-consuming (ms)
1	http://www.eecs.berkeley.edu/Pubs/TechRpts/	4798	5981392
2
3
4
5
6
7

3.3 Resource Usage

CPU utilization (%)	Memory consumption ()
40%~80%	350mb~600mb

3.4 Reliability

Test content	Basic requirements	Whether to pass
Power down	The client restarts the machine after power-down or forced shutdown, without losing data.	√
File download	The crawled content has been saved when the crawler is accidentally or artificially interrupted.	√
Crawl Content classification	The crawler obtains the resources to carry on the proper classification, in order to guarantee the data reasonable reliable	√

3.5 Security

Test content	Basic requirements	Whether to pass
Database security	The database has only permissions for the user to query and not modify, delete, etc.	√
Security of crawled information	The information that is crawled is placed within a specific path, and only the specified user can extract	√
User Rights	Whether all authorized users can work under delegated authority and do not tolerate super-privilege	X

3.6 Ease of Use

Test content	Basic requirements	Whether to pass
Ease of installation	The installation parameters give the default value or prompt, need user intervention place as little as possible, easy to operate.	√
Easy interface	It is easy to use the program with reference to the instruction manual.	√
Easy to operate	Run the crawler directly by double-clicking the icon	X
Easy Data Extraction	By redirecting the file path, the user can find the file path to save the resource more conveniently.	√

Iv. statistics and analysis of defects

Defect Type	Specific instructions	Cause analysis
Crawl Action exception	When a crawl action is in progress, some exceptions occur	The exception is not adequately positioned and the error message is fed back to the developer. These exceptions need to be handled and the error message thrown to the developer
UI actions	Illegal operation of the UI will cause the program to die	The listener does not specifically handle the illegal input of the UI, and the crawler is less tolerant to the user.

V. Conclusion of the Test

The AI code Room Alpha version of the crawler system in many aspects of a certain test. The general test, including the following summary: Functional, reliability, safety, usability four aspects of a comprehensive, rigorous, standardized testing. The test results show that the crawler achieves the requirements of alpha release and has the following characteristics:

1, the system architecture is advanced, simple, and compared to the original version more optimized.

2, feature richness has improved, if continue development can be further developed for security.

3, the system reliability is high, and compared to the original version, the classification is more clear. Restart the machine after the client has power down or forcibly shut down, and the network is interrupted unexpectedly. There is a perfect data verification mechanism, the user input of non-compliant data, gave a concise, accurate information, when necessary to help. At the same time, the information classification in the database is clear, which facilitates the user to reasonably invoke the database information.

Test conclusion: Pass.

Alpha version test report