Analysis and solution of Software Evaluator (PM) test questions in the second half of 2013

Real title three (15 points): Read the following instructions, answer questions 1 to 3, and fill in the corresponding column of the answer sheet.

Description: A software company designed and developed an online banking system for a bank. The system provides basic payment, enquiry, transfer and information modification functions. The bank has put forward the preliminary performance index to the online banking system:
(1) The transaction response time is not more than 2 seconds
(2) Concurrent users =1000
(3) CPU utilization does not exceed 80%
(4) The system needs to support uninterrupted and stable operation on a 24x7 scale
(5) The number of transactions without seconds is 7
(6) The trading success rate is 100%
The software is now required for performance testing.

Issue 1 (4 points):
Common performance tests include load tests, stress tests, concurrency performance tests, fatigue strength tests, and big data volume tests. For the 6 performance indicators described in the topic, what are the indicators involved in concurrent performance testing and fatigue strength testing?

Issue 2 (6 points): Performance testing for a single performance indicator, often requires a number of different testing methods, the software company needs to test performance indicators (1) and (5), designed the following test scenario:
Test the number of concurrent users in general, and gradually increase the number of concurrent users, Test:
(1) When the response time is 2 seconds, the system can withstand the maximum number of concurrent access users;
(2) The number of concurrent access users, the response time is not acceptable (for example, more than 2 seconds)
Please indicate respectively which of the two Tests belong to which type of test, The basic concepts of the two test types are explained separately.

Question 3 (5 points):
When testing performance indicators (5), the software company simulates a large number of concurrent users on the client side to perform business operations, counting the number of transactions per second in a draw. The software company considers that the client receives the response information unrelated to the test of the performance indicator, and therefore initiates a normal business request on the impersonated client, discarding the response information directly after receiving the system response, without performing a functional check. Please indicate whether the software company is doing the right thing, and briefly explain the cause and the side effects of performing a function check.

Reference Answer:

Question 1:
Indicators involved in concurrent performance testing are (1) (2) (5)
Fatigue strength testing involves indicators (4)


Question 2:
The first test is a load test, and the second Test is a stress test.
Load testing is done by progressively increasing the load on the system, testing the performance of the system, and ultimately determining the maximum amount of load that the system can withstand in the event of performance metrics being met.
The stress test is to obtain the maximum service level test that the system can provide by gradually increasing the system load, testing the system performance changes, and finally determining under what load conditions the system performance is in a failed state.


Question 3:
The practice of the software company is wrong.
The software company did not perform the function check in the load pressure test, ignoring the problem of the function instability under the condition of load pressure. Without proper function assurance, the load pressure performance test loses its meaning.
During the testing process, it is necessary to record the result of business operation, which leads to the resource consumption, the increase of operation behavior and the large number of logs.

Analysis and solution of Software Evaluator (PM) test questions in the second half of 2013