Transactions (User transaction analysis)
User transaction analysis is a basic performance analysis from the user's perspective.
1. Transation Sunmmary (transaction summary)
Comprehensive analysis of transactions is the first step in performance analysis. By analyzing the success and failure of user transactions within the time period,
You can directly determine whether the system is running normally.
2. Average Transaciton Response Time (Average Transaction Response Time)
The "average Transaction Response Time" shows the average transaction execution time per second during the test scenario,
It can analyze the performance trend of the application system during the test scenario.
For example, as the test time changes, the transaction processing speed of the system gradually slows down. This shows that the overall performance of the application system will decrease as the production time changes.
3. Transactions per Second (number of Transactions per Second/TPS)
The number of transactions per second/TPS is displayed every second of the scenario. The number of transactions that pass, fail, and stop makes the system performance an important parameter. It can be used to determine the transaction load of the system at any given time point.
The analysis TPS mainly refers to the performance trend of the curve.
Compare it with the average transaction response time to analyze the impact of the number of transactions on the execution time.
For example, when the pressure increases, if the click rate/TPS curve changes slowly or flat,
It is likely that the server becomes a bottleneck.
4. Total Transactions per Second (number of Transactions passed per Second)
"Number of transactions passed per second" shows the total number of transactions passed in each second during the scenario,
Total number of failed transactions and stopped transactions.
5. Transaction Performance Sunmmary (Transaction Performance summary)
The transaction performance summary shows the minimum, maximum, and average execution time of all transactions in the solution,
You can directly determine whether the response time meets the user's requirements.
Focus on the average and maximum execution time of transactions. If the range is not within the acceptable time range,
Cause analysis is required.
6. Transaction Response Time Under Load (Transaction Response Time and Load)
The "Transaction Response Time and load" is a combination of the "running Virtual users" diagram and the "Average Response transaction time" diagram,
It shows the relationship between the transaction response time and the number of users at any point in time,
In this way, you can master the performance data of the system in terms of user concurrency and provide a reference for expanding the user system.
This figure shows the overall impact of virtual user load on execution time,
It is useful for analyzing test scenarios with gradient loads.
7. Transaction Response Time (Percentile) (Transaction Response Time (percentage ))
The transaction response time (percentage) is a comprehensive analysis graph obtained based on the test results,
That is, charts indirectly obtained by tools through statistical analysis methods.
It can be used to analyze the percentage of transactions that can be executed within a given transaction response time range.
8. Transaction Response Time (Distribution) (Transaction Response Time (Distribution ))
The "transaction response time (distribution)" shows the distribution of the time used for transaction execution during the running of the scenario,
It can be used to understand the number of transactions with different response times during the test.
If the system pre-defines the minimum and maximum Transaction Response Time acceptable for the relevant transaction,
You can use this figure to determine whether the server performance is within the acceptable range.
Web Resources)
Web Resource Analysis analyzes the performance of Web servers from the perspective of servers.
1. Hits per Second (clicks per Second)
"Number of clicks per second", even if the number of HTTP requests that virtual users submit to the Web server per second during the running scenario.
It can be used to evaluate the workload generated by a virtual user, for example, compare it with the "average Transaction Response Time" graph,
You can view the impact of the number of clicks on transaction performance.
You can check the number of clicks per second to determine whether the system is stable.
The decrease in the system click rate usually indicates that the server's response speed is slowing down. Further analysis is required to find out the bottleneck of the system.
2. Throughput (Throughput)
The "throughput" shows the server throughput per second during the scenario. The measurement unit is byte,
Indicates the amount of data that the virtual machine obtains from the server every second.
The workload generated by virtual users can be evaluated based on the server throughput,
And check whether the server's traffic processing capabilities and bottlenecks exist.
Differences between the "throughput" and "click rate" charts:
The click rate chart shows the number of HTTP requests processed by the server per second.
The "throughput" diagram shows the total data volume that the client obtains from the server per second.
3. HTTP Status Code Summary (HTTP Status Code overview)
The "HTTP status code overview" shows the number of HTTP status codes returned from the Web server during the scenario or session step. This figure is grouped by code. The HTTP status code indicates the status of the HTTP request.
4. HTTP Responses per Second (number of HTTP Responses per Second)
"HTTP responses per second" shows the number of different HTTP status codes returned from the Web server per second during the running scenario. It also returns status codes. By analyzing status codes, you can determine the running status of the server under pressure, or you can group the results shown in the figure to locate the code scripts that generate errors.
5. Pages Downloader per Second (number of download Pages per Second)
"Number of pages downloaded per second" shows the number of webpages downloaded from the server per second during the scenario or session step.
Use this figure to calculate the load generated by the Vuser based on the number of pages downloaded.
Like the throughput chart, the number of page downloads per second icon is the volume of data that a Vuser receives from the server within any given second. However, the throughput of each resource is extremely large (for example, the size of each GIF file and the size of each webpage)
The number of pages downloaded per second is only the number of pages.
Note: To view the page views downloaded per second, you must set the number of pages per second (HTML mode only) in the R-T-S )".
6. Retries per Second (number of Retries per Second)
"Number of retries per second" indicates the number of connections tried by the server in the scenario or session step.
The server connection will be retried in the following cases:
A. The initial connection is unauthorized.
B. Proxy Server authentication is required
C. The server closes the initial connection.
D. The initial connection cannot connect to the server.
E. The server cannot parse the IP address of the Server Load balancer.
7. Retries Summary (Summary of Retries)
The "retry count summary" shows the number of server attempts during the scenario or session step operation,
It is grouped by retry reason.
Using this diagram with the number of retries per second graph can determine the time at which the server retries during the scenario or session step.
8. Connections (Connections)
"Connections" shows the number of TCP/IP connections opened at each time point during the scenario or session step.
With this figure, you can know when to add a connection.
For example, when the number of connections reaches a stable state and the transaction response time increases rapidly, adding a connection greatly improves the performance (the Transaction Response time decreases ).
9. Connections Per Second (number of Connections Per Second)
"Connections per second" shows the number of TCP/IP connections established per second during the running process.
Ideally, many HTTP requests should use the same connection, instead of opening a new connection for each request.
The number of connections per second graph shows the processing status of the server, indicating that the server performance is gradually decreasing.
10. SSLs Per Second (number of SSL connections Per Second)
"Number of SSL connections per second" shows the new and re-used SSL connections opened per second during the scenario or session step.
Number of connections. When a TCP/IP connection is enabled to the security server, the browser opens the SSL connection.
Web Page Breakdown (Page element segmentation)
"Page element subdivision" is mainly used to assess whether the page content affects the response time of transactions,
It can be used to analyze in depth the problematic images on the website that are slow to download or interrupted connections.
Element.
1. Web Page Breakdown (Page Breakdown overview)
"Page breakdown" shows the response of a specific transaction in the test process, and then analyzes whether the related transaction runs normally.
The page breakdown chart can be further subdivided in the following four ways:
1) Download Time Breaddown (Download Time subdivision)
The "download time subdivision" graph shows the download time of different elements on the web page. You can also split the time according to the download process, different colors are used to display the proportion of DNS resolution time, connection establishment time, and first buffer time.
2) Component Breakdown (Over Time) (Component subdivision (changed Over Time ))
The "component segmentation" chart shows the page components of the selected webpage that change over time.
The figure shows which elements have unstable download time during the test.
This figure is especially suitable for pages with many controls to be downloaded from the client. By analyzing the response time of the control, it is easy to find the unstable or time-consuming controls.
3) Download Time Breakdown (Over Time) (Download Time subdivision (changed with Time ))
The "download time subdivision (changed over time)" graph shows the page element download time subdivision (changed over time) of the selected page, it clearly shows the download of each element on the page during the stress test.
The "download time subdivision" graph shows the time statistical analysis result of the element response on the entire test process page, and the "download time subdivision (changed over time) "displays the statistical results of page element response time in every second during the scenario running. The two analyze the download time of page elements from both the macro and micro perspectives.
4), Time to First Buffer Breakdown (Over Time)
(First buffer time subdivision (changes with time ))
The "first buffer time segment (varies with time)" graph shows that the first buffer returned from the Web server is successfully received.
The server time and Network Time (
In seconds ). You can use this figure to determine the time when a server or network problem occurs during the scenario or session step.
First Buffer Time: after the client establishes a connection with the server,
Start from the time when the server sends the first packet, and the data is transmitted to the client over the network,
The time when the browser receives the first buffer.
2. Page Component Breakdown (Page Component subdivision)
The "Page component subdivision" graph shows the average download time (in seconds) of each webpage and its components ).
You can sort the chart columns based on the average number of seconds used to download the component. This helps isolate problematic components.
3. Page Component Breakdown (Over Time) (Page Component Decomposition (changed Over Time ))
The "Page component breakdown (changes over time)" chart shows each page in each second during the running of the solution.
And the average response time of its components (in seconds ).
4. Page Download Time Breakdown (Page Download Time subdivision)
The "page download time subdivision" graph shows the subdivision of the download time of each page component,
You can determine whether the slow Transaction Response Time is caused by a network error or a server error during the download process.
The "page download time subdivision" graph displays the DNS resolution time, connection time, first buffer time,
The SSL handshake time, receipt time, FTP verification time, client time, and error time are used to download each component.
The process is subdivided.
5. Page Download Time Breakdown (Over Time) (Page Download Time subdivision)
(Changed over time ))
The "page download time subdivision (changed with time)" graph shows each page component in each second during the running of the solution.
Download time segments. Use this figure to determine the time point at which the network or server encountered a problem during the execution of the solution.
"Page component subdivision (changed over time)" and "page download time subdivision (changed over time )"
The diagram is usually combined for analysis: first, determine the problematic components and then analyze their download process,
Then locate the cause.
6. Time to First Buffer Breakdown (First Buffer Time subdivision)
The "first buffer time subdivision" graph shows the server/network time of each page component before the first buffer is successfully received from the Web server. If the component has been downloaded for a long time,
You can use this figure to determine whether the problem is related to the server or the network.
Network Time: the average time that begins at the moment of the first HTTP request until it is confirmed.
Server time: defined as starting from receiving the initial HTTP request for confirmation,
The average time that passes until a buffer from the Web server is successfully received.
7. Time to First Buffer Breakdown (Over Time) (First Buffer Time subdivision
(Changed over time ))
The "first buffer time segment (varies with time)" graph shows that the first packet returned from the Web server is successfully received.
The server time and network time of each web page component in each second of the scenario running during the period before buffering.
You can use this figure to determine the time when a server or network problem occurs during the running of the scenario.
8. Downloader Component Size (KB) (Size of downloaded components)
The downloaded component size graph shows the size of each downloaded webpage.
It can be seen which components are relatively large and need further optimization to improve performance.