"Software analysis and Mining" Boat:an experimental Platform for researchers to comparatively and reproducibly Evaluate Bug Localization Techni Ques

Summary:

There are many bug targeting techniques, but because they are based on different datasets, and some datasets are not public , and even some techniques are only applied to small datasets and are not universal , it is not good to compare the pros and cons of these technologies.

Therefore, boat was born. Boat refers to:Bug lOcalization Experimental PL at form. This is a web platform, developers register, you can upload their bug location technology, because the data set tested on this platform is the same, so with other bug location technology is comparable.

Address: HTTP://WWW.VLIS.ZJU.EDU.CN/BLP. (Don't know what the reason is, can't access =.=)

S1 Introduction

Main introduction Motive, and abstract basically same.

S2 BOAT PLATFORM

The boat consists of 3 modules:

• Data Collection Component: run the software project and analyze their bug tracking system and version control system (extract logs from it, and analyze whether or not the corresponding bug was fixed after each commit). Boat uses regular expressions to determine if there is a bug in the log, and if so, gets the details of the bug from the appropriate bug tracking system. Boat will be grouped to fix a similar bug report. With this information, fix the source code for each bug that has been submitted. The information that has been extracted exists in the database for use by other boat modules. Note that boat does not need to perform a large number of projects at once, it can constantly add bug report and the corresponding buggy file, so boat will continue to contain more report.
• Local Debugging Component: Boat enables developers to execute their bug locator in their local environment. The goal is to reduce the impact of debugging when developers upload their executable files.

• Remote Execution Component: executes the uploaded executable file, extracts the dataset from the data Collection Component, and returns the results to the developer.

At the same time, developers can use a configuration file to manage how boat executes an uploaded executable file. In this configuration file, several tasks are specified. Each task specifies a bug location algorithm for performing algorithmic engineering. When the configuration file is set, the remote execution module executes the bug report specified in the selected project. The developer will receive an email informing you of the details of the implementation. If the task executes successfully, it is ranked by several indicators. Facilitates comparisons between developers.

S3 existing datasets and technologies

6080bug Report

29 Open Source System

S4 related work

What is the difference between boat and TRACELAB (tracking experimental platform)?

• The target problem and the data set. Tracelab is a generic, back-up platform that focuses on the connection requirements of program code. Small data set.

Boat focus on code positioning, mainly to collect bug report;

• Compute resource support. In order to use Tracelab, developers need to download and install their machines and computing resources.

Boat provides the developer with compute resources and manages the executable files.

• Support and assessment. In order to compare, Tracelab needs to submit their code.

Boat is automatically compared to a variety of technologies.

To meet large-scale feature positioning benchmarks. Based on the benchmark, Xing and other people put forward the Linux kernel, this article's work and its differences:

• Experimental platforms and benchmarks: This article not only provides a benchmark, but also provides a platform to support researchers in comparing and evaluating their algorithms;
• Datasets: Data sets for people such as Xing are primarily text descriptions and code. The data set in this article is mainly the bug report and the bugs they fixed.

S6 Conclusion and future research direction

Will add more data sets, implement more bug locating algorithms, add more metrics, and organize competitions through boat.

"Software analysis and Mining" Boat:an experimental Platform for researchers to comparatively and reproducibly Evaluate Bug Localization Techni Ques