Download the installation package and test filesDeteval-linux.tgz, Linux binaries for Ubuntu 14.04 testxmls.tgz, both test files (detection and Groundtruth) for testing
Decompress and install
Tar zxvf deteval-linux.tgz
The resulting directory structure is as follows:
Its usr/bin contains a binary executable that will be called. But I don't want to put it in my root directory, as the document says. So I chose to add this usr/bin to my path variable. Modify the ~/.BASHRC file to add:
Export path= $HOME/installed/deteval/usr/bin: $PATH
Note that $home/installed/deteval/is where I placed the unpacked folder.
SOURCE ~/.BASHRC
There are some dependencies that need to be installed:
sudo apt-get install ruby libxml2 libxml2-dev gnuplot texlive-extra-utils
Test
Unzip the test file first:
Tar zxvf testxmls.tgz
CD testxmls
evalfixed
Use default parameters: tr=0.8,tp=0.4 t_r=0.8, t_p=0.4 compute recall,precision with fscore recall, precision and Fscore
Command:
Evalfixed Det1.xml Gt1.xml
Output:
...
generality:1.16
inverse-generality:0.862069
<evaluation noimages= ">
<icdar2003 r=" 0.310036 "p=" 0.236342 "hmean=" 0.268219 "nogt=" 580 "nod=" 1012 "/>
<score r=" 0.118966 "p=" 0.0768775 "hmean=" 0.093399 "nogt=" 580 "nod=" 1012 "/>
</evaluation>
Meaning: icdar2003 node: Results calculated using the evaluation method of ICDAR2003 score node: deteval result. Should be the same as the deteval results in ICDAR2013 Nogt, Nod:ground truth bbox and detected bbox R:recall, p:precision, Hmean:f-score, harmonic m Ean
The same result, in the local calculation and submission to the site Deteval calculation, the value of the various indicators have several points of difference, but the overall can be on the number. References http://liris.cnrs.fr/christian.wolf/software/deteval/index.html