Key Frame Extraction-Based on Motion Information (Continued 2)

Source: Internet
Author: User

References summarisation of surveillance videos by key-frame selection icdsc 2011

The idea in this article is roughly the same as that in the previous two articles. This article does not take this step in segments, but directly selects key frames based on a certain selection policy.

Feature Extraction: EHD edge histogram descriptor, LFE localised foreground entropy.

The EHD feature extraction procedure is as follows:

1). Convert the image into a grayscale image and divide it into 4x4 image blocks.

2) calculate each image sub-block and correspond to MF (I, j) in five directions ).

3). Combine the MF (I, j) in each direction of each graph sub-block into a vector (5*4*4) 80.

For more information, see efficient use of local edge histogram descriptor.

The LFE feature extraction procedure is as follows:

1) divide the foreground result image into N x n image blocks.

2) Calculate the entropy of each image sub-block.

3) Calculate the Mean Entropy of N x n sub-blocks to obtain the entropy of the final image.

M = N * n.

Select the local maximum value corresponding to EHD and LFE as the key frame.

This processing method is iterative. During each iteration, key frames with a smaller feature value are deleted for each pair of connected key frames until a certain number of key frames are selected, stop iteration.

Thoughts:

1). Whether EHD is used to calculate the original image sequence or the foreground result image sequence of the detection. (You need to read the article efficient use of local edge histogram descriptor)

2). The block division in LFE is even, and the weight of each image sub-block is the same when the mean value of the image sub-block entropy is obtained.

Without considering the video features of a person, the person may be more interested in the area of the image center. The weight of the content of the image center should be greater.

You can use unequal partitioning policies and assign different weights to each block.

3). The key frame selection policy is too simple and the selection of key frames is not necessarily accurate.

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.