Google Map-Similar image search principle-Java implementation

The former in Ruan Yi Feng's blog saw this "similar image search principle" blog, there is a kind of impulse to realize these principles.

Google "Similar image search": You can use an image to search all images on the internet that resemble it.

To open the Google Image search page:

Click Use to upload a Angelababy original image:

When you click Search, Google will find a similar image, with the higher the image similarity. Such as:

What is the principle of this technology? How does a computer know that two pictures are similar?

According to Dr. Neal Krawetz's explanation, the key technology for similar image search is called "Perceptual hashing Algorithm" (Perceptualhash algorithm), which generates a "fingerprint" (fingerprint) string for each image. Then compare the fingerprints of the different pictures. The closer the result is, the more similar the picture is.

The following is one of the simplest Java implementations:

Preprocessing: Reading pictures

[Java]View Plaincopyprint?

1. File inputfile = newFile (filename);
2. BufferedImage sourceimage = Imageio.read (inputfile); //Read picture file

The first step is to reduce the size.

Reduce the image to 8x8 's size, a total of 64 pixels. The role of this step is to remove the details of the picture, only the structure, shading and other basic information, discard the different sizes, proportions of the picture differences.

[Java]View Plaincopyprint?

1. int width= 8;
2. Intheight = 8;
3. Targetw,targeth indicates the target length and width, respectively.
4. int type= sourceimage.gettype (); //Picture type
5. Bufferedimagethumbimage = null;
6. Double sx= (double) width/sourceimage.getwidth ();
7. Double sy= (double) height/sourceimage.getheight ();

[Java]View Plaincopyprint?

2. Set the width and height of the image to the same length, whichever is shorter
4. if (b) {
6. if (SX > Sy) {
8. sx= Sy;
10. width= (int) (SX * SOURCEIMAGE.GETWIDTH ());
12. }Else {
14. sy= SX;
16. height= (int) (SY * sourceimage.getheight ());
18. }
20. }
22. Custom picture
24. if (type== bufferedimage.type_custom) { //handmade
26. COLORMODELCM = Sourceimage.getcolormodel ();
28. Writablerasterraster = Cm.createcompatiblewritableraster (width,height);
30. booleanalphapremultiplied = Cm.isalphapremultiplied ();
32. thumbimage= New BufferedImage (cm, raster, alphapremultiplied, null);
34. } Else {
36. //Known pictures, such as Jpg,png,gif
38. thumbimage= New BufferedImage (width, height, type);
40. }
42. Call drawing class drawing to reduce the size of the diagram
44. GRAPHICS2DG = Target.creategraphics ();
46. Smoother than Exlax:
48. G.setrenderinghint (renderinghints.key_rendering, renderinghints.value_render_quality);
50. G.drawrenderedimage (sourceimage,affinetransform.getscaleinstance (SX, SY));
52. G.dispose ();

The second step is to simplify the color.

Converts the zoomed-in image to a level 64 grayscale. That is, all pixels have a total of 64 colors.

[HTML]View Plaincopyprint?

2. int[]pixels = New int[width * height];
4. for (inti = 0; I < width; i++) {
6. for (int j = 0; J < height; j + +) {
8. pixels[i* height + j] = Rgbtogray (Thumbimage.getrgb (i, j));
10. }
12. }
14. /**
16. * Gray Value Calculation
18. * @param pixels color RGB value (red-green-blue Red green blue)
20. * @return int Gray value
22. */
24. public static int Rgbtogray (int pixels) {
26. int _alpha = (pixels >>) & 0xFF;
28. int _red = (pixels >>) & 0xFF;
30. int _green = (pixels >> 8) & 0xFF;
32. int _blue = (pixels) & 0xFF;
34. return (int) (0.3 * _red + 0.59 * _green + 0.11 * _blue);
36. }

The third step is to calculate the average.

Calculates a grayscale average of all 64 pixels.

[Java]View Plaincopyprint?

1. int avgpixel= 0;
2. int m = 0;
3. for (int i =0; i < pixels.length; ++i) {
4. M +=pixels[i];
5. }
6. m = m/pixels.length;
7. Avgpixel = m;

Fourth step, compare the grayscale of the pixel.

The grayscale of each pixel is compared to the average. Greater than or equal to the average, recorded as 1, less than the average, recorded as 0.

[Java]View Plaincopyprint?

1. Int[] comps= new int[width * height];
2. for (inti = 0; i < comps.length; i++) {
3. if (Pixels[i] >= avgpixel) {
4. comps[i]= 1;
5. }Else {
6. comps[i]= 0;
7. }
8. }

Fifth step, calculate the hash value.

By combining the results of the previous step, you make up a 64-bit integer, which is the fingerprint of the image. The order of the combinations is not important, just make sure all the pictures are in the same order.

= = 8f373714acfcf4d0

[HTML]View Plaincopyprint?

2. Stringbufferhashcode = new StringBuffer ();
4. for (inti = 0; I < comps.length; i+= 4) {
6. intresult = comps[i] * (int) Math.pow (2, 3) + comps[i + 1] * (int) Math.pow (2, 2) + Comps[i + 2] * (int) Math.pow (2  , 1) + Comps[i + 2];
8. Hashcode.append (Binarytohex (result));//binary into 16 binary
10. }
12. Stringsourcehashcode = hashcode.tostring ();

After getting the fingerprint, you can compare different pictures and see how many of the 64 bits are not the same. In theory, this equates to the calculation of "Hamming distance" (hammingdistance). If the data bits are not more than 5, the two images are similar, and if they are greater than 10, they are two different pictures.

[Java]View Plaincopyprint?

1. int difference = 0;
2. int Len =sourcehashcode.length ();
4. for (inti = 0; i < len; i++) {
5. if (Sourcehashcode.charat (i)! = Hashcode.charat (i)) {
6. difference++;
7. }
8. }

You can put a few pictures together, and also calculate their Hamming distance comparison, you can see whether the two pictures are similar.

The advantages of this algorithm are simple and fast, not affected by the size of the picture, the disadvantage is that the contents of the picture can not be changed. If you add a few words to the picture, it will not be recognized. So, it's best to use thumbnails to find out the original image.

In practical applications, more powerful phash algorithms and sift algorithms are often used to identify the deformation of images. As long as the degree of deformation does not exceed 25%, they can match the original image. Although these algorithms are more complex, the principle is the same as the simple algorithm above, that is, to first convert the image into a hash string, and then compare.

Most of the above content directly from the Nanyi site copy, want to see the original children's shoes can go to the top link click to see.

Provide source download, source download link: http://download.csdn.net/detail/luohong722/3965112

Reference Links: Magic image processing algorithm, 11 similar image search engine recommendation, to map search will not be difficult, http://insidesearch.blogspot.com/2011/07/teaching-computers-to-see-image.html

Google Map-Similar image search principle-Java implementation