What does it mean to read lip tones? I can see where you are with a bag of potato chips.

Some people with super ability can see the mouth and guess what the other person said, of course, such people are very rare. But if someone can look at a bag of potato chips in a soundproof environment and restore what you're saying, do you believe it?

What the hell are you talking about? Isn't it more outrageous than casting pearls on the wall?

Researchers at MIT, Microsoft and Adobe have done something seemingly super outrageous. The mystery is the study of vibrations. The researchers were able to restore the sound signals in the environment by analyzing the tiny vibrations in the video produced by the sound in the body. In one group of experiments, the researchers, in the case of soundproofing, made a speech sound by shooting the vibration of a potato bag from a high-speed camera 15 feet away. In addition to the potato bag, the researchers also conducted experiments on aluminum foil, water cups and even potted plants, all of which received good results.

The principle is that sound travels to an object to cause vibrations, and this vibrational motion creates a very subtle visual signal that is invisible to the naked eye. But the computer can capture the premise of capturing video at frequencies higher than the audio--in the experiment, the researchers used the high speed camera's FPS (the number of frames per second) reached 2000~6000 (average smartphone video fps is typically 60, High-end commercial high-speed cameras can reach 100000FPS.

Of course, this high-speed camera is not what ordinary people can have. But the researchers then experimented with ordinary digital cameras. Using a bizarre design of most camera sensors, the researchers succeeded in inferring high-frequency vibration information at 60FPS frequencies. Although this reduction is not as good as a high-speed camera, it is enough to identify how many people speak, male or female, and even have enough accurate speakers ' acoustic characteristics.

Clearly, this ability has extensive use in legal forensics and criminal investigation. In turn, given the different vibrational modes of different objects/objects to sound, this characteristic can give birth to a new kind of imaging technology. The interesting thing about science is that the first thing you study about it is cool, but others keep coming up with new uses.