Interactive Design Theory: A brief analysis of future interactions in movies

In an interactive meeting, some students mentioned in the film's future interaction, aroused my interest, so collected some of the film's data, do some superficial analysis, hope to be able to provoke some thinking.

Novel human-computer interaction has always been one of the highlights of science fiction movies, Hollywood sci-fi blockbuster invested a lot of money, energy into the details of the film design, such as Tom Cruise starring in the Minority Report, the team invited HCI scientists to participate in film production, the film's visual designer specifically visited the MIT Multi-media Laboratory, the cutting-edge technology of various attitude recognition is viewed. Spielberg persuaded John Underkoffler (the famous hand-gesture recognition expert) and Jaron Lanier (the creator of the word "Virtual Reality") to join the team, forming a think-tank, a 2048-year-old human-computer interface. Through these efforts, the film presents a variety of novel human-computer interaction, so the study of human-computer interaction in these films is very valuable.

I noticed that the future user interface in the movie is actually more complex and confusing, and the reality of the interface is simple, intuitive trend is diametrically opposed. The reason is also very simple: the role of film character shaping the need! The complex system gives the impression of being very powerful and advanced, and the skillful operation of this complex system is more impressive for the audience than a simple one. You see, no matter how complex the interface, our hero is always proficient in the operation of the cool interface and the skills of the actors to dazzle the audience. It is possible that some UI enthusiasts will be fascinated by such UI operations, but this is certainly not the case with our real needs and UI trends. This complex interactive interface trend in the movie doesn't really give us a look at the future of the UI.

Although the design of the movie does not really show us what the future human-computer interaction looks like, it can be seen in some ways.

Gesture operation

The most striking part of the minority report is the way in which gestures are operated. I was impressed by the coolness of Tom Cruise waving his arms around the phone and manipulating the video. However, such a large interface operation is really a problem, due to a large range, the arm should be easy to tired, then can not do the precise operation, and there is no entity of the operation of feedback. In reality, there are already some devices that have gestures, such as the iphone and the Wii. I believe gesture manipulation will be a part of our future.

Eye Tracking Interface

If you have seen "Iron Man", you will certainly have an impression. When Tony Stark put on his iron suit, the interface of his operation will follow his eyes. When he looks at the information of each part, he only needs to look at it and the corresponding information will be magnified. What I don't quite understand is how quickly the system can judge whether the gaze is across the area or is focused here. As far as I know, people's eyes focus on a UI interface is not smooth across the fall to the target point, but a point of a point along with a short stay through the interface, so the interface may not be as smooth as the film. In addition, it is possible that when we use the process due to some other things interrupted, eye movement will cause the operation of the program closed. However, see the design of some interactive ads, useful to such technology, maybe we will not be so boring to see ads.

Speech control

This should be familiar to everyone, the phone is very early to do voice phone calls, the iphone can do more complex operations. What was impressive in the movie was that Ripcord, the special forces, chased the last missile with a night-raven plane, when the fire destroyed the missile, he did not find the Operation button, at the time of Nick, through the red hair of the reminder, he finally through voice control to stimulate the operation, but the film a little joke, This night Raven can only understand the Celtic language of Scots. In fact, "Iron Man" Tony Stark's steel clothing system is also controlled by voice. At present, there are still some problems in the voice operation in reality: it is not flexible to understand human language, users also need to remember specific control words. However, this is very useful for those who are temporarily inconvenient or physically handicapped. In the future, speech control should have a wider application, it will become more intelligent and easier to use.

Stereo/Holographic Interface

"Avatar" and "ninth District" you should have seen it. In Avatar, when Jack is connected to his avatar, a worker can see the active image of his brain in a 3D interface, and can detect anomalies at any time.

In the ninth district, the alien spacecraft was driven by a holographic operating interface. This interface is very advantageous to navigation operation, it can automatically distinguish the importance of content from the UI, judge the present useful information present in the immediate, useless temporarily hidden. This interface can not be calculated as a 3D interface, the two layers of information is a space between the front and back, but each layer of information is flat. In such a use situation, this kind of information has been applied, if in order to cool the use of 3D, I think may be formed interference, more harm than good. 3D interface used in maps, industrial models and other multi-dimensional display should be more timely, this in the "Avatar" in the map and "Iron Man" in the design process of iron and steel have performance.

Transparent user interface

The transparent interface is almost always present in recent movies, for example, the above mentioned several: "Iron Man" in the steel Garment operating interface, "Avatar" in the use of the technical staff of the ring transparent display screen; "Ninth District" in the protagonist Wikus driving robot operating interface and the operating interface of the alien spacecraft are transparent. Transparent interface is really cool, there are already manufacturers have introduced a transparent screen of notebooks and mobile phones, but this should not be a major future interface interaction mode. Because of the transparency, the elements of the interface are easily disturbed by things in the background. However, as an aircraft operating interface is appropriate, the current user interface can be stacked to the natural scene behind.

Unconsciously speaking so much, in fact, in addition to these, there are many noteworthy points, such as "Ninth District" in the Wikus driving robot, there is no movement and language, estimated that the operation is EEG induction control, the reality has been such practical applications, such as the control of wheelchairs, chess and so on. If you are interested, you can discuss and look forward to seeing your share: