My development (5) Interactive vehicle interaction automobile System

This concept was brewing last year, and I have always wanted to mention this. In the future, I think there will be such a concept in it to achieve the integration of people and cars. At present, I am also engaged in related R & D work. I hope I can sort out my ideas and inspire my thinking. I hope that I can design and implement a system like this one in the near future. To realize the concept of interactive vehicles, a series of product chains are required to support it. It is a big system project. Interactive cars are highly intelligent and highly integrated. Of course, security is always the first consideration. This can also be a subset of the Vehicle Navigation central control system.

This is to solve the problem of human identification, as well as the platform selection, using DSP, the estimation is spent on optimization.

Some preliminary work is being done or has been done:

System: Linux

Platform: ti dsp Platform dm6437 or higher, need to bringAlgorithmAcceleration, the current dm8168 is more consistent

Communication Method: WiFi

Sensors: image acquisition equipment, voice equipment, radar equipment, RF communication equipment, temperature sensors, photosensitive devices, laser equipment,

Pattern Recognition: image recognition, including face and human body recognition; Speech Recognition (still working on algorithms)

Control: the results obtained by pattern recognition are used to assist other factors in controlling the objects to be controlled, including alarm devices, vehicle actions and interactions, and network interactions.

Protocol: RTP, TCP/IP, serial port, CAN, custom communication and sharing protocol (so-called Internet of vehicles Protocol)

Recognition part: Pedestrian recognition (including images and sharing GPS location information with mobile devices through the network, opencv), face recognition (in-vehicle), Lane Recognition (including road signs) (Lane deviation warning or alarm), vehicle recognition (including images and information such as location shared with mobile devices through networks, distance estimation), and speech recognition (network interaction and control applications ).

Agreement Part: information sharing agreement between vehicles. Information sharing agreements between vehicles and people inside vehicles and between vehicles and pedestrians (holding mobile devices), self-organizing agreements between individuals (similar to vanet)

Communication part: RF Device, Supporting WiFi and 3G, plus GPS module, communication in high-speed driving (may be a problem that has not been tested)

Server and client systems at each end: images or images can be accelerated Based on Embedded operating systems, Linux, or other systems with an interface. Currently, Linux is used. I do not know whether a system with higher stability and real-time performance is available.