Audio and video functions

I. Introduction

AnyChat is a well-known audio and video Interactive Development Platform in China. After six years of extensive application and detection of complicated environments, the AnyChat SDK system has a high reputation in terms of compatibility, security, stability, and ease of use. AnyChat is a core product built by cutting-edge technology. It has the full support of many industry elites such as chinamap.com and ffmpeg Engineering Group, and has a leading technical advantage.

II.AnychatMain functions

1.Multi-party audio/video Interaction

The "AnyChat instant messaging platform" supports "one-to-one", "one-to-many", and "many-to-many" audio and video interaction modes. During the interaction process, upper-layer applications can control the transfer of only audio, only video, or simultaneous transmission of audio and video.

Audio and video data are transmitted through UDP channels, which give priority to P2P channels. When the P2P channels between two users fail, they will be forwarded through the server.

2.Text Communication

The "AnyChat instant messaging platform" enables "one-to-one" and "one-to-many" text communication, that is, it can only send text messages to specified users, or broadcast text messages to the entire room.

Text messages are encrypted in the kernel and transmitted over the TCP channel. A copy of the transmitted data is sent to the server at the business layer. The server at the business layer can be centrally stored to meet special requirements.

After a text message is sent, the callback function of the other party is triggered. The upper-layer application displays the text message to the user on the interface.

3.File Transfer

The "AnyChat instant messaging platform" supports the file transfer function, which allows the client to send files to the client, the client to the server, or the server to the client.

During file transmission, the kernel will automatically subcontract the transmission, and the receiving end group package and verification will trigger the corresponding callback function after the recipient receives the file, the file transfer is complete.

File transmission uses UDP channels for P2P transmission. The kernel automatically controls traffic to achieve optimal transmission efficiency under different network bandwidths.

The transmission progress and Transmission Bit rate can be queried in real time during file transmission to facilitate the transmission progress bar on the interface and enhance the user experience of the system.

4.Transparent Channel Transmission

As the name suggests, a transparent channel is a channel for upper-layer applications to transmit data. As the "AnyChat instant messaging platform" does not care about the transmitted content, that is, the transmitted data is "Transparent" compared with the platform, and is called "transparent channel ".

Upper-layer applications can use the transparent channel provided by the "AnyChat instant messaging platform" to expand services and transmit corresponding business logic.

Transparent channels use TCP channels to ensure the reliability of data transmission.

5.Private Chat and public chat Modes

The client has two data transmission modes: public chat mode by default) and private chat mode.

Public chat Mode means that anyone requests local audio and video data through the API, the data will be sent to the other party; Private Chat Mode means: the local audio and video data is only sent to the user in the local private chat list, that is, the user who agrees to the private chat). In private chat mode, the user can receive public chat data from other users. Text messages are not affected by the private chat mode.

A single user can chat with multiple users privately at the same time.

6.Streaming media data proxy

The "AnyChat instant messaging platform" supports the "user streaming media data proxy function". This function can be used to specify the user's streaming media data audio and video) as their own data, forward to other request users.

III.AnyChat SDKThe technical fields involved include:

1. Video Processing Technology: video collection, encoding, transmission, decoding and display;

2. Audio Processing Technology: audio collection, encoding, transmission, decoding and display;

3. Audio Preprocessing Technology: Voice monitoring (VAD), noise suppression (NS), automatic gain control (AGC), and echo elimination (AEC;

4. Streaming Media Transmission Technology: audio Jitter Buffer (Jitter Buffer), video mosaic elimination (MS );

5. P2P network technology: UDPNAT, tcp nat, P2P multi-path routing algorithm (MPA );

6. Server concurrent processing technology