OMCS voice and video framework

As. it is very difficult for developers on the NET platform to develop a decent video chat system, not just because. NET has limited support for multimedia, but it also involves many professional technologies. NET in these aspects of precipitation is rare. The emergence of OMCS will completely change this situation. It encapsulates all the underlying, complex, and cumbersome details inside and provides you with an easy-to-use and powerful interface.

OMCS voice and video framework is a network multimedia framework integrated with multiple media, such as voice, video, remote desktop, and electronic whiteboard. You can connect to the OMCS server to access any online multimedia device at any time. Based on OMCS, you can quickly develop multimedia-based application systems such as video conferencing systems, network monitoring systems, remote assistance systems, and distance education systems.

1. OMCS features 1. Owner and Guest

Each OMCS Client has two identities: Owner and Guest.

When a Client acts as the Owner, it provides local cameras, microphones, desktops, electronic whiteboards, and other multimedia devices for other clients to access.

When a Client accesses multimedia devices provided by other clients, the Client is displayed as a Guest.

2. N-to-N relationship

A Client can access multimedia devices of multiple online clients at the same time. A multimedia device provided by a Client can also be accessed by multiple other clients at the same time.

3. Access Control

The Client application implements the IMultimidiaGateway interface to control the access of guest to local multimedia devices. When a guest is connected to a local multimedia device, OMCS controls whether to allow this connection based on the results of calling the IMultimidiaGateway interface.

4. P2P Channel

When the two clients communicate with each other, the OMCS underlying layer will automatically try P2P connection. If the P2P channel can be created successfully, subsequent communication between the two clients will go through the P2P channel. Even if the P2P channel is based on UDP, OMCS ensures the reliability of P2P communication.

5. Super simple programming model

When developing based on OMCS, to access multimedia devices provided by other clients, we only need to drag the corresponding connector controls/components from the toolbox to the UI, then, call the Connect method to Connect to the target device. The Connect method returns the connection result. If the connection is successful, the connector control/component will work normally (for example, the CameraConnector control will display the video captured by the target camera ).

In addition, we have deployed the dedicated omcsserver program, namely, omcs.server.exe. You only need to deploy the program and start it.

6. Integration with Applications

OMCS only solves the management, connection, display/play, control and other problems of multimedia devices, and does not introduce specific business logic. Therefore, when integrated with a specific application, the OMCS server is usually independent, And the OMCS client dll will be embedded into the client program of the specific application, just as below:

Ii. Technical Features of OMCS 1. Video

(1) supports multiple collection resolutions, including 160*120, 320*240, 480*360, 640 p, and 480 p. This resolution can be dynamically modified at runtime.

(2) supports three types of video encoding quality: High, Medium, and low.

(3) supports frame rate 1 ~ 25fps.

(4) Actively discard frames when the network is congested.

(5) automatically adjusts the video encoding quality based on the network status.

(6) You can obtain the current video frame in bitmap format.

(7) supports multiple video devices: Common cameras, usb cameras, virtual cameras, and video cards.

2. Audio

(1) supports 8 k, 16 k, 32 k audio sampling rate.

(2) supports three types of Audio Encoding quality: High, Medium, and low.

(3) Support for network speech technologies such as Echo Cancellation (AEC), mute detection (VAD), DENOISE, and automatic gain (AGC.

(4) A maximum of 16 audio mixing channels are supported.

(5) Adaptive JitterBuffer: dynamically adjusts the buffer depth based on the network status.

(6) If both audio and video sessions are enabled, the video screen and sound are automatically synchronized.

(7) When the network speed is slow, the video quality is automatically adjusted to ensure audio clarity and coherence.

(8) automatically switch voice data to a high-quality network channel based on the network status to ensure the effect of voice calls.

3. Remote Desktop

(1) supports three types of video encoding quality: High, Medium, and low.

(2) automatically select the frame rate based on the machine performance and network speed.

(3) the screen resolution can be dynamically adjusted.

(4) two options are available: viewing mode and control mode.

(5) Actively discard frames when the network is congested.

(6) automatically adjust the definition of the Remote Desktop based on the network status.

4. Whiteboard

(1) common view elements are supported: Straight Line, curve, Arrow, rectangle, triangle, ellipse, and text.

(2) You can modify the border color and fill color.

(3) you can insert images and screenshots to save the entire whiteboard as a bitmap.

(4) two options are available: viewing mode and operation mode.

(5) Laser pens are supported.

(6) Multiple Guest users can view or operate the whiteboard of the same Owner at the same time.

Iii. Run OMCS Demo

Video/audio connector:

Electronic whiteboard Connector:

Remote Desktop connector:

For more information about OMCS, see detailed descriptions.