1. Because the audio and video codec involves a lot of knowledge points, the basic knowledge of image processing should have, such as BMP bitmap, color representation mode YUV, Fourier transform, cosine transform, JEPG image coding. Then carefully understand the fundamentals of audio and video coding, including coding prediction, motion compensation, motion estimation ... It would be better to retell the whole process. Then can look at the source code, the first structure, then a function block a function block, a function of a letter, a sentence to understand. Finally, it is also very important to do some exercises.
2. Streaming media learning is the same as the above steps. Read the RTP/RTCP/RTSP protocol document to understand the specific meaning of each field. If you understand it, it's not hard to try and write a streaming service. Then let go of the stream. Then use the open source engineering architecture to stream media services.
The right way to learn to encode and decode and stream media