[IOS/translation] Media Layer

[IOS/translation] Media Layer

Media layer includes image, audio and video technologies to achieve multimedia experience in your applications. At this layer, these technologies can make the applications you create look better and sound better.

Graphics Technologies

One of the important parts of high-quality graphics-based applications, and IOS provides many technologies to help you customize design and display graphics on the screen. IOS graphics technology provides extensive support, seamless operation on the UIKit interface, and easy display. You can quickly display standard interfaces with high quality, or you can create personalized interfaces and use the following technologies to display a rich graphic experience interface.

Graphics technologies in iOSUIKit Graphics
UIKit supports high-level rendering of images, bé's path, and animation effects in applications. In addition, class implementation is provided, and the UIKit interface provides a fast and different way to browse images and text-based content. The application can use animations, which not only clarify but also use the dynamics of UIKit. Provides reconciliation to improve user interaction experience. Core Graphics framework Core Graphics Library Core Animation Core Image OpenGL ES and GLKit Metal TextKit and Core Text Image I/O Photos Library

IOS provides built-in methods for running applications, including Retina Display and standard differentiation display. For vector rendering, the system library automatically displays clear content in pixels on the Retina screen. If you use images in your application, UIKit provides support for automatic loading of high-resolution images. App-Related Resources in App Programming Guide for iOS.

Audio Technologies Audio Technology

IOS audio and underlying hardware provide users with a rich audio experience. This experience includes displaying and recording high-quality audio, controlling MIDI content and playing built-in sound effects on the device.
If you want your app to use audio, there are many technologies available for you to use, as shown below

Audio technologies in iOSMedia Player framework AV Foundation OpenAL Core Audio

IOS supports many industrial standards and apple-specified audio formats, including

ACC Apple Lossless (ALAC) A-law IMA/ADPCM (IMA4) Linear PCM μ-law DVI/Intel ima adpcm Microsoft GSM 6.10 AES3-2003 Video Technologies

IOS video technology supports managing static video content and playing back network video content. Devices with recording hardware can record videos and merge them in applications.

Video technologies in iOSUIImagePickerController AVKit AV Foundation Core Media

IOS supports many industry-standard video formats and compression standards

H. 264 video, up to 1.5 Mbps, 640 by 480 pixels, 30 frames per second, Low-Complexity version of the H. 264 Baseline Profile with AAC-LC audio up to 160 Kbps, 48 kHz, stereo audio in. m4v ,. mp4, and. mov file formats H. 264 video, up to 768 Kbps, 320 by 240 pixels, 30 frames per second, Baseline Profile up to Level 1.3 with AAC-LC audio up to 160 Kbps, 48 kHz, stereo audio in. m4v ,. mp4, and. mov file formats MPEG-4 video, up to 2.5 Mbps, 640 by 480 pixels, 30 frames per second, Simple Profile with AAC-LC audio up to 160 Kbps, 48 kHz, stereo audio in. m4v ,. mp4, and. mov file formats AirPlayMedia Layer Frameworks

The following sections describe the library at the media layer and the services they provide.

List 4.0 photo and video AssetsLibrary. framework(AL) 2.2 video module_ AVFoundation. framework
_ (AV) 8.0 video playback (new)_ AVKit. framework
_ (AV) 2.0 core audio_ CoreAudio. framework
_ (Audio) 8.0 core audio Kit_ CoreAudioKit. framework
_ (CA) 2.0 core graphics_ CoreGraphics. framework
_( Guide) (CG) 5.0 core image_ CoreImage. framework
_ (CI) 3.2 core fields_ CoreText. framework
_( Guide) (CT) 4.0 core videos_ CoreVideo. framework
_ (CV) 7.0 game device connection_ GameController. framework
_( Guide) (GC) 5.0 OpenGL ES_ GLKit. framework
_ (GLK) 4.0 image IO ImageIO. framework(CG) 7.0 subtitles MediaAccessibility. framework(MA) 2.0 Media Player MediaPlayer. framework( Guide) (MP) 8.0 GPU Metal. framework( Guide)( Metal Shading Language Guide) (MTL) 2.0 OpenAL sound effects OpenAL. framework(AL) 2.0 OpenGLES OpenGLES. framework( Guide) (EAGL, GL) 8.0 album Photos. framework(PH) 8.0 album UI PhotosUI. framework( Guide) (PH) 2.0 Animation QuartzCore. framework( Guide) (CA) 8.0 scenarios SceneKit. framework(SCN) 7.0 genie SpriteKit. framework( Guide) (SK)

4.0 photo and video AssetsLibrary. framework
Go to manage photos and videos. You can use this library to save albums or photos on devices. You can also save New photos and videos to system albums. (AL)

2.2 video module_ AVFoundation. framework
_
Provides tools to manage audio and video in column OBJ-c, such as playback, recording, and management. This Library provides the ability to seamlessly integrate audio and video, and provides many advanced processing functions. For example, you can play multiple different sounds at the same time to control the process of multiple visits or records. (AV)

Manage Audio sessions, including support for obtaining audio functions from the system declaration management application audio and video resources editing audio and video content with the ability to capture audio and video playback function Audio and Video Tracking Management Media Unit data management stereo playback mode precise sound synchronization obtains the attributes of an audio file, such as data format, bit rate, and channel support for stream playback, AirPlay

8.0 video playback (new)_ AVKit. framework
_
You can use an object on the AV Foundation on the device to manage the video demonstration function. You can use MediaPlayer. Framework to play video content instead. (AV)

2.0 core audio_ CoreAudio. framework
_
Define the audio data type. (Audio)

8.0 core audio Kit_ CoreAudioKit. framework
_
Provides a standard interface for managing audio between applications. An application selector-like interface that displays audio and video of other applications. You can use the main application to operate on them. (CA)

2.0 core graphics_ CoreGraphics. framework
_(Guide)
Provides the Z 2D interface painting Api. In OS X development, Quzrtz has the same outstanding capabilities as the vector painting engine. This library provides path painting, rendering, gradient, image, color, coordinate space conversion, PDF document creation, display and analysis, etc. This Api is based on the C language. It displays basic descriptive Objects Based on objects, making objects easier to store and display. (CG)

5.0 core image_ CoreImage. framework
_
Provides a series of powerful filters for operable recording and static images. You can use a filter in the direction of the captured image, current image, story film, or QR code. The advantage of using this filter is that it is non-destructive, so that your original image is not processed at all. Because these filters are the best results provided by device hardware, and they are different and fast. (CI)

3.2 core fields_ CoreText. framework
_(Guide)
It provides a simple, funny, and C-based excuse to plot fields and process font libraries. This library can help some words to be applied in the TextKit library, but can still improve the field processing capability. This library provides a Complex Field Layout Engine, including automatic line feed. It also supports multiple advanced library types and rendering capabilities. (CT)

4.0 core videos_ CoreVideo. framework
_
Contains the most common audio and video that can be operated. Do not directly use this framework. (CV)

7.0 game device connection_ GameController. framework
_(Guide)
In your application, this library allows you to discover and configure game hardware that can be used on iPhone, iPad, and iPod devices. This library allows the device to physically connect to an IOS device or use a bluetooth link. When controllers can use it, or the game device enters related commands, a library will notify your application. (GC)

5.0 OpenGL ES_ GLKit. framework
_
Creates an OpenGL ES app Based on the OBJ-c Union class. (GLK)

The GLKView and GLKViewController classes provide a standard and achievable OpenGL ES-enabled view and rendering. This View manages the underlying frame cache in the application. Your application only depicts it. In applications, the GLKTextureLoader class provides image conversion and daily event loading. Allows you to attach a texture image to a category. You can load textures synchronously or asynchronously. When the texture is synchronized, a notification Block is issued after the texture is loaded into the content. GLKBaseEffect, GLKSkyboxEffect, and GLKReflectionMapEffect provide the existing and configurable graphic coloring devices. Allows consistent graphic operations. Specifically, GLKBaseEffect class implements illumination and material model in OpenGL ES 1.1 specification, which can be used in OpenGL ES 1.1 or later versions.

4.0 image IO ImageIO. framework
Provides interfaces to import and export image data and image metadata. This library is used in core image data processing, and supports all standard image formats displayed on IOS. You can also use the Exif and IPTC image formats. (CG)

7.0 subtitles MediaAccessibility. framework
Manage subtitle display content under a media file. This library is integrated with new settings so that users can display subtitles. (MA)

2.0 Media Player MediaPlayer. framework(Guide)
Play high-quality audio and video content in applications. (MP)

The video is played on the user interface or on the device through AirPlay. You can use the full screen or scale-up interface. Access your iTune music library. You can play music tracks, lists, search for music, and launch media Pircker to the user interface. Configure and manage the Video Player. The current playback information is displayed on the screen lock page. You can also use AirPlay to display this information on Apple TV. Detects media stream playback on AirPlay.

8.0 GPU Metal. framework(Guide)(Metal Shading Language Guide)
Complex graphics and computing tasks can be drawn when A7 CPU usage is extremely low. This library reduces many performance bottlenecks, such as expensive state verification-Traditional Painting APIs. This library is designed specifically for this problem, and the compilation operation avoids the path code written by many sensitive codes. Provides the coloring tool pre-compilation, object status, and clear instructions to determine whether your application can use your GPU graphics and computing tasks with high quality and high performance. This design concept extends to tools to build your reference. When your application is being Built, Xcode will integrate the library coloring tool into the default library in the project, eliminating a lot of preparation costs for running.
Drawing, computation, and bit operations are designed together to ensure seamless and efficient operation. Metal is especially designed for the current framework, such as multi-processing and shared memory, so that it can easily execute GPU commands.
In Metal, you can get a stream API, a unified language for drawing and texture calculation, and Xcode basic tools, so that you do not need to learn many libraries, languages and tools can improve GPU performance in games and applications. (MTL)

2.0 OpenAL sound effects OpenAL. framework
The library interface provides cross-platform audio standards. You can use this library to create high-quality and efficient sound effects in the game. Or other programs need to output audio. Because OpenAL is a cross-platform standard, writing OpenAL code modules on IOS can easily be transplanted to other platforms. (AL)

2.0 OpenGLES OpenGLES. framework(Guide)
Provides tools to draw 2D and 3D content. This is a C language-based library that works very closely with hardware devices and provides very subtle texture control and full screen applications with a high frame rate, such as games. This library can be used in parallel with EAGL. The EAGL interface provides interfaces between OpenGL ES drawing cals and interfaces.
This library supports OpenGL ES1.1, 2.0, 3.0, and so on. The 2.0 standard supports fragment and Vertex coloring devices and the 3.0 standard adds many features, including multi-point profiling and change feedback. (EAGL, GL)

8.0 album Photos. framework
Provides new APIs for image and video operations, including cloud photos and photo album management applications. This Library can replace the Assets Library framework. The key feature is to include a secure off-the-shelf verification to capture, cache, original size albums, request to modify albums, and notice changes and modifiable album content from other applications.
(PH)

8.0 album UI PhotosUI. framework(Guide)
Modify the image and video album in the photo album application. (PH)

2.0 Animation QuartzCore. framework(Guide)
Contains core animation interfaces. Core animation is an advanced image synthesis technology. It is easy to create View-based animations with smooth animation effects and different complex combinations. With the help of hardware, the image merging engine makes the animation content different and runs instantly. Specifies the starting and ending points of the animation, and can also pause the core animation. The core animation is built on the UIView level, so it can always run. (CA)

8.0 scenarios SceneKit. framework
SceneKit is an OBJ-c library that provides an advanced and efficient reading engine and descriptive API for simple games and rich 3D image user interfaces. SceneKit is intended for OS X v10.8 and IOS. Relatively low-level APIs. For example, OpenGL ES requires you to implement precise performance algorithms to display a scenario. Compared with SceneKit, SceneKit allows you to describe your own scenario and use its own scenario content- ry, object, light source, and angle-To vividly and interestingly describe the changes of the object.
SceneKit's 3D physical engine is your application or game that becomes vivid to simulate gravity, attacks, collision of hard objects, and joint links. Add high-level actions to make it easier to move objects. For example, if a wheel turns a car and a physical area is added to the car, gravity is required for the object, or the effects of objects flowing in an area. (SCN)
Use OpenGL ES to add content to a scenario, or provide GLSL tools to replace or present the performance of SceneKit. You can also add the color-based post-processing technology to the performance of SceneKit, such as color layering and the Space Environment mask of the interface.

7.0 genie SpriteKit. framework(Guide)
([Media Layer Frameworks] [4])
Provides an animation System for 2D and 2.5D hardware acceleration. SpriteKit provides many basic game controls, including animation engines, image rendering, sound effects, and physical engines. With SpriteKit, you can avoid creating these by yourself. Instead, you are more focused on the game content you designed and interacting with the high-level games in the game.
The game content is organized into a scenario in SpriteKit. Scenarios include texture objects, videos, paths, core image files, and other special effects. SpriteKit displays these things on the screen with the best effect. When using this in your scenario, you can use SpriteKit to explicitly set the action you want or use a physical engine to define a specific physical effect.
In addition to this library, the Xcode tool for creating particle effects and texture maps is also provided. You can use these tools to manage application resources and quickly upgrade SpriteKit. (SK)