Android Compatibility test Framework (CTS) Manual

<span id="Label3"></p><p><p><span style="color:#3333FF;font-family:Lato,sans-serif;font-size:16px;"> <span style="color:#3333FF;font-family:Lato,sans-serif;font-size:16px;line-height:24px;">to understand the old yards of personal privacy, please see here:</span>http://www.koulianbing.com/?page_id=12</span></p></p> <p><p><br></p></p> <p><p>This document is translated from Android's official CTS manual Android-cts-manual-r4.pdf</p></p> <p><p></p></p> <p><p><span style="font-size:12px;">Android</span> <span style="font-family:‘DejaVu Sans‘;"><span style="font-size:12px;">Compatibility test Framework manual</span></span></p></p> <p><p></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;"></span></p></p> <p><p></p></p> <p><p>1.<span style="font-family:‘DejaVu Sans‘;">Why do I need a compatibility test (hereinafter referred to</span> as CTS<span style="font-family:‘DejaVu Sans‘;">)? </span></p></p> <p><p>1.1<span style="font-family:‘DejaVu Sans‘;">, let</span> <span style="font-family:‘DejaVu Sans‘;">the APP provide a better user experience. Users can choose more apps that are right for their devices</span> <span style="font-family:‘DejaVu Sans‘;">. Make</span> apps <span style="font-family:‘DejaVu Sans‘;">more Stable. </span></p></p> <p><p>1.2<span style="font-family:‘DejaVu Sans‘;">, let developers design more high-quality</span> apps<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>1.3<span style="font-family:‘DejaVu Sans‘;">,</span> <span style="font-family:‘DejaVu Sans‘;">the device through the CTS can run</span> androidmarket<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">in addition,</span> CTS <span style="font-family:‘DejaVu Sans‘;">is free, and very simple. </span></p></p> <p><p></p></p> <p><p>2<span style="font-family:‘DejaVu Sans‘;">, how to make my device compatible. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;"></span></p></p> <p><p>2.1<span style="font-family:‘DejaVu Sans‘;">, matched with</span> androidcompatibility Definition <span style="font-family:‘DejaVu Sans‘;">document (</span> ACD<span style="font-family:‘DejaVu Sans‘;">)</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">let's look at the matching version of your system</span> ACD<span style="font-family:‘DejaVu Sans‘;">, which describes the software and hardware parameters that you need to have in the Documentation. </span></p></p> <p><p>2.2<span style="font-family:‘DejaVu Sans‘;">, through</span> the CTS <span style="font-family:‘DejaVu Sans‘;">test</span></p></p> <p><p>CTS <span style="font-family:‘DejaVu Sans‘;">is an Open-source test framework that you use to test your device for Compatibility. </span></p></p> <p><p>2.3<span style="font-family:‘DejaVu Sans‘;">, submission of reports</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">you can send the test results to</span> [email protected] <span style="font-family:‘DejaVu Sans‘;">. When you submit a</span> CTS <span style="font-family:‘DejaVu Sans‘;">report, You can also request access to</span> Androidmarket.</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">we are preparing special purpose testing and certification of the website and the corresponding services, we will inform you later. </span></p></p> <p><p></p></p> <p><p>3<span style="font-family:‘DejaVu Sans‘;"></span> <span style="font-family:‘DejaVu Sans‘;">. How the CTS works</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;"></span></p></p> <p><p>The CTS <span style="font-family:‘DejaVu Sans‘;">mainly consists of two components:</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">run on</span> <span style="font-family:‘DejaVu Sans‘;">test Framework components on a PC. Primarily used to manage the execution of test cases (</span>testcase<span style="font-family:‘DejaVu Sans‘;">). </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">a test case that runs on a device or Emulator. These use cases</span> <span style="font-family:‘DejaVu Sans‘;">are written in</span> JAVA APK <span style="font-family:‘DejaVu Sans‘;">file. </span></p></p> <p><p></p></p> <p><p>3.1<span style="font-family:‘DejaVu Sans‘;">, Workflow</span></p></p> <p><p>1<span style="font-family:‘DejaVu Sans‘;">, the CTS can be compiled from the source code</span> <span style="font-family:‘DejaVu Sans‘;">, you can also download the compiled CTS from the website</span></p></p> <p><p>2.<span style="font-family:‘DejaVu Sans‘;">Install and configure</span> CTS<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>3.<span style="font-family:‘DejaVu Sans‘;">connect the device to</span> the PC <span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>4<span style="font-family:‘DejaVu Sans‘;">, run</span> CTS<span style="font-family:‘DejaVu Sans‘;">. </span>the CTS transmits <span style="font-family:‘DejaVu Sans‘;">the corresponding test case (</span> that is, an APK <span style="font-family:‘DejaVu Sans‘;">File) to the device and runs through</span> instrumentation <span style="font-family:‘DejaVu Sans‘;">, then logs the result of the run and finally deletes the test case. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">once all the test cases have been executed, you can readjust or optimize the system with reference to the test Results. Then continue to run</span> the CTS <span style="font-family:‘DejaVu Sans‘;">test. </span></p></p> <p><p>5.<span style="font-family:‘DejaVu Sans‘;">After the test is passed, you can</span> submit <span style="font-family:‘DejaVu Sans‘;">the results of CTS (</span> the. zip file <span style="font-family:‘DejaVu Sans‘;">named after</span> the result of the test <span style="font-family:‘DejaVu Sans‘;">) to</span> [email protected]<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p></p></p> <ol> <ol> <li> <ol> <li><p><span style="font-family:‘DejaVu Sans‘;">types of test Cases</span></p></li> </ol></li> </ol> </ol> <p><p>The CTS <span style="font-family:‘DejaVu Sans‘;">consists of the following three levels:</span></p></p> <p><p>1<span style="font-family:‘DejaVu Sans‘;">, the unit level. Test</span> <span style="font-family:‘DejaVu Sans‘;">The code unit on the Android platform. For example, a</span> <span style="font-family:‘DejaVu Sans‘;">class like java.util.HashMap. </span></p></p> <p><p>2<span style="font-family:‘DejaVu Sans‘;">, Functional level. </span> <span style="font-family:‘DejaVu Sans‘;">A more advanced feature combined with multiple Apis. </span></p></p> <p><p>3<span style="font-family:‘DejaVu Sans‘;">, program Level. </span> <span style="font-family:‘DejaVu Sans‘;">Execute a</span> collection of APIs <span style="font-family:‘DejaVu Sans‘;">and</span> Android Runtime services by running a simple APP <span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">Future versions will also contain the following types:</span></p></p> <p><p>1<span style="font-family:‘DejaVu Sans‘;">, Strength Test. Test</span> <span style="font-family:‘DejaVu Sans‘;">The stability of the system under high CPU Operation. </span></p></p> <p><p>2<span style="font-family:‘DejaVu Sans‘;">, Efficiency Test. For example, the number of frames rendered per second. </span></p></p> <p><p></p></p> <p><p>3.3<span style="font-family:‘DejaVu Sans‘;">, current test coverage</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">currently, to ensure compatibility, test cases cover these ranges</span></p></p> <p><p>1<span style="font-family:‘DejaVu Sans‘;">,</span>Signature</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">for each</span> Android <span style="font-family:‘DejaVu Sans‘;">products, There are some</span> XML <span style="font-family:‘DejaVu Sans‘;">files to describe all the public</span> APIs<span style="font-family:‘DejaVu Sans‘;">. </span>The CTS <span style="font-family:‘DejaVu Sans‘;">contains a tool to detect</span> whether the APIs included in these API <span style="font-family:‘DejaVu Sans‘;">signatures</span> are supported in the <span style="font-family:‘DejaVu Sans‘;">System. </span></p></p> <p><p>2<span style="font-family:‘DejaVu Sans‘;">,</span>Platform</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">Test</span> <span style="font-family:‘DejaVu Sans‘;">The platform APIs described in the SDK documentation</span> <span style="font-family:‘DejaVu Sans‘;">, such as</span> the Corelibraries,android application Framework <span style="font-family:‘DejaVu Sans‘;">. These</span> APIs <span style="font-family:‘DejaVu Sans‘;">are required to provide:</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">correct class, attribute, method signature, method behavior, Error parameter handling mode</span></p></p> <p><p>3<span style="font-family:‘DejaVu Sans‘;">,</span>DALVIKVM</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">specifically for</span> DALVIKVM <span style="font-family:‘DejaVu Sans‘;">'s Test. </span></p></p> <p><p>4<span style="font-family:‘DejaVu Sans‘;">.</span>Platformdata Model</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">platform through</span> ContentProvider <span style="font-family:‘DejaVu Sans‘;">provides data for developers to use, such as</span>contacts,browser,settings <span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>5<span style="font-family:‘DejaVu Sans‘;">,</span>platformintents</p></p> <p><p>the <span style="font-family:‘DejaVu Sans‘;">platform provides for core functionality</span> Intent<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>6<span style="font-family:‘DejaVu Sans‘;">,</span>platformpermission</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">The platform provides some important</span> APP <span style="font-family:‘DejaVu Sans‘;">Permissions</span></p></p> <p><p>7<span style="font-family:‘DejaVu Sans‘;">,</span>platformresources</p></p> <p><p>Simplevalues,drawables,nine-patch,animations,layouts,styles andthemes<span style="font-family:‘DejaVu Sans‘;">,</span>loading alternate resources, <span style="font-family:‘DejaVu Sans‘;">etc. </span></p></p> <p><p></p></p> <p><p>4<span style="font-family:‘DejaVu Sans‘;">. Configuring and using the</span> CTS</p></p> <p><p>4.1<span style="font-family:‘DejaVu Sans‘;">, configuring</span> the CTS</p></p> <p><p>1.6 <span style="font-family:‘DejaVu Sans‘;">and later to run</span> CTS<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">Unzip</span> ZIP <span style="font-family:‘DejaVu Sans‘;">package, Edit</span> The android-cts/tools/startcts <span style="font-family:‘DejaVu Sans‘;">script, Modify the variable</span> sdk_root <span style="font-family:‘DejaVu Sans‘;">to match the Environment. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">for Example:</span></p></p> <p><p>Sdk_root=/home/myuser/android-sdk-linux_x86-1.6_r1</p></p> <p><p></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">that is, point to</span> <span style="font-family:‘DejaVu Sans‘;">The root directory of the SDK. </span></p></p> <p><p>4.2<span style="font-family:‘DejaVu Sans‘;">, configuring Devices</span></p></p> <p><p>the <span style="font-family:‘DejaVu Sans‘;">following instructions are important, and improper configuration can result in a test timeout or a test failure:</span></p></p> <p><p>1<span style="font-family:‘DejaVu Sans‘;">, download</span> the SDK <span style="font-family:‘DejaVu Sans‘;">to the Machine. </span></p></p> <p><p>2<span style="font-family:‘DejaVu Sans‘;">, the device you want to test should be running a</span> userbuild<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>3. Please<span style="font-family:‘DejaVu Sans‘;">refer to this link (</span><span style="color:#000080;"><span><span style="text-decoration:underline;">http://developer.android.com/guide/developing/device.html</span></span></span><span style="font-family:‘DejaVu Sans‘;">) to set up your device. </span></p></p> <p><p>4. Before<span style="font-family:‘DejaVu Sans‘;">running</span> CTS <span style="font-family:‘DejaVu Sans‘;">, make sure your device has been burned into a</span> userbuild</p></p> <p><p>5. The TTS file <span style="font-family:‘DejaVu Sans‘;">needs to be</span> <span style="font-family:‘DejaVu Sans‘;">downloaded</span> via settings->speechsynthesis->install voice data before<span style="font-family:‘DejaVu Sans‘;">running the</span> CTS test <span style="font-family:‘DejaVu Sans‘;">. If Androidmarket is not installed</span> <span style="font-family:‘DejaVu Sans‘;">, manual installation is Required. </span></p></p> <p><p>6.<span style="font-family:‘DejaVu Sans‘;">It is recommended that you</span> <span style="font-family:‘DejaVu Sans‘;">log in to your device using a Google account that is designed to be tested. </span></p></p> <p><p>7.<span style="font-family:‘DejaVu Sans‘;">Make sure that the device has an</span> SD <span style="font-family:‘DejaVu Sans‘;">card</span> and that <span style="font-family:‘DejaVu Sans‘;">the SD card is Empty. Because</span> the CTS <span style="font-family:‘DejaVu Sans‘;">may modify/delete</span> <span style="font-family:‘DejaVu Sans‘;">the data on the SD Card. </span></p></p> <p><p>8<span style="font-family:‘DejaVu Sans‘;">, on the device to do a factory reset (</span>Settings->sdcard & phone storage->factory data reset<span style="font-family:‘DejaVu Sans‘;">). Note: This will delete all user data on the Device. </span></p></p> <p><p>9<span style="font-family:‘DejaVu Sans‘;">. Make sure the device is not under any</span> lockpattern <span style="font-family:‘DejaVu Sans‘;">(cancel</span> settings->security&location->requirepattern <span style="font-family:‘DejaVu Sans‘;">this Option) </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">ensure that "</span>screentimeout" <span style="font-family:‘DejaVu Sans‘;">is set to "</span>nevertimeout"<span style="font-family:‘DejaVu Sans‘;">(</span>settings->sound&display-> Screentimeout <span style="font-family:‘DejaVu Sans‘;">should be set to "</span>nevertimeout"<span style="font-family:‘DejaVu Sans‘;">)</span></p></p> <p><p>One by one<span style="font-family:‘DejaVu Sans‘;">, make sure "</span>stayawake" <span style="font-family:‘DejaVu Sans‘;">is selected (</span>settings->applications->development->stayawake<span style="font-family:‘DejaVu Sans‘;">)</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">Ensure that</span> the Settings->application->development->allowmock locations <span style="font-family:‘DejaVu Sans‘;">is set to</span> true<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>When<span style="font-family:‘DejaVu Sans‘;">running</span> CTS, the <span style="font-family:‘DejaVu Sans‘;">device stays on the Desktop. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">When the settings are being tested, no other tasks can be performed. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;"></span> <span style="font-family:‘DejaVu Sans‘;">do not press any key or touch the screen while the CTS is Running. </span></p></p> <p><p></p></p> <p><p>4.3<span style="font-family:‘DejaVu Sans‘;">, using</span> CTS</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">running a</span> testplan <span style="font-family:‘DejaVu Sans‘;">requires:</span></p></p> <p><p>1.<span style="font-family:‘DejaVu Sans‘;">at least one device or simulator is connected to the</span> PC <span style="font-family:‘DejaVu Sans‘;">. Then run the script</span> android-cts/tools/startcts</p></p> <p><p>2. You can perform <span style="font-family:‘DejaVu Sans‘;">the default</span> testplan<span style="font-family:‘DejaVu Sans‘;">by executing</span> the Start–plan CTS<span style="font-family:‘DejaVu Sans‘;">. This</span> test plan <span style="font-family:‘DejaVu Sans‘;">contains all the test Cases. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">use</span> ls-p <span style="font-family:‘DejaVu Sans‘;">to view</span> repository</p></p> <p><p>a <span style="font-family:‘DejaVu Sans‘;">List of test cases that are included in The. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">use</span> Ls–plan <span style="font-family:‘DejaVu Sans‘;">to view</span> repository</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains a list of</span> Testplan <span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>3.<span style="font-family:‘DejaVu Sans‘;">You can also run</span> Startctsstart–plan <plan_name> <span style="font-family:‘DejaVu Sans‘;">to execute a specified</span> Testplan<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p></p></p> <p><p>4.4<span style="font-family:‘DejaVu Sans‘;">, choose</span> Ctsplan</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">Current</span> In the CTS <span style="font-family:‘DejaVu Sans‘;">version, the following</span> 7 <span style="font-family:‘DejaVu Sans‘;"></span> Testplan are included altogether<span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>1<span style="font-family:‘DejaVu Sans‘;">.</span>CTS</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains all of the test cases, and approximately</span> 121000 tests are performed on the device <span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>2<span style="font-family:‘DejaVu Sans‘;">,</span>Signature</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains all the public</span> <span style="font-family:‘DejaVu Sans‘;">Signature authentication of the API. </span></p></p> <p><p>3<span style="font-family:‘DejaVu Sans‘;">.</span>Android</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains the</span> Testing of the Android <span style="font-family:‘DejaVu Sans‘;">platform</span> API <span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>4<span style="font-family:‘DejaVu Sans‘;">.</span>Java</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains the</span> Testing of the Java <span style="font-family:‘DejaVu Sans‘;">Core library</span> API <span style="font-family:‘DejaVu Sans‘;">. </span></p></p> <p><p>5<span style="font-family:‘DejaVu Sans‘;">.</span>VMS</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains the</span> DALVIKVM <span style="font-family:‘DejaVu Sans‘;">'s Test. </span></p></p> <p><p>6<span style="font-family:‘DejaVu Sans‘;">,</span>Refapp</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains tests for related applications</span></p></p> <p><p>7<span style="font-family:‘DejaVu Sans‘;">,</span>performance</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">contains tests for system Performance. </span></p></p> <p><p></p></p> <p><p>5<span style="font-family:‘DejaVu Sans‘;">, explain the test results</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">The test results are placed in the</span> $CTS _root/repository/results/<starttime>.zip</p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">. In this</span> ZIP <span style="font-family:‘DejaVu Sans‘;">file,</span>The testresult.xml <span style="font-family:‘DejaVu Sans‘;">file contains the actual test results, open the file with a browser to see the effect of the following</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;"></span></p></p> <p><p>the <span style="font-family:‘DejaVu Sans‘;">"</span>deviceinformation" <span style="font-family:‘DejaVu Sans‘;">section provides details of the device and firmware (such as</span> make,model,firmwarebuild,platform, <span style="font-family:‘DejaVu Sans‘;">etc.) and the hardware configuration of the device (screen parameters, keyboard , screen type, and so on). </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">in addition, the "</span>testsummary" <span style="font-family:‘DejaVu Sans‘;">section provides</span> an <span style="font-family:‘DejaVu Sans‘;">execution detail description</span> of the testplan, containing the Ctsplan name <span style="font-family:‘DejaVu Sans‘;">and the start and end time of the Execution. There are also statistics for test results, including test pass, failure, timeout, number of failed Executions. </span></p></p> <p><p>the <span style="font-family:‘DejaVu Sans‘;">table below counts how many test cases in a package are Passed. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;"></span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">This table is followed by a more specific description of the execution Results. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">This report lists</span> the Testpackage,test suite,testcase <span style="font-family:‘DejaVu Sans‘;">and the tests performed, as well as the results of the test execution: passed, failed, timed out, not Executed. When the test fails, the StackTrace can be found in</span> the XML <span style="font-family:‘DejaVu Sans‘;">file</span> , and these stacktrace are not included in<span style="font-family:‘DejaVu Sans‘;">order to make the execution results more concise</span> <span style="font-family:‘DejaVu Sans‘;">. Use a text editor to view</span> the XML <span style="font-family:‘DejaVu Sans‘;">file, search</span> for <Test> <span style="font-family:‘DejaVu Sans‘;">tags and</span> <StackTrace> <span style="font-family:‘DejaVu Sans‘;">tags on it. </span></p></p> <p><p></p></p> <p><p>6<span style="font-family:‘DejaVu Sans‘;">.</span> precautions</p></p> <p><p>The CTS restarts the <span style="font-family:‘DejaVu Sans‘;">device during testing, which is a normal behavior. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">The CTS can only be executed on one device at a Time. </span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">Run</span> CTS <span style="font-family:‘DejaVu Sans‘;">may have a popup force close dialog box that asks the user to choose to close or wait. Re-run this test will generally be good. </span></p></p> <p><p></p></p> <p><p></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;">Here are a few articles, speak relatively concise, you can first look at these several to read this article, so it will be easier to understand</span></p></p> <p><p><span style="font-family:‘DejaVu Sans‘;"></span></p></p> <p><p>http://chenhuawei1234567.blog.163.com/blog/static/194526712010629111638224/</p></p> <p><p>Http://blog.csdn.net/zjujoe/archive/2010/06/01/5640461.aspx</p></p><p><p>Android Compatibility test Framework (CTS) Manual</p></p></span>