Windows Phone mall rule Testing Tool

Windows Phone mall test kit

 

The Windows Phone marketplace test kit provides automated testing, monitoring testing, and manual testing kits to help you fully prepare for your first application submission so that the marketplace can accept them. The test Toolkit can be used to identify and fix problems before submitting at the mall, thus reducing the submission process time. You can use this test toolkit to evaluate applications that target Windows Phone OS 7.1 or later.

Install

The mall test kit is a component of the Windows Phone SDK. For information about how to install the Windows Phone SDK, see install the Windows Phone SDK.

What information does the test kit tell me?

Running the test toolkit on your application will help you determine whether the application will pass the mall authentication. If the test fails, the test toolkit provides detailed information about the content that needs to be fixed in the application before submitting the application for a marketplace evaluation. Some tests in this test toolkit are listed below.

• Whether the specified image and screen meet the authentication requirements.

• Whether the application icons and background images used in the application meet the authentication requirements.

• Which functions are used by the application.

• Whether the xap meets the size requirements and whether the Application List is valid

• Whether the application correctly handles the error.

• Whether the application startup speed is fast enough to meet the authentication requirements.

• Whether the application exceeds the memory usage requirements.

• Whether the "back" button is used correctly in the application.

• Whether the application uses an API that is not allowed on the mobile phone.

• Whether the application uses APIs that are not allowed by the background proxy.

• Whether there are unprocessed exceptions in the application and whether the application can be closed normally.

Open test Toolkit

The test toolkit is integrated in Visual Studio. Use the following steps to open the test toolkit.

1. In Visual Studio, open the Windows Phone OS 7.1 or later as the target Windows Phone application solution.

2. In Solution Explorer, select the project you want to test.

3. On the project menu, select the OPEN mall test kit option.

   -Or-

   Right-click the project to display its context menu, and select the OPEN mall test kit option.

   The test kit will open in a New Visual Studio label named mall test kit. The test toolkit opened in Visual Studio is displayed.

    

   You may see a yellow bar at the bottom of the test toolkit tag, which indicates that the test case has been updated. An update prompt is displayed.

4. If you see an update prompt at the bottom of the test toolkit tag, click the "Update" button. If you want to update the test toolkit, close it and restart it before continuing.

Because the test kit is opened in the New Visual Studio label, you can easily switch between files in the application and those in the test kit. The test toolkit Interface contains the labels for listing tests. These labels can be used to switch between the functions of the test toolkit. Each tag contains a set of different tests that can be run on the application.

Note:

All tests will run on the project selected when the test toolkit is opened. You can run multiple test kit instances targeting different projects at the same time. If you want to open a test toolkit for another project, select the project in Solution Explorer and select OPEN mall test toolkit from its context menu ". Otherwise, to change the target project, you must close the test toolkit, select a project, and re-open the test toolkit.

Use test kits

The test kit has multiple labels that contain application details and test classes. Each test category lists a series of tests with names and descriptions. The test is classified based on the running mode (whether it can be run automatically or whether some or all developers are required to participate. The test kit contains the following labels:

• Application Details

• Automatic Test

• Monitoring Test

• Manual test

The following sections detail these labels and how to run the test.

Application Details

The Application Details tab lists application packages and allows you to specify images that will be evaluated later during the test. The "application details" tab in the test kit is displayed.

The "application package" box lists the path of your application package (xap file). By default, this path is the bin \ release folder of the selected project. This means that you must use the released version to pass the automatic test and monitoring test.

The Application Details tab also allows you to specify an image that will represent your application in the marketplace. These images will be tested as part of the test kit. If you do not specify the desired image, your application will not be able to pass the test in the test kit. The following table lists the images you can specify.

Note:
Note that the image requirements can be changed. Make sure to test your application by using an updated version of the test kit and check the authentication requirements on msdn. For more information about image requirements, see application submission requirements.

 

Image	Size (pixels)	Format	Required
Application Tile	173x173	PNG	Yes
Application Tile	99x99	PNG	Yes
	200x200	PNG	Yes
Application Screen	480x800	PNG	Yes
Up to 7 Additional Application screens	480x800	PNG	No

For more information about the illustrations required to submit an application, see application illustrations.

You can use the screen tool provided by the simulator to easily obtain the application screen with the correct size and resolution. For more information, see How to Create a screen for a Windows Phone store.

Automatic Test

The automated testing tab provides some tests that evaluate the basic conditions (such as the size of the Application) of the application, the features required by the application, and the presence and size of the application image. The "Automatic Test" label in the test kit is displayed.

Note:
Note that the authentication requirements may change. Make sure to test your application by using an updated version of the test kit and check the authentication requirements on msdn. For more information about Automatic Test authentication requirements, see application submission requirements.

Steps for running an automatic test

1. On the "Application details" tab in the mall test kit, make sure that other resources are specified for the application.

2. Create a release version. For more information, see How to: Use Visual Studio to generate and deploy a Windows Phone application.

   You must use the released version to pass the automatic test.

3. Click the automatic test tab.

   Automatic Test display.

4. Click "Run test.

   Automatic Test starts. When the test is complete, you will receive the result of passing or failing each test. You will also receive the test description and any related error messages.

5. If necessary, use the "function verification" test results to update the wmappmanifest. xml file with the correct information.

   For more information about how to perform this operation, see how to determine the application features.

6. If the test fails, use the provided information to fix the problem and run the test again. Repeat this process until your application passes all tests in this section.

Monitoring Test

The monitoring test TAG provides a set of tests that analyze the performance and reliability of your applications during use on the device. Displays the monitoring test label in the test kit.

Note:
Note that the performance and reliability requirements may change. Make sure to test your application by using an updated version of the test kit and check the authentication requirements on msdn. For more information about monitoring test requirements, see technical certification requirements.

Steps for running a monitoring test

1. Create a release version in Visual Studio. For more information, see How to: Use Visual Studio to generate and deploy a Windows Phone application.

   You must use the published version to pass monitoring detection.

2. In the Standard toolbar, set the target device to "Windows Phone device ".

   The performance on the simulator does not represent the actual performance. You must run on the device to obtain accurate measurement data.

3. Connect the registered Windows Phone device to your computer. Make sure that the power of the device is on and the screen is not locked.

4. In the mall test kit, click the monitoring test tab.

   The monitoring test is displayed.

5. Click Start application.

   This will deploy your application to the stacked device, start the application, and then start monitoring and testing.

6. Navigate to your application and perform common user tasks. In addition, you should also use the "return" button on the device when the application is running.

7. After navigating the application, close the application. You can close the application by clicking the return button or clicking the close application button on the monitoring test tab. Clicking the "return" button is the preferred method to disable it.

   After the application is closed, the test result is displayed. For each test, the results details column uses pass or fail to update to indicate the test status. If there is not enough data to run the test, the column is updated with "not analyzed. If the test is already running, more details about the test result are displayed in the "error message" column.

8. If the test fails, use the provided information to fix the problem and run the test in this section again. Repeat this process until your application passes all tests in this section.

Manual test

The manual test tab provides a series of test cases that you should complete by running your applications on the window phone device. These manual tests require you to browse your application and observe its behavior in various situations to ensure that it meets the application authentication requirements. Displays the manual test label in the test kit.

Note:
Note that the authentication requirements may change. Make sure to test your application by using an updated version of the test kit and check the authentication requirements on msdn. For more information about manual verification requirements, see technical verification requirements.

Steps for running a manual test

1. Create a release version in Visual Studio. To get the best results, you should also specify the Windows Phone device as the deployment target. For more information, see How to: Use Visual Studio to generate and deploy a Windows Phone application.

2. In the Standard toolbar, set the target device. To obtain the best results, you must specify a Windows Phone device.

3. In the mall test kit, click the manual test tab.

   Manual test display.

4. For each test, follow the steps in the test description column.

5. Observe the application behavior and change the drop-down list in the result column to "pass" or "fail" based on the results you receive ".

6. If the test fails, use the provided information to solve the problem. Click the "more information..." link in the "test description" column to obtain more information about the test authentication requirements.

7. After resolving the application's problems, you can redeploy the application to the device and perform the test again. Repeat this process until your application passes all tests in this section.