Read Designed for Palm Test Kit text version

Designed for Palm Products

Program Test Guide

Rev 2.0.7 (3/22/2007)

Product Quality Partners, Inc. Experience and Creativity in Wireless Test Services

450 Main Street, Suite 207 Designed for Palm Compatibility Test Lab Pleasanton, CA 94566 Phone (925) 484-2527 Fax (925) 484-2631

Visit us at www.qpqa.com

Table of Contents

1 2

2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.7.1 2.7.2 2.7.3 2.8

INTRODUCTION .............................................................................................................................. 3 TESTING YOUR PRODUCT ........................................................................................................... 4

CONTACT INFORMATION.......................................................................................................................... 4 BEFORE BEGINNING................................................................................................................................... 4 PERFORM TEST SUITE................................................................................................................................ 4 SUBMIT REQUIRED DOCUMENTS ........................................................................................................... 5 SUBMIT PAYMENT ...................................................................................................................................... 5 SUBMIT PRODUCT/APPLICATION............................................................................................................ 5 PRICING ......................................................................................................................................................... 6 Initial Submission "Compact" Test Suite ........................................................................................................ 6 Re-test Submission "Extended" Test Suite...................................................................................................... 6 Method of Payment ......................................................................................................................................... 6 WAIVERS AND TEST CUSTOMIZATION.................................................................................................. 7

3

3.1 3.2

DURING TESTING ........................................................................................................................... 9

SCHEDULING TEST DATES........................................................................................................................ 9 COMPACT & EXTENDED TEST SUITES................................................................................................... 9 Initial Submission "Compact" Test Suite ........................................................................................................ 9 Re-test Submission "Extended" Test Suite...................................................................................................... 9 TEST RESULTS & COMMUNICATIONS.................................................................................................... 9 PALM INCIDENT SUPPORT ...................................................................................................................... 10 QP'S AUTOMATED WORK FLOW SYSTEM (AWS) .............................................................................. 10 USING AWS ................................................................................................................................................. 11

3.2.2 3.2.3 3.3 3.4 3.5 3.6

4

4.1 4.2

UPON COMPLETION OF TESTING............................................................................................. 19

DFPP DELIVERABLES AFTER TESTING ................................................................................................ 19 REVISION HANDLING............................................................................................................................... 19

5 6

6.1 6.2

TROUBLESHOOTING GUIDE...................................................................................................... 20 TEST CASES.................................................................................................................................. 21

GENERAL TESTS........................................................................................................................................ 22 CATEGORY SPECIFIC TESTS................................................................................................................... 32

Before submitting your application to QP, perform only the tests in this section those apply to your application...... 32 6.2.1 6.2.2 6.2.3 6.2.4 6.2.5 6.2.6 Personal Productivity..................................................................................................................................... 32 Games............................................................................................................................................................ 33 Messaging...................................................................................................................................................... 33 Entertainment ................................................................................................................................................ 35 Enterprise/Business ....................................................................................................................................... 36 Hardware ....................................................................................................................................................... 37

2 Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

1

INTRODUCTION

Welcome to the Designed for Palm Products Program Test Guide. The tests detailed in this document have been designed by Product Quality Partners, Inc. in partnership with Palm®, Inc., and approved by Palm. Quality Partners is an independent test company chosen to execute Palm's Designed for Palm Products compatibility testing program. All program specifics including process, test design and program design have been approved and are enforced by Palm, Inc. The purpose of this Guide is to provide developers with detailed information about the testing process and the specific tests that will be run when a product is submitted to the program. Developers are required to perform the tests detailed in the Test Guide product prior to submitting it to Product Quality Partners, Inc. to avoid the need for re-tests at additional expense. Designed for Palm Products Program compatibility testing ensures that products conform to the compatibility standards required by Palm, Inc. Meeting the compatibility requirements ensures interoperability with Palm smartphone devices. Once your solution has passed Palm's third-party compatibility test, you will be granted access to the Designed for Palm Products logo, which you can use to demonstrate compatibility with Palm Products. You will have permission to use the logo on your product packaging, website, at events, and on printed sales and marketing collateral. The Designed for Palm Products Program compatibility test is not a full product quality assurance guarantee. Product Quality Partners' function is to ensure that your product meets a set of compatibility standards from Palm, and that your product's stability is adequate throughout the compatibility tests. Product Quality Partners, Inc. is pleased to be the exclusive compatibility test lab for both hardware and software packages. IMPORTANT: Meeting the requirements of the compatibility test does not represent any type of quality assurance seal from Product Quality Partners, Inc. Palm, Inc. has reserved the right to refuse participation by any Vendor in the use of any trademark, licensing or compatibility program regardless of the test results determined by Quality Partners. We look forward to contributing to your product's success and working with you as part of the Designed for Palm Products testing program.

QP/Palm Compatibility Test Team Product Quality Partners, Inc.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

3

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

2

TESTING YOUR PRODUCT

This section details the steps developers are required to follow in order to submit a software application and/or hardware for testing.

2.1

CONTACT INFORMATION

For inquiries regarding submission, compatibility testing, test results, etc., contact Quality Partners. You will receive confirmation the same working day for all calls and emails received by 3:00 PM PST. Product Quality Partners, Inc. Designed for Palm Products Program 450 Main Street, Suite 207 Pleasanton, CA 94566 USA Tel: +1 (925) 484-2527 Fax: +1 (925) 484-2631 Email: [email protected] For inquiries regarding the Designed for Palm Products program benefits, logo usage, etc., send email to [email protected]

2.2

BEFORE BEGINNING

Review the Designed for Palm Products Program Test Guide (this document). The DFPP Program Test Guide contains all details of the program and a full list of tests that will be performed on your application.

2.3

PERFORM TEST SUITE

Before submitting your product to Quality Partners, make sure that it is ready for testing by performing the tests included in this Test Guide, including: 1. General Tests 2. Any Category-specific tests that apply to your product including: o Personal Productivity o Games o Messaging o Entertainment o Enterprise/Business o Hardware As you perform the self-test, make note of any tests that you feel do not apply to your product. You may apply for a waiver before, during, or after testing. Waiver requests will be responded to within 2 business days of receipt. For more information, refer to Section 2.8. For more tips on preparing your product for testing, see Section 5.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

4

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

2.4

SUBMIT REQUIRED DOCUMENTS

Next, complete the following documents and submit them to Quality Partners via fax at (925) 484-2631: 1. 2. 3. The Palm Developer Questionnaire available online. (Required when submitting a new product, or for a re-test) The Legal Agreement. (Not required for a re-test.) Addendum A. (Required when submitting a new product, or for a re-test.)

2.5

SUBMIT PAYMENT

When you fax your legal agreement you should also submit payment in the form of a company check, cashier's check, electronic, or wire transfer. Refer to Section 2.7 to determine the pricing that applies to your submission based on your product category. Note: A separate payment is required per device model supported by your product.

2.6

SUBMIT PRODUCT/APPLICATION

Once Quality Partners has received your required documents and payment, we will schedule your test period to begin within 5 business days. Your product must be received by the beginning of your test period. If you are submitting a hardware accessory, you must provide 2 product samples. They must be submitted in the packaging in which the product will be released to your target market. Only full versions of software can be accepted. No "demo" or "lite" versions will be accepted. Also, make sure to supply any necessary licenses and/or activation codes with your submission. You may deliver software in the following ways: FTP (an FTP account will be created for you on QP's FTP server) Email (to [email protected]) CD Ship all submission items to: Product Quality Partners, Inc. Designed for Palm Products Program 450 Main Street, Suite 207 Pleasanton, CA 94566 USA When scheduling your tests, Quality Partners will make every attempt to accommodate requests for specific test dates. However, due to program load, we cannot guarantee the availability of tests dates earlier than the specified 5 business day period.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

5

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

2.7

PRICING

If your product supports multiple devices, each device will be considered a separate submission. Separate pricing will apply for each supported device. If your product installs a suite of applications onto the Palm device, each application will be treated as a separate submission. Separate pricing will apply for each individual application on each supported device.

2.7.1

Initial Submission "Compact" Test Suite

The initial submission of your product will undergo a "compact" suite of tests. For the Compact Suite, QP will randomly select a subset of test cases from the entire list of test cases detailed in Section 6. PRODUCT CATEGORY Initial Submission "Compact" Test Suite (all categories) Accessories ­ Hardware ONLY PRICE $ 450.00 $ 250.00

2.7.2

Re-test Submission "Extended" Test Suite

If your product does not pass the compatibility requirements on the first attempt, you must fix the issue, then submit your application again for a re-test of your product. Each re-test will undergo "extended" testing. During "Extended" testing, all applicable tests detailed in Section 6 will be performed. In order to provide a value added service, while offering a cost effective solution, the testing and test cost has been categorized as follows: PRODUCT CATEGORY Personal Productivity Games Messaging Entertainment Enterprise/Business Solutions Standard Software Accessories ­ Hardware ONLY Accessories ­ Hardware & Software PRICE $ 850.00 $ 700.00 $ 850.00 $ 700.00 $ 850.00 $ 630.00 $ 250.00 $ 700.00

2.7.3

Method of Payment

Preferred method of payment is by check. Make checks payable to: Product Quality Partners, Inc. Designed for Palm Products Program 450 Main Street, Suite 207 Pleasanton, CA 94566 USA (925) 484-2527

You may also submit payment by wire transfer or electronic funds transfer. Please contact QP for further information.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

6

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

2.8

WAIVERS AND TEST CUSTOMIZATION 2.8.2 Requesting Waivers

On occasion, there are justified cases that require a waiver. For example, if the design of a product prohibits a developer from conforming to one of the tests listed in the criteria, or if a developer is unable to conform to a test because of a specific problem with the SDK or a reason completely out of the developer's control. Once you have performed the tests outlined in this Test Guide on your application or received problem status information on your submissions, if you feel that your product will not meet a portion of the test criteria, you may request a waiver. Submit waiver requests to [email protected] Please indicate "WAIVER REQUEST" in the email subject line. All waiver requests should include a technical explanation for the request. Waiver requests may be submitted prior to, during, or immediately after your product has been tested. Each case will be handled separately. Palm will approve or deny the waiver request within 2-3 working business days. An immediate e-mail will be sent to the developer reporting approval results for their waiver candidate. If the waiver request has been approved, Quality Partners and/or Palm will record the information in our online reporting system. If all other requirements have been met, the developer will receive a "test requirements met" result. If the waiver has been denied, a retest of the product will be necessary to fix the problem as documented in the "test requirements not met" result. NOTE: No failure status will occur if the failure cannot be reproduced in the lab at QP. If QP discovers a problem once and cannot reproduce the problem, it will be noted in the test results report but will not affect the test status. However, if QP can reproduce the problem consistently, but the developer cannot, we will work with the developer to help isolate the condition for reproducibility. Problems that are not reproducible at the developer site will be escalated to Palm, Inc. for decision handling through the test results report.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

7

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

2.8.3

TEST CUSTOMIZATION

You may be eligible for test customization if: Your product does not apply to the majority of the tests described in this Test Guide. Due to the nature of your product, Palm, Inc. requires a customized test in order to achieve compatibility. The procedure for deciding whether an application qualifies for a customized test suite uses the following steps. 1. QP emails the Palm Committee describing the product and states justification for the customization. ==> If Palm approves/agrees the product needs to have a customized set of test suites, then proceed to next step. Otherwise, go through the standard program. 2. QP requests detailed information from the developer. With this information QP provides a cost estimate to customize, develop, and execute the test suite for the submission. ==> If the developer agrees to pay for a customized suite, then proceed to next step. 3. QP develops and sends to Palm, Inc. a customized test suite. QP requests Palm's approval of the test suite. ==> Palm, Inc. approves the test suite or requests modifications/additions 4. QP publishes the information to Palm, Inc. and the developer. The developer will receive all information (test suite and test cases) detailing what tests will be executed. Developer schedules their tests with the QP Palm Compatibility lab and submits software, hardware, documentation, and other relevant information.

5.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

8

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

3

3.1

DURING TESTING

SCHEDULING TEST DATES

Quality Partners will schedule your test to begin within no more than five (5) business days of receiving all required submission materials. In an effort to continue to offer submission scheduling within a one-week time frame, it is important that once you have submitted and received confirmation of a start date that the commitment be met. Delayed submissions by the development company and/or no shows, result in delayed schedule availability. If no change of date or cancellation has been received prior to the original planned submission start date, then a new submission date will need to be requested and your submission will be placed in the queue for the next available submission start time. A late or no show submission penalty fee may be applied and due upon submission. Prior to submission, QP will require the Legal Agreement to be signed and receipt of the Palm Program Submission Questionnaire and test payment. You will receive confirmation of receipt of your package. If there is a need for a re-test, a second submission will be necessary. No additional legal agreement or will be needed assuming the submission includes bug fixes only. An additional Addendum A, questionnaire, and payment for the retest submission will be required.

3.2

COMPACT & EXTENDED TEST SUITES 3.2.2 Initial Submission "Compact" Test Suite

The initial submission of your product will undergo a "compact" suite of tests. For the Compact Suite, QP will randomly select a subset of test cases from the entire list of test cases detailed in Section 6.

3.2.3

Re-test Submission "Extended" Test Suite

If your product does not pass the compatibility requirements during a previous submission, you must submit for a re-test of your product with the required fixes. Each re-test will undergo "extended" testing. During "Extended" testing, all applicable tests detailed in Section 6 will be performed.

3.3

TEST RESULTS & COMMUNICATIONS

You will receive confirmation from Palm when testing begins, including login information for Quality Partners' secure online test management system, QP AWS, which will allow you to view your test results. During your test period, you will also receive emailed results information for all testing. All products will be returned once the testing has been completed. All items requiring shipment will be returned C.O.D.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

9

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

3.4

PALM INCIDENT SUPPORT

During testing, you will be allotted 2 support cases with Palm per paid testing run. To open a case, first go to the Palm Developer Network at https://pdn.palm.com, and search the Knowledge Base of frequently asked questions. If your question is not answered there, select the "Open a Case" tab, and submit your question.

3.5

QP'S AUTOMATED WORK FLOW SYSTEM (AWS)

Executive and senior management within QP have been managing test projects for decades. In doing so, the team members have used numerous enterprise database packages, off the shelf and freeware "bug" database and reporting products. To truly manage and track a test project, much more than a bug-reporting database is needed. Most database products were not designed to accommodate all of the features needed to manage and track a complete wireless test project. QP's Automated Workflow System (AWS) was designed to consolidate test cases and test programs, manage those tests, track test results, easily communicate on-line, and track all components of the test project. This includes managing test cases, devices, platforms, and tracking and reporting on completed tests. The use of our AWS is included in QP's test service. QP's service and tools save time and provide valuable data. The AWS is a web-based tool that allows our customers to quickly access problem reporting information on-line from anywhere at any time. Quality Partner's proprietary AWS provides the following capabilities to QP's test engineers, our customers, and our customer's third party customers:

· · · · ·

· ·

Uniform environment for execution of test cases and storing of results Container for execution of automated test scripts Test case prioritization and test case management Test results can be provided as attachments to the test cases Integrated defect reporting and management, with defects tied to the execution of the test cases. This associates the device and operating system with the defect automatically. Customized reporting through JSP tags. Administration system for development of test cases, tracking of applications, personnel, devices, etc.

The AWS provides security via a role-based system that can also be IP address limited. Each user for the system is provided with a login name, which is usually an email address, and a password. The Administrator then specifies the roles for that user. The system currently uses four levels. More can be added if needed based on customer requirement.

· · ·

·

admin users have full privileges for administration of the system. tester users are test engineers. These users create and execute test suites and enter and regress defects. developer users are 3rd party developers. They have viewing rights only for the data in the system and can only view the results for applications/handsets, which are from their company. program users are employees of the company that is running the program, in this case. These users can view the results for any applications/handsets that are submitted for their program.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

10

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

3.6

USING AWS

For purposes of instruction, the following terms are used: Submission: A product from a Content Partner to be tested. This will be reflected in the Application table in the database and will be the object against which Test Suites are executed. TestCase: An individual test to be performed on a submission. TestSuite: A collection of Test Cases encompassing a complete test. AWS Location: ­ http://aws.qpqa.com/prog/Home.jsp (case sensitive)

Login Credentials and Security: User name and password (username is generally your email address) Password is generated by the AWS admin and sent in a separate message (your password must be at least 8 characters in length and must have a mix of upper and lower case characters as well as at least one numeral or symbol)

Once logged in you will arrive at the following page:

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

11

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

12

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

The functionality and description of the features and navigation links listed on the previous page are detailed below.

Modify Profile

On the Modify Profile page you can change the User's Name, Phone Number and Password settings:

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

13

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

View Program Dashboard

The View Program Dashboard screen displays all of the submissions submitted to the program by your company. This page gives you a quick view of all submissions for your company with their associated status and/or completion progress.

Green indicates that the test is complete and all requirements have been met. Yellow indicates that the test is incomplete and displays a percentage complete. Red indicates criteria or requirements were not met within the test. Yellow with Red Stripe indicates the test is incomplete. At least one criteria or requirement has not been met in the testing completed thus far. Yellow with Green Stripe indicates the test is incomplete. For the testing completed thus far, all criteria or requirements have been met. Transparent or Pending indicates that the testing has not yet begun. Typically the submission has not arrived at QP or has been received into the program but the testing has not yet begun.

Clicking any of the tests in the colored status areas allows you to drill down into the test execution report as you can see in the following screenshot.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7 14 Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

Selecting the "Failed," "Pass" or "N/A" links will drill down into the details of the individual test case. Any Failed tests can be drilled down further to review the details of the test case and any associated defects.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

15

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

View Applications

The View Applications screen displays all of the submissions submitted to the program by your company.

"Drilling down" into an application by selecting the application name displays information about the application like version number, associated devices, test suites that have been executed against the applications and its various versions, etc.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

16

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

Further drilling down into the test suite by selecting the associated "Test Started" link, displays the individual test cases executed and their results. Any failed tests can be drilled down further to review the details of the test and any associated defects. See the following screenshot for an example of a defect.

View Defects

Selecting the View Defects link on the home page provides a mechanism to query defects as detailed in the following screenshot:

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

17

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

This query will return a sort able summary listing of the defects matching the constraints entered. This listing also allows for the drilling down into each defect within the listing for details and further descriptions of the defects. As you can see in the defect screen in the following screenshot, comments and attachments can be added to the defect.

Create Reports

There are several custom reports contained in the AWS that are useful to developers · The Defects by Severity by Application report returns the total number of all defects found, which are broken down by application and sorted by severity. Selecting the application name returns a summary listing of defects for that Application. The Defects by Severity by Company report returns totals of all defects found sorted by severity.

·

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

18

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

4

4.1

UPON COMPLETION OF TESTING

DFPP DELIVERABLES AFTER TESTING

Once your solution has passed the Designed for Palm Products compatibility test, you will receive a congratulatory e-mail from Palm within 24 to 48 hours. This email will include details on obtaining the Designed for Palm Products Logo. You will have permission to use the logo on your product packaging, website, at events, and on printed sales and marketing collateral.

4.2

REVISION HANDLING

The Designed for Palm Products Logo only applies to the developer's product version and/or model AND Palm device model on which the product was tested and has met the Designed for Palm Products compatibility requirements. If a new version or model of the developer's product becomes available, the product must be resubmitted and meet the Designed for Palm Products compatibility requirements.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

19

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

5

TROUBLESHOOTING GUIDE

This section describes the most common problems found during Designed for Palm Products compatibility testing.

Have you checked for these?

1. 2. 3. 4. 5. 6. 7. 8. 9.

Application text must correctly display on the device's screen. Application must support touch screen stylus interaction and react predictably to touch input. Application must enable the 5-way button for one-handed operation. Application must correctly sync. Application must correctly install with Palm® Desktop software. Application must gracefully exit with an error message if problems occur. Application must not soft reset or hard reset ("crash") the Palm device under any normal application operation. Application must correctly respond by suspending operation when the red or green key is pressed. Application must correctly respond by suspending operation when an incoming phone call or SMS is received.

10. Application must gracefully exit with an error message when a low memory situation is detected. It must not reset or freeze the phone. 11. Application must launch from an SD card and continue normal execution if the SD card is removed.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

20

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

6

TEST CASES

Test Definitions

Before submitting your application to QP, you should perform all tests in this section that apply to your software. 1. 2. GENERAL TEST CASES (applied to all products) CATEGORY-SPECIFIC TESTS (perform only the tests that apply to your application) · · · · · · PERSONAL PRODUCTIVITY (e.g., Calorie Counter, Tip Calculator, Chat, etc.) GAMES (e.g., solitaire, pinball, tic-tac-toe, giraffe, etc.) MESSAGING (e.g. Instant Messaging, MMS, etc.) ENTERTAINMENT (e.g., Audio and Video applications, ring tones, wallpapers, etc.) ENTERPRISE/BUSINESS (e.g., email, document viewers, etc.) HARDWARE (e.g., headsets, GPS devices, battery chargers, etc.)

Test Approach

The initial submission of your product will undergo a "compact" suite of tests. For the Compact Suite, QP will randomly select a subset of test cases from the entire list of test cases detailed below. If your product does not pass the compatibility requirements on the first attempt, you must fix the issue, then submit your application again for a re-test of your product. Each re-test will undergo "extended" testing. During "Extended" testing, all applicable tests detailed below will be performed. For information on Incident Support that is provided with each purchase, refer to Section 3.4.

Test Configurations

Conduit or Desktop testing will be performed on the following supported platforms and operating systems: · Windows · Desktop OS · Windows XP · Syncing Software · PalmOS · Testing will also be performed using PalmTM Desktop/HotSync Manager v4.1 for Windows · Windows Mobile · ActiveSync 4.x · Mac · G4/5 configurations running Mac OS 10.4. · Testing will also be performed using PalmTM Desktop/HotSync Manager v4.1 for Macintosh.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

21

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

6.1

GENERAL TESTS

Before submitting your application to QP, perform ALL tests in this section. If you feel that you must request a waiver, follow the instructions in Section 2.8.

ID #

Description/Steps ­ General Test

Expected results

Installation / Uninstallation

A-INST-1 Install - Installation from cd/windows executable 1. Launch installation of the application from the CD or windows executable. 2. Follow the steps to install the application on to the device. INST-1 Install - Device Setup 1. Populate device with PIM data, at least 2 records in Date Book / Calendar application. 2. Make/receive a few phone calls; make sure the phone radio is on. 3. Install all Palm-bundled software. This means installing all the software that's on the CD; and all the software this is installed by a stub application (possibly in ROM). A-INST-2 Install - Installation from stub app [For applications that are installed wirelessly via a stub app on the device] 1. Launch the stub application on the device. 2. Follow the steps to download and install the application. INST-2 Install - Installation from stub application with no data connection available [For applications that are installed wirelessly via a stub app on the device] 1) Create an environment where a data connection is not possible i.e. phone radio turned off or out of coverage. 2. Launch the stub application on the device. If the phone radio is turned off the user should be prompted to turn the phone ON If a data connection cannot be made because of the lack of cellular coverage or any other reason, the process should fail gracefully with no crashes, freezes, or other unexpected behavior. Application should download and install without crash or errors. Application should download and install without crash or errors.

3. Follow the steps to download and install the application.

INST-3

Perform OTA Installation of Application If OTA applicable 1. Perform an Over-The-Air installation of the application. 2. Launch application. Verify that application is installed without any errors. Application launches without any errors.

INST-4

Subscribe and/or Perform Upgrade of Application-Within application 1. If application has a subscription and/or upgrade function within the application, perform that function. 2. Launch application. 3. Perform a couple of functions and network connections in the application. Verify Application is upgraded without any errors. Application launches without any errors. Application performs without any error.

INST-5

Subscribe and/or Perform Upgrade of Application-outside application 1. If application has a subscription and/or upgrade function, which involve Application is upgraded without any errors. installing a patch or file, execute that function. 2. Launch application. 3. Perform a couple of functions and network connections in the application. Application launches without any errors. Application performs without any errors.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

22

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

Description/Steps ­ General Test

Expected results

General Functionality

A-GF-1 Functionality - Main Functionality 1. Open application under test. 2. Perform High Level cursory tests to ensure features function as expected. A-GF-2 File Formats - Supported files 1. If applicable, open supported file formats in the application. A-GF-3 Exit application via OK button (Windows Mobile) 1. Launch application. 2. Press the X in the top right hand corner of the display. 3. Repeat steps 1-2 but in different screens of the application. GF-1 File Operations - Open 1. Launch application. 2. Open a file from all supported locations (i.e. internal memory or expansion card) GF-2 File Operations - Save 1. Launch application. 2. Perform "Save" function on files from all supported media and locations Files should save without error. (RAM, Hard Disk, SD Card, MMC Card, etc.). GF-3 Functionality - Main Functionality 1. Open application under test. 2. Perform High Level cursory tests to ensure features function as expected. GF-4 File Formats - Unsupported files 1. If applicable, attempt to open the un-supported file formats in the application. GF-5 Interaction - Native application (separate) 1. If applicable, launch 2-3 stressful native applications (native Web Browser and Email program) of the device and then launch the test application. 2. Switch back and forth between the applications and enter data in all applications. GF-6 Exit application via X in the top right hand corner of the screen (Windows Mobile) 1. Launch application. 2. Press the X button. 3. Repeat steps 1-2 but in different screens of the application. Application launches without error. Application exits without error. Application exits without error. Verify applications display and function as expected as they are switched. Application displays error messages and handles attempted viewing of unsupported files gracefully. The application should execute without error and function as expected. Files should open without error. Application launches without error. Application exits without error. Application exits without error. Supported file formats display / playback as expected. The application should execute without error and function as expected.

UI

A-UI-1 Windows Mobile Applications - Screen Independence 1. On the Windows Mobile device with a 240x240 screen, launch application and view the main screen. Verify user is not required to scroll left or right to view contents.

Verify user is not required to scroll left or right to view 2. Verify in other screens of the application that the user is not required to contents. Exceptions would be applications that need to move left or right to view the data. scroll up and down to accommodate large numbers of options or data. The screen should fit left to right.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

23

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID # A-UI-2

Description/Steps ­ General Test 5-way navigation - Normal 5-way presses do not crash the application or OS 1. Open application. 2. Press each of the hard buttons on the 5-way navigator.

Expected results

5-way button presses should function as expected within the application with no errors, freezes, or crashes.

A-UI-3

5-way navigation - Popup lists 1. Open application. 2. Navigate to and highlight a popup list. 3. Press center select. 4. Press up and down hard buttons. 5. Press center select. 3) Should open list 4) Should navigate within list 5) Should select highlighted item in the list.

A-UI-4

5-way navigation - Button navigation 1. Open application. 2. Use 5-way navigation and activate soft buttons within application. Should be able to navigate to and activate soft buttons within application.

A-UI-5

5-way navigation - List navigation [For applications that support lists] 1. Open application list view. 2. Press up and down hard buttons. Should be able to navigate list with up and down buttons on 5-way navigator.

UI-1

Buttons - Hard button functionality within application 1. Launch application. 2. Press one of the Hard buttons on the device Repeat steps 1 and 2 trying each of the hard buttons. Each button should function as designed with no hangs, crashes, or other unexpected behavior.

UI-2

Buttons - Hard button restore default functionality [For applications use the hard buttons for a unique purpose] 1. Launch application. 2. Use hard buttons within application. 3. Exit application. Hard buttons should have the same function they had before launching the application.

A-ST-3

Stylus - Select options / buttons [During the course of testing the application] 1) Verify that the application handles the use of the stylus for buttons, options, menu selections, and other functions."

UI-3

Icon - Verify application icons 1. Navigate to the Home Launcher on the device. 2. Check icon for the application in Icon view. 3. Check icon for the application in list view. Icons unique to the application should be present in both views and be displayed correctly. Generic icons should not be used.

UI-4

UI - About <appname> box 1. Open application. The application uses its own About box and not the Palm About box and that information contained on the screen is correct and has version number.

2. Go to About <appname> in menu.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

24

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID # UI-5

Description/Steps ­ General Test UI - Caps/Caps Lock and Option/Option Lock status indicators [For applications with screens that have text entry fields] 1. Launch application. 2. With cursor in a text entry field, activate and deactivate Caps lock and Option lock. 3. Look for correct display of status indicator in the lower right corner of the screen.

Expected results

The status indicator exists in the Application and is visible in the lower right corner of the display from all data entry screens and dialogs.

A-ST-2

UI - Display issues [During the course of testing the application] 1) Verify that the application displays properly, screen refreshes/renders properly over the course of testing. Mark as Pass or Fail after all tests have been completed."

Data / Sync

DS-1 Records - Sync/Transfer large records 1. Create 1-3 very large records containing maximum amount of data to internal memory. 2. Sync and/or Transfer the data. DS-2 Auto Sync - Background data connection while in another app For applications that are capable of syncing or downloading data in the background at a scheduled time] 1) Configure application under test to auto-sync. 2) Exit application. 3) At the time the sync is scheduled to take place, open another application. Try syncing data while in various applications: Contacts, Calendar, Tasks, Web, email, Messaging. A-DS-1 Sync - Windows only synchronization. 1. Sync application data with Windows platforms. DS-3 Sync - Mac Only synchronization. 1. Sync application data with Mac platforms. If Macintosh Operating Systems are only supported, the test will verify data can be synchronized across Mac systems. Data must be synchronized in full on each platform. If Windows Systems are only supported, the test will verify data can be synchronized across windows platforms. Data must be synchronized in full on each platform. Background sync or data connection should complete without error. If there is a reason the data connection cannot be made the sync should fail gracefully with the appropriate error message and no crashes, freezes or other unexpected behavior. The records should be written without error. The data should transfer successfully without truncation.

Power Management

A-PM-1 Auto-off function - SW/HW does not interfere with Auto-off 1. Launch application and/or connect and power on hardware accessory. 2. Leave open but inactive/idle. PM-1 Power - Battery consumption For Palm OS devices: 1. Install the attached Battery application to both the reference device and the device under test. 2. Open Calendar application on reference device and enter <shortcut.3> to force device to remain powered on. 3. On device under test, launch application and/or connect hardware accessory and use for 1 hr (can run other tests while testing this). Device should auto off in accordance with the settings in the Preferences Power panel i.e. (30 seconds, 1 minute, 2 minutes, or 3 Minutes).

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

25

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

Description/Steps ­ General Test 4. Use Battery application to compare battery usage between test device and reference device. For Windows Mobile Devices Setup: Two (2) devices, fully charged (overnight) On reference device, go to Settings > System: - Power > Advanced. On Battery power, Uncheck/disable "Turn off if device not used" - Backlight > Battery Power. Uncheck/disable "Turn off backlight if device is not used" 1. On the reference device, from the Programs menu launch Excel or Word Mobile. 2. On device under test, launch application and/or connect hardware accessory and use for 1 hr (can run other tests while testing this). 3. After 1 hr. go to Settings > System > Power > Battery. Compare the remaining battery life on both devices.

Expected results Launching and using the application doesn't accelerate normal battery usage.

Launching and using the application doesn't accelerate normal battery usage.

PM-2

Power - Launch App, Low battery status Verify that when the device is in a low battery state, the application launches without error or gracefully exits and informs the user that application cannot launch while in the low battery state.

1. While the device is in a low battery state, launch the application.

Stress

STRESS-1 Memory - Check for memory leaks. 1. Take note of free memory. 2. Launch and use your application as a user would for 5 minutes. 3. Exit application. Should not see any drops in the amount of free memory on 4. Check the memory again and see if it has gone down. Repeat steps 2 or the device not accounted for by data that was 3 times. created/saved in the application. STRESS-2 Memory - Dynamic Heap memory usage- Compatibility [Amount of Dynamic Heap Memory required by application will vary. Launch an application that uses a fair amount of heap space and use this in conjunction with the application under test to test Dynamic heap memory usage] 1) Install and setup Heap memory stressing application on the device and make sure it is running in the background. 2. Launch and run the application under test. STRESS-3 Memory - Low memory condition handled gracefully 1. Fill all but 100K of memory on the device. On Windows Mobile devices fill device such that Storage Space is below 100K. 2. Try to launch the application under test. The application should either launch or fail gracefully. If there is not enough free memory available to launch the application, a dialog should be displayed informing the user with any crashes or freezes on the device. Application under test should launch and run without crash or error.

STRESS-4

Gremlins and Hopper 1. Use Gremlins and Hopper to stress test the application. A Gremlin test will be executed for all Handheld applications using the Stress testing does not show any Gremlins and Hopper Palm OS Simulator tool. The application must allow Gremlins to run errors with the test application. throughout the entire application without exiting into the Launcher. An IF statement may be included in the application in order to detect when Gremlins is running.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

26

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

Description/Steps ­ General Test

Expected results

Device Interoperability

DI-1 Sound - Sound adjustment in application does not affect Global sound setting [For applications that have their own sound settings within the app] 1. Launch application. 2. Adjust sound settings within application. 3. Exit application and check global sound settings. A-DI-1 Sound - When system sound is off, verify app sound is off also. 1. Turn OFF System sound in Preferences. 2. Open application check behavior with various sound settings. A-DI-2 Find - Application supports Global Find [For applications that have editable text fields] 1. Launch application. 2. Enter data that is unique in one of the fields. 3. Exit application. Verify that text fields within the application support Global Find where appropriate and data in the application can be found. Whole words and beginnings of words should be used. Turning OFF System sound in Preferences should override any sound settings within the application. Adjusting sound settings within application should not affect global sound settings when you exit the application.

4. Launch Global Find and search for the data entered in step 2.

A-DI-3

Find - Launch Global Find within application. 1. Launch application. 2. Launch Global find. 3. Search for data in that can be found in another application. Global find launches with the application open. Data located in another application can be searched for and found.

DI-2

Compatibility - Song playing in the background 1. Launch device's media player (e.g. pTunes or Windows Media Player) and play a song. 2. Exit application such that song is playing in the background w/o skipping. 3. Launch application under test. Application should launch and run with a song playing in the background with no crashes, errors, or other unexpected behavior.

DI-3

Auto Sync - download or sync email while using the application. [Set email to sync automatically] 1. Launch test application and be actively using while email is syncing in the background.

Interrupts

A-INT-1 Messaging interplay - Receive an SMS or MMS message while in the application. 1. Launch application. 2. From another device, send an SMS to the device under test. Alert screen for message is displayed on the receiving device. Try the following: a) Select Reply; b) Select [Callback] ; c) Select [Go To] 3. Repeat step 2 with an MMS. a) You are taken to Messaging application chat view. b) A call is placed to the sending device. c) You are taken to Messaging application chat view. a) You are taken to Messaging application chat view. b) A call is placed to the sending device. c) You are taken to Messaging application chat view.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

27

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

A-INT-2

Description/Steps ­ General Test

Phone interplay - Answer incoming 1. Open the application. 2. Call the device.

Expected results

3. Answer the call.

Verify that you can answer the call and exit the application to go to the phone application gracefully. Also verify that the incoming call ring tones are audible and played over any application sounds. Also verify that any application sounds stop so that they don't interfere with the call's audio.

A-INT-3

Phone interplay - Make a phone call 1. Open the application. 2. If it is a data app, be connected to data. 3. Switch to the phone application and make an outgoing phone call. Call should ring out successfully.

A-INT-4

Windows Mobile - Pressing Send/Green while test app is open (Windows Mobile only) While the test application is open, press the Send/Green key. It goes to the Main Menu. No crashes or errors should occur.

A-INT-5

Windows Mobile - Pressing End/Red key while test app is open It goes to screen saver mode and if it is pressed again, it will go back to the test application screen. No crashes or errors should occur. Important Note: For Treo 750, the expected result is different. It will go to the Main Menu if the End/Red key is pressed.

(Windows Mobile only) While the test application is open, press the End/Red key.

A-INT-6

Palm OS - Pressing Send/Green key while test application is open (Palm OS only) Press Send/Green while test application is open. Nothing occurs and it stays at the test application screen. No crashes or errors should occur.

A-INT-7

Palm OS - Pressing End/Red key while test application is open (Palm OS only) While the test application is open, press the End/Red key. It goes to screen saver mode and if it is pressed again, it will go back to the test application screen. No crashes or errors should occur.

A-INT-8

Alarm - Set alarm to go off while the application is open. 1. Set alarm to go off at a certain time. 2. Open application during the time selected alarm time. This test should be run with alarms originating from World Clock, Calendar, and Tasks. Alarm sounds while application is open and attention manager dialog can be dismissed.

INT-1

Alerts - System alarms and warnings- Low Battery 1. Drain battery on device until battery level is critically low. 2. Launch application. Low battery warning dialogs display correctly with application open. Application screens redraw correctly after closing the Low Battery dialog.

INT-2

Interplay - Application interrupts other applications [For applications that have their own internal alerts, notifications, or anything that can cause an interruption in another application] 1. Launch application. 2. Configure test application to trigger an alert, notification, or interrupt 3. Exit test application and open another application on the ROM at the time when the interrupt is due to occur. 4. Repeat test in Contacts, Email, and Music Player. When another application is interrupted by the test application it happens without crash or error and occurs as documented.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

28

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

INT-3

Description/Steps ­ General Test

Messaging interplay - Receive an SMS or MMS message while in the application. 1. Launch application. 2. From another device, send an SMS to the device under test Alert screen for message is displayed on the receiving device. Try the following: a) Select Reply; b) Select [Callback]; c) Select [Go To] 3. Repeat step 2 with an MMS.

Expected results

a) You are taken to Messaging application chat view. b) A call is placed to the sending device. c) You are taken to Messaging application chat view. a) You are taken to Messaging application chat view. b) A call is placed to the sending device. c) You are taken to Messaging application chat view.

INT-4

Phone interplay - Answer incoming 1. Open the application. 2. Call the device. Verify that you can answer the call and exit the application to go to the phone application gracefully. Also verify that the incoming call ring tones are audible and played over any application sounds. Also verify that any application sounds stop so that they don't interfere with the call's audio.

3. Answer the call.

INT-5

Phone interplay - Ignore incoming call. 1. Open the application. 2. Call the device. 3. Ignore the call. Ignoring the call should dismiss the dialog return you to the application. The call will be sent to voicemail. Also run this using the "Ignore with text message" option. 4. Caller leaves Voicemail. Voicemail notification is received on the device.

INT-6

Phone - Interplay - Application interrupts - phone call [For applications that have their own internal alerts, notifications, or anything that can cause an interruption in another application] 1. Launch application. 2. Configure test application to trigger an alert, notification, or interrupt 3. Exit test application and make a phone call to the device at the time when the interrupt is due to occur Any interruption caused by the test application should not disrupt an active phone call.

INT-7

Phone interplay - Make a phone call 1. Open the application. 2. If it is a data app, be connected to data. 3. Switch to the phone application and make an outgoing phone call. Call should ring out successfully.

INT-8

Interrupt - Voice call interrupts data connection 1. Connect to the network and use the application. 2. Place a call to the device. 3. Answer the call then hang up. 4 Return to the application and continue using the application. The data connection should be interrupted and the call can be answered. Returning to the app, the application functions normally with no adverse affects.

A-ST-1

Power off device while changes are being saved 1. Make changes to the device from the application in test. 2. While the changes are being saved turn off the device. 3. Turn on the device The changes are saved or the device remains in its original state. The device should not crash or become unusable.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

29

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

Description/Steps ­ General Test

Expected results

SD / Memory

A-SDMEM-1 Expansion - Common functionalities for application that use card. 6. Launching from card. A-SDMEM-2 Expansion - Negative- Data transfer to card with no card present [No card inserted into device] 1. Attempt to transfer data from application to card. A-SDMEM-3 Expansion - Remove card with application open [SD card inserted] 1. Launch application. 2. Remove card. A-SDMEM-4 Expansion Card - Removing the card when the app is in use 1. Copy the application to an SD card and use the application. 2. Perform an action that causes the application to retrieve data from the network. 3. Remove the SD card. 4. Insert the SD card and perform the same function. A-SDMEM-5 Expansion - Common functionalities for application that use card With application installed, verify functionality of: 1. Saving records to/from card. 2. Saving databases to/from card. 3. Deleting records from card. 4. Beaming data from card to other device. 5. Copying/Moving to and from card. SLFSDMEM-2 Expansion - Common functionalities for application that use card Operations that are supported by the application complete successfully without error or Crash. The application should not crash or freeze. The function should complete as expected and not post any error messages. Card should be able to be removed without crash, error, or change in application. Card removal sound should still be heard. If the application supports data transfer directly onto an expansion card, the application will gracefully handle an attempt to transfer data without the card present (e.g., will not crash and will post an appropriate warning message). Operations that are supported by the application complete successfully without error or Crash.

Bluetooth / IR

A-BIR-1 Bluetooth - Receive with application open 1. Launch application. 2. Send data via BT from another device. BIR-1 IR - Receive Beamed data with application open 1. Launch application. 2. Beam data to device from another handheld. Data should be received while the application is open. Upon accepting the beamed data, the user should be in the appropriate application or category for the beamed data. Data should be received while the application is open without crash or error

Network

A-NET-1 Disconnect- Port is released and a call can be placed 1. Connect the application to the network and perform its primary function. 2. Disconnect from the network and place a call to the device. The call can be placed/connects and does not go to voicemail.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

30

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

A-NET-2

Description/Steps ­ General Test

Disconnect - Network disconnect time 1. Connect the application to the network, perform a function, and then disconnect.

Expected results

Verify the connection goes dormant or disconnects in the time specified in the documentation.

NET-1

Network - Exit and relaunch during retrieval process 1. Connect to the network and perform a function where data is being retrieved. 2. Exit the application. 3. Return to the application. The application exits gracefully. When returning to the application the application continues to function as expected.

NET-2

Data interplay - download or send data after using the application. 1. Launch application. 2. Make a data connection within the application if that functionality is supported. 3. Exit the application. 4. Launch Web, Email, or Messaging application and make a data connection. Using the application should not inhibit the ability of other applications to make a data connection after the application under test is exited.

NET-3

Dropped Coverage - Within application, graceful reconnection 1. Launch application and enter screens that perform a network connection. 2. Insert device into shield box as application is performing network connection. 3. Remove device from box and access screens that performs a network connection. Verify application is able to connect to network in the screens that access the network.

Peripherals

A-PER-1 Keyboard- Test App Data input with the Palm Branded keyboard 1. If the application allows data entry, connect the Palm Branded keyboard. 2. Begin enter data via the keyboard Verify data is entered.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

31

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

6.2

CATEGORY SPECIFIC TESTS

Before submitting your application to QP, perform only the tests in this section those apply to your application.

6.2.1

ID #

PP-1

Personal Productivity

Description/Steps ­ Personal Productivity

Personal Productivity - Launcher screen 1. If the application changes the look and feel of the launcher screen make these changes. 2. View all PIM icons. 3. View menus and shortcuts 4. Restore the launcher to its default state. 5. Launch each Palm/Windows native applications. Icons should not be changed to a generic icon. Menus launch and shortcuts are not duplicated. All changes made by the application have been removed. Applications launch as expected, no corruption occurs or error messages post.

Expected results

PP-2

Personal Productivity - System time 1. If a clock application works independently from the device time set a time. 2. Set an alarm within the application. 3. Set an alarm on the device for the same time as the application. Verify both alarms post and one alarm does not cancel out the other. View the device time and make sure the device time has not changed.

PP-3

Personal Productivity - System time 1. If the clock application changes the device time change the time and view the time on the device. 2. Setup an alarm within the application. The device time is changed and matches the application. Verify the alarm posts at the correct time.

PP-4

Personal Productivity - Clock deletion 1. Set a time from the application. 2. View the time on the device. 3. Delete the application and view the system time. Device time changes to match the application. Verify the time is still at the time set or reverts back to the network time. The time should not change to a random time.

PP-5

Personal Productivity - Address book/Contacts 1. If the app shares the Palm/Windows Address book install the application. 2. Add addresses to the device through the application. 3. Delete the application and view the Palm/Windows Address book. Verify addresses originally on the device are not deleted and addresses added through the application are still present on the device. Verify the device's addresses are imported to the application.

PP-6

Personal Productivity - Date Book 1. If the application shares the Palm/Windows Date Book install the application. 2. Add Date Book entries through the application. Verify the devices Date Book entries are imported to the application. Entries are added.

PP-7

Personal Productivity - Date Book alarms 1. Set an alarm through the application. 2. Set an alarm through the device Date Book.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

32

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID #

Description/Steps ­ Personal Productivity

3. Delete the application and wait for the alarms to post.

Expected results

Verify both alarms post. Since the application shares the Date Book PIM they both should post even if the application is removed.

PP-8

Personal Productivity - Device back-up 1. If the application performs a device back-up, back-up the device to a SD card. 2. Hard reset the device. 3. Using the SD restore the device data. All files should be restored with no data corruption or lost.

PP-9

Personal Productivity - Remote Control usage. 1. Setup the application to use the supported devices CD/DVD, TV/Cable, Audio. 2. Standing within range, begin using the device. Verify the application functions as expected, channels and audio can be changed/adjusted.

6.2.2

ID#

GAMES-1

Games

Description/Steps - Games

Game - Application interaction 1. Begin playing the game. 2. While playing the game launch another application. 3. Return to the game. Verify the game does not freeze, crash, or affect the application that was launched.

Expected results

GAMES-2

Game- Saving a score 1. Play the game so a score can be saved. 2. If the scores are saved locally, exit the game then relaunch. Verify the score is saved appropriately. Verify the score remains saved and is not lost.

GAMES-3

Game - Exit Application 1. Launch application. 2. Exit application using the exit function stated in the application. Verify application is clear in the directions on how to exit and functions accordingly.

6.2.3

ID#

Messaging

Description/Steps ­ Messaging Expected results

MMS

MMS-1 Sending MMS - 50kb/100kb 1. Mobile A sends a MMS message with file size ~ 50kB/100kB to Mobile B Message is successfully received. MMS-2 Sending MMS - Call during send 1. Mobile A sends an MMS message to mobile B of at least 50K. 2. While transmission in progress, place a phone call to Mobile A. 3. Accept and hang-up Phone call. Verify Mobile A returns to MMS application, and Mobile B receives MMS transmission and no interruption was encountered.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

33

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID#

MMS-3

Description/Steps ­ Messaging

Receiving MMS - 50kb/100kb 1. Send an MMS message of at least 50K from Device "B" to Device A.

Expected results

Device "A" receives message.

MMS-4

Receiving MMS - during call 1. Send an MMS message of at least 50K from Device "B" to Device A while Verify Device "A" receives phone call and there is no a phone call is in progress on Device "A". interruption.

MMS-5

Receiving MMS - after terminating call 1. Send an MMS message of at least 50K from Device "B" to Device A while a phone call is in progress on Device "A". 2. Terminate phone call on Device "A" Verify Device A receives notification of new MMS arrival.

MMS-6

Receiving MMS - during call 1. Send an MMS message of at least 50K from Device "B" to Device A while Verify Device "A" receives phone call and there is no a phone call is in progress on Device "A". interruption. 2. Terminate phone call on Device "A". Verify Device A receives notification of new MMS arrival.

Instant Messaging

IM-1 Sending IM - 50 characters 1. Mobile A sends an IM message with at least 50 characters. IM-2 Sending IM - Receive Call during send 1. Mobile A sends an IM to mobile B of at least 50 characters. 2. While transmission in progress, place a phone call to Mobile A. 3. Accept and hang-up Phone call. 4. Send another IM. 5. Repeat steps 1-2 but ignore call. 6. Leave a voicemail while an IM is being sent. IM-3 Receiving IM - 50 characters 1. Send an IM message of at least 50 characters from Device "B" to Device Device "A" receives message. "A". IM-4 Receiving IM - during call 1. Send an IM message of at least 50 characters from Device "B" to Device Verify Device "A" receives phone call and there is no A while a phone call is in progress on Device "A". interruption. 2. Terminate phone call on Device "A" 3. Launch application and send an IM. Verify Device Application disconnects. Verify user is able to send an IM. Verify that Mobile A disconnects you from the IM application. Verify Mobile A returns to IM application, and Mobile B receives IM transmission. Verify Mobile A returns to IM application, and Mobile B receives IM transmission and no interruption was encountered. Verify Mobile A returns to IM application and screen displays properly after notification is dismissed. Message is successfully received. Message is successfully received.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

34

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

6.2.4

ID#

Entertainment

Description/Steps ­ Entertainment Expected results

VOD / MOD

ENT-1 View Streaming Movies 1. In the VOD application, view a streaming movie. ENT-2 Download and view videos 1. In the VOD application, download a movie. 2. View the movie in the VOD application. ENT-3 Listen to Streaming Audio 1. In the MOD application, listen to a streaming audio file. ENT-4 Download and listen to Audio files 1. In the MOD application, download a music file. 2. Listen to the music file in the MOD application. ENT-5 Music file - Set as Ring Tone 1. If applicable, download a music file and set it to be the devices ringtone within and outside the application. ENT-6 Music file - Set as Alert Tone 1. If applicable, download a music file and set it to be the devices alert tone within and outside the application. Verify downloaded audio can be set to the ring tone within the application and using the device's alert tone settings. Verify downloaded audio can be set to the ring tone within the application and using the device's ring tone settings. Audio downloads without error. Audio plays without error. Audio file plays without error. Movie downloads without error. Movie is displays without error. Movie displays without error.

RINGTONES / WALLPAPERS

RW-1 Ring tones ­ Preview 1. In the application, preview a ring tone. RW-2 Ring tones ­ Download 1. Download a ringtone. 2. Verify ringtone is saved on the device using the device's native media player or file explorer application. RW-3 Ring tone - Download and Set As ringtone within application 1. In the application, download a ringtone. 2. Set the downloaded ringtone as the Call ringtone within the application. 3. Call the device and verify ring tone is set. RW-4 Ring tone - Download and Set As ringtone outside of application 1. In the application, download a ringtone. Application sets ring tone without error. Downloaded ringtone is played. Verify ring tone downloads without error. Ring tones are located on the device's shared media file directory or other media file directory. Verify ring tone previews without error.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

35

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID#

Description/Steps ­ Entertainment

2. Exit the application and set the ring tone using the devices system preferences. 3. Call the device and verify ring tone is set.

Expected results

Downloaded ringtone is played.

RW-7

Wallpaper ­ Preview 1. In the application, preview a wallpaper image. Verify wallpaper image previews without error.

RW-8

Wallpaper ­ Download 1. Download a wallpaper image. 2. Verify wallpaper is saved on the device using the device's native media player or file explorer application. Verify wallpaper image downloads without error. Wallpaper image is located on the device's shared media file directory or other media file directory.

RW-9

Wallpaper - Download and Set As Background within application 1. In the application, download a wallpaper image. 2. Set the downloaded wallpaper image as the device's background within the application. 3. Exit the application and view the device's background. Application sets background without error. Downloaded wallpaper displays as the background.

RW-10

Wallpaper - Download and Set As Background outside of application 1. In the application, download a wallpaper image. 2. Exit the application and set the wallpaper image using the devices system preferences. 3. View the background of the device after exiting preferences. Downloaded wallpaper image is displayed.

6.2.5

ID#

EB-1

Enterprise/Business

Description/Steps ­ Enterprise / Business

Sending Email - no attachment 1. Mobile A sends an email message from the application with no attachments to an email address. Email message is successfully received.

Expected results

EB-2

Sending Email - 1 attachment 50K 1. Mobile A sends an email message to an email address with 1 attachment at least 50K. Email message is successfully received with the attachment. Attachment is not corrupted.

EB-4

Sending Email - Call during send 1. Mobile A sends an email message to an email address with an attachment (if possible) of at least 50K. 2. While transmission in progress, place a phone call to Mobile A. 3. Accept and hang-up Phone call. Verify Mobile A returns to email application, and email is received.

EB-7

Receiving email - no attachments 1. Send an email message with at least a 100 characters without an attachment to Device A. Device "A" receives email message.

EB-8

Receiving email - 50kb/100kb 1. Send an email message with at least a 100 characters with an attachment (50kb100kb) to Device A. Device "A" receives email message with attachment.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

36

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

ID#

EB-9

Description/Steps ­ Enterprise / Business

Receiving email - during call

Expected results

1. Send an email message of at least 50K to Device A while a phone call is in progress Verify Device "A" receives phone call and there is on Device "A". no interruption. 2. Terminate phone call on Device "A". EB-10 Receiving email - mass emails (at least 100) 1. Send at least a hundred email messages to Device A in a short time frame. EB-11 Spreadsheet - Font and Size Display 1. Enter at least 10 cells / rows of data. 2. Change the font of the text multiple times. 3. Change the size of the text multiple times. EB-12 Spreadsheet - 5-way navigation 1. Move focus of spreadsheet cells using 5-way navigation. EB-13 Document Form - Font and Size Display 1. Enter at least 1 page of text or paragraph. 2. Change the font of the text multiple times. 3. Change the size of the text multiple times. EB-14 Document Form - 5-way navigation 1. Enter at least 2 pages of text or paragraph. 2. Use the 5-way navigation to move cursor left, right, up, and down the document. EB-15 Graph Form ­ Navigation Graph displays without error and the user can view If possible, generate a graph that is larger than the screen. Use the 5-way navigation all parts of the graph using the 5-way navigation pad to view all parts of the graph. button. User is able to scroll left, right, up, and down to view the entered data and the entered data displays properly in the document form. Text displays without error. Text displays without error. Focus can be set using the 5-way navigation. Verify text displays without error. Verify text displays without error. Verify that the application is able to handle receiving a large number of emails. All emails are received without error. Verify Device A receives notification of new email.

6.2.6

#

HW-1

Hardware

Description/Steps ­ Hardware

Functionality - Main Functionality 1) Connect 3rd party accessory with device. 2) Perform High Level cursory tests to ensure features function as expected. The accessory should function as expected.

Expected results

HW-2

Abrupt Disconnect handling 1. Connect the hardware device. 2. During an active connection, abruptly disconnect the device from the Palm device. 3. Re-establish a connection. Verify an appropriate message displays. Verify the connection can be re-establish, the Palm device and 3rd party device continue to function as expected, and no data loss/corruption occurs.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

37

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

#

HW-3

Description/Steps ­ Hardware

Bluetooth peripherals - incoming calls 1. Connect the hardware device. 2. Make a Bluetooth connection with the device. 3. Receive an incoming call.

Expected results

Connection is successful. Call is received without error.

HW-4

Bluetooth peripherals - incoming SMS 1. Connect the hardware device. 2. Make a Bluetooth connection with the device. 3. Receive an incoming SMS. Connection is successful. SMS is received without error.

HW-5

Bluetooth peripherals - device compatibility 1. Connect the hardware device. 2. Make a Bluetooth connection with the device. Connection is successful.

HW-6

Power - Battery consumption with Hardware accessory attached while Palm device is off [For accessories that physically connect to the device] 1. Install the attached Battery app 2. Leave the hardware product attached to a powered off Palm unit for an extended period of time, e.g. 2 hours minimum. Verify that the hardware product does not draw power from the Palm device when it is powered off.

HW-7

Power - Low battery for hardware accessories 1. Install the attached Battery app 2. Put the Palm device and the 3rd party device in a low battery condition 3. Perform the main function of the 3rd party device Verify that when the Palm unit and/or hardware product is under a "forced low battery" condition, that no data loss or data corruption occurs.

HW-8

Palm device continues to function properly and returns to its normal state once the hardware is detached. 1. Connect the 3rd party device and perform main function. 2. Disconnect the 3rd party device. 3. Perform the following functions on the Palm device: - IR/Beam - phone call - Bluetooth connection - Sync - Data transfer to Expansion card Once connectivity and usage between the Palm unit and the hardware has been established, the test will verify that the Palm unit continues to function properly after the hardware is detached. The test will ensure that the Palm device does not enter loop back mode.

Copyright 2007 Product Quality Partners, Inc. Rev 2.0.7

38

Test Guide prepared by Quality Partners Edited and Approved by Palm, Inc.

Information

Designed for Palm Test Kit

38 pages

Report File (DMCA)

Our content is added by our users. We aim to remove reported files within 1 working day. Please use this link to notify us:

Report this file as copyright or inappropriate

1000629


Notice: fwrite(): send of 207 bytes failed with errno=104 Connection reset by peer in /home/readbag.com/web/sphinxapi.php on line 531