Subscribe via E-mail

Your email:

published qa papers free

Browse by Tag

Posts by Month

Follow Me

NTT DATA Canada Discussion Room

Current Articles | RSS Feed RSS Feed

Mobile Application Testing Tools

 

 

Mobile Application Testing Tools

A Comparison Between The Leaders

KEYNOTE DEVICE ANYWHERE   vs.    PERFECTO MOBILE

Perfecto Mobile vs Device Anywhere resized 600

Written by Prateek Bhatnagar

 
Mobile phones have heralded a new era named “The Mobile Age “.   It has shifted the focus from computers to mobile phones for browsing, online transactions, listening music, watching videos etc. This shift has exponentially increased the development of mobile applications.
Types of mobile applications:
1. Data centric Applications (e.g. Sales Force Automation (SFA) , Customer Relationship Management (CRM), Enterprise applications)
2. Devises Capability based applications  (e.g. Location Based Service(LBS), Camera , Multimedia, VOIP applications)
It has been observed that the better the mobile application is, the  tougher is the task of developing and testing. The main challenge is to test the mobile applications on various platforms of mobile devices.
Major constraints for Mobile Automation Testing:
1. Increasing complexity of mobile applications
2. In depth functional testing
3. Testing device features used in applications i.e. camera , accelerometer
4. Bluetooth and Location Based Service (LBS)
5. Call and Voice mail scenario
6. Multimedia, Barcode , Near Field Communication (NFC) applications
7. Games and AI applications

Mobile automation testing can only be done for Data-centric applications.
To undertake mobile automation testing we must look at the tools that are specifically designed for mobile testing.

Mobile automation testing tools perform:  
1. Application specific Test case writing
2. Conversion of test cases into scripts (record)
3. Execution of test scripts on devices
4. Unattended test cycles

There are various mobile automations testing tools in the industry but one of the first leaders is DEVICEANYWHERE. However the growth of this demand area has brought a fierce competitor in PERFECTO MOBILE.
 In this article we intend to perform a comparison between these 2 leading mobile test automation tools: Keynote DeviceAnywhere and Perfecto Mobile. ( All data collected is obtained by direct interaction with both companies , demonstrations of their respective tools and performing intensive research online ) 

 

            Factors

 

Device Anywhere resized 600

http://www.deviceanywhere.com/

 

 

Perfecto Mobile 

http://www.perfectomobile.com/

 

They state: Keynote DeviceAnywhere provides an end-to-end platform for planning, testing, and monitoring of mobile apps to ensure the quality, performance

and uptime of your products and services as you extend your business to the mobile channel and

with its ongoing innovation and unmatched investment in product development and customer support. Keynote DeviceAnywhere continues to set the standard for Mobile App Lifecycle Management.

 

They state: Perfecto Mobile is a leading provider of remote access and automated testing solutions for mobile devices. It enable mobile operators, device manufacturers, application developers, testers and content providers to significantly increase the quality of their products and services while reducing time-to-market, costs and logistical efforts.

 

1.Image quality (for

   taking screen shots,

   videos )

High resolution device still image is pixel to pixel, exact and perfect.

For video the high frame rate depends on the internet connection.

Outstanding image quality no matter how high resolution the device is.

Again for video, frame rate depends on internet connection.

2.Coverage (countries)

Facility provided in USA, UK, France, Canada etc. and has the ability of giving access to a lot more countries.

Facility provided in USA, UK, Israel, Canada etc. and has the ability to provide access to a lot more countries.

3.History (Video frames

    and Scripts)

Provides the facility of storing history of frames.

10 minutes history can be obtained.

History is deleted if system is closed for security purposes.

Also provides script history of all users.

It also provides the facility of storing history of video frames and scripts.

History is stored in a central server and can be retrieved anytime and it is private to each user.

4.Exporting History

History can be exported to  .avi, .mpeg etc. formats and also to local files.

History can be exported to FLV formats or you can also extract  and  download it wherever you want.

5.Platform /OS Support

Supports every device ( Windows , Android,

Symbian, iphone, Blackberry etc.)

It also provides support for every device.

6.Ability to enter text

Provides ability to enter text in any field and in any device( device keyboard and  the computer keyboard both can be used)

Also provides copy paste feature

Provides ability to enter text in any field in any device similar to device anywhere.

7.Download time

Time depends on internet speed and system

on which the application is being downloaded

Time depends again on internet speed and system on which application  is being downloaded

8.Time required for the

     application to open 

2 to 5  seconds

2 to 5 seconds

9.Navigation of mouse

   on Blackberry screen

   (non touch)

2 types of keys are present.

1)      Precision key - Normal mouse

2)      Regular key – This one is for more easy navigation as it is provides easy movement of the mouse on screen

Normal movement can be performed using regular key but it allows for more easy navigation with the help of a click and drag feature of the mouse on the screen.

10.Pricing

The buyer must purchase a package plus an hourly commitment

1)      Device packages: These are packages containing devices.

PACKAGES                ACCESS FEE

First                           $100/Month  

Second                      $75/Month

Third                          $50/Month

Fourth                       $25/Month

Fifth (and above)          FREE   

2)      On the basis of hours:

HOURS                      HOURLY RATE $

120                                        16

300                                        15

600                                        14

1200                                      13

3 ways:

1)      Pay Per Project:

10 hours  - $250 ($25/hour)

2)      Subscription:

       Monthly:

                 Starting at $15/hour

       Quarterly:

                 Starting at $13/hour

       Annual:

                 Starting at $10/hour

3)      Premium License:

       Monthly:   $690

       Quarterly: $1,821

       Annual:      $5,796

              

11.Large selection of

     devices

 

Have a large selection of devices

Have a large selection of devices

12.Connectivity

    (Remote Location)

                                     YES

YES

13.Smooth running of

    device

                   YES

YES

14.Device interaction

                                     YES

YES

15.Reporting

                                     YES

YES

16.Scripting

Device agnostic (Keyword and Image based)

Device agnostic (Keyword and Image based)

17.Scripting (portability  

     across multiple

     target platforms)

                                     YES

YES

18.Flexibility – Devices

     can be changed in  

     minutes + Request

    new devices to be

    connected

                                     YES

YES

19. Additional Features

1) Application repository is present

2)FTP device log present

3)Freedom to build actions yourself or device

    or device anywhere can populate it

    (drag and  drop to customize)

4)Checkpoints can be inserted

    (Text, Image, Page)

5)It provides the facility of video compression

 

1)By far the best QTP integration          

   (Jointly developed by HP)   

 2)A new feature added to collect all  

    Vital information (e.g. Memory cache battery level , battery voltage , CPU usage)

3)Provides a secured private cloud   

    behind your firewall

4)Stronger image matching which  

    allow not only identical but also

    similar 

5)Provides log retrieval

Major source: http://www.slideshare.net/momobangalore/mdc2010-automated-mobile-testing

In the next blog we will compare pricing scenarios and make conclusions.  Please feel free to add comments and ideas.

 

  read-part-2

The opinions expressed on this discussion room are writer's and don't necessarily represent NTT DATA Canada's positions, strategies or opinions.

Comments

Very informative Mr Bhatnagar, a very lucid comparison there. Looking forward to more of these.
Posted @ Monday, February 13, 2012 10:30 by Akshay
Post Comment
Name
 *
Email
 *
Website (optional)
Comment
 *

Allowed tags: <a> link, <b> bold, <i> italics