You Are Here:

Community: Blogs

Risto Helin's Forum Nokia Blog

Any views on the test houses?

Rippe | 08 December, 2006 11:09

Wanna stir up some discussion about test houses in Java Verified and Symbian Signed. Please bear in mind that I will only publish constructive comments, the rest will remain between you and me...

I don't want to discuss pricing. As any cost is too much anyways. And my dream is a box in the Internet where you submit the application and it will say pass/fail (if failed, you get results why and advice how).

I would like to see how you find the test house services? Should the test house just do testing or provide additional testing/coding/"passing the process" related services? Would you be willing to pay for such? What is important. How do you find the current offering? Any differencies between the test houses?

What about testing quality? Is it better to pass the process and suffer the consequences for the left over bugs or the get all the bugs found and move on to other projects?

RSSComments

Re: Any views on the test houses?

mgroeber9110 | 10/12/2006, 19:32

Without wanting to go into the specifics of different test houses, one general recommendation I saw mentioned once in a Symbian presentation which still very much holds true, is the following: (paraphrasing)

"Prefer to choose a test house near your own timezone."

Unfortunately, this is quite an important factor, because even in the best of cases of a straightforward "pass", there will be quite a few interactions between you and the test house, and depending on the relative time when e-mails are responded to, each of these can easily add a day of simply waiting for the other side:

- Test house makes quotation
- Developer accepts quotation, and gets payment instructions
- Devloper makes payment
- Test house waits for payment
- (if something goes wrong...) Test house and developer chase up payment
- Actual testing takes place
- Test house sends report
- (if needed) Developer asks for clarification on failures, Test house replies
- (if needed) Developer sends waiver request
- (if needed) Test house contacts Nokia or Symbian to clarify
- (occasionally) Certificate problems prevent signing of application, e.g. because Distinguished Name is missing "City" field
- (if certificate failed) Developer contacts Verisign and gets new certificate
- Application is signed (or rejected)
- Developer downloads application

This is not as far fetched as it sounds - each of these has happened to me at last once. If you look at the case of embedde SIS files, where you need to submit twice, you can see how this easily becomes something that can easily drag on for several additional days.

[In reality, it is not quite as scary as this, because you often have a few hours of overlap to exchange a few mails per day very early or very late. Also I found test houses to be generally quite reasonable about not insisting on following the process "by the letter", especially if they know you from previous projects...]

So for this reason, all other things being equal, the geographic location of the testing house does indeed play a significant role, and may require a great deal of discipline in responding to e-mails and being proactive about possible issues on both sides - if in doubt, ask for clarification immediately, rather than waiting another day for the other side to hopefully do what you think it does...

Re: Any views on the test houses?

michael2008 | 09/09/2008, 11:00

Nokia is branded name in Mobile Industry.
N-95 is a very good mobile.
Nokia's all mobile phone is very good.
============================
Michael
[url="http://foreclosures.gov-auctions.org"]foreclosures[/url]

Nokia

bula143 | 29/09/2008, 07:09

Nokia is a good mobile and the options are very interesting to the who are cell likes and the ringtones are very interesting to download and i like very mush this services.
=================================================
bula143
Foreclosed Homes

You must login to post comments. Login
 

Rate This

 
 
Bookmark this page: DeliciousDiggFacebookGoogleYahooStumbleUponRedditDiigoTechnocratiTwitter  Share this page Share this page Print this Page Print this page Invite a friend Invite a friend
京ICP备05048969号    Email Newsletters Press Terms & Conditions Privacy Policy Sitemap Contact Us © 2009 Nokia 
RDF Facets: qdcZdescriptionQSxWorksE20forE20ForumE20NokiaE20whereE20hisE20taskE20isE20toE20representE20NokiaE20inE20SymbianE20SignedE20andE20JavaE20VerifiedE2eE20E52ippeE20E7cE2009E20OctoberE2cE202007E2008E3a50E20HelloE2cE20WeE20areE20internallyE20wonderingE20theE20importanceE20ofE20addingE20SeriesE2040E20devicesE20toE20E52E44AE20E28youE20knowE2cE20theE20serviceE20whichE20allowsE20youE20toE20accessE20devicesE20overE20theE20InternetE2cE20wwwE2eforumE2enokiaE2ecomE2frdaE29E2eE20WhatE20doE20youE20thinkE3fE20ShouldE20weE20alsoE20supportE20SeriesE2040E20orE20justE20stickE20withE20S60E20supportE3fE20PleaseE20noteE20thatE20weE20didE20addE20fewE20SIMsE20thereE20asE20wellE2cE20soE20inE20caseE20youE20haveE20notE20triedE20themE20outE20yetE2eE2eE2eE20TesE2eE2eE2eX qdcZidentifierQSxhttpE3aE2fE2fblogsE2eforumE2enokiaE2ecomE2fblogE2fristoE2dhelinsE2dforumE2dnokiaE2dblogE2f2007E2f10E2f09E2frdaE2ds60E2dvsE2eE2dseriesE2d40X qdcZpublisherQUxhttpE3aE2fE2fswE2enokiaE2ecomE2fidE2fc764fd1cE2d8b06E2d499aE2d9a6aE2d17c3903d5a65E2fforumE5fnokiaE5fcrawlerE5fagentX qdcZtitleQSxE52istoE20HelinE27sE20ForumE20NokiaE20BlogE20E7cE20E52E44AE3aE20S60E20vsE2eE20SeriesE2040X qdcZtypeQUqfnZE45E78cludedFromGeneralE4cistingsQ qdcZtypeQUqfntypeZBlogContentQ qdcZtypeQUqfntypeZBlogE45ntryQ qdcZtypeQUqfntypeZCommunityContentQ qdcZtypeQUqfntypeZE52esourceQ qdcZtypeQUqfntypeZWebpageQ qdcZtypeQUqmarsZManagedE52esourceQ qdcZtypeQUqwebZInformationE52esourceQ qdcZtypeQUqwebZPageQ qdcZtypeQUqwebZE52esourceQ qdcZtypeQUqrdfsZE52esourceQ qrssZdescriptionQSxWorksE20forE20ForumE20NokiaE20whereE20hisE20taskE20isE20toE20representE20NokiaE20inE20SymbianE20SignedE20andE20JavaE20VerifiedE2eE20E52ippeE20E7cE2009E20OctoberE2cE202007E2008E3a50E20HelloE2cE20WeE20areE20internallyE20wonderingE20theE20importanceE20ofE20addingE20SeriesE2040E20devicesE20toE20E52E44AE20E28youE20knowE2cE20theE20serviceE20whichE20allowsE20youE20toE20accessE20devicesE20overE20theE20InternetE2cE20wwwE2eforumE2enokiaE2ecomE2frdaE29E2eE20WhatE20doE20youE20thinkE3fE20ShouldE20weE20alsoE20supportE20SeriesE2040E20orE20justE20stickE20withE20S60E20supportE3fE20PleaseE20noteE20thatE20weE20didE20addE20fewE20SIMsE20thereE20asE20wellE2cE20soE20inE20caseE20youE20haveE20notE20triedE20themE20outE20yetE2eE2eE2eE20TesE2eE2eE2eX qfnZdistributionQUxhttpE3aE2fE2fblogsE2eforumE2enokiaE2ecomE2fX qfnZtopicQUqfnTopicZtestingQRqdcZtypeQUqrdfsZE52esourceQRqmarsZrelevanceQNx100X qfnZtypeQUqfntypeZBlogContentQ qfnZtypeQUqfntypeZBlogE45ntryQ qfnZtypeQUqfntypeZCommunityContentQ qfnZtypeQUqfntypeZE52esourceQ qfnZtypeQUqfntypeZWebpageQ qfnZupdatedQDx2007E2d10E2d26X qfnZuserE5ftagQSxtestingX qmarsZdescriptionQSxWorksE20forE20ForumE20NokiaE20whereE20hisE20taskE20isE20toE20representE20NokiaE20inE20SymbianE20SignedE20andE20JavaE20VerifiedE2eE20E52ippeE20E7cE2009E20OctoberE2cE202007E2008E3a50E20HelloE2cE20WeE20areE20internallyE20wonderingE20theE20importanceE20ofE20addingE20SeriesE2040E20devicesE20toE20E52E44AE20E28youE20knowE2cE20theE20serviceE20whichE20allowsE20youE20toE20accessE20devicesE20overE20theE20InternetE2cE20wwwE2eforumE2enokiaE2ecomE2frdaE29E2eE20WhatE20doE20youE20thinkE3fE20ShouldE20weE20alsoE20supportE20SeriesE2040E20orE20justE20stickE20withE20S60E20supportE3fE20PleaseE20noteE20thatE20weE20didE20addE20fewE20SIMsE20thereE20asE20wellE2cE20soE20inE20caseE20youE20haveE20notE20triedE20themE20outE20yetE2eE2eE2eE20TesE2eE2eE2eX qmarsZlanguageQUxhttpE3aE2fE2fswE2enokiaE2ecomE2flanguageE2d1E2fenX qrdfZtypeQUqfnZE45E78cludedFromGeneralE4cistingsQ qrdfZtypeQUqfntypeZBlogContentQ qrdfZtypeQUqfntypeZBlogE45ntryQ qrdfZtypeQUqfntypeZCommunityContentQ qrdfZtypeQUqfntypeZE52esourceQ qrdfZtypeQUqfntypeZWebpageQ qrdfZtypeQUqmarsZManagedE52esourceQ qrdfZtypeQUqwebZInformationE52esourceQ qrdfZtypeQUqwebZPageQ qrdfZtypeQUqwebZE52esourceQ qrdfZtypeQUqrdfsZE52esourceQ