Oh you shld read the last sentence from Steve Litchield's post comparison between the N95 8gb, apple iphone 3g and HTC touch diamond: http://tinyurl.com/6dj4dj I love you Steve :)
1 month, 2 weeks ago.
4 comments so far
I am not going to knock Steve (again) for these tests; but that
scoring system (statistically) is horrible. Using a simple 1-2-3
scoring system would have given a better view to
any person reading it. Having such a wide range of
numbers without an explaination of the methodology behind them
makes scoring so subjective to bias its just not fair to any of the
devices used.
There was also some considerable tweaking of the user experience
given his S60 leanings that may have also played a part in how
items were scored. I'm a fan of S60 as much as many others are, but
there is a fair way to do a compairson that speaks to a rightful
evaluation, and not just one that (again) borders on fanboyism
I also think that he omitted a lot from his review.
Beyond that, the key to me moving forward is going to be what
happens with third-party developers. To see solutions available for
the iPhone on day 1 of the app store launch that we're STILL
waiting for on S60 should tell you something...
Ok, I kinda cleaned up my above response; hopefully Steve and
the AAS team understands that I didn't mean to slam them, but offer
a means for bias to be less of a factor in reviews of this type -
link
to AAS posted response
@arjw - I replied on the
comment thread (and Steve will too I imagine)... but basically the
thing is about these comparisons is they are hard to do in a way
that everyone thinks is fair because everyone has different
criteria. Personally I think you;re wrong about a simple scoring
system - this does not allow differentiation between how good or
badly a device does something. If you use a 1-2-3 system it is just
a race to see who 'wins' most functions. Taking an extreme example
- a phone could be top in 9/10 categories (with all other device
being very close), and then last in 1/10 by a long way. If that
category is important (say making a phone call) then.... Ideally
you would weight the scoring based on personal preference and
produce a personal score, but that's hard to do (though maybe i
should look into creating such a system).
@zacharye - inevitably
there are omissions - you could spend months writing something like
this :) One area you could talk about is third party software, but
perhaps that's better left for another article. 3rd party software
gets a lot of attention from power users, but it is still
relatively little used. Even on the iPhone there's going to be more
people who install nothing or just a few apps. I do think that
Nokia needs to address this area, but I also think people need
perspective on the whole mobile market not just what they
think.
and just to emphasise - all feedback is good - thanks for
providing it.
4 comments so far
I am not going to knock Steve (again) for these tests; but that scoring system (statistically) is horrible. Using a simple 1-2-3 scoring system would have given a better view to any person reading it. Having such a wide range of numbers without an explaination of the methodology behind them makes scoring so subjective to bias its just not fair to any of the devices used.
There was also some considerable tweaking of the user experience given his S60 leanings that may have also played a part in how items were scored. I'm a fan of S60 as much as many others are, but there is a fair way to do a compairson that speaks to a rightful evaluation, and not just one that (again) borders on fanboyism
1 month, 2 weeks ago by arjw.
+1
I also think that he omitted a lot from his review.
Beyond that, the key to me moving forward is going to be what happens with third-party developers. To see solutions available for the iPhone on day 1 of the app store launch that we're STILL waiting for on S60 should tell you something...
1 month, 2 weeks ago by zacharye.
Ok, I kinda cleaned up my above response; hopefully Steve and the AAS team understands that I didn't mean to slam them, but offer a means for bias to be less of a factor in reviews of this type - link to AAS posted response
1 month, 2 weeks ago by arjw.
@arjw - I replied on the comment thread (and Steve will too I imagine)... but basically the thing is about these comparisons is they are hard to do in a way that everyone thinks is fair because everyone has different criteria. Personally I think you;re wrong about a simple scoring system - this does not allow differentiation between how good or badly a device does something. If you use a 1-2-3 system it is just a race to see who 'wins' most functions. Taking an extreme example - a phone could be top in 9/10 categories (with all other device being very close), and then last in 1/10 by a long way. If that category is important (say making a phone call) then.... Ideally you would weight the scoring based on personal preference and produce a personal score, but that's hard to do (though maybe i should look into creating such a system).
@zacharye - inevitably there are omissions - you could spend months writing something like this :) One area you could talk about is third party software, but perhaps that's better left for another article. 3rd party software gets a lot of attention from power users, but it is still relatively little used. Even on the iPhone there's going to be more people who install nothing or just a few apps. I do think that Nokia needs to address this area, but I also think people need perspective on the whole mobile market not just what they think.
and just to emphasise - all feedback is good - thanks for providing it.
1 month, 2 weeks ago by rafeblandford.