[Perlfect-search] [Fwd: Perlfect Search usability test]
Giorgos Zervas firstname.lastname@example.org
Mon, 11 Sep 2000 10:18:23 +0000
This is a multi-part message in MIME format.
Content-Type: text/plain; charset=iso-8859-7
A very interesting read below...
Thanks to David Travis who did the test.
Received: from fozzie.webservepro.com (email@example.com [188.8.131.52])
by perlfect.com (8.9.2/8.9.2) with ESMTP id FAA17838
for <firstname.lastname@example.org>; Fri, 25 Aug 2000 05:44:05 -0400 (EDT)
Received: from bbnrel4.net.external.hp.com (bbnrel4.net.external.hp.com [184.108.40.206])
by fozzie.webservepro.com (8.9.3/8.9.3) with ESMTP id FAA08676
for <email@example.com>; Fri, 25 Aug 2000 05:44:04 -0400
Received: from hpbplfs4.bpo.hp.com (hpbplfs4.bpo.hp.com [220.127.116.11])
by bbnrel4.net.external.hp.com (Postfix) with ESMTP id 050C315E2B
for <firstname.lastname@example.org>; Thu, 24 Aug 2000 18:01:57 +0200 (METDST)
Received: from [18.104.22.168] (CacheFlowServer@bpowebcache1.cns.hp.com [22.214.171.124]) by hpbplfs4.bpo.hp.com with ESMTP (8.8.6 (PHNE_17135)/8.7.3 SMKit7.0) id SAA10709 for <email@example.com>; Thu, 24 Aug 2000 18:01:47 +0200 (METDST)
Date: Thu, 24 Aug 2000 18:01:52 +0200
Subject: Perlfect Search usability test
From: David Travis <firstname.lastname@example.org>
Organization: System Concepts Ltd
Content-type: text/plain; charset="US-ASCII"
I recently downloaded Perlfect Search and included it in my company's
website. I think it's a great tool and I want to thank you for making this
My company makes money by carrying out usability tests for clients. I
recently tested our own website and thought you might be interested to hear
the comments that related to the search engine. Our implementation can be
seen at http://www.system-concepts.com/proto. Our old search engine can be
seen at http://www.system-concepts.com/cgi-bin/syscon/search.pl.
1. Most of our participants immediately used the search to find articles of
interest to them and the search engine did an excellent job of identifying
the best articles. It helped participants get to the best article in 2-3
clicks. Compared to our old search engine (that doesn't relevancy rank)
Perlfect Search is a major usability improvement.
2. However, only 1 out of the 10 participants used the "+" and "-" syntax to
force or exclude terms. All the other participants assumed that the search
would automatically AND the terms together. So there was surprise when (for
example) "website usability" returned more hits than just "usability". We
suggest that you add an option so that webmasters can turn off the Boolean
operators and make the search automatically AND terms together.
3. Users didn't understand the scoring system. When forced, they guessed
that the values were percentages. We suggest that the results of each search
are normalised, with the best page given a rank of 100%. (This also helps
developers who want to write a Mac OS 9.0 Sherlock plug-in since the
"relevancy" tags in Sherlock assume that the search engine provides a
It's important to keep the last two comments in perspective. Overall, I want
to stress that Perlfect Search will provide a major usability improvement to
any site. Thanks again!
System Concepts Ltd, 2 Savoy Court, Strand, London WC2R 0EZ
Tel: 020 7240 3388 Fax: 020 7240 5212