Website Awards
Success with awards requires knowledge!
Answers to the question in these pages offer you expert advice about awards,
directly from the leading authorities on this topic!

Richard Berends, Webmaster, Website Awards
Expert Answers
Home || The Worksheet ||  Best Award Indexes
World's Top Awards ||  Superb! Awards
The purpose of Ask the Experts is to provide timely answers to common questions about awards and running award programs. The authors of the answers offer you expert advice based on many years of experience. They run some of the best programs in the world, and they are the leading authorities on the topic of awards. Armed with all the helpful advice in their answers, you will be better prepared to apply for website awards or run a successful award program!
Current Questions | Question 8 | Questions Archive
Page 1 | Page 2
The Question

How long does an evaluation take and do you look at every page?

by Debra Sharp, Webmistress, Mesweet's Haven & Awards
15 April 2002

Bitten Jønsson, Webmaster
DWD Award Program (site closed)

This question actually contains two parts, and I feel it necessary to treat them separately. My answers are based on the experience I have gained from working as an evaluator for various award programs.

How long does an evaluation take?

1.   Some evaluations take less than one minute, and others take up to 2-3 weeks. Why the difference? To answer this question, we have to look at the criteria and the disqualifying items within the criteria.
   The entry/splash page of the web site presented for evaluation may be one of the most beautifully designed and technically sound pages on the Web, but if the criteria says "Horizontal scroll bars are not acceptable at screen resolutions of 800/600 and 1024/768," and the page has a scroll bar, then this site takes less than one minute to evaluate.
2.   I personally visit each web site at least 3 times before I make my final evaluation. My evaluation routine has been set up in sections. The web site has to pass with "flying colours" to continue from step one to step two, and so forth. Evaluators have to visit a web site more than once to make a fair and objective evaluation, in my humble opinion.
   It is not a good idea to make the visits consecutively. The evaluator has to leave the web site, stay away for a few days, then go back again. Take of your glasses, sit back, close your eyes, relax and visualize the site in your mind. I often do this and it helps me to find things I may have overlooked. It also often raises questions which remain unanswered until I visit the site again.
3.   Evaluating a web site is not done with one hand behind the back, and I truly hope it never comes to that. Evaluating web sites is almost like going to work. If your employer isn't satisfied with your efforts, you'll lose your job. I know most of us are doing this "job" in our spare time, but we should still be conscientious about this kind of "work."
4.   Evaluations must be objective, profound, fair and ethically correct. This is why an evaluation can take up to several weeks.

Do I look at every page?

To make a proper evaluation, you have to look at every page in the site. If we only look at a few pages, what have we seen? What are we going to base the evaluation on? Remember, it is not just the technical and visual part of a web site that is being evaluated. It is also the content. Think of all the knowledge we gain by evaluating web sites.

It's great to be entertained — to have a good laugh — but to gain new knowledge makes a web site even more interesting. If the content is presented in a visually pleasing manner and the site is technical sound, then I think it's safe to say, "We have a winner!"

Geetha Thirunakkarasu, Webmistress
Geetha's Web Design Awards (program closed)

The evaluation period varies for each award program, and it takes about a maximum of 6 weeks, depending on the number of evaluators involved and the number of visits made by each evaluator.

It also depends on the quality of the evaluations. New or inexperienced evaluators might base their evaluations strictly on the look of a website or on their likes and dislikes. If they can't make their own decision, sometimes they'll look at the awards previously won by the website and make a decision based on that.

Good quality award programs are judged by highly experienced evaluators. The evaluations are done in a professional way, and the evaluators can identify even small problems. They use a score sheet to make sure all websites are evaluated using the stated procedure.

The evaluation starts with the list of disqualifiers. This is the fastest way to determine if the site has all the required elements. The evaluator then continues to apply standardized testing procedures, and sometimes multiple visits are required.

Professional evaluators will do a fair and THOROUGH evaluation to get accurate and consistent results. Evaluators help to improve the quality of the web by dedicating time and effort to reviewing websites and encouraging webmasters to strive for excellence.

Kim Cole, Webmistress
World of Knowledge Awards (program closed)

The length of time an evaluation takes and whether every page is examined is really dependent on the site being evaluated. I will cease an evaluation if I come to a disqualification point, and so will many award givers I know. If I see that all of the text on the first few pages of a site has been centered for no apparent reason, I do not proceed any further. This review is very short.

Sites that pass my disqualification points take longer to evaluate. I click through them to visit most of the pages, but I don't spend a great deal of time on any one page or section. At this point, I am just getting a feel for the site. Perhaps ten minutes for a large site.

The second time I visit the site I go through it much more slowly. I try to visit every page, although it is possible that a linked page gets missed here and there. This second review can take an hour, an hour and a half, or it may be spread out over two days. It all depends on the size and complexity of the site in question.

Although I use very detailed criteria, each evaluation is really a brand new start. The structure of the site, in large part, will determine how I view it. So will the design, as far as ease of navigation and reading are concerned. Even the topic may lead me to view the site in a particular order.

Rest assured, however, that look at the site I do. All of it. After all, I cannot put my seal of approval on a site unless I am sure the entire site has earned it.

Debra Sharp, Webmistress
Mesweet's Awards

The time it takes to evaluate a site depends on the size of the site and how many times you visit it. My first visit usually takes between 2 and 15 minutes. Just long enough to get a first impression and make sure the site passes all my disqualification points.

Sites that pass the first visit are put in my "yes" folder, and they get a second visit, which takes between 15 minutes and an hour. Every site left in my "yes" folder after the second visit gets a third one, which is probably the final visit. The third visit also ranges from 15 minutes to an hour.

I look at most of the pages in a site, but I can't say that I look at every one. I don't always look at the "awards won" pages.

Page 1 | Page 2
The Authors
We would like to thank the authors who took time out of their busy schedules to write the answers in these pages. They wrote them to share the knowledge they gained from years of reviewing websites and operating award programs. By so doing, they are making their expertise available to webmasters at large and helping to improve the quality of websites and awards on the Web. We applaud them for sharing their knowledge!
Please go to the Print Version if you want to print these answers!
  Next Page >>

<< Prior Question | Next Question >>
Current Questions | Question 8 | Questions Archive
The World Wide Web is dynamic and constantly changing. New websites are being added every day and existing sites sometimes move, or even close down. If you find a website in this page without a link, it has either closed or moved to an unknown address. If you find any broken links or discontinued awards, please email us now. It will be appreciated!

My sincere thanks to Descendants of Thomas Simms Graves for sponsoring this web site.

Home || The Worksheet ||  Best Award Indexes
World's Top Awards ||  Superb! Awards
Tell A Friend |  Contact Form |  Send Email |  Privacy Policy |  Ethics |  Legal Notice

Top of Page