Project Module W78e
Web Site Project Management

PhaseE: Success Criteria

 
Previous | Series Home | Next

Overview

When will the client consider the site to be successful? How can we measure success? This phase and the next, User Needs and Task Analysis, are closely related. Both are derived from the Web Site Objectives and Project Scope.

Project LogoWhat's in this module
  1. What is Success?
  2. Step 1: Identifying and Prioritizing Goals
  3. Step 2: Can Goals be Measured Before Launch?
  4. Step 3: Assigning Measurable Outcomes to Pre-Launch Goals

What is Success?
to Top

to Top

Success is when goals are met or exceeded. In order to measure success, we need to be very specific about the goals. This will require a great deal of interaction with the client, the purpose of which is to understand the client's hopes for the site. It is necessary to know which goals matter most to the client - which goals count most in the client's opinion.

It is the design team's responsibility to restate the client's goals for the site in ways that are as measurable as possible. Many clients have a general idea of what the site should be doing, but have no experience in stating those goals in ways that can be measured. But the design team needs to be able to measure as many goals as possible.

Of course this lets the team know when the client's site is successfully completed, but in addition, the team needs to be able to prioritize tasks. Prioritizing is necessary when resources run short and the client's goals can't all be realistically met. Measuring success lets the team identify goals that are largely, if not completely, met; the degree of success can be balanced against the priority of the goal to help decide where resources are best spent.

Step 1: Identifying and Prioritizing Goals
to Top

to Top

Identifying Goals

The site's "Objectives and Project Scope" document is the starting place for the list of goals. From its prose, you would extract a list of goals. The process should be a team activity, to make sure everyone on the team has input on this important matter.

Example:

The Stony Creek Historical Museum's "Objectives and Project Scope," from W78b:

The Stony Creek Historical Museum (SCHM) is a non-profit community organization based in Stony Creek, Michigan (seven miles southeast of Ann Arbor). The mission of SCHM is "to raise up a sense of pride in the heritage of Stony Creek, Michigan, and its many generations of hard-working pioneers, farmers, tradesmen, and family-builders; and to showcase the tools and treasures of their life and livelihood." The main purpose of the Web site will be to make residents and tourists aware of the existence, location, and hours of SCHM, and to highlight its collections and activities. To accomplish this, the site will include photographs of the building and collections, maps and directions, listings of open hours, and calendar of special events.

At this time, the site will not include on-line shopping at the museum shop, though that may be added at a later date.

From this paragraph, the design team extracted a list of goals and sent them in an email to the Public Relations Director, Sherry Moore, who is the team's liason at the museum:

Dear Ms. Moore:

Thank you for your suggestions on improving the project's Objectives and Scope statement. We have incorporated them as you requested.

Our next step is to make sure we have the Museums specific goals for the Web site, not only pinned down but prioritized. Here is our draft list of goals:

Goals (first draft)

  • Express pride in Stony Creek's heritage
  • Make the existence, location, and hours of the museum available to the public
  • Display photos of the museum's collections and buildings
  • List upcoming activities in a calendar of special events
  • Present maps to the museum and directions to it

We will be using the list of goals as the basis for the site design, and will monitor our success by our ability to fulfill them. Please look over this list carefully and let us know if you would like us to add change, or remove any of the goals. If you feel more detail is needed in any, please specify or clarify them when you return them to us.

Finally, please number the goals in priority order. It is very important to us to know what you care about most!

Sincerely,

Sarah Strong
Project Manager

After receiving Serry Moore's reply, the list was revised and prioritized (shown here with Sherry's additions in italics and deletions struck through):

  1. Make the existence, location, and hours of the museum available to the public
    1. Address and phone number on every page
    2. Page with directions from north, south, east, and west
    3. Maps showing location of Stony Creek and Michigan and at the county level
  2. List upcoming activities in a calendar of special events
  3. Express pride in Stony Creek's heritage through quiet dignity
  4. Display photos of the museum's collections and buildings
  5. Present maps to of the museum and directions to it
    1. Overview of the museum buildings
    2. Map of each building
    3. Detailed map of each room, showing type of artifact in each part of the room
Step 2: Can Goals be Measured Before Launch?
to Top

to Top

Some goals are easy to measure; others are more difficult. And some of the goals that can be measure must wait until after the site is launched and has had a chance to be made known.

Here are some examples of goals that can be measured, either before or after launch:

Measurable Before Launch
Example Goal How to Measure
Make location known Number of pages (or percent of pages) with address; number of maps
Make hours and special events known Number of pages with regular hours; number of special events listed
Expressing pride Ask user testers to rate the level of pride shown on a scale of 1 to 5
Display photos Percent of pages displaying at least one photo; total number of photos displayed on the site
Mood expressed by site colors, fonts, and layout Survey or user-testers, possibly presenting alternatives
50% of visitors can find the information they want in 60 seconds or less Timing user-testers (but this amount of precision requires several user-testers)
Measurable After Launch
Example Goal How to Measure
10,000 visits to the site per month Server logs
70% of site visitors go deeper than the home page Server logs
Sales of at least $20,000 gross per month from the site Sales records
At least 20% of site visitors make a purchase Sales records compared with server logs
At least 35% of museum visitors have seen the Web site Survey of museum visitors
Step 3: Assigning Measurable Outcomes to Pre-Launch Goals
to Top

to Top

For each of the goals identified by the development team and approved by the client, the development team needs to decide which can be measured before launch, and how they can best be measured. It may be a good idea to have more than one way of measuring a goal.

The success criteria will be the foundation for the usability test plan (Phase L) as well as the overall measure of the success of the project, so they should be written carefully and examined by all team members. The examples above can serve as a model.

Procedure for Submitting Materials

to Top
to Top
  1. Individual team members get their part of this assignment to the Team Leader by email attachment, or some other method mutually agreed upon in discussion.
  2. Team Leader makes sure all documents in the milestone of which this is a part are gathered together in a compatible form.
  3. Team Leader and/or content specialist check for correct spelling and English usage.
  4. Team leader verifies that material submitted meets the requirements.
  5. Team leader or content specialist FTP the material to the team's Web site, informing the instructor and other team members by emailing to them the URI.

Previous | Series Home | Next
Original: 3 March 2005; Last modification: Monday, 31-Aug-2009 11:48:07 EDT