W2W NetRaker Eval
I’m finalizing the usabilty eval for W2W and I wanted to ask the team to do the dry run before I “start” the eval. I’ve got a couple of questions about how things are set up, and I’m guessing that if everyone goes through it more will come up. I’d like to ask everyone to give feedback on what they think.
Thanks!
Posted by Jessica on 30 September 2003
[comments]
Thanks for the feedback. My thoughts…
- It’s my understanding that the participants use DO/DU now so I don’t think they’ll be confused by using the Loan List, although it may need some additional insutruction by the facilitator.
- Agreed.
- Good suggestion—this is one of the questions I was not sure about and wanted to get some specific feedback.
- Agreed. This is actually from a presentation that we heard at UPA and a continuing conversation that we had w/Bill about how to baseline using NetRaker and to see how perceptions change over time as we evolve the product. I hunted about in NetRaker and this is actually a “pre-fab” question so any suggestions are welcome. Bill—if you have any specific thoughts on this question, please share!
Jessica, I did the dry run. A few comments on the evaluation.
- Are participants going to be confused about the URID Test Originator institution, and about displaying entries on the Loan List?
- When the screwy redirect screen comes up (after clicking the “featured link”), I think the facilitator may have to provide some reassurance to the participant that the screen is the lender’s site.
- I think the two questions, “How well do you rate this feature?” are a little vague. I suggest something along the lines of “How satisfactory is this feature to use?”
- The “overall impression” question is an interesting animal. It might be useful to keep this as a standard question asked in all of our evaluations to establish a baseline over time about user behavior that we observe and its relation to some of these reported dimensions.
[add a comment]