Friday, April 29, 2011

User Evaluation - Session 2

It's Friday the 29th of April 2011 on which we conducted the second part of our evaluation. It was the same place and no of participants was five (5). This time all the participants were blind among which 3 were female and 2 were male. There was one participant who had a Facebook account and hoping to learn programming stuff. However typing speed of all the participants were low compared to the other day.Evaluation procedure was same as the other day. We were on the schedule as expected.

ajor feedback we got was the difficulty of identifying differences in vertical direction. Only one user stated that there is no difference in the vertical and horizontal directions (these are not horizontal and vertical planes. They are the directions on the vertical plane).

Another novel finding was the fact that they are not familiar with the arrow keys. They don't use arrow keys much in their day-to-day work. Instead they heavily depend on Tab, Shift and Enter keys. Users haven't had any issues with the introduction of the Function keys (F1, F2, F3) in this system. They got used to it as they work on the system and no one complained about it as well.


One user pointed out that it is better to read out the password text box at least like "***" when it loses the focus. he suggested that he got confused when he didn't hear the entered password and he thought it as his fault.

In the end we were able to conduct our use evaluation for 10 users. We divided them in to two groups A and B - 5 users per group.

For group A we presented the positioned system firstly and recorded the time, error memory aids provided. Then we asked them to describe the direction of the layout of the home page from memory and then while playing home page. Finally we presented them the questionnaire.

For group B we presented the non-positional system to gather quantitative data (i.e. time, error memory aids provided ) and then demonstrated the positioned system to gather qualitative data (i.e. layout of the home page and questionnaire).

Results were more or less the same from the previous session. Now we have to analyse these results and document them in our thesis. But I can tell one thing this experience was worthy of more than thousand documents!!!


No comments:

Post a Comment