{"id":3251,"date":"2022-11-01T17:43:10","date_gmt":"2022-11-01T21:43:10","guid":{"rendered":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/?p=3251"},"modified":"2022-11-01T17:44:10","modified_gmt":"2022-11-01T21:44:10","slug":"individual-assignment-3-representative-user-test-6","status":"publish","type":"post","link":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/?p=3251","title":{"rendered":"Individual Assignment 3: Representative User Test"},"content":{"rendered":"\n

Norman Rockwell Museum, https:\/\/www.nrm.org\/<\/a><\/h2>\n\n\n\n
\"\"<\/figure>\n\n\n\n

The Norman Rockwell Museum website provides information about the artist, museum exhibits and events, and hosts the museum archive. The homepage has two menu bars, each with some distinct links as well as several overlapping links.  The green-blue menu bar at the very top of the page also has dropdown sub menus. The second menu bar is below the museum name banner and social media links. The remainder of the homepage features photographs on a loop. <\/p>\n\n\n\n

Not all pages within the website have titles or headers, several have menus on the left-hand side where two of the site\u2019s pages have a link to the Rockwell Center for Visual Studies, URL rockwellcenter.org<\/a>. <\/p>\n\n\n\n

The website also has embedded YouTube videos and uses a third-party popup window for ticket sales.<\/p>\n\n\n\n

Users<\/h2>\n\n\n\n

Persona<\/h3>\n\n\n\n

Slightly modified from group assignment so it could be read to the user-testers and to include a starting location for directions: You are an undergraduate art history student at Bay Path University in Longmeadow, Massachusetts. Your are interested in Norman Rockwell\u2019s works since Rockwell was a fellow Massachusetts native. One of your class projects includes Rockwell\u2019s Pointing Hand.<\/em> You are going to use the NRM website as a source for your project, but you are also interested in visiting the museum over break. Also, you will need an internship before you graduate and you will seek information about opportunities at the museum.<\/p>\n\n\n\n

User-testers<\/h3>\n\n\n\n

The individual user-tester is an 18 year old male high school graduate, June 2022. He is taking a gap year before matriculating at George Mason University, Fall 2023.<\/p>\n\n\n\n

The user-tester team consists of a 16 year old female junior high school student and a 23 year old male who recently graduated from the University of Mary Washington with an art history degree and a minor in math.<\/p>\n\n\n\n

Testing Methods<\/h2>\n\n\n\n

Concurrent Think Aloud – This method makes it easy to evaluate the experience of the user: understand participants\u2019 thoughts and elicit real time feedback.<\/p>\n\n\n\n

Paired User Testing – an interesting twist on the above that is expected to require less prompting from the moderator.<\/p>\n\n\n\n

Test Plan and Tasks<\/h2>\n\n\n\n

Test Purpose<\/h3>\n\n\n\n

To determine how quickly and easily an undergraduate student can navigate the website and use it for academic purposes. <\/p>\n\n\n\n

Methods<\/h3>\n\n\n\n

The user characteristic description will be read to user-testers. They will then be asked to describe what information they need from the website in order to confirm their understanding of the scenario. <\/p>\n\n\n\n

The test moderator will provide encouragement if frustration levels become a roadblock. If all attempts of the moderator fail, the participant will be given a hint at the discretion of the moderator. <\/p>\n\n\n\n

Benchmarks & Metrics<\/h3>\n\n\n\n

Frustration level of participant and post task user review (subjective); error rates, task completion and time will be measured (qualitative)<\/h3>\n\n\n\n

Tasks<\/h3>\n\n\n\n

Plan a visit to the museum including getting directions from the university and purchasing a ticket.<\/strong> This represents a high frequency task for website users since many people who visit a museum website are planning to visit the museum itself. Or conversely, many who want to visit a museum will use the website to plan their visit.<\/p>\n\n\n\n

Find out if the museum has any internship opportunities for undergraduate students and details about the internship, including how to apply.<\/strong> This is an important community engagement activity for the museum.<\/p>\n\n\n\n

Find a specific work called Pointing Hand<\/em> in the Norman Rockwell Museum\u2019s digital collections<\/strong>. Finding artwork is a foundational concept for an art museum.<\/p>\n\n\n\n

Addendum<\/strong>: Finding Pointing Hand<\/em> did not present any significant navigational issues for the paired users. So for the individual user-tester, the artwork was changed to New Kids in the Neighborhood<\/em> and the participant was asked to determine if the website had any narrative information about the work that might be useful in an art history project.<\/strong> <\/p>\n\n\n\n

Test Analysis<\/h2>\n\n\n\n

Paired User Test (PU<\/strong>) – all three tasks were completed in less than ten minutes with no real navigation difficulties. <\/p>\n\n\n\n

Think Aloud User Test (TA<\/strong>) – All tasks were completed in 11 minutes. There was difficulty in searching for information about the artwork and confusion with navigating between the NRM site and the Rockwell Center.org site (RC).<\/p>\n\n\n\n

Benchmarks & Metrics<\/strong><\/td>Finding Artwork<\/strong> <\/td>Planning Visit1<\/sup> <\/strong> <\/td>Internships<\/strong> <\/td><\/tr>
Task Completion<\/strong><\/td>yes2<\/sup><\/td>yes<\/td>yes<\/td><\/tr>
Time <\/strong>
minute:second<\/td>		Paired 2:15
Think Aloud 2:40<\/td>		Paired 33<\/sup>
Think Aloud 5:49<\/td>		Paired 4
Think Aloud 2:25<\/td><\/tr>
Error Rate<\/strong><\/td>All testers tried the main search bar before going to “Collections”\u2192”Search the Collection”<\/td>Paired – none; used “Visit” link
TA – none<\/td>		Paired – none; typed “internships” in search bar<\/td><\/tr>
Frustration Level <\/strong><\/td>none<\/td>TA – confusion surrounding the need to choose a date before proceeding to checkout<\/td>TA – confusion between nrm.org and rockwellcenter.org<\/td><\/tr><\/tbody><\/table>
1. Both users declined to get directions from the website saying they would use google maps on their phones; they were able to display the website on their phones during the time of the test. 2. TA tester did not complete the subtask of finding narrative information about the artwork. He did not recognize a blog post which could be used in an art history project. This post was displayed when the tester searched \u201cNew Kids in the Neighborhood\u201d in the main search bar, but the link for the post was between a grade K-5 lesson plan and two past museum events. 3. PU testers also briefly looked at the current exhibits advertised on the homepage while planning their visit.
<\/figcaption><\/figure>\n\n\n\n

User Review<\/h3>\n\n\n\n
\"\"<\/figure>
\n

The collection artworks are displayed in what I will describe as an archival view. None of the user-testers liked this display, nor the interactivity of the page. Works are displayed in shadowed boxes which highlight when the cursor hovers over them.<\/p>\n<\/div><\/div>\n\n\n\n

However, the cursor had to be directly over the image to display an enlarged version of the image, likewise the cursor had to be directly over the title of the work to display metadata for the work. None of the users found the metadata informative. They all expected to find narrative commentary displayed with the artwork image or for links to that information to be provided with the image. <\/p>\n\n\n\n

Users also found it inconvenient that the archive page had no back function. The users expected a left pointing bracket (<) that is above the images to act as a back arrow, but it has no functionality. Both users used browser back arrows from here even though the NRM name at the top acts as a homepage return.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

When TA was searching for narrative commentary about New Kids on the Block<\/em>, he got led to the Rockwell Center for Visual Arts. This has a different URL, it has the RC name in place of the NRM name, and a new menu bar, however there are enough similarities that tester was unaware that he was at a different website. The browser tabs for both sites contain red \u201cNR\u201d and both sites have the same menu bar at the very top of the page, although there is a slight color difference from blue-green to gray-blue.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Neither set of users found the popup window used when purchasing tickets bothersome. The 23 year old in the PU group opined that it might be a more secure site to enter his credit card information. And the PU testers happily noted the Trip Advisor ratings on the popup site. <\/p>\n\n\n\n

Design Recommendations<\/h2>\n\n\n\n
Violation<\/strong><\/td>Improvement <\/strong> <\/td><\/tr>
Heuristic 1<\/td> – Use popup message when moving from nrm.org to rockwellcenter.org<\/td><\/tr>
Heuristic 2<\/td> – Add a breadcrumb trail to the top of each page
– Enlarge the very top blue-green-gray menu bar. 
– Keep the top menu bar pinned throughout both websites. 
– Highlight the \u201cInternships\u201d link by adding a colored field to improve visibility
and recognition that it is a button.<\/td><\/tr>
Heuristic 3<\/td> – Add a title or header to the top of each page<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Discussion<\/h3>\n\n\n\n

Redesigning how images of artwork are displayed is only realistic if NRM wants to do a major overhaul of their site, however there are some smaller improvements that will improve the navigability of the site. <\/p>\n\n\n\n

Based on Nielsen\u2019s first heuristic, visibility of system status, the user should clearly know when they are moving from nrm.org to rockwellcenter.org. A simple popup message that the user is leaving the original website would work. Additionally, clear instructions should be given within the popup window that the user needs to first choose a visit date before proceeding to checkout.<\/p>\n\n\n\n

User control and freedom, heuristic #3, states that links should be easily discoverable, especially back and cancel. NRM website should add a \u201cbread crumb\u201d trail so that users know where they are in the website, improving their ability to make decisions about which link to use next. The website has two menu bars at the top  of the page, a blue-green bar at the very top, and semi-transparent one under the website name. This stays consistent between nrm.org and rockwellcenter.org with the exception of the slight color change in the top bar. Enlarging this top bar and pinning it so that it does not disappear with scrolling will also improve navigation. Also, the search for internship opportunities would be easier if the \u201cinternships\u201d link at the top of the webpage included a colored field that changed color so that it is more obviously a link and not merely a heading. <\/p>\n\n\n\n

\"\"
Find the “Internship” link<\/figcaption><\/figure>\n\n\n\n

Finally, in accordance with the fourth heuristic of maintaining consistency with other websites, each page should contain a header so the user understands where they have landed and what content is found on that page. This would help others from feeling like they are looking at \u201canother page with a bunch of random articles\u201d as the think aloud user-tester described one page.   <\/p>\n","protected":false},"excerpt":{"rendered":"

Norman Rockwell Museum, https:\/\/www.nrm.org\/ The Norman Rockwell Museum website provides information about the artist, museum exhibits and events, and hosts the museum archive. The homepage has two menu bars, each with some distinct links as well as several overlapping links.  The green-blue menu bar at the very top of the page also has dropdown sub … <\/p>\n

Continue reading “Individual Assignment 3: Representative User Test”<\/span><\/a><\/p>\n","protected":false},"author":80,"featured_media":0,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[40,7],"tags":[],"class_list":["post-3251","post","type-post","status-publish","format-standard","hentry","category-group-museums","category-representative-user-test"],"_links":{"self":[{"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=\/wp\/v2\/posts\/3251","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=\/wp\/v2\/users\/80"}],"replies":[{"embeddable":true,"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3251"}],"version-history":[{"count":2,"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=\/wp\/v2\/posts\/3251\/revisions"}],"predecessor-version":[{"id":3274,"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=\/wp\/v2\/posts\/3251\/revisions\/3274"}],"wp:attachment":[{"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3251"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3251"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/torch.cci.fsu.edu\/~pmarty\/5275\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3251"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}