{"id":9,"date":"2026-01-13T14:47:45","date_gmt":"2026-01-13T20:47:45","guid":{"rendered":"https:\/\/projects.vrac.iastate.edu\/hci5990\/?page_id=9"},"modified":"2026-02-13T15:25:42","modified_gmt":"2026-02-13T21:25:42","slug":"two-semester-design-project","status":"publish","type":"page","link":"https:\/\/projects.vrac.iastate.edu\/hci5990\/two-semester-design-project\/","title":{"rendered":"Two Semester Design Project"},"content":{"rendered":"\n\n<div\n\tclass=\"paragraph-widget paragraph-widget--text-html\">\n\t<div class=\"text-content\">\n\t\t<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">For students using their HCI 523 research project as their &#8220;M2&#8221; phase for their capstone (<\/span><a class=\"XqQF9c\" href=\"https:\/\/docs.google.com\/document\/d\/1nmsWx_GDzMG3i49c-7gbiYVyuyvHCUSa_OMkfQnsk0I\/edit?usp=sharing\" target=\"_blank\" rel=\"noopener\"><span class=\"C9DxTc aw5Odc \">see more context about why this option was created here<\/span><\/a><span class=\"C9DxTc \">), their milestones will be as detailed below.\u00a0<\/span><\/p>\n<div class=\"CjVfdc\"><strong><span class=\"C9DxTc \">Timeline (during capstone semester)<\/span><\/strong><\/div>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Everything is due on Monday by midnight Central Time, of the week listed. This timeline can be negotiated, and I&#8217;m happy to react if you turn in milestones early. The more you plan ahead, the better. The oral presentation date is determined by the Grad College\u00a0<\/span><a class=\"XqQF9c\" href=\"https:\/\/www.grad-college.iastate.edu\/student#degreerequirements\" target=\"_blank\" rel=\"noopener\"><span class=\"C9DxTc aw5Odc \">deadlines<\/span><\/a><span class=\"C9DxTc \">\u00a0for MS thesis oral presentations, which means it needs to happen by around Week 13.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 1 &#8211;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 2 &#8211; M2 mini-report<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 3 &#8211;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 4 &#8211;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 5 &#8211;\u00a0<\/span><span class=\"C9DxTc \">M3\u00a0<\/span><span class=\"C9DxTc \">Design explorations<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 6 &#8211;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 7 &#8211;\u00a0<\/span><span class=\"C9DxTc \">M<\/span><span class=\"C9DxTc \">3.5<\/span><span class=\"C9DxTc \">\u00a0Concept testing<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 8 &#8211;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 9 &#8211;\u00a0<\/span><span class=\"C9DxTc \">M4 Prototype<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 10 &#8211;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 11 &#8211;\u00a0<\/span><span class=\"C9DxTc \">M5 Usability Testing<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 12 &#8211;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 13 &#8211; Oral Presentation (if graduating this semester)<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 14 &#8211; You&#8217;re usually done by now because of graduation deadlines.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Week 15 &#8211;\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Below are full details for each milestone:<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><strong><span class=\"C9DxTc \">M1:<\/span><\/strong><span class=\"C9DxTc \">\u00a0Skipped<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><strong><span class=\"C9DxTc \">M2:<\/span><\/strong><span class=\"C9DxTc \">\u00a0Done during the semester they take HCI 5220 or 5230. Their final report for HCI 5220\/5230 is akin to the M2 report described on the\u00a0<\/span><a class=\"XqQF9c\" href=\"https:\/\/projects.vrac.iastate.edu\/hci5990\/one-semester-design-project\/\"><span class=\"C9DxTc aw5Odc \">main Design Project page<\/span><\/a><span class=\"C9DxTc \">, and must include:<\/span><\/p>\n<ul>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">findings on users&#8217; current needs and practices (for which a future technology might be designed), including how users see and describe the problem to be solved<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">at least three tasks that users will want to accomplish, with a solution they will be designing<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">w<\/span><span class=\"C9DxTc \">hat are the key steps of the tasks? (You might consider a narrative like a user scenario or a structured task analysis.)<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">What is the task environment where users will perform these tasks in the real world? In the car? In an elevator? Only sitting down, only standing up? In a hurry?\u00a0 (Mention physical environment as well as time constraints and culture if appropriate.)<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">What breakdowns occur while users perform their tasks currently (that your system will address)?<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">What do they see as their needs for better tools?<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">What system(s) are currently available to accomplish these tasks?<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">What are their strong and weak characteristics?<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Overall, what are the other design implications for your system, based on what you learned? (e.g. what aspects or details of your design will be most important to get right? Are there particular ways they should be designed? Or, what constraints will you need to consider?)<\/span><\/li>\n<li dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Cite as least 3 academic references as part of the lit review, to demonstrate your ability to cite research on what is known already in this space.<\/span><\/li>\n<\/ul>\n\n\t<\/div>\n<\/div>\n\n\n<div\n\tclass=\"paragraph-widget paragraph-widget--text-html\">\n\t<div class=\"text-content\">\n\t\t<h2>M2: MINI-REPORT<\/h2>\n<p>This will be the first milestone due, during the semester the student is doing HCI 599. This report should draw on the insights from their HCI 5220\/5230 research, but will need additional analytical thinking and product sense to answer (some additional online research may also be needed). It should be about 2-3 pages total.<\/p>\n<p><strong>PROBLEM DEFINITION (2 points)<\/strong><\/p>\n<ul>\n<li>Describe in 1-2 sentences the user problem or need that exists, that you&#8217;ll be addressing in your design solution.<\/li>\n<li>Tell me your early thoughts on strategy for addressing the problem. Make sure this includes:\n<ul>\n<li>what form will your system take: app? website? VR application? robot? smartwatch? etc<\/li>\n<li>what high-level mechanics are involved: e.g. a LLM? chatbot? is it a two-sided marketplace? does it make use of gamification? etc<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><em>See the main Design Project page&#8217;s M1 section for several examples of problem statements and strategy for addressing the problem.<\/em><\/p>\n<p><strong>USERS (1 point)<\/strong><\/p>\n<ul>\n<li>Besides the user group you will focus on, what other stakeholders are there for your system (both users, as well as non-users who are impacted by your system)?<\/li>\n<\/ul>\n<p><strong>ANALYSIS (3 point)<\/strong><\/p>\n<p><em>Think about what you learned in your research, about what current systems are available, their strong and weak characteristics, and users&#8217; desires for better tools. Then answer:<\/em><\/p>\n<ul>\n<li>What functionality should your system include to accommodate users&#8217; tasks, but in a way that is differentiated (and better) than other alternatives?<\/li>\n<\/ul>\n<p><strong>MEASURES (2 points)<\/strong><\/p>\n<ul>\n<li>Imagine that in the future, your system idea is actually built and being used by users. What measurable criteria would you want to use to evaluate the success of your system (e.g. number of users? usage metrics? self-reported satisfaction metrics, etc)?<\/li>\n<\/ul>\n<p><strong>BUSINESS PERSPECTIVE (2 points)<\/strong><\/p>\n<ul>\n<li>If built by a for-profit company, how would your system make money? What requirements does this add, to the design? (Paid apps, subscriptions, or ads are some ways to make money. Selling the data collected by your app could be another. There could also be other ways.)<\/li>\n<li>What will be necessary for your system to be feasible, and how would you ensure this happens? (For instance, if your system idea depends on a certain stakeholder group to provide data or to agree to be part of it, how would you incentivize their participation?)<\/li>\n<\/ul>\n<p>Total points: 10<\/p>\n\n\t<\/div>\n<\/div>\n\n\n<div\n\tclass=\"paragraph-widget paragraph-widget--text-html\">\n\t<div class=\"text-content\">\n\t\t<h2>M3: THE DESIGN<\/h2>\n<p><strong>Now that you understand your users, it&#8217;s time for brainstorming to ideate on concepts that address the problem you identified.<\/strong><\/p>\n<p>Come up with 2-3 concepts, that you will get feedback on during M3.5: Concept Testing. These concepts should be created in low fidelity: either paper sketches of the interface, a simplified digital interface, or storyboard scenarios. The concepts should be articulated in just enough detail that a concept test participant can understand the key details of the solution. <a href=\"https:\/\/www.userfocus.co.uk\/articles\/lean_ways_to_test_your_new_business_idea.html\" target=\"_blank\" rel=\"noopener\">See a helpful article with more guidance on this, here<\/a>.<\/p>\n<p>It will be helpful if you can brainstorm with someone.<\/p>\n<p><strong>M3 Grading &#8211; 25 points<\/strong><\/p>\n<ul>\n<li>Write a report or presentation with your concepts. A total of 25 points will be assigned to this portion of the project as detailed in the grading matrix below. The outline of your document should look something like this:<\/li>\n<\/ul>\n<p><strong>SUMMARY (2 points)<\/strong><\/p>\n<ul>\n<li>Brief summary of the system, its users&#8217; needs, and the tasks it will support. (Feel free to re-use content from before.)<\/li>\n<\/ul>\n<p><strong>DESIGN SPACE (4 points)<\/strong><\/p>\n<ul>\n<li>What key dimensions did you explore as you did your ideation? (e.g. for a robotic lawn mower system, one dimension might be how automated the system is by default. Another dimension might be: how much to explain to users about what is happening.)<\/li>\n<\/ul>\n<p><strong>THE CONCEPTS (10 points)<\/strong><\/p>\n<ul>\n<li>Describe the 2-3 solution concepts you came up with, and what user feedback\/research insights they were based on.<\/li>\n<li>Describe what each concept optimizes for, in terms of the dimensions you explored (e.g. maybe one solution optimizes for explainability but at the expense of interpretability, or convenience vs. privacy). Describe at least one, per solution concept.<\/li>\n<li>Include the sketched and scanned or digitally created images of the solution concepts here.<\/li>\n<li>If you created a paper or digital sketches rather than storyboards, also give a usage scenario for each solution concept, that is written from the user&#8217;s perspective. This helps you avoid a presentation that&#8217;s just &#8220;Here&#8217;s my concepts!&#8221; and instead tells a story of how a real user would use them.<\/li>\n<\/ul>\n<p><strong>FUTURE TECHNOLOGIES &amp; SOCIAL IMPLICATIONS (6 points)<\/strong><\/p>\n<ul>\n<li>Comment on the ways that emerging technologies affect or inspire your design. This is the part of the course where you demonstrate your knowledge of emerging technologies and HCI-related technologies, e.g. that you might have learned about from Alex Stoytchev or Tony Townsend (approximately 1 page).<\/li>\n<li>Discuss any ethical issues that may arise from your design, as well as the social implications of your design if it were successful (approximately 1 page). E.g. with smart phones, some people worry about members of families not communicating as well at family dinners because they&#8217;re distracted, or you could talk about txt-msging undermining political regimes. If you were designing software for sending instant videos across the network, you could worry about the privacy of people in public who might get filmed.<\/li>\n<\/ul>\n<p><strong>RESEARCH-BASED (3 points)<\/strong><\/p>\n<p>Use academic references where appropriate in the report (perhaps ones you read in the HCI core courses) to justify your approach and to demonstrate your ability to cite research as the basis of your decisions.<\/p>\n\n\t<\/div>\n<\/div>\n\n\n<div\n\tclass=\"paragraph-widget paragraph-widget--text-html\">\n\t<div class=\"text-content\">\n\t\t<h2 class=\"CjVfdc\"><span class=\"yAbvcd C9DxTc \">M3.5:\u00a0<\/span><span class=\"yAbvcd C9DxTc \">CONCEPT TESTING\u00a0<\/span><\/h2>\n<div class=\"CjVfdc\"><span class=\"C9DxTc \">20 points<\/span><\/div>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">It&#8217;s now time to get feedback on your concepts, to see if your solutions are headed in the right direction, and which concept (or combination of concepts) you should narrow down to focus on for further refinement in the next phase.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">The point of concept testing is to see whether users think your design solutions are good solutions for addressing the problem you are trying to solve, what changes are needed to address it better, and which concept users like best. Concept testing is not usability testing! Usability testing is about how usable a prototype is to use, and comes later in the process. One useful guide to concept testing can be found\u00a0<\/span><a class=\"XqQF9c\" href=\"https:\/\/dscout.com\/people-nerds\/concept-testing\" target=\"_blank\" rel=\"noopener\"><span class=\"C9DxTc aw5Odc \">here<\/span><\/a><span class=\"C9DxTc \">; an example HCI paper from a concept testing study is\u00a0<\/span><a class=\"XqQF9c\" href=\"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3334480.3383097\" target=\"_blank\" rel=\"noopener\"><span class=\"C9DxTc aw5Odc \">here<\/span><\/a><span class=\"C9DxTc \">.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Test with at least 5 users. The users should meet the same minimum criteria you established in M2 to ensure they were part of your target user group (e.g. environmentalists). They ideally should also strongly identify with the problem you are trying to solve, though for this milestone it\u2019s fine if some don\u2019t identify with it as strongly (e.g. suburban homeowners who care a bit about borrowing tools, though it isn\u2019t a huge need).<\/span><span class=\"C9DxTc \">\u00a0<strong>You may recruit the same users you talked to during M2 for the evaluation if you wish<\/strong><\/span><span class=\"C9DxTc \">. This is helpful, as they will already have context about the problem space you are aiming to address, and can give good detailed feedback about your solution.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><strong><span class=\"C9DxTc \">During the test session<\/span><\/strong><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Remember that it can be intimidating to be a participant in a user study, so be extra nice. The user will be trying to please you, which could distort your data (i.e., prevent you from hearing critical feedback). Therefore, be very open and receptive to anything and everything the user may say or do in order to gain trust.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Present each concept, one by one, to the user. For the first one, start with giving a brief overview. Do not show how to do tasks with it, but give a general idea of the system to set some context. &#8220;This is an interface for a robotic lawn mower. You would see this touch screen inside your house and use it to control the mowing of your lawn. This image shows your lawn currently, and this map shows the position of your mower.&#8221;\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">After the introduction, stop to get their initial impressions of the concept (in terms of the high-level solution, not the aesthetics or design details!). Ask for elaboration to understand if their sentiment is positive\/negative\/neutral, and why. Then, walk through the rest of the concept to show any further key details of the solution (&#8220;Let&#8217;s say you are going to be on vacation, and want to set the lawnmower to mow your yard while you are gone. This is the screen you would see.&#8221;). [For concept testing, it&#8217;s alright to show and explain what&#8217;s happening to users, rather than gauge their understanding, since we are not testing for usability yet.] If you want, you\u00a0<\/span><span class=\"C9DxTc \">could\u00a0<\/span><span class=\"C9DxTc \">ask them to describe what they see on the screen and what they would do next, to get a bit of usability feedback (e.g. on design elements that are confusing). Just remember that usability is not the focus of this round of testing.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">After showing the details of each concept, interview the user to get their overall feedback. Before asking these questions, make sure they no longer have any confusion about what your concept is or how it works &#8211; you might have to explain how it is intended to work, if it was still unclear. This will allow you to understand whether your solution, once understood, is a good one (you can always improve the clarity of how it is communicated). Ask questions such as:\u00a0<\/span><\/p>\n<ul>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Now that you have seen the full concept for this system, how compelling is it to you? (Followup: explain why it is compelling or not compelling)\u00a0<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">How would you describe this to a friend or family member?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">How well do you feel the system solves the problem of &lt;problem you are aiming to address&gt;? Why?\u00a0<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">How would this concept improve (and\/or not improve) the experience of [activity related to concept]?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">How would you use this concept in your daily life?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">What stands out to you as great about this concept?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">What stands out to you as concerning about this concept?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">What parts, if any, were confusing?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">If the system was built and ready to use, how eager would you be to use it? Why?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">What changes would you make, to make the system more useful for you?<\/span><\/li>\n<\/ul>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">After showing all 2-3 solution concepts, also make sure to ask:<\/span><\/p>\n<ul>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Which of the solutions did you like best? Why?<\/span><\/li>\n<\/ul>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Think about privacy: assign your users fake IDs to use in your write up to protect their identity. Ask for their consent to take pictures and if you want to post any identifying photos of them on your website.\u00a0<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><strong><span class=\"C9DxTc \">Report<\/span><\/strong><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Write a document presenting your method and results. Email it to me as a PDF.\u00a0 Aim for approximately 10 pages.<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">The outline of your document should look something like this:<\/span><\/p>\n<ul>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Brief summary of the system, its users, and the tasks it will support. (Feel free to re-use content from before.)<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\">Evaluation Details\n<ul>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Your users (demographics, background, etc) &#8211; work with at least 5 users<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">The questions you asked each participant during the session<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Your testing environment (At a bookstore caf\u00e9? At the user&#8217;s home?)<\/span><\/li>\n<\/ul>\n<\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\">Results: Present your data\n<ul>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">No need to discuss the data here; that&#8217;s the next section<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Be sure to include how many users, some data from each user<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Give quotes, summary of findings, and a summary of overarching themes<\/span><\/li>\n<\/ul>\n<\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\">\u00a0Discussion\n<ul>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">What do you conclude based on your data? <\/span><span class=\"C9DxTc \">What do the data mean?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Was anything surprising?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">What are the main implications for your design? Which one concept (or combination of parts of the concepts) do you intend to move forward with?<\/span><\/li>\n<li class=\"zfr3Q CDt4Ke \" dir=\"ltr\" role=\"presentation\"><span class=\"C9DxTc \">Reflect on your evaluation process: what was the hardest part of this milestone? What would you do differently when doing concept testing for a future system design project?<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><strong><span class=\"C9DxTc \">Grading for M5 &#8211; Evaluation Report<\/span><\/strong><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Summary: 2 points<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Evaluation: 6 points<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Results: 6 points<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">Discussion: 6 points<\/span><\/p>\n<p class=\"zfr3Q CDt4Ke \" dir=\"ltr\"><span class=\"C9DxTc \">TOTAL: 20 points<\/span><\/p>\n\n\t<\/div>\n<\/div>\n\n\n<div\n\tclass=\"paragraph-widget paragraph-widget--text-html\">\n\t<div class=\"text-content\">\n\t\t<h2>M4: PROTOTYPE<\/h2>\n<p>Use the insights from concept testing to narrow down to one design solution. Then, create a high-fidelity digital prototype of it, including fleshing out the details of how at least one task would be done in it, end-to-end. Your choice of prototyping tool is up to you: e.g. Figma, HTML, Powerpoint. In M5, you&#8217;ll be showing this prototype to five (5) users.<\/p>\n<p><strong>Prototyping<\/strong><\/p>\n<p>When prototyping, remember that they key is developing the interface, not the back-end functionality. You can use a &#8220;<a href=\"https:\/\/www.nngroup.com\/articles\/wizard-of-oz\/\" target=\"_blank\" rel=\"noopener\">Wizard of Oz<\/a>&#8221; approach during testing to simulate how the system would respond.<\/p>\n<p><strong>M4 Grading &#8211; 15 points<\/strong><\/p>\n<p>Create a document or website or video, etc (anything digital) presenting your prototype.<\/p>\n<p>Make sure you document:<\/p>\n<ul>\n<li>Functional Requirements (3 points)\n<ul>\n<li>This is where you&#8217;re telling us specifically what the system must do. You can frame it from the user perspective, e.g. &#8220;The user must be able to: 1) &#8230;. 2) &#8230;.&#8221; or in the traditional &#8220;The system shall 1) and shall 2)&#8230;&#8221; We&#8217;re not as concerned about the specific format, as long as it shows a more mature set of requirements that are driving your design.<\/li>\n<\/ul>\n<\/li>\n<li>Description of prototype (include images or link to prototype) &#8211; 10 points\n<ul>\n<li>Its features and screens<\/li>\n<li>The tasks it supports<\/li>\n<li>The tasks \/ features it doesn&#8217;t support, and why that&#8217;s ok (just mention briefly)<\/li>\n<\/ul>\n<\/li>\n<li>Reflection &#8211; 2 points\n<ul>\n<li>Reflect on the prototyping process: what was the hardest part of this milestone? What, if anything, would you do differently when prototyping for a future system design project?<\/li>\n<li>What did you learn about your design, and about prototyping generally?<\/li>\n<li>Write about a page.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Two Semester Design Project<\/p>\n\n\t<\/div>\n<\/div>\n\n\n<div\n\tclass=\"paragraph-widget paragraph-widget--text-html\">\n\t<div class=\"text-content\">\n\t\t<h2>M5: USABILITY TESTING<\/h2>\n<p>There are many ways to conduct evaluative testing. Think about what makes the most sense, for your project.<\/p>\n<p>The point of the evaluation, however, should be to understand what&#8217;s working about your design, and what changes are needed to make it better.<\/p>\n<p>Test with at least 5 users. Again, the users should meet the same minimum criteria you established in M2 to ensure they were part of your target user group, and you may recruit the same users you talked to during M2 and M3.5 if you wish.<\/p>\n<p><strong>During the test session<\/strong><\/p>\n<p>When you meet the user, explain what you&#8217;re doing. Explain that you&#8217;re testing the interface, not him or her. If there&#8217;s confusion, it&#8217;s bad design, not the user&#8217;s fault.<\/p>\n<p>As in the concept testing, present the system to the user and give a brief overview. Do not show how to do the tasks, but give a general idea of the system to set some context. Then, introduce the first task scenario and show the starting point in the prototype for that scenario. Ask them what they would do next, and listen and observe what they do. If needed, advance the prototype through the steps for that task, to respond as the real system would (you might use a <a href=\"https:\/\/www.nngroup.com\/articles\/wizard-of-oz\/\" target=\"_blank\" rel=\"noopener\">Wizard of Oz technique<\/a> to simulate the system&#8217;s behavior). Also take notes, describing why and when the user made comments like, &#8220;This is cool!&#8221; and &#8220;What in the world is that?&#8221;<\/p>\n<p>After all your task scenarios, interview the user to get their overall feedback. Ask questions such as:<\/p>\n<ul>\n<li>What did you like the most about using this system?<\/li>\n<li>What did you like the least?<\/li>\n<li>What changes would you make, to make it work better for you?<\/li>\n<\/ul>\n<p>For data gathering, it will be most valuable if you present users with the exact same tasks and exact same prototype. Even if user #1 gets really dislikes some aspect of your system, resist the urge to change it before user #2, because you don&#8217;t know whether the other users will have the same feedback. Don&#8217;t change things unless the issue significantly disrupted the evaluation process or prevented you from getting important feedback on some other aspect of the system.<\/p>\n<p>Think about privacy: assign your users fake IDs to use in your write up to protect their identity. Ask for their consent to take pictures and if you want to post any identifying photos of them on your website.<\/p>\n<p><strong>Report<\/strong><\/p>\n<p>Write a document presenting your method and results. Email it to me as a PDF. Aim for approximately 10 pages.<\/p>\n<p>The outline of your document should look something like this:<\/p>\n<ul>\n<li>Brief summary of the system, its users, and the tasks it will support. (Feel free to re-use content from before.)<\/li>\n<li>Evaluation Details\n<ul>\n<li><span style=\"font-size: 1rem;\">Your users (demographics, background, etc) &#8211; work with at least 5 users<\/span><\/li>\n<li>The task scenarios you gave to users<\/li>\n<li>Your interview questions<\/li>\n<li>Your testing environment (At a bookstore caf\u00e9? At the user&#8217;s home?)<\/li>\n<\/ul>\n<\/li>\n<li>Results: Present your data\n<ul>\n<li>No need to discuss the data here; that&#8217;s the next section<\/li>\n<li>Be sure to include how many users, some data from each user<\/li>\n<li>For qualitative data: Include quotes and a summary of any overarching themes. Also summarize what was learned in terms of usability issues, categorizing them this way:\n<ul>\n<li>Severe; must fix<\/li>\n<li>Major problem<\/li>\n<li>Minor problem<\/li>\n<li>Cosmetic problem (more related to prototype itself than system)<\/li>\n<li>New feature request<\/li>\n<\/ul>\n<\/li>\n<li>For any quantitative data, give raw data since stats like average don&#8217;t make sense with a small sample size, e.g. &#8220;3 of 6 users said&#8230;&#8221; or a chart showing a bar for each of 6 users with their ratings.<\/li>\n<\/ul>\n<\/li>\n<li>Discussion\n<ul>\n<li>What do you conclude based on your data? What do the data mean?<\/li>\n<li>Was anything surprising?<\/li>\n<li>What are the main implications for your design?<\/li>\n<li>Reflect on your evaluation process: what was the hardest part of this milestone? What would you do differently when doing usability testing for a future system design project?<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Grading for M5 &#8211; Evaluation Report<\/strong><\/p>\n<p>Summary: 2 points<\/p>\n<p>Evaluation: 6 points<\/p>\n<p>Results: 6 points<\/p>\n<p>Discussion: 6 points<\/p>\n<p>TOTAL: 20 points<\/p>\n\n\t<\/div>\n<\/div>\n\n\n<div\n\tclass=\"paragraph-widget paragraph-widget--text-html\">\n\t<div class=\"text-content\">\n\t\t<h2>ORAL PRESENTATION<\/h2>\n<p>Same as for one-semester capstone option. See details on main Design Project page. Just make sure to flag that you did the &#8220;two-semester capstone option&#8221; so the faculty committee has that context.<\/p>\n<p>&nbsp;<\/p>\n\n\t<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":22,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-9","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/pages\/9","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/comments?post=9"}],"version-history":[{"count":11,"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/pages\/9\/revisions"}],"predecessor-version":[{"id":105,"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/pages\/9\/revisions\/105"}],"wp:attachment":[{"href":"https:\/\/projects.vrac.iastate.edu\/hci5990\/wp-json\/wp\/v2\/media?parent=9"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}