Workflow Guide Testing Continued

Status on the Workflow Guide Testing

I put myself and the two designers side-by-side, for comparison, to identify areas of improvement in the workflow guide:

Side by side comparison of all the converted schematics
Side by side comparison of all the converted schematics
Side by side comparison of all the converted schematics
Side by side comparison of all the converted schematics
Side by side comparison of all the converted schematics
Side by side comparison of all the converted schematics
Side by side comparison of all the converted schematics

User Testing with Azalea

Made Krizia’s changes to the style guide and tested it again with Azalea. This time, I took her through the first one and asked her questions since it’s a bit of a steep curve to getting into flow.

Azalea's analog in design
Azalea's key for Arduino Switch design
Azalea's Arduino Switch design
Azalea's key for LED resistor in series design
Azalea's LED resistor in series design
Azalea's potentiometer design

Debriefing the usability testing:

  • Add Braille translator step to template
  • Add guides to template
  • Clarify what a “templatized text/Braille box” is
    • Put Braille and text in same text box so that they’re always visually related to each other
  • Indicate that you can do a line break with Braille after a space
  • Change 20% key threshold to “Anything more than 3 labels or if there are already abbreviations, use a key”
  • Clarify that when you copy and paste symbols from the library, the Braille size might change so ensure that it is set to 30
  • Put the ENTIRE workflow guide in w/o making another artboard
  • Change to “delete anything that is red”

New Template:

Adobe illustrator file for converting schematic SVGS, optimizing the design and translating to Braille

Design Feedback Meeting with Chancey

I’m in the process of arranging a meeting with Chancey to get some preliminary feedback on my schematics and talk about usability testing. My questions for her can be found here.

Testing Script and Questions

Tactile Graphics Usability Study

Research Personnel

Amy Hurst

Associate Professor, New York University

Director, NYU Ability Project

Lauren Race

Graduate Student, New York University

Welcome (5 min)

Hi, my name is Lauren Race and I’m going to be guiding you through this usability study So I’m just going to go over a little of what to expect for the next hour. You might know a bit about why we asked you to come help us with these schematics today, but I’m just going to do a quick recap. After that I will ask you some simple questions about your experience with electronics and ask you some questions about six specific schematics that I will put in front of you. Afterwards, I will follow up with some questions once the study is over.

We are designing tactile schematics for electronics and microcontrollers and want to see what it’s like for people to use them. There aren’t any mistakes in this study, we just want to identify areas of improvement for usability.

We want to know what you think so don’t worry about hurting my feelings. We want to make these better, so we’d love to know honestly what you think. As we go through this, I’m going to ask you to think out loud, whatever is going through your mind. So just making your internal monologue external- this will help us a ton to make these better.

Informed Consent (3 min)

Is it okay if I take pictures of our usability study today for my thesis documentation? The pictures will be used to show my process for my final thesis presentation at NYU, which is public.

Is it okay if I audio record today? It will be used only to help us figure out how to improve these schematics and won’t be heard by anyone but the design team working on it. It also helps me because I won’t get distracted by taking too many notes.

Is it okay if I video record? The video will be used to create short, soundless gifs for my public NYU thesis presentation.

I have a simple consent form here that just says we have your permission to record you. Do you have any questions before we get started?

Introduction (5 min)

  1. Tell me about your experience with electronics?
  2. Tell me about your experience with tactile graphics?

Phase 1 (25 min)

  1. This is a schematic of a ________. Will you find microcontroller?
  2. Can you tell what kind of resistor is depicted?
  3. Will you tell me many LED’s are shown here?
  4. Can you see if you can tell where is ground located?
  5. Can you find all the components that are listed in the key?
  6. Which schematic, of these two versions, is more clear to you? Which do you prefer?

Phase 2 (10 min)

  1. How would you explain the schematic back to me in your own words?
  2. How do you orient the page?
  3. What is title of the schematic?

Follow Up Questions (10 min)

  1. Was there anything you didn’t understand?
  2. How do you feel about the material you’re seeing here?
  3. What are your thoughts about the tactile graphics?
  4. Do you have any suggestions for the design of these graphics?
  5. Do you see any other uses in  your life for tactile graphics?

Thank You (2 min)

Thank you so much for helping us out today. This has been a great help to improve these schematics and we are so thankful for your time, so we’d like to compensate you for your time. Is there anything else you’d like to add or ask questions about?

Weekly Status

Phase 1 | Observation 1/29/19-  2/12/19 |

  1. Organize existing research for a status check and onboarding Amy Hurst.
  2. Complete a competitive analysis on other electronics/microcontroller education techniques for low vision readers.
  3. Begin IRB approval process.
  4. Register and take IRB training
  5. Look into how similar the best practices are for other graphics, like AFB
  6. Make Tom and Amy’s edits to the style guide
  7. Add visuals to style guide
  8. Write How-To guide

Phase 2 | Ideation 2/12/19-  2/26/19 |

  1. Consider user testing methodologies.
  2. Develop personas.
  3. Test style guide with Emily.
  4. Design the main 6 schematics for testing.
  5. Prepare IRB documents.
  6. Create the inventory of tactile graphics with cataloguing in order of PComp labs
  7. CITI Investigators Common Rule training/Refresher course.

Phase 3 | Rapid Prototyping 2/26/19-  3/12/19 |

  1. Define tasks for testing.
  2. Write user testing script.
  3. Go through Emily Lin’s itemized feedback and apply to Style Guide
  4. Continue to refine Style Guide
  5. Finish Cayuse submission
  6. Attend NYU IRB info session on 2/26 from 2-4pm
  7. Update Usability Testing questions
  8. Test with Krizia
  9. Prepare binder of printed tactile graphics for testing.
  10. IRB approval

Phase 4 | User Feedback | 3/12/19- 4/2/19 |

  1. Make a doc of designs: me, Emily, Krizia, side by side
  2. Make a questions list for Chancey
  3. Write user testing script
  4. User test Style Guide again with another designer (Azalea)
  5. Confirm feedback meeting/schedule user test date with Chancey
  6. Contact Research and Development at the NFB to connect with a user test population.
  7. Contact Josh Miele, Ken Perry of the APH for design feedback
  8. Design a Grove Shield schematic for Chancey Fleet and her Arduino group
  9. User testing on NYU campus
  10. Debrief by listing the most serious issues.
  11. Order the issues by how serious they are- fix the top ones first.

Phase 5 | Iteration | 4/2/19- 4/16/19 |

  1. Repeat Phase 3 and 4 as many times as necessary to optimize the graphics for a larger user set.

Phase 6 | Implementation | 4/23/19- 4/30/19 |

  1. Prepare presentation of designer’s journey.
  2. Print and bind a book of the completed tactile graphics.
  3. Build an online hub that includes:
  • Style guide
  • Workflow guide
  • Research abstract
  • Downloadable book of all the finished tactile graphics.

Leave a Reply

Your email address will not be published. Required fields are marked *