Assignment: Passwords
For this assignment, your goal is to collect data about how multiple people use and don’t use password managers, and then use the data you collected to make design recommendations for improving a password manager.
You can do this by yourself or you are allowed to work with a partner from class. When working with a partner, you both must submit the same thing to Canvas, and both members will receive the same grade.
The goal in this assignment is to do some user research that will help inform the design of password managers. Right now, there is speculation that password managers are confusing and not easy to use, and that is why people don’t use them. Your goal is to collect user data that will hopefully allow you to (re-)design one or more features of a password manager. To do this, you will need to choose one (or more) password manager to focus on, interview at least one user of that password manager, interview at least one non-user (someone who doesn’t use it right now), and then create some design recommendations based on those interviews.
Part 1: Competitive Analysis: Identify one or more password managers to focus on
There are multiple password managers on the market right. Some are just a feature of a larger product, such as the password manager built into Google Chrome. Some are standalone products such as LastPass or 1Password.
The first task is to identify a range of different password managers and look at their security and usability features. What features do all password managers have? What features are different between password managers? Which features are most important in a password manager?
You should be able to gather the infomation you need by looking at websites and reading review articles. Use this information to build a table that summarizes what you see as the major features and which password managers have what features.
-
Make a list of the major password managers. Be sure to include different types of password managers (e.g. built-in, standalone, plugins, mobile apps, etc.) Also consider other apps that can be repurposed to be a password manager (e.g. Excel / Google Sheet spreadsheet)
-
Read reviews of password managers to identify what the most important features of password managers are. Use your personal experience and judgement to identify features that are important. An example of a review can be found on Wirecutter
-
Create a table to map out which password managers have which features. Put features as rows and password managers as columns.
-
Use product websites and the reviews you found to fill in the table – which password managers have which features?
Finally, choose one (or possibly two) password managers to focus on.
Part 2: Understand Users and How they Use Password Managers
Next, you need to collect data to understand how people use password managers. What kinds of things do they use them for? Do they generate random passwords instead of memorizing them? Or just get the manager to save already-memorized passwords? Do they type in passwords or do they use some form of cut-and-paste? Do they use browser integration? How do they save passwords? And, above all – WHY? Why do they do things this way?
To do this, you will need to conduct at least 1 contextual interview with a current users of your choosen password manager. You should follow the same basic steps as the first assignment:
-
Find someone who is a current user of your chosen password manager. This should ideally be someone that you don’t know or at least don’t know very well.
-
Arrange to be able to watch them use their technology (computer, phone, tablet – whatever they normally use). When you meet them, be sure to get their informed consent to participate in this project.
-
Ask them to log in to multiple websites. They should use their password manager to log in. Note: Be sensitive here; passwords are secret information. You don’t need to know their password to understand how they use a manager. Don’t try to see or write down their passwords, and be clear with your participant that you will not record their actual passwords.
-
Watch them and take notes. What website do they use the password manager on? How did they use it – what specifically did they do? Did it work smoothly, or were there frictions or other problems that made it not work right?
-
Ask them questions about their use of password managers. You should prepare a list of questions ahead of time. What do you want to know about how they use their password managers? Are their aspects of password manager use (e.g. creating a new password) that you can’t observe as part of the observation phase?
You will need to take detailed notes about the answers to these questions.
Immediately after the interview is over, be sure to take more notes – record anything you remember about how they used the password manager, why they did what they did, anything they said you think is interesting, and your own personal thoughts and opinions about their use. Basically, write down anything that might possible be helpful in the future when you try to improve the design. Pay particular attention to things that worked well for the participant (so your recommendations don’t screw those up) and things that worked poorly, caused problems, or that the user complained about (because those are places where there is room for improvement).
Later, read through your notes and try to identify findings: what are the interesting and important things that you learned from watching this user and talking to them? What is working well for them? What is not working well? How does this password manager fit into their life? What are the challenges they have?
Part 3: Understand Non-Users
Next, you will also need to interview at least one non-user – someone who might reasonably decide to use your chosen password manager, but currently has chosen not to. This can be someone who doesn’t use any password manager, or someone who uses a different (competing) product.
Because this person is a non-user, it will not be possible to do a contextual interview where you arrange to watch them use the a password manager. Instead, you should focus on trying to observe them doing the types of activities (e.g. logging in, creating passwords) that a password manager might help with.
Part 4: Make Design Recommendations
Imagine that you have been asked by the company that made your chosen password manager for advice for how to improve the design of their password manager. What new features should they prioritize? What current features do they need to change?
What would you say to them? Try to identify specific, actionable, concrete advice that you could give to the company.
All advice you give must be connected back to your data. If you recommend they add feature X, then describe something that your user did that could be made better by feature X. If you recommend changing feature Y, then describe how your non-user didn’t like feature Y and how changing it would alleviate their concern.
DO NOT just pontificate or give them a wish list of features YOU want. Make sure that all of your recommendations reflect actual user feedback and concerns. If you can’t connect your recommendation to your data, then don’t make the recommendation.
Write Report
Finally, you should write a report that contains all of your findings. Pretend that the company that makes your chosen password manager has hired you as a consultant to provide ideas, advice, and recommendations to them for improving their product. Write a report that you could deliver to them.
The report from your would should contain:
-
The table with the competitive analysis of password managers, highlighting the chosen password manager you are studying.
-
Findings from your contextual interview with a user of that password manager. What were the major things you learned from this user – what worked and what didn’t?
-
Findings from your interview with a non-user of that password manager. Why don’t they use it? And what might change their mind?
-
Specific, actionable recommendations for improving the design of the password manager, along with a justification for why you are making each recommendation and the data that led you to believe this was a good recommendation.
The report should be relatively short; it can probably be as few as 2-3 pages, though can be up to 6 pages long. It should begin with a 1 paragraph “Executive Summary” that summarizes the most important findings and/or recommendations.
Your report should also include an appendix that includes:
a. All sources of information (with links) that you used for your competitive analysis.
b. Your notes (with any sensitive / personal information redacted) from both interviews
The appendix does not count as part of the page limit.
Due: Thursday October 16, before class