Is a survey a good start for a research project when you don't know much about the group you want to serve?

Is a survey a good start for a research project when you don't know much about the group you want to serve?

What experts say

"(...) a key message of this book is that a survey isn't my first choice of method when you really don't know much about the people you want to hear from. You'll be much better off starting with some interviews or finding a way to observe people doing whatever you are interested in, and then maybe consider doing a survey later when you know more about what you need from it."

— Caroline Jarrett, in the book Surveys That Work

My two cents

Interviews lead to unexpected learning

I like to start bigger research projects with interviews because interviews are not 100% scripted conversations. This means that people will often go in directions you didn't expect.

And if you are okay to improvise a bit, you can follow people further in those conversations and suddenly arrive at places you would never had the question that made people say that.

These days, when I go in an interview, I limit myself to one key question, as I know the rest will follow up naturally. This shows how much interviews are to me more like an exploration than a search for an answer to an exact question.

Surveys are great when you know are under time pressure

But yes, I know, interviews take a shit load of time. Especially the recruiting (even if that part can be outsourced pretty easily today to recruiting companies like TestingTime).

In projects where time is a big pressure, having a tiny bit of data is better than relying on just your assumptions. So, if the timing doesn't allow for interviews, surveys can still be a good starting point.

Q&A: Research in Service Design

Buy nowLearn more
  • How do I verify that there are enough people with this problem?
  • How to prioritize user research?
  • What are good structures for a prototype?
  • Does research in service design look like research in social sciences or market research?
  • How can I know if I have a good product/service market fit?

Mapping

  • How do you start a competition analysis for a new physical service?
  • What are tricks when creating digital maps with Google Maps for research?

Recruiting and compensation of research participants

  • How much should I pay research participants?
  • What are important elements to put in a screener?
  • Should feedback be free?
  • Should I use family and friends in my prototyping testing sessions?
  • How do you recruit users and testers?
  • What are the different ways to recruit research participants?

Research reports

  • How can you make your research age well?
  • How can I visualise complex ideas with simple forms?
  • What's a good structure for a research report?
  • What are examples of research reports?
  • What information should be included in a design report?
  • ▶️ What is a good structure for a slide that summarises a research report?
  • ▶️ What are different types of research insights?
  • Why do I make websites for some workshop reports?

Synthesizing research

  • ▶️ How to structure the synthesis or insights of user testings?
  • How to analyze interviews or research data?
  • What to do when I'm stuck in analysis paralysis?
  • How can I turn open questions into numbered data?
  • How do I choose the chart type to show my data?
  • ▶️ What do I do with all the research I've made?

Surveys for Service Design

  • How can I combine surveys and interviews?
  • Is a survey a good start for a research project when you don't know much about the group you want to serve?
  • How can I make street or door to door survey less akward?

Note taking during research

  • How do you take notes during user interviews?
  • Where can I find sample interviews to train my note-taking skills?
  • Should I collect more data?

Shadowing for Service Design

  • How can I speed up a shadowing session?
  • What can make or break a shadowing session?
  • What should I do after a shadowing session?