TO PRODUCT DEVELOPMENT.
Developing products and services users love is easier said than done.
Much more than brainstorming and making ‘best guess’ decisions. The development process involves extensive research and creating numerous hypotheses.
Adding Experiments to Product Development greatly improves success by validating ‘gut feel’ before investing extensive time and dollars..
This approach can sound convoluted to those yet to adopt experiments, but it should become a core part of your development process. Although going with ‘gut feel’ is tempting and often easier, rarely is it the safest option.
Experiments are not only quick and inexpensive, they indicate your likelihood of success. Therefore, help teams make insight based decisions instead of acting on assumptions.
Adding experiments to product development, is not as easy as it sounds. So we’re here to offer you some guidance. Steps you can adopt to get the most out of your product/service design experiments.
Step 1: Research, Research, Research
To find out what opportunities to develop, you need to gather and analyse relevant information.
You can do this in a variety of ways, but the most common techniques include:
- Usage tracking
- Direct observation
- Jobs to be Done
- Demographics (age, location, gender, etc.)
- User Personas (characteristics — interests, behaviours, habits)
- User Needs — Functional (tasks), Emotional (feelings), Social (status)
Step 2: Formulating Hypotheses
As a rule, you can consider your hypotheses valid if they correspond to the real world and have enough evidence to support them.
Before you move on to testing, you need to answer the following:
- Can your hypotheses be tested?
- Can your hypotheses be proven wrong?
Once hypotheses have been validated. Work with the team to select the highest priority. Be clear why you’ve chosen one over another.
Step 3: Designing Experiments
- Highest possibility of success
- Largest opportunity
- Ability to solve the biggest problems
- The purpose of the experiment and what will happen with the results
- Provide the user an authentic experience
- Clickable prototype mock-up
- Role play the User Journey
- Wizard of Oz
- Concierge service
- A/B testing
- Landing page sign-ups
Step 4: Running Experiments
Of course there are many ways to implement experiments to product development. Common techniques include:
- A/B testing
- Geolocation based
- Focus groups
- 3rd party service
- Off-brand public prototype
An “off-brand prototype” experiment is particularly useful for larger companies. The experiment runs without brand bias. Avoids damaging the brand if experiments fail ‘awkwardly’. Will also show customer/brand sentiment, if the branded release has contradictory results.
Specify the techniques you’ll use to capture insights. Technique may include note taking, video/audio recording, usage tracking and analytics. Focus on gathering as many insights as possible. Collate the evidence to assess results and reflect on actual vs predicted outcomes.
Consider the following questions…
It’s not just about users doing the experiment. There are more valuable insights to focus on, such as:
- How did they approach the experiment?
- What steps were taken?
- How many re-tries were necessary?
- Did they require support?
- How did the user feel emotionally?
- Did they display confidence when in use?
- Were the interactions predictable for the user?
- Did they follow up to find out more?
- Had they tried to find this solution before?
When the experiment has concluded, it is time to analyse the results. Consider:
- Does data validate or invalidate the hypotheses?
- What worked / What wowed?
- Areas to improve or remove?
- What could be integrated?
- How did assumptions measure up?
- Were there unexpected outcomes?
- Which delivered the biggest impact?
- Which results align with set goals?
- Did any experiment truly delight the users?
- Which one delivered mutual benefits?
- Do any results complement your existing roadmaps?
- What is the degree of implementation?
- Which adhere to your Product Principles
Aim to find the best fit between user needs, your objectives and results of the experiment. Experiments aligning all three should proceed to the next iteration of the solution.
As we said at the beginning of this article, our aim is to offer guidance. This is not a strict set of rules to abide by. Quite the contrary, we’re always interested in hearing your insights. Feel free to share your thoughts. We’d love to add the techniques you’ve used!