{"id":3168,"date":"2026-03-31T08:12:16","date_gmt":"2026-03-31T07:12:16","guid":{"rendered":"https:\/\/blogs.manchester.ac.uk\/itl\/?p=3168"},"modified":"2026-04-20T11:25:22","modified_gmt":"2026-04-20T10:25:22","slug":"how-to-test-and-learn","status":"publish","type":"post","link":"https:\/\/blogs.manchester.ac.uk\/itl\/2026\/03\/31\/how-to-test-and-learn\/","title":{"rendered":"How to test and learn?"},"content":{"rendered":"

[et_pb_section bb_built=”1″ admin_label=”section” fullwidth=”on” next_background_color=”#000000″ global_module=”322″][et_pb_fullwidth_menu global_parent=”322″ _builder_version=”3.0.106″ menu_id=”7″ submenu_direction=”downwards” fullwidth_menu=”off” background_layout=”dark” module_class=”main-navigation” \/][\/et_pb_section][et_pb_section bb_built=”1″ fullwidth=”off” specialty=”on” prev_background_color=”#000000″ next_background_color=”#1d1d1d”][et_pb_column type=”2_3″ specialty_columns=”2″][et_pb_row_inner locked=”off”][et_pb_column_inner type=”4_4″ saved_specialty_column_type=”2_3″][et_pb_post_title _builder_version=”3.17.6″ featured_placement=”above” locked=”on” parent_locked=”off” featured_image=”off” comments=”off” \/][et_pb_text _builder_version=”3.17.6″ background_layout=”light” parent_locked=”off”]<\/p>\n

\"\"<\/p>\n

Sarah Dyer is Manchester\u2019s Associate Vice-President for Teaching Excellence and Innovation. She is a social scientist whose disciplinary research has explored work, expertise, care, and ethics. Drawing on these interests, her scholarly work has focused on courage and compassion in teaching and learning, partner-enabled learning, and human-centred design in HE. She based in the Manchester Institute of Education.<\/p>\n

\u00a0<\/p>\n

\u00a0<\/p>\n

\"\"<\/p>\n

Iria Lopez specialises in Human-Centered Design and Service Design and works as an independent consultant. She has worked in design and innovation for 20 years, focusing on Higher Education over the past five years. She led the introduction of design sprints for curriculum development at the University of Leeds for three years and has collaborated with King\u2019s College London and London Business School. Previously, she worked in digital transformation for government, local councils, and international development agencies. You can find Iria on linkedin<\/a>.<\/p>\n

How to test and learn?<\/strong><\/h2>\n

\u201cWe will make it normal to test, learn and adapt openly.\u201d<\/em><\/p>\n

The Manchester University 2035 Strategy Delivery Handbook<\/em><\/p>\n

\u00a0<\/em><\/p>\n

Given that we are used to experimenting and reviewing evidence in universities, the intention to make it normal to \u2018test, learn, and adapt\u2019 may not feel particularly radical. We have familiar and practiced approaches to review and improve what we do: degree programmes, assessments, services, and students\u2019 learning experience. Annual review cycles, surveys, and committees are the rhythm of the academic year. Piloting innovations is part of institutions\u2019 muscle memory.<\/p>\n

But here\u2019s the thing, however familiar \u2018test and learn\u2019 seems in principle, however reassuringly recognisable the terms, testing and learning through a human-centred design (HCD) lens is mostly unfamiliar in practice. It requires adapting how we work; adopting new approaches and indeed mindsets. In this blog we explore the difference between how \u2018test and learn\u2019 is traditionally understood in Higher Education and what it would look like with a human-centred design framing. We begin by outlining how HCD \u2018test and learn\u2019 differs from our familiar ways of working. We then introduce a tool which may help support this new way of working, providing a worked example from our own work.<\/p>\n

What is human-centred design test and learn?<\/h5>\n

Traditionally, universities run pilots once a proposal is largely defined. For example, a new course unit, skills framework, or assessment approach is trialed with one cohort for an academic year. Often these pilots are run in areas where there is an enthusiasm to be involved, rather those which are somehow representative. These pilots usually involve significant investment of time and resources and are often treated as near-final versions of the initiative. At this point, there is a lot at stake.<\/p>\n

In human-centred design, \u2018test and learn\u2019 comes before any pilot and is a strategy to de-risk innovation. Rather than piloting the whole initiative, we first test and adapt key elements of it through small, low-risk activities. These tests might last two weeks or just an afternoon. As an example, let\u2019s imagine we want to develop students\u2019 ability to articulate the skills they are learning. We have seen others provide students with a skills audit framework to use. Any initiative requires students to understand a list of skills. An appropriate \u2018test\u2019 would be of what these students\u2019 understand when presented with a list of skills. To test that, we could conduct a quick feedback session, with only three or four students, asking:<\/p>\n

\u201cCan you explain to me what you understand from this list of skills? How would you explain this list of skills to a friend of yours?\u201d<\/em><\/p>\n

While someone teaching these students might have a sense of what they are likely to say, explicitly asking outside of the context of actual teaching means these assumptions can be tested. The responses enable an adjustment to the content of a skills audit or even to assess if it makes sense to distribute such document at all. Such a test also supports wider adoption of successful innovations. Because the assumptions are made explicit and empirically tested in context, these assumptions can be reviewed and tested in any new context too.<\/p>\n

Once the different elements of the planned initiative have been tested, then a pilot provides wider representation. This means that quick \u2018test and learn\u2019 rounds do not replace the more traditional pilots, but instead help us to ensure pilots have the best chance of being successful. Moreover, when we pilot without previously gathering feedback on the elements that constitute the pilot, it is harder to understand what<\/em> caused a pilot to struggle as many variables have introduced at once. Smaller contained tests can help surface risks earlier and more clearly.<\/p>\n

Where can we apply a quick \u2018test and learn\u2019 approach?<\/h5>\n

Human-Centred Design is a set of tools and methods. It is also a mindset that values experimentation and learning and a \u2018muscle\u2019 that gets stronger with practice. It\u2019s a more experimental way of working that can be applied as much to how meetings are run, how decisions are made, how staff and students collaborate, as to \u2018Innovation\u2019. We can test: a different agenda structure, an asynchronous activity before a meeting, the different use of space or facilitation techniques, or a new way of working together after the meeting. These are all great places for \u2018testing and learning\u2019.<\/p>\n

A tool to support \u2018test and learn\u2019<\/h5>\n

Highlighting \u2018test and learn\u2019 approaches as quick and low stakes risks them being undertaken without real clarity about what is being tested. \u2018Quick\u2019 can easily be misinterpreted as without attention to detail or without a clear method. To mitigate these risks, in the Student Change Lab<\/a>, we have been using hypothesis-driven test and learn. When we use the word hypothesis here, we mean our assumptions about what we might do differently to change outcomes. By making these assumptions and our rationale explicit, it helps us to more intentionally define the tests we will run.<\/p>\n

We have been using this hypotheses template to help define the tests we have been running in the Student Change Lab. We are sharing it as a tool to help you guide others\u2019 thinking. And we would love to hear whether it is useful for others.<\/p>\n

\u00a0<\/p>\n

\"Image<\/p>\n

\u00a0<\/p>\n

Members of the University can download the template\u00a0here<\/a>.<\/p>\n

We would like to share an example of using this tool applied to how we collaborate with student representatives.<\/p>\n

A worked example<\/p>\n

The example below comes from our work in The Student Change Lab, where we have been experimenting with using human-centred design approaches with student academic reps.<\/p>\n

What is our hypothesis?<\/h5>\n

We developed these hypotheses after discovery research where we spoke to those involved in Student Voice\/ Staff Student Liaison Committees, academic reps, the Students Union, PS staff, and academics, as well as attending meetings to observe.<\/p>\n\n\n\n\n\n
\n

What is the hypothesis?<\/p>\n<\/td>\n

\n

What are we trying to solve?<\/p>\n

(insights or observations that justify our hypothesis)<\/p>\n<\/td>\n<\/tr>\n

\n

We believe that supporting student academic reps to run participatory whole cohort sessions using human-centered design tools (such as journey mapping),\u00a0 will increase student engagement because these are participatory tools.<\/p>\n<\/td>\n

\n

Academic reps tell us that they sometimes find it hard to engage their peers when they are gathering feedback and that they often get quite low responses to surveys they create.<\/p>\n<\/td>\n<\/tr>\n

\n

We believe that the use of HCD tools will make it easier to interpret root causes, making it easier for committees to understand the problem we are trying to address<\/p>\n<\/td>\n

\n

In our observation of Staff Student Liaison\/Student Voice committees often spend a long time interpreting feedback that is provided via a survey<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

\u00a0<\/p>\n

What initiative will allow us to test the hypothesis?<\/h5>\n

Our \u2018test and learn\u2019 involves working with one year of one programme in two whole cohort timetabled sessions. The experiment was designed with the years\u2019 student academic reps, the programme director, and the academic year manager. The student academic representatives receive training to introduce journey mapping and light touch training on how to facilitate their peers creating journey maps in small groups. We then ask them to use journey mapping on their own to collect feedback and present the output to their Student Voice Meeting.<\/p>\n

How exactly do we expect this initiative to affect change?<\/p>\n

We expect that the training will enable reps to run participatory feedback events:<\/p>\n\n\n\n\n\n\n
\n

Change<\/strong><\/p>\n<\/td>\n

\n

Expected impact<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

From individualised to whole cohort feedback opportunities.<\/p>\n<\/td>\n

\n

Feedback given represents more diverse experiences.<\/p>\n<\/td>\n<\/tr>\n

\n

From feedback collected using surveys, to feedback collected using journey mapping.<\/p>\n<\/td>\n

\n

Feedback covers a narrative with a story that help us make sense of why the students had a particular experience.<\/p>\n<\/td>\n<\/tr>\n

\n

From survey analysis based only on summarising findings, to journey mapping analysis based on group discussions.<\/p>\n<\/td>\n

\n

Analysis process encourages reflection to improve depth and how actionable feedback is.<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

\u00a0<\/p>\n

How will we know if those changes generate our desired impact?<\/h5>\n

The \u2018test\u2019 only leads to learning through light touch but systematic and evidence-based evaluation. In this case the evidence includes the views of those involved in the experiment and the project team\u2019s reflections.<\/p>\n

Simple indicators might include:<\/p>\n