Psychology Dissertation Pilot Study: Complete Guide

Psychology dissertation pilot study planning tests whether your proposed research process can work before you commit participants, time, and data to the main study. A useful pilot is not a miniature hypothesis test. It is a structured rehearsal with explicit feasibility questions, recorded decisions, and ethical safeguards.

This guide explains how to define pilot objectives, choose a defensible sample, test quantitative and qualitative procedures, set progression criteria, analyse feasibility evidence, and report changes transparently. The examples apply internationally, but your programme handbook, supervisor, ethics committee, and applicable law always take priority.

What is a psychology dissertation pilot study?

A pilot study runs all or part of a planned study on a smaller scale to learn whether the future study is workable and how it should be improved. The central questions are practical: Can recruitment reach suitable participants? Do people understand the instructions? Does the task run reliably? Is the burden acceptable? Can the data be exported, scored, and analysed as planned?

Eldridge and colleagues place pilot studies within the broader family of feasibility studies. A feasibility study asks whether a future study can and should proceed, and how. A pilot additionally rehearses the future study, or part of it, on a smaller scale. This distinction prevents “pilot” from becoming a label for any small or underpowered project.

A pilot should serve the design described in your psychology dissertation methodology. If there is no credible main-study decision that the pilot evidence will inform, the extra participant burden may not be justified.

Pilot study, feasibility study, pretest, and main study

These activities can be combined. A questionnaire project might begin with expert review, use cognitive interviews to investigate interpretation, and then pilot the entire online journey. Describe each activity by its actual purpose rather than calling every preliminary check a pilot.

Decide whether a pilot is needed

Piloting is especially valuable when the study uses a new or adapted measure, unfamiliar population, complex eligibility route, translated material, experimental manipulation, timed cognitive task, sensitive topic, multiple data sources, recording technology, or a process that could fail silently. It can also test whether recruitment and completion are realistic within the dissertation period.

A separate participant pilot may add little when you are analysing a fixed secondary dataset, conducting a literature-based dissertation, or using a thoroughly established procedure without adaptation. Even then, a technical dry run can test code, extraction forms, file naming, or analysis syntax without recruiting people.

Do not run a pilot simply because the obtainable sample is small. Thabane and colleagues stress that limited funding, student status, or a small single-centre sample does not by itself make a project a pilot. A pilot needs specific feasibility objectives and an intended future study or decision.

Turn uncertainties into pilot objectives

Begin with uncertainties that could stop, delay, bias, or weaken the main study. Convert each uncertainty into an observable feasibility outcome and a decision. “Check the survey” is too vague. “Estimate the proportion of eligible participants who complete all primary measures and identify the main causes of break-off” is actionable.

Use a limited set of primary feasibility objectives. Secondary checks can still be recorded, but a long list without priorities makes the final progression decision arbitrary.

Set progression criteria before collecting pilot data

Progression criteria connect evidence to action. They should be justified by the minimum conditions needed for the main study, not chosen to guarantee a green result. A traffic-light structure is often useful:

• Proceed: the process meets the pre-agreed feasibility standard.
• Modify: the study remains possible if named changes are made and approved.
• Stop or redesign: the barrier is too serious for the current design, resources, or timeline.

For example, a sleep-diary project might proceed if most pilot participants provide the minimum number of valid diary days, modify if technical reminders improve missing entries, and redesign if the device cannot record timestamps consistently. Thresholds depend on the study. Avoid copying recruitment or retention percentages from an unrelated clinical trial.

Not every decision should be reduced to one percentage. A serious safeguarding problem, systematic misunderstanding, inaccessible interface, or corrupted data export can outweigh a high completion rate. State which criteria are decisive and how qualitative evidence will contribute.

Plan ethics and governance before piloting

A participant pilot is research activity, not a private practice run. Consent, privacy, distress, deception, compensation, withdrawal, safeguarding, and data security may matter just as much as in the main study. Do not recruit or collect identifiable data until the required institutional approval is in place.

Include the pilot in the ethics application when required. Explain what is being tested, what participants will experience, what data will be retained, whether pilot data could enter the main dataset, and how changes will be reviewed. If a pilot reveals a materially different risk or procedure, seek the amendment or new approval required by your institution before continuing.

Participants should receive an accurate explanation of the study’s preliminary purpose. Do not imply that the pilot will necessarily lead to a larger study. The psychology dissertation ethics guide provides a fuller risk and consent workflow.

Choose a pilot sample that answers the feasibility questions

There is no universal pilot sample size. Choose it according to the information needed, the precision required for key feasibility outcomes, the diversity relevant to comprehension or acceptability, the number of study conditions, and available ethical resources.

For a quantitative process outcome, justify the sample using the precision of the estimate when feasible. A completion proportion based on a very small pilot will be highly uncertain. Report the numerator, denominator, and confidence interval rather than presenting the observed percentage as a stable population value.

For cognitive interviews or qualitative pilot interviews, select people who can reveal important variation in language, experience, accessibility, or context. Sample adequacy depends on the purpose and richness of feedback, not a generic numeric rule. Iterative rounds can be more useful than one larger batch because revisions made after the first round can be tested in the next.

Match eligibility closely to the intended population. Testing a mobile diary with only highly experienced research students may conceal usability barriers affecting the main population. Document where the pilot sample differs and limit the conclusions accordingly. Our psychology dissertation sampling guide explains population and recruitment alignment.

Pilot the whole participant and data journey

Run the process from the first invitation to the final analysis-ready file. A link opening successfully says little about eligibility logic, consent, timing, debriefing, withdrawal, export, or scoring.

1. Test recruitment wording, access routes, and response tracking.
2. Check information, consent, eligibility, and withdrawal steps.
3. Observe instructions, practice trials, task order, routing, and breaks.
4. Record duration, technical faults, missing responses, and requests for help.
5. Test debriefing, compensation, distress procedures, and researcher contact.
6. Export data, preserve a raw copy, apply coding rules, and run the planned analysis workflow.
7. Ask participants what they thought was happening and where they felt uncertain.

Use realistic devices and settings. If the main study is remote, test common screen sizes, browsers, internet interruptions, audio permissions, and return-from-break behaviour. If the main study is in a laboratory, rehearse room setup, equipment calibration,

Pilot different psychology dissertation designs

Survey and questionnaire pilot

Test item comprehension, response options, recall periods, routing, required fields, mobile display, completion time, and scoring. Use cognitive interviewing when an answer could hide misunderstanding. A tidy dataset cannot show whether participants interpreted “regular exercise” in the same way.

Do not claim that a small pilot validates a new questionnaire. Reliability and validity require several forms of evidence and suitable samples. See the guides to psychology dissertation survey design and reliability and validity.

Experimental and cognitive-task pilot

Rehearse random allocation, counterbalancing, practice trials, stimulus timing, manipulation delivery, attention checks, outcome recording, exclusions, and debriefing. Examine whether the manipulation is understood without treating a small significance test as proof that it works.

Ask whether the control condition is credible and whether unintended differences could explain responses. A pilot of an online inhibition task might reveal that keyboard lag varies across devices, requiring a compatibility restriction or a different task before the main study. The experimental design guide covers causal alignment in more detail.

Qualitative interview pilot

Check whether prompts are open, neutral, understandable, and capable of eliciting material relevant to the question. Observe where participants need clarification, where the sequence feels abrupt, and where a sensitive prompt needs stronger preparation or support information.

Review the recording, transcription, anonymisation, and secure-transfer process. Note how the interviewer’s assumptions shaped follow-up questions. If the pilot interview contributes rich material and the procedure remains unchanged, inclusion in the main dataset may be possible only when consent, ethics approval, and the analytic plan support it.

Mixed-methods pilot

Test each strand and the connection between them. Confirm that identifiers can link datasets safely, that the timing of one strand informs the next as intended, and that qualitative follow-up can explain the quantitative pattern. A pilot that tests two separate tools but ignores integration misses the defining challenge of mixed methods.

Analyse pilot data for feasibility, not discovery

Begin with the prespecified feasibility outcomes. Report counts, denominators, rates, timing summaries, missingness, technical faults, protocol deviations, and uncertainty. Use plots or distributions to identify floor effects, ceiling effects, extreme duration, or unexpected response patterns, but do not turn every pattern into a new hypothesis.

Qualitative feedback can explain why a process failed or succeeded. Summarise recurring comprehension problems, burden, acceptability, contextual barriers, and suggested repairs while preserving important minority experiences. A single accessibility failure can justify change even when most users report no difficulty.

Pilot estimates of a substantive effect are unstable and can mislead a power calculation. Thabane and colleagues recommend caution when using small pilot estimates of effects or variances. Combine pilot information with relevant prior evidence, acknowledge uncertainty, and use sensitivity analyses rather than selecting the most convenient estimate.

Decide whether pilot data can enter the main study

Do not decide after seeing whether inclusion improves the result. Plan the rule in advance. Combining data may be inappropriate if measures changed, instructions were rewritten, participants learned the hypothesis, eligibility changed, software faults affected records, or the pilot lacked the approval and consent needed for main-study use.

An internal pilot is designed as the first stage of the main study, with compatible data retained when prespecified conditions are met. An external pilot is separate, so its outcome data are normally not part of the main dataset. These trial terms can guide thinking, but student projects should use the definitions and governance rules accepted by their institution.

Keep a version log. Record what changed, why, when, who approved it, and whether the change affects comparability. Update preregistration, study documents, and ethics materials when required. The preregistration guide explains how to preserve planned decisions and disclose deviations.

Worked psychology pilot example

Imagine a dissertation examining whether a brief self-compassion exercise is followed by lower state anxiety before a simulated presentation. The main design is an online randomised comparison with a neutral audio condition.

1. The student identifies feasibility uncertainties: audio playback, condition concealment, task completion time, anxiety-scale display, participant distress, and data export.
2. Primary pilot outcomes are the proportion completing both audio and outcome items, median completion time, technical-failure count, and any safeguarding trigger.
3. Progression rules are agreed before recruitment, including a rule that any failure of the distress route requires repair and rechecking.
4. Participants meeting the intended eligibility criteria complete the full journey on varied devices and provide structured feedback.
5. The pilot reveals that phones lock during audio playback and that one debrief link is unclear. The platform and wording are changed.
6. The student reruns technical checks, updates the protocol and approved documents, and excludes pilot outcome data because the delivery process changed materially.
7. The dissertation reports feasibility results and changes without claiming that the small anxiety-score difference demonstrates effectiveness.

This pilot succeeds because it protects the main study from known failure points. Success is not defined by a statistically significant anxiety difference.

Report the pilot transparently in your dissertation

In the methodology, explain the rationale, objectives, sample, procedure, feasibility outcomes, progression criteria, analysis, ethics approval, and rule for pilot-data inclusion. In the results, report participant flow, denominators, uncertainty, faults, deviations, feedback, and the progression decision. In the discussion, explain what changed and what uncertainty remains.

If the pilot was completed before the dissertation main study, a concise subsection and change table may be enough. If the pilot is the dissertation’s principal study, the title, questions, analysis, and conclusion should remain focused on feasibility. Use the CONSORT extension when the work is a randomised pilot or feasibility trial, while recognising that not every psychology pilot is a trial.

Common pilot-study mistakes

• Using “pilot” to excuse a small sample. Define feasibility objectives and the future decision.
• Testing the main hypothesis. Focus analysis and conclusions on feasibility.
• No progression criteria. Agree decision rules before observing results.
• Testing only the questionnaire page. Rehearse recruitment through data export and debriefing.
• Recruiting an unrepresentative convenience group. Include people who can expose relevant barriers.
• Ignoring ethics because it is preliminary. Obtain the review and consent required for pilot activity.
• Changing the protocol silently. Keep versions and update approvals or registration.
• Pooling data opportunistically. Predefine whether compatible pilot data may be retained.
• Calling one pilot validation. Match claims to the evidence actually collected.
• Reporting only what worked. Faults and abandoned routes are often the most useful findings.

Psychology dissertation pilot study checklist

• The pilot has a clearly identified future study or design decision.
• Primary feasibility objectives are observable and limited in number.
• Progression criteria and decisive safety rules were set in advance.
• The sample reflects relevant features of the intended population.
• Ethics approval, consent, privacy, and distress procedures are appropriate.
• The complete participant and data journey is tested.
• Technical, accessibility, scoring, export, and storage checks are recorded.
• Analysis prioritises feasibility outcomes and uncertainty.
• Pilot effect estimates are not treated as confirmatory evidence.
• The rule for retaining pilot data is justified before the main analysis.
• Every revision is logged and authorised where necessary.
• The dissertation reports both problems and successful processes.

Frequently asked questions

How many participants should be in a psychology dissertation pilot study?

There is no universal number. Base the sample on the feasibility outcome, required precision, study conditions, population diversity, and purpose of qualitative feedback. Explain why the chosen sample can inform the intended decision and acknowledge uncertainty.

Can a pilot study test my dissertation hypothesis?

A pilot can confirm that planned variables and analyses are operational, but a small pilot is usually not designed to test the substantive hypothesis. Emphasise feasibility, not statistical significance or a definitive effect.

Do I need ethics approval for pilot interviews or surveys?

Often yes, because people, sensitive experiences, identifiable data, and research risks may be involved. Requirements differ. Follow your institution’s review process and do not assume that calling an activity a pilot exempts it.

Can pilot participants join the main study?

Possibly, if the protocol, eligibility, consent, approval, and analysis plan permit it and exposure to the pilot does not bias later responses. Exclude or separate them when procedures changed materially or they learned information that compromises the main design.

What if the pilot shows that the main study is not feasible?

That is an informative outcome, not a failed pilot. Report the evidence and decide whether to stop, simplify, change recruitment, change technology, narrow the question, or develop a different design with your supervisor and ethics committee.

Should I include pilot results in the dissertation?

Yes, when the pilot informed the final study or is the dissertation’s central feasibility project. Report objectives, sample, outcomes, limitations, changes, and the progression decision. Follow the structure required by your programme.

Conclusion

A psychology dissertation pilot study is a decision tool. It rehearses the research process, identifies practical and ethical barriers, tests the data pathway, and shows whether the main study should proceed unchanged, proceed with modifications, or be redesigned. Its credibility comes from clear feasibility objectives, justified sampling, pre-agreed progression criteria, transparent analysis, and an honest change record.

If you want ethical academic support, Psychology Dissertation Help can review your own pilot plan, feasibility matrix, progression criteria, or supervisor feedback. You remain the author and decision-maker, and any support should comply with your institution’s rules rather than replace required research work.

Authoritative references

• Eldridge et al. (2016), defining feasibility and pilot studies
• Thabane et al. (2010), a tutorial on pilot studies
• EQUATOR Network, CONSORT extension for randomised pilot and feasibility trials
• Center for Open Science, preregistration guidance
• American Psychological Association, Ethics Code