Pilot Testing

Pilot testing is what you do prior to collecting data you will ultimately analyze in an experiment. This is an iterative process that typically begins as you're writing your stimulus program, and carries through to first behavioural testing with other people (e.g., friends or lab volunteers), then a full run-through using the neuroimaging system.

Pilot testing is essential and can take a lot of time. It is a critical step in de-risking your study, so that by the time you are using a neuroimaging system you are not wasting resources (including participant time, your time, EEG disposables, MRI scan fees, etc.). While many people think of pilot testing as focused on running through the stimulus program and colelcting data, an essential (but not always obvious) component of pilot testing is reviewing the data that are generated, and running them through preprocessing/analysis pipelines. This ensures that not only does the experiment seem to run right, but that the data that result contain all the information you need, and can be analyzed as you plan.

In general, you should have REB approval for your study before engaging in pilot testing with individuals other than yourself. This can be a bit of a grey area, because the TCPS guidelines allow for "quality assurance" testing without REB approval. However, if human participants are being subjected to proceudres intended for a research study, it's best that those procedures have been reviewed and approved by a REB. Please discuss this with Aaron if you are the point of pilot testing and do not yet have REB approval for your study.

Last updated