A flowchart of how our ten principles fit together. The flowchart starts with an online experiment idea. Principles 1 through 4 are, in order, Maximize the advantages; Plan for technical variability; Plan for behavioral variability; and Validate your experiment. At this point, researchers must decide whether the trade-off of pros to cons favors conducting the experiment online. The experiment then passes through: Recruit participants strategically; Instruct clearly; Make it engaging; Collect data comprehensively; Respect your participants; and Make it discoverable. This then loops back to a new online experiment idea, using all of the learnings to improve future experiments.
New preprint with @tsay.bsky.social. We synthesise the literature and our experience conducting sensorimotor experiments online to present ten principles for crowdsourcing human behaviour online, giving guidance on navigating the benefits and pitfalls of online testing
osf.io/preprints/ps...