Collaborative review of pilot projects to inform policy: a methodological remedy for pilotitis?

Abstract

Background: In rural health and other health service development contexts, there is frustration with a reliance on pilot projects as a means of informing policy and service innovation. There is also an emerging recognition that existing research methods do not draw lessons from the failed sustainability that characterises many of these pilots and demonstration projects. Discussion: This article describes critical aspects of the methodology of a successful collaborative, multi-method, systematic synthesis of exemplary primary health care pilot projects in rural and remote Australia, which synthesised principles from a number of pilot projects to inform policy makers and planners. Hallmarks of the method were: the nature of the source materials for the research, the subsequent research engagement with the actual pilot projects, the extent of collaboration throughout the study with end-users from policy and planning arenas, and the attention to procedural quality. Summary: The methodology, while time consuming, has resulted in applied, policy-relevant findings, and evidence of consideration by policy-makers.