"There was often a feeling that without ‘concrete evidence’ or a specific allegation from a child nothing could, or should, be done", said the chief investigator.