There is a large related recent literature both in NN and specific domains, for instance object recognition. Key words are "hints", "virtual examples", "speaker adaptation", "virtual views", "recognition invariants".