It should be possible to create private notes or (even better) set a visibility for notes.