If you're unable to say 'X was a great person to be around and I always enjoyed our interactions' without also adding that their output was fucking abhorrent, you're only telling half the story and you'd be better off saying nothing.