You need to speak to him and state that it's a private conversation. You don't need to state it's about his performance, just that it's private and not sprint related.