Well, that makes it either more or less awkward...but it sounds as though it is a conversation that needs to be had, and sooner rather than later.

[He stifles a yawn and a grumble.]

Otherwise, you risk having to give that explanation in the wake of said boundaries being inadvertently pushed.