Use separate bathrooms
If you have more than one bathroom, have a strict rule that you two are to stay to separate bathrooms. Do not go in his bathroom for any reason. If you realize you forgot your toothbrush in there, it’s time to just go buy a new toothbrush. And do not let him get anything he needs from your bathroom. Deliver that to his door.