He sees you in between things
He sees you on his way somewhere. He sees you before his main event for the evening. There is always something he has to do after seeing you. He never sets aside an unlimited amount of time for you, like a full evening or day together.