he just can't seem to grasp the idea that if something is a casual comment, asking someone to repeat it over and over again is just going to kill the conversation.

If she can't hear what you said, or understand what you said, how is she supposed to know it's a casual comment? She can't read minds, Leonard.