Yep, I feel precisely that way at the moment about the guy I'm seeing and I'm trying not to be shallow (one of my more unfortunate attributes, even though I'm nothing to look at myself) - if the this guy was ridiculously hot I would be absolutely smitten. So I'm giving it a fair chance and seeing if a spark will develop.
Also - L O L. Oh my god, how rude! I would have replied, 'not at all!'. That kind of happened to me with another guy I never met but chatted to online - he didn't talk to me for like a week, after some half-hearted convos, and then a week later when he messaged I was like, 'oh, hello. Wasn't really expecting to hear from you again'. And he said, 'I was too busy to chat.' I said, 'I don't really mind either way, I'm just surprised'. Never heard from him again hahaha