Okay, here's an update. I called him, we talked, he apologized to me. He says he's working a lot, on a couple of projects simultaneously, he's burdened with work. I asked him politely to turn me down if he doesn't want me, and he told me it's not about that. He claims he'd rather stay and talk to me than go back to work.