I know the middle of the night thing seems ridiculous, but I have to say I've noticed that. If I post during off-hours in North America, or over the weekend, or on a holiday, I will get fewer comments on whatever I've posted, fic or not. It doesn't make sense, but it's true. So go ahead and stress. ;)