I think Giles was just projecting. He looks at Spike, there's animosity, he senses in his gut that something's just plain wrong... and since he's Spike's daddy all of a sudden and taking shit for it, he fills in disappointment in the emotional blank.

Just as he convinced himself he was in love or at least lust with Anya, which (of course) he so wasn't.