I always thought when he sang "I sing this song to you, wherever you are" and there "I sing this song to you, whoever you are", it's not to the person in question the song is about, rather to the people listening to the album/the fans/whomever. Like him saying "I'm down, this is what happened, Im telling you this whoever this is listening to the album" etc. At least that's how I pictured it.