It's totally not insensitive of you, there's no reason you should keep track of where everyone is. And it's a sadness we have learned to live with in our fannish lives for the most part, it is just a SHAME.

I am dreading the wait for season 2 and we haven't even finished this one yet. A rewatch will definitely help.