To me it means that every story about a great love is haunted by the beloved. They hang over the story, and the fact of the story, like a ghost. Any story set in the past involves people who no longer exist because they've since grown with the passage of time. So the people-who-used-to-be are ghosts over the writer and reader. Just one idea.