I agree, which is one of the reasons I don't believe it.Leaving aside the fact that all attempts to explain telepathy and related effects elecromagnetically have failed, it's a moot point whether finding a physical explanation for hauntings would remove it from the realm of the spiritual.
I have seen and heard of instances where certain items which were undergoing some kind of stress were able to act similar to a phonograph, recording sounds which occurred around them during that period of stress. I would guess that something similar could happen with electromagnetic impulses. But this is a physical process, not a spiritual one.The fact that I started the post by invoking a theory which I stated I didn't believe in, and then referenced an idea I put forward in a work of fiction, should have made it clear that I was playing with ideas and not putting forward hard theories.
This is the best reason in the world to suspect this idea. Without actually having objective, reproducible evidence, you can make up anything that feels or sounds good and claim it to be true. Can you envision a mechanism that allows some kind of memory of our consciousness to cling to atoms? Can you demonstrate it? Or can you at least come up with something that would show it to be false? Without those things, it's just speculation and wishful thinking.