lost book

You lose your book that you write all your thoughts in, when someone finds it and writes in it, they can control you and your memories. How does this work in these people's favor and how do you escape this fate?