Booklice tend to hang out in windows as well as in the books that give them their name. Since they feed on molds, reducing the humidity that encourages mold growth is the simplest way to control these tiny, harmless pests. When you wiped the window sills with dilute bleach, you probably killed their food source.