Author James Patterson, who was Jeffrey Epstein's neighbor in Florida, wrote a book critical of him