The gunman’s ‘militancy and excitement’ increased as Australian far-right groups grew bolder, a new book suggests