To add a new chapter, click the "Add new chapter" button located at the bottom of the Left Navigation Pane.
This button also includes three dots on the right side. Clicking those dots will expand a new menu where you can choose from a variety of formats for pages for front and back matter, add Full Page Images, or upload a .docx to a book you’ve already started.