Open your document, and hover between chapter sections — you’ll see a Choose Template button appear.
Click it to open the template modal, then select the Layouts tab. From there, you can browse available options using the filter pills, and hover over any layout to reveal the Add Chapter button.
