You can create a black page image and use that as a background image for the first page of each chapter. You would set it up as if it were a picture, but it would just be a solid color.
There are detailed steps for adding a background image in this tutorial: https://www.atticus.io/create-a-custom-theme/
It will only work for the first page of each chapter, not all pages in the book.