Changing the section colour will change the colour displayed in the index and separator pages.
To do this, first open the section properties by right clicking the desired section and selecting "Properties".
You can then select a colour by clicking the dropdown next to the "Colour" setting.