Yes, you can remove any set time block from your working hours.
How to remove a time block
Go to Edit availability
Locate the time block you want to remove
Click the trash icon next to that time block
Example of removing a time block
Save your changes
Click Save work hours to apply your updates
Once removed, that time will no longer be available for client bookings.