If you're permitted to see your colleagues calendar, you'll be able to select which users you want to see in the calendar view. 

Click the funnel and select the users you want to see. Choose specific users or select a department.
​