You can customize the favicon site-wide for a course.
Edit your course
Open
Step 1: Basic Course InfoUpload an ICO file to the Site Icon area
Note: An ICO file is the only file type that will work for your favicon.
You can create an ICO file using this site here.