You can remove the logo from Theme Settings. Once an image has been uploaded, you'll be able to see a remove logo button underneath:

Please don't forget to republish your quiz to make sure the changes go live.