Every push has a settings button. You have to click on that settings button and remove the website from the permission page.
This answer explains how to unsubscribe from push notifications in case your Shopify store customers contact you with this question.
Written by Tom
Updated over a week ago