You can use custom rules to hide Arrives By for products.

Uncheck "Show Arrives By" to hide Arrives By for all products that belong to the rule.

You can also hide Arrives By by default in the "Settings" section of the app. This way, Arrives By will only display for products that are enabled by a custom rule.