Fees that use a placeholder product (like order-level fees or fees bundled with other fees) need to be published to the Online Store. This is required for the app to apply the fee.
If your fee is set to type ‘Product’ and is bundled directly with the product it applies to, it doesn’t use a placeholder and isn’t published to the Online Store by default.