Yes, it can work if you’re using Shopify Plus and have access to checkout extensions.
The store need to be on the Growth Plan to unlock the checkout ui extension. Once the extension is added to the checkout, fees will be added just like they are in a regular store.
There is no support for displaying fee information on the product or cart page of a headless store.