Do customers need to maintain a list of wallet ids/auth tokens on their server to be able to insert items?

No need, unless you go full custodian mode.

If you want full custodian wallets you would need to. If you rely on Trinsic authorization you can skip this.

For issuers and verifiers this is different: you’ll likely want to keep track of those on the backend.