You must have a registered agent in each state where your company is registered with the state.
That means:
If you form your company in your home state only, your registered agent must have a physical address in that state.
If your company is registered in multiple states (for example, domestic in one state and foreign qualified in another), you need a registered agent in each of those states.