No, you can manage your clients whether they're connected with you or not.
Connected clients allow you to send them programs and plans, and they can book sessions but it's not necessary for them to be connected with you to manage their sessions, payments and training progress.