If you reduce the number of packs, you will have less seats. If there are more people in your workspace than the number of seats, the most recently joined members will lose access to your workspace.
If you cancel subscription, at the end of your current billing cycle, you will lose access to the team workspace feature. As the owner, you can still access everything, but all your members will lose access to your workspace.