Mobile:
Click More in bottom right corner
Click Teams/Users
Scroll to People who haven’t joined yet
Click User’s name
Click Remove from Organization
Click OK
Web:
Go to Teams/Users tab
Click Users
Find User in User list
Click User’s name
Click Remove from Organization in profile
Click OK