What happens to my lounge passes if I cancel Premium?

Any passes you've already bought stay valid until they expire, so you can still use them after your membership ends. You just won't be able to buy new ones once you're no longer a Premium member.