Often yes. Depending on your location and activity you may need:
City or county business licenses
Professional licenses (for example legal, medical, real estate)
Industry permits (for example food, alcohol, childcare)
These are separate from your state LLC/corporation filing. Check local rules or ask a professional.