When you remove a custom question from your account, you will still be able to view the responses to that question if it has been used in previous surveys.

All historic surveys that ask the custom question will be maintained, along with the responses to the question.

However, when you remove the question it will no longer be available to include in future surveys.