Yes you can. Select the rule and choose the "Delete rule" option. You'll be asked to confirm before the rule is deleted.