To delete a preset simply click on the "Show Plugin Folder," button inside of Atom:

From here you'll be taken to the preset folder, where custom made presets can be deleted just like any other file on your pc or mac can.

You are not able to delete factory presets however, so please keep this in mind.