To delete a category or preset open the preset menu at the top of the Atom interface, right above the animation:

Next right-click on the category or preset you are interested in deleting, and click "Delete."
​

 Once selected the preset or category you chose to delete will disappear. 

Please note you cannot delete presets or categories that Atom originally came with.