1. Go to Setup > Monitoring > Alert Definitions:
    Alert Definitions
  2. Select an alert definition.
  3. Click Remove.
  4. Click Save.