Zabbix Integration Guide – Agentless

Zabbix is a very powerful open source enterprise-class network management system designed to monitor the status of network services, servers and other hardware. It's playing an important role in monitoring IT infrastructure for many organizations. PagerDuty extends Zabbix's functionality by providing on-call scheduling, alerts and incidents tracking through the PagerDuty API. PagerDuty notifies you of the most critical Zabbix events so that you are able to take immediate action. This guide describes how to integrate your Zabbix 1.x or Zabbix 2.x installation with PagerDuty using a Python script. This guide will provide instructions on setting up a script, a media type, a user and an action in Zabbix. You might need to slightly alter these instructions depending on your exact Linux distribution and your Zabbix configuration. Note: This guide has been replaced by a new Zabbix Integration Guide that uses the PagerDuty Agent. Please try following the steps in the new integration guide first, and use this one only if you have a system which the PagerDuty Agent can not be installed on.

In PagerDuty

1. Click Services on the navigation bar.
2. On the Services page:
   • If you are creating a new service for your integration, click + New Service.
   • If you are adding your integration to an existing service, search for the service you want to add the integration to and click into the service. Then click the Integrations tab and click the Add a new Integration button.
3. Select your app from the Integration Type menu and enter an Integration Name.If you are creating a new service for your integration, in General Settings, enter a Name for your new service. Then, in Incident Settings, specify the Escalation Policy, Notification Urgency, and Incident Behavior for your new service.
4. Click the Add Service or Add Integration button to save your new integration. You will be redirected to the Integrations page for your service.
5. Copy the Integration Key for your new integration.

 

In Zabbix

1. The PagerDuty plugin for Zabbix requires Python. It will work with Python 2.7.9 and up. However, it may also work on Python 2.5 with the simplejson module and a recent version of OpenSSL installed. If you don't have Python installed on the machine running Zabbix, please follow the instructions here to install Python.
2. Download pagerduty.py from GitHub and copy it into Zabbix's AlertScriptsPath directory. By default, the AlertScriptsPath is set to be /etc/zabbix/alert.d; however, it can be changed. If you don't know your path, check your zabbix_server.conf file.

   wget https://raw.github.com/PagerDuty/pagerduty-zabbix-py/master/pagerduty.py
   cp pagerduty.py /etc/zabbix/alert.d/

3. Make sure the script is executable by Zabbix:

   chmod 755 /etc/zabbix/alert.d/pagerduty.py

4. Now add a cron job that runs every minute to flush Zabbix events that aren't yet submitted to PagerDuty. Edit the Zabbix user's crontab (you may need to adjust this depending on which user runs Zabbix).

   sudo crontab -u zabbix -e

5. Add the following line to the crontab:

   * * * * * /etc/zabbix/alert.d/pagerduty.py

6. Now, let's add PagerDuty as a media type in Zabbix. Click on the Administration tab.
7. Click on the Media types tab.
8. Click on the Create Media Type button.
9. On the following screen, enter "PagerDuty" for Description.
10. Select "Script" for Type.
11. Enter pagerduty.py for Script name.
12. Click Save to create the PagerDuty media type.
13. Let's use this new media type in a user, for the purpose of this guide, let's create a new user in Zabbix. Note: You can also modify an existing user and add the PagerDuty media to them.Click on the Administration tab.
14. Click on the Users tab.
15. Select "Users" from the drop-down list and click on the Create User button.
16. Fill in the details of this new user, and call it "PagerDuty User". The default settings for PagerDuty User should suffice as this user will not be logging into Zabbix.
17. Click on the Add button at the bottom.
18. On the pop-up window that follows, select "PagerDuty" for Type.
19. Paste the Service key from PagerDuty into the text field labeled Send to.
20. Change the Status to Enabled.
21. Click the Add button.
22. Once you are finished with the configuration, make sure to save your changes. For additional reference on how your setup should look, please see the screenshot below:
23. Go back to Administration > Users. Click on Create Group.
24. Enter the name for the Group name (e.g. PagerDuty Service).
25. Select the PagerDuty Service user, then click the << button to add them to this group.
26. Click on the Add button under Read only to choose which Host Groups will be monitored by PagerDuty.
27. Select which Host Groups you would like the PagerDuty to have read access to for monitoring, then click the Select button.
28. Click on Create Group to save your new user group.
29. Go to Configuration > Actions, and click on Create Action.
30. Give the action a Name such as PagerDuty Notifications, then set the Default subject to trigger and the Recovery subject to resolve. Nothing else should be part of the subject lines, just the single word trigger or resolve. Delete all of the content in Default message and the Recovery message boxes, then set them both to the following:

    name:{TRIGGER.NAME}
    id:{TRIGGER.ID}
    status:{TRIGGER.STATUS}
    hostname:{HOSTNAME}
    ip:{IPADDRESS}
    value:{TRIGGER.VALUE}
    event_id:{EVENT.ID}
    severity:{TRIGGER.SEVERITY}

    
31. Click on New to add a new Action operation.
32. Change Send message to single user and select the PagerDuty Service. Then click Add.
33. Save your action.Congratulations! Your Zabbix should now be integrated with PagerDuty!

FAQ

What if a Zabbix event happens while my network is down?

You should also configure an external ping check service to monitor your site's external connectivity. Of course, you can use PagerDuty to forward alerts from these services as well.

How do I setup Zabbix to work with multiple PagerDuty services?

This is easy to do with the current integration, all you would need to do is setup multiple actions with separate action conditions and action operations. You would also need to setup a separate user group, user and media. The additional media would use the service key of your additional service and would be of type PagerDuty.

The integration doesn't seem to be working. What's going on?

Please check out our Zabbix Troubleshooting Guide for common issues or contact our support team for assistance.