VictorOps is a popular incident lifecycle management platform. You can use Wavefront alerts to trigger a VictorOps incident of varying types (information, warning, critical) and also to let VictorOps know when an alert has stopped firing to mark the incident as recovered within the VictorOps timeline. With the help of webhooks you can integrate Wavefront alerts with VictorOps.
Step 1. Enable the Wavefront Integration in VictorOps
- In VictorOps, go to account Settings at the top of the page.
Select Alert Behavior > Integrations.
On the Integrations page, scroll down until you see the Wavefront integration option and select it.
If not already enabled, click the Enable Integration button which generates a unique URL to use for notifications.
- Copy the Service API Endpoint URL. The URL will end with $routing_key. You can change this to the appropriate routing_key you want to use in VictorOps. If you don’t have one, set it to wavefront-group for now. This can be any string, and can even be different for different types of alerts so you can manage which team will get routed the incoming incidents. To view or configure route keys in VictorOps, click Alert Behavior, then Route Keys.
Step 2. Create a VictorOps Alert Target
- In Wavefront, create an alert target.
- Give the alert target a meaningful name.
- In the Triggers field, select the alert state changes that should trigger the notification. See Creating an Alert Target.
- Make sure the Type is Webhook.
Paste the application’s notification URL into the URL field.
- Set the URL field to the one generated within VictorOps API Endpoint (including your routing key).
- Select Alert Target POST Body Template > TEMPLATE > VictorOps.
- Customize the template.
Give a meaningful description to your new alert target:
- Click Save.
Step 3. Add the VictorOps Alert Target to a Wavefront Alert
- In Wavefront, open the Alerts browser.
- If you have an alert, locate the alert and click the alert name to open the Edit Alert screen. Otherwise, create an alert. For help, see Creating an Alert.
Scroll down to the Target List field.
- Enter the alert target ID into the Alert Target field.
- Select the alert target from the dropdown list to add the list of targets.
- Click Save.