alert manager not working properly in prometheus

0 votes

I have some IoT devices connected to a server being monitored by Prometheus. I have it configured in a way that whenever a device shuts it sends an alert. But right now, whenever a device goes offline the alert manager is sending alert of all the devices which are offline and not a single device at a time.

ALERT IoT_online
  IF IoT_online == 0
  LABELS {severity="critical"}
  ANNOTATIONS {description="This device is offline  {{ $value }}.", summary="Instance {{ $labels.instance }} IoT device is offline"}

I just want it to send alerts of the only device which went offline at that particular time. Help Please...

Apr 10, 2018 in DevOps & Agile by Atul
• 10,250 points

1 answer to this question.

0 votes

This is the default functionality of the alert manager. Whenever an alert group sends an alert, it includes all alerts that are currently active.

What you can try is to separate alert group into smaller groups by labeling group_by. This may increase the amount of notifications that you'll get. You can also try and throttle how often these alerts are sent because of group changes using grpoup_interval.

answered Apr 10, 2018 by DareDev
• 6,850 points

Related Questions In DevOps & Agile

+1 vote
1 answer

How to add a node as a manager in swarm cluster?

Here is what you can try and ...READ MORE

answered Dec 10, 2018 in DevOps & Agile by Damon Salvatore
• 5,540 points
+1 vote
2 answers

is it possible to assign a Feature/User Story/Task to a team [Group] in VSTS

In most cases, we would break Work ...READ MORE

answered Oct 11, 2018 in DevOps & Agile by lina
• 8,200 points
+5 votes
3 answers

Steps to Call Python method in BuildBot

To run python code, you must write ...READ MORE

answered Mar 27, 2018 in DevOps & Agile by ajs3033
• 7,280 points

edited Oct 12, 2018 by Kalgi 422 views
+3 votes
1 answer

Unable to find the TargetArguments path While configuring dot cover in VSTS

For your unable to find the TargetArguments ...READ MORE

answered Mar 27, 2018 in DevOps & Agile by ajs3033
• 7,280 points
+13 votes
2 answers

Git management technique when there are multiple customers and need multiple customization?

Consider this - In 'extended' Git-Flow, (Git-Multi-Flow, ...READ MORE

answered Mar 26, 2018 in DevOps & Agile by DragonLord999
• 8,400 points
0 votes
1 answer
0 votes
1 answer

High availability clustering (HA-C) in nexus repo manager oss

It's a paid feature available in Nexus ...READ MORE

answered Apr 26, 2018 in DevOps & Agile by DareDev
• 6,850 points
+1 vote
8 answers

How can I implement process.env in Angular 5 environment?

Users do not have access to process.env ...READ MORE

answered Apr 3, 2018 in DevOps & Agile by DareDev
• 6,850 points