nagios

Hi, I started working with check_mk version 1.4.0b4 and had some warnings and critical errors. When I corrected them they still showing. Do I have to remove those alerts manually or does it go away after some time? Thank you