Catchpoint provides an extremely flexible Alert system which allows you to define events that Catchpoint will notify you about and log during testing.
Creating Alerts
- Edit the properties of the desired test and in the Alerts, click Alerts Enabled
- Recipients - enter up to 20 email addresses that will be default recipeints of alerts for this test. When configuring individual alerts, you will have the option to message these recipients and/or another alert-specific list of recipients.
(In addition to email recipients, you can also configure alerts to be sent to Webhooks.) - Subject - specifies the subject of the alert emails. This field supports Macros for including variable content.
- New Alert, which opens the Alert Configuration Blade.
- Alert Type from the list on the left. The Alert Type determines what test metric will be used to trigger alerts. Alert configuration options will vary slightly depending on the alert type.
- Trigger. These settings define what is being checked to determine whether an alert should be sent. Most alert types provide the following options:
- Specific Value - trigger an alert if a test run is above/below a specified value
- Trailing Value - trigger an alert if a test run varies significantly from recent test runs. You can define what statistical calculation and percentage difference will trigger the alert, and the time-range of test runs to compare.
- Trend Shift - trigger an alert when Catchpoint's algorythm automatically detects a trend shift in test data.
- Conditions. These settings determine how many Test Runs must experience the triggering condition before an Alert is actually sent.
- # (Number) or % (Percentage) of runs that breach the Alert Trigger within the Time Threshold
- Consecutive - select if triggering test runs must occur consecutively to trigger an alert.
- Timeframe - the timeframe within which multiple triggering test runs must occur to trigger an alert.
- Reminders - determines how frequently an alert message will be re-sent following the initial alert when the alert condition has not resolved.
- Scatterplot - if enabled, include a scatterplot of recent test run performance in the alert email.
- Instructions - optional additional instructions to include in the alert email
- Notification Settings
- Recipients - specify recipients of this alert, instead of or in addition to the default recipients.
- Default Recipients - send this alert just to default recipients
- Do not notify, log only
- When finished, click Apply to save this alert configuration.