Node run rate is the rate at which a node has been able to complete tests and properly report data compared to the total number of tests scheduled for that node. This rate is displayed as a percentage value under the Nodes menu and is available for authorized Enterprise Node and Private Node users.
To view a node's run rate history, go to Nodes from the navigation menu and then select Nodes and click on the node of your choice. The node properties page includes a graph of the Node's recent run rate and Request Slippage, which refers to test runs that were scheduled in Catchpoint, but which the node did not request during the timeframe.
Run Rate Calculation
The reported run rate is determined over five-minute windows. When a node has completed all scheduled tests for a given time window and reported all data back, the run rate is 100%. A run rate of 0% means tests were scheduled for the node, but no test data was reported by the node during the interval. If no tests are scheduled over a given time interval, the run rate will be indicated as "NA".
Interpreting Run Rate
A variety of issues (described below) can cause temporary delays in nodes running tests or reporting the results back to Catchpoint, therefore a run rate below 100% does not necessarily indicate a problem with the node or any loss of data. Catchpoint's flexible architecture allows tests which "slip" past their scheduled time window to catch up over time. As nodes recover they continue to automatically report data. This recovery period can take anywhere from 1 to 2 hours.
Catchpoint recommends using the following benchmarks when evaluating a node's run rate:
90-100%
A run rate at or above 90% is considered to be normal and is usually no cause for concern.
50-90%:
A node with a run rate between 50-90% is considered to be in "warning" status and should be investigated if it persists. This may be caused by temporary conditions, but it could be a sign that the node is over-scheduled.
1-50%
A node with a run rate below 50% is considered to be in "critical" status and should be investigated right away. It most likely means the node is experiencing downtime, or is over-scheduled and unable to perform all the requested tests.
0%
A 0% run rate indicates that a node is down, unable to report test results, or that network conditions are prohibiting Catchpoint from communicating with the node.
We recommend you follow the troubleshooting checklist and ensure no additional tests are added to the node.
Factors that Influence Run Rate
Fluctuations in the run rate are normal. Run rates can be influenced by factors such as ISP issues, the test browser hanging on a test, new tests being scheduled, changes to test schedules, or delays in the test reporting its data.
Prolonged periods of low run rates, however, can be an indicator of an impaired node, persistent network trouble, or a node that has too many tests scheduled.
Troubleshooting steps:
-
Please RDP/SSH into your Enterprise nodes and check whether your services are running as expected. Try to restart the Catchpoint services and see if there is any improvement.
-
Please confirm that all the IPs and URLs required for the node to communicate with our command and control services are whitelisted. You can find the list of these IPs and URLs here here.
-
Please reboot the node and see if there is any improvement.
-
If you are still observing issues with Node Run Rate please collect logs and share them with us at support@catchpoint.com.
Node Run Rate Email Reports
You can subscribe to receive node run rate reports via email. If one of your organization's Enterprise Nodes drops below 90%, a report will be sent.
Click in the My Account button(top-right), select email preferences, and enable Node Run Rate.
If you have any further questions please reach out to us at support@catchpoint.com.