Transaction Test

Prev Next

The Transaction Test Type will be retired on March 1, 2026. We recommend transitioning any Transaction tests to Playright or Puppeteer, and have introduced a script converter to assist you. Learn More.

Catchpoint provides support for multi-step browser automation testing in multiple languages. This article focuses on the Transaction test type, which is compatible with the Selenium language. Additionally we offer support for Playwright and Puppeteer, via those respective Test Types. We recommend Playwright and Puppeteer, as these languages are more modern browser-automation tools.

The Catchpoint Transaction Test enables you to run scripts written in Selenium language to continuously monitor Web Applications. If you are comfortable with the Selenium Language you can write your scripts, but it is also possible to record a web transaction in Selenium Language and copy the resulting script into the Transaction Test configuration.

Transaction Test Properties

Name A name used to identify this test.
Description Optional additional information about the test
Monitor

The browser that Catchpoint will use to run the test. Options include:

  • Emulated(Catchpoint monitor emulates a generic browser)
  • Mobile(must select mobile device type)?
  • Chrome(must select specific version)
Script

The Selenium script that the Test will execute.

Selenium Scripting Guide

Location The Product/Folder location of this test (read only)
Status Determines whether this test is currently Active or Inactive

Supported Metrics

# Connection FailuresThe number of times the system was unable to establish a TCP connection to the primary URL server.
# ConnectionsThe total number of TCP connections established during the test.
# Content Load ErrorsThe total number of elements on the webpage that the test was unable to load or that generated errors during loading.
# CSSTotal number of CSS files downloaded during the test.
# DNS FailuresThe number of times the system was unable to resolve the domain from the primary URL to an IP address.
# FlashTotal number of Flash files downloaded during the test.
# FontTotal number of font files downloaded during the test.
# HostsThe total number of unique external hosts referenced by elements on the page.
# HtmlTotal number of HTML files downloaded during the test.
# ImageTotal number of image files downloaded during the test.
# Items (Total)The total number of files included on the webpage. For Object monitor tests, this value is always one.
# JS Errors per PageThe average number of JavaScript errors on each webpage.
# MediaTotal number of media files downloaded during the test.
# OtherTotal count of all files not defined otherwise.
# Purged RunsThe number of test runs manually excluded from calculation for purposes of SLA accuracy.
# RedirectTotal number of redirects on the webpage.
# Response FailuresThe number of times no response was received from the server for the primary URL.
# RunsTotal number of test runs for the defined time period.
# ScriptTotal number of JS files downloaded during the test.
# SSL FailuresThe number of times a secure connection to the server for the primary URL could not be established.
# Test ErrorsThe total number of test runs that failed. This is the sum of all of the following types of test failures:
  • # DNS Failures
  • # Connection Failures
  • # ssl Failures
  • # Response Failures
  • # Timeout Failures
  • # Test Limit Errors
# Test FailuresThe total number of elements that Catchpoint was unable to connect to, receive a response from, or load on the page.
# Test Limit ErrorsThe number test runs that surpassed one of the following system boundaries:
  • Test takes longer than 30 seconds.
  • Test contains a URL that redirects more than 5 times in a row.
  • Test references more than 1,000 URLs.
  • Test references more than 255 different hosts.
# Tests with JS ErrorsThe number of individual test runs that resulted in at least one JavaScript error.
# Timeout FailuresThe number of times a test failed because a server process did not complete and it returned a timeout.
# XMLTotal number of XML files downloaded during the test.
# ZonesThe number of defined Zones containing hosts that were accessed during the test.
% Adjusted AvailabilityIgnoring any purged runs, the percentage of test runs where the primary URL server was reached and the test was completed (i.e. there was not a Test Error.)
% AvailabilityThe percentage of test runs where the primary URL server was reached and the test was completed (i.e. there was not a Test Error.) Availability is calculated as:
(# Test Runs - # Test Errors) / # Test Runs
% Content AvailabilityThe percentage of time that all the elements on the webpage were available. Content Availability is calculated as the number of times the test ran successfully with no loading errors, divided by the total number of times the test ran. If at least one object failed to load during testing, that test run is regarded as having content that failed to load properly.
% DowntimeThe percentage of test runs where the primary URL server was unavailable, unreachable, or otherwise failed (i.e. there was a Test Error.) Downtime is calculated as:
# Test Errors / # Test Runs
% FrustratedThe percentage of test runs that exceeded the Apdex “frustrated” threshold.
% Not FrustratedThe percentage of test runs that completed in less time than the Apdex “frustrated” threshold. This is equivalent to: % Satisfied + % Tolerating
% Ping Packet LossThe percentage of pings packets sent which did not receive a response. Calculated as:
(# packets received / # packets sent) * 100
% SatisfiedThe percentage of test runs that completed in less time than the Apdex “Satisfied” threshold.
% Self BottleneckThe percentage of Document Complete time that hosts in the "self" zone were a bottleneck for.
% Third Party BottleneckThe percentage of Document Complete time that hosts in the "third party" zone were a bottleneck for.
% ToleratingThe percentage of test runs that exceeded the Apdex “Satisfied” threshold but completed in less time than the “Frustrated” threshold.
ApdexA scoring mechanism that translates performance metrics of diverse applications into generic “User Satisfaction” levels using predefined response time thresholds. You can use default Apdex thresholds or configure your own on a per basis. For more details about Apdex, visit http://www.apdex.org/
Client Time (ms)The total amount of time where no request was on wire, from the start of the test or step to Document Complete.
Connect (ms)The time it took to establish a TCP connection with the server.
Content Load (ms)The time it took to load the entire content of the webpage after the connection was established with the primary URL server. This is the time from the end of Send (ms) until the final element, or object, on the page was loaded.
CSS (ms)Total time spent loading CSS files, in milliseconds.
CSS BytesTotal size of CSS files downloaded during the test, in bytes.
Cumulative Layout ShiftMeasures the unexpected shifting of webpage elements while the page is still loading. CLS looks at the proportion of the viewport that was impacted by layout shifts and the movement distance of the elements that were moved.
DNS (ms)The time it took to resolve the domain name to an IP address.
Document Complete (ms)The time it took from the initial URL request being issued until the browser triggered the "onload" event. Any inline requests or requests inserted via "document.write" must complete loading before the event is fired. Document Complete does not account for dynamic requests that may be generated later via JavaScript and/or DOM manipulation.
DOM Load (ms)The time it took to load the Document Object Model (DOM) for the webpage.
Downloaded BytesThe total number of downloaded bytes from the primary URL of the test(s).
Experience ScoreA composite metric that captures the overall experience of a user on a scale of 0-100.
File SizeThe size of the content received from the host for a specific element, in bytes.
First Contentful PaintThe time when the browser rendered the first bit of content from the DOM. (May be text, image, SVG, or even a <canvas> element.)
First PaintThe time when the browser first rendered anything visually different from what was on the screen prior to navigation.
Flash (ms)Total time spent loading Flash files, in milliseconds.
Flash BytesTotal size of Flash files downloaded during the test, in bytes.
Font (ms)Total time spent loading font files, in milliseconds.
Font BytesTotal size of font files downloaded during the test, in bytes.
Frames Per SecondMeasures the performance of animations.
Html (ms)Total time spent loading HTML files, in milliseconds.
Html BytesTotal size of HTML files downloaded during the test, in bytes.
Image (ms)Total time spent loading image files, in milliseconds.
Image BytesTotal size of image files downloaded during the test, in bytes.
Largest Contentful Paint (ms)The time when the largest image or text block (by screen area) visible within the viewport was rendered.
Load (ms)The time from the first packet to the last packet of data for the response.
Media (ms)Total time spent loading media files, in milliseconds.
Media BytesTotal size of media files downloaded during the test, in bytes.
Other (ms)Total time spent loading all files not defined otherwise.
Other BytesTotal size of all files not defined otherwise.
Ping Round Trip (ms)Average time between sending a ping packet and receiving a response.
Redirect (ms)Time from the start of navigation to the end of the last Redirect.
Render Start (ms)The time from initial navigation until the first visual content is painted to the browser display.
Response (ms)The total time from the initial request until receiving the last packet of response data. It is the sum of DNS + Connect + ssl + Send + Wait + Load for all elements.
Round Trip Delay (ms)The total amount of time that the NTP request packet and response packet were traveling between the Node and the ntp server.
Script (ms)Total time spent loading JS files, in milliseconds.
Self Downloaded BytesTotal file size in bytes (including headers) downloaded from hosts in the "self" zone.
Send (ms)The time it took to send the request to the server.
Server Response (ms)The time from when DNS was resolved to receiving the last response packet from server. (This shows the server response exclusive of dns times)
Signal QualityMeasures the quality of the WLAN connection in terms of data transfer speed. It indicates what percent of the available network are you using to move data (upload / download). 99% is as good as it gets in terms of signal quality.
Signal Strength (dBm)This number represents the power the clients device is receiving from the Access Point / Wi-Fi router. A number of -30 dBm indicates excellent while a number of -70dBm indicates very poor signal strength.
Speed IndexA calculated metric that represents how quickly the page rendered the initial user-visible content above the fold. A lower Speed Index indicates faster rendering of visible content.
SSL (ms)The time it took to complete the ssl handshake with the server.
Test Time (ms)One cohesive metric that applies to all test types and indicates the total duration of the test run. Test Time is equivalent to Response, Test Response (Transaction and web tests) and ping RTT (Trace Route tests), and is used when calculating Apdex. Test Time is not available for Request, Host, or Zone charting.
ThroughputMeasures how efficiently the system was able to retrieve all elements in kilobytes per second. Throughput is calculated as follows:
Throughput = Size / Time where:
Size = (FileSize + HeaderSize)/1024 *converts from bytes to KBs
Time = (Wait + Load)/1000 *converts from ms to seconds
Time To First Byte (ms)The total time from the initial DNS request to receiving the first response packet from the server. This is calculated as:
Time To InteractiveThe time when the page first became interactive. TTI marks the point at which the webpage is both visually rendered and capable of reliably responding to user input.
Time to Title (ms)The time from initial navigation until browser displayed the title of the page.
Total Downloaded BytesThe total number of downloaded bytes for all elements of the webpage, including from the primary URL server and any redirects.
Visually Complete (ms)The time when the visual area of a page has finished loading, meaning that all visible elements of the web page are 100% loaded.
Wait (ms)The time from when the request was sent to the server until the first response packet was received. (Known as "First Byte" in some tools)
Webpage
Webpage ThroughputMeasures how efficiently the system downloaded the content of the entire webpage. Webpage Throughput is calculated as:
(File Size + Header Size) / Webpage Response (ms)
Wire Time (ms)The total amount of time where at least one request was on the wire, from the start of the test or step to Document Complete.
XML (ms)Total time spent loading XML files, in milliseconds.
XML BytesTotal size of XML files downloaded during the test, in bytes.