question

Drew C. avatar image
Drew C. asked ·

Configuring custom pass/fail thresholds in Test Automation dashlet?

Hello, I want to set a PurePath Response Time threshold of 100 ms -- if an API exceeds this time, the test will be marked as "Failed". Is this possible to achieve using the Test Automation settings shown below?

If so, what should the settings be changed to for this specific use case?

Thanks!

configurationdashboard6.3web performance monitoringtest automation
settings.jpg (90.5 KiB)
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

1 Answer

Andreas G. avatar image
Andreas G. answered ·

Hi Drew

This is currently not possible. The current mechanism is based on our automatic baselining and alert in case your response time is outside the baseline.

We are however working on a REST API where you can either set the Failure status of Tests from "the outside". We also think about allowing you to set thresholds for individual measures per test - but thats for future versions

Andi

1 comment Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Hi @Andreas G.,

Thanks for you reply, looking forward to future versions where this kind of configuration is possible.

Best,

Drew

0 Likes 0 · ·