Answer by James K. ·
I think Dan is right that this is not something you can configure for a test and RFE would be a good idea.
As a workaround perhaps you could create two active tests running the same scripts with most of the same settings- one with alerts going to A and one with alerts going to B - and then set different maintenance windows so that one is active from 5:00 to 9:00 and the other is active from 9:00 to 5:00.
Answer by Don B. ·
Old issue, I know, but you could do something with custom error handling and conditional steps.
IF error and time is between 9-5 execute step A, do not execute step B
else IF error and time is between 6pm - 8am execute step b, do not execute step A
Then set up step level alerting on steps A and B with different alert groups.
Answer by James F. ·
So it's not possible today, unless with James's suggestion this is done with two tests and maintenance windows. We are looking to enhance our alerting capabilities for the next few releases and I will add this as a Request for Enhancement.