I'd like to see an option for specifying a delay before a dependent test is run.
For example, servers come up and begin pinging before they're ready to respond to a test for disk space. But the disk space alert will be thrown, because it runs immediately once the ping test qualifies.
Increasing the test count is a bad way of dealing with this, because it forces test counts during normal operation to accommodate how machines start up. That's a fudge.
Keep up the great work -