Atomic Spin :: Elements of Software

Project XXX has 37 selenium tests with 405 assertions in 19 test files. All integration testing is done with Selenium.

Using deepTest I was able to decrease run time from 317 seconds down to 116 seconds using 4 processes.

I ran experiments using more than 4 processes and a mongrel cluster, but about 2 minutes seemed the best time possible on my laptop. I would like to try it out on the quad mac in the office.

The trick to getting this to work was to turn off transactional fixtures and to use no fixtures in tests. This required that all tests be written so that they had the capability of running in parallel.

Here’s a graph showing the speed improvement based on number of processes used. More than 4 processes was consistently about the same speed on my laptop.