diffbench
Bogan Gusiev wrote in to tell us about his tool, diffbench. Given a set of performance tests, a patch, and a codebase, it runs the tests both with an without the patch, producing a table with the statistics. You can see it in use on these patches for ActiveRecord, ActiveModel, ActiveSupport, and Mail.