RFOBenchmark (2015) is here!
This is an extension of the AUBench tool, with some added tests, verified function for all verticals, and modularized to make adding tests and porting to new versions of Revit much easier.
Please post your results in
Some things to be aware of...
- The 2015 (and revised 2014) Benchmark will launch and close a non full screen session of Revit at the beginning of execution, to ensure that the follow on tests can be run fuel screen and with Coordination discipline default and to preload any required DLLs and ensure a more accurate test..
- The 2015 (and revised 2014) Benchmark automatically sets the default view Discipline to Coordination, to address the RST crash, and make the resulting test more of an equal comparison between verticals.
- Be aware that this DOES have a material impact on performance. Coordination views are rather faster across the board, so if you want to compare 2014 to 2015, make sure you get the revised version of the 2014 test. Both are build 5.7.2014.
- The 2014 benchmark automatically runs for the appropriate vertical of revit installed on your machine. If you have multiple verticals it will run for all of them automatically.
- If you are testing RVT (i.e. OneBox) AND you have ONLY the Structural UI enabled, answer no to the popup. This will run the OneBox test as if it was RST 2014.
- The benchmark runs full screen automatically now.
- The results file is automatically named with a date/time stamp, name of machine and vertical being benchmarked.
- The RFOBenchmark folder doesn't need to be renamed. Just copy the folder from the ZIP to your disk and run the _RFOBenchmark.vbs file. You will then be asked what vertical you want to test, progress will be shown in a popup between tests, and a final popup will let you know the benchamrk is done and let you open the results file. 2013: With 2013, you have more vertical options. RVT is OneBox, and RVT-S is OneBox with ONLY Structural UI enabled.
- 2013: The new test also asks if you want to run full screen or not. PLEASE run full screen. The impact is not trivial. if we all do full screen tests, we can then look at the screen size information reported in the hardware section and make much more meaningful comparisons.
- The test can ONLY be run via the VBS file. Running the journals manually will not produce the results you want. Simply double click the _RFOBenchmark_2011.vbs or _RFOBenchmark_2012.vbs file or _RFOBenchmark_2013.vbs file.
- The test is longer than before. Up to 15 minutes. I think the expanded data is worth it, and since most people won’t be running it regularly, hopefully this won’t be a problem.
- Read the readme. Especially the part about using _Kill Test.vbs
- The test attempts to quantify GPU performance. However, the results you see are in no way a complete picture. Over time we will see what the data tells us. It may be that the results are in fact misleading, and we decide to remove that part of the test. In the mean time, use the benchmark as a datapoint for decision making, but remember that nothing is as meaningful as a butt-dyno comparison of two different cards, on your machines, on your projects.2013: The new test expands a bit on the GPU test, which when combined with running full screen is getting close to being a meaningful metric. Not there yet, but closer!
- On the GPU test, you will notice that Consistent Colors is very fast on the non hardware accelerated test in 2011, but on a par with the other views in 2012. This is because CC doesn’t do shadows in 2011, so the major hardware acceleration benefit is lost. In 2012, where shadows are available in Consistent Colors, the results match expectations.
- 2013: Lastly, I regret to say that they new test will not run in 32 bit Windows XP. If I can find a way to make this happen I will update ASAP, but for the moment it looks like that is not going to happen. That said, I hope that Win XP x32 has become an edge case and this won't affect too many people.
Please keep all discussions about the tools in this thread, and use the Result thread ONLY for results. One last note. Some folks have had issues with the downloads being corrupted. If you have this issue, I recommend you try the download with a browser that is NOT Internet Explorer. Maybe IE9 is better, but even IE8 sometimes results in corrupted download. Chrome and Safari for Windows have both worked well for me, and others have reported good results with Firefox.Thanks all, I hope you find RFOBenchmark useful.Gordon