Cryptic Globe DAW Performance Testing Results - 2009

Go right to test results graphs    Go right to test results numbers

Go right to test result screenshots    Go right to test specifics

Go right to computer hardware details

Steve Lamm Home

    Hopefully this page will make it easy for everyone to find out exactly what they are most interested in, at the level of detail they seek.

Computers Tested:

  • AMD 16 Core Opteron 8360se 2.5Ghz, 4gb Memory, Windows Server 2003 RC2 - RME HDSP MADI Card

  • AMD 8 Core Opteron 2360 2.5Ghz, 4gb Memory, Windows XP professional SP-3 -  RME HDSP MADI Card

  • Intel 8 Core Xeon 2.5Ghz 4GB Memory, Windows XP professional SP-3 -  RME HDSP MADI Card

  • Intel Core 2 Quad 2.4Ghz, 4Gb Memory, Windows XP professional SP-3 - RME HDSP MADI Card

For more specifics about the computers click HERE.

 

Tests Performed

  • Low Latency Audio Tracking at 32 and 64 buffers

  • Low Latency Audio Tracking with multiple Steinberg Amp Simulator Plug-in's at 32 and 64 buffers

  • Low Latency Audio Tracking with multiple Steinberg VST effects at 32 and 64 buffers

  • Steinberg VST-I heavy project at 32, 64, 128, 256, 512, and 1024 buffer settings

  • Heavy VST plug-in load at 1024 buffers (stress test)

XP vs Vista - 32bit vs 64 bit?!?!?!? - I chose XP Professional SP-3 32 bit for these tests because it is still the most reliable, and has good quality driver support for everything I use.   To calm the fears of those that have forged ahead to Vista and/or 64 bit operating systems, I have also done a LOT of testing on these systems with those operating systems.    I found that the performance is almost exactly the same in every test.   The numbers may vary from 1 to 3%... but no more.   So these tests will translate almost completely to other "post XP" Microsoft Operating systems.

For more specifics about the tests click HERE.

 

Results sought:

  • Best DAW for low latency performance (low buffers)

  • Best DAW for Sheer Horsepower performance (high buffers)

  • Best DAW for VST-Instruments (high and low buffers)

  • Measure Steinberg software's ability to take advantage of multiple cores in both high and low latency projects

  • Proof that in many cases, multi-core systems actually perform better at low buffer settings with the "multi-processing" check box in Cubase/Nuendo UNchecked, and better at high buffer settings with this box checked.   We have observed this for some time and thought it would be helpful for users and Steinberg alike to see our findings.

For results in Graph Form click HERE

To download ALL test materials including spreadsheet used to collect data (including graphs), screen shots of the actual tests, and actual performance tests (Nuendo project files - that will also open in Cubase 4.x) click HERE.

 

My basic opinions about the results:

In my opinion these test results show the following with Microsoft operating systems and Steinberg's Nuendo 4.x:

  • Dual Intel Quad Core XEON (8 core) based systems currently provide the best low latency performance for both VST-I's and Audio Tracking

  • Dual AMD Quad Core OPTERON (8 core) based systems compared VERY favorably to the Intel systems for both VST-I's and Audio Tracking, but based on the discrepancy between VST performance meter and Windows performance meters, Steinberg software is better optimized for Intel processors at this time.

  • Quad AMD Quad Core Opterons (16 core) based systems provided the most sheer horsepower in all higher buffer applications.   However, discrepancies found in the Windows vs Steinberg meter readings still indicate poor optimization for this platform.

  • Multi-Core scaling issues seem quite apparent as all 4 systems performed very closely in low buffer tests, and came very close to parity in high buffer tests despite a jump from a Quad Core system to a 16 Core system.

  • For heavy VST users the Intel 8 Core system has a slight edge at low latencies on the AMD Opteron 8 Core systems, but this appears to be in big part processor specific optimizations (again based on Windows performance meter vs Steinberg performance meter statistics)

  • On Intel based systems, often when tracking audio at low buffer settings with few or no plug-in's, the system will actually perform BETTER with multiprocessing unchecked!

 

My Disclaimers:
  • These test projects were created by me as performance testing and burn testing for the Custom DAW's that I build.  They were created with NO bias to any brand or manufacturer.
  • I used Steinberg's Nuendo because the vast majority of DAW's I build are for Steinberg users (though I build systems for all DAW's)
  • All the tests I used here are based completely on plug-ins available in the Nuendo 4.x/Cubase 4.x to try to make these tests available to all users
  • Yes, I do have some other tests that involve 3rd party applications, but because they are difficult for everyone to run (since we don't all have the same 3rd party software) I did not use them in these comparisons.
  • I was VERY careful to use identical peripherals and software except in the one case this was impossible.   For instance, the same video card, sound card, memory brand, OS hard drive, Audio hard drive, Media/Content drive, etc were used on all 4 computers.   The one exception was that I used Windows Server Standard 2003 RC2 on the 16 core rig, because XP will not recognize more than 2 processor sockets.   I did however tweak the OS to perform exactly as XP professional does (turned off services, installed things like Java, Direct-X, etc).   All other computers were XP Professional SP-3
  • I am willing to answer any questions that anyone may have, but please understand I am very busy and it may take some time to respond.    These results were collected very carefully and in a very professional manner.   I am not open to debate about them, or their legitimacy, or anything really.   This is strictly information for the sake of information.    :)

 

Using these tests/results:
  • Anyone is welcome to use these tests and the materials I have made available for download for any purpose they like.   All I ask is that if you use them on your website, you include a link to my website with the proper credit.

 

Cryptic Globe Home

Steve Lamm Home