Jump to content
  • Sign in to follow this  

    AMD: Is SYSmark a Reliable Benchmark?


    Brian

    We all love drama between technology companies and the latest deliciousness comes courtesy of AMD. They have a 4 minute video on YouTube that questions whether or not SYSmark is a reliable, objective benchmark to use when evaluating performance between different systems. 

     

    AMD's video opens with John Hampton, Director Computer Client Products, talking about how it is very important in choosing the right benchmark when evaluating a purchase because if you choose the wrong one , you can end up overpaying for technology or getting a lesser performing PC. To emphasize his point, he indirectly mentions Volkswagen's diesel debacle and uses the latter case as an example of how even established organizations can be misleading. 

     

    We are then introduced to Tony Salinas, an AMD Engineering Manager, who runs through a couple tests in SYSmark using two notebooks, one that has an Intel i5 CPU and the other with an AMD FX CPU. SYSmark returns a score of 987 for the Intel system and 659 for the AMD one which is a delta of 50%. AMD notes that this is misleading and not reflective of real life performance. To prove this, they run a different benchmark called PCMark 8 on both systems and the results show the Intel i5 system scoring 4199 and the AMD equipped one 3908 which is a delta of 7%. AMD says this is a far more realistic indicator of true performance as PCMark 8 tests the CPU, GPU and video subcomponents rather than emphasizing the CPU like SYSmark does.

     

    And just to drive the point home some more, AMD created their own in-house test using Microsoft Office Suite where they run a custom script on both notebooks and then measure the start and end of a task with a time stamp to gauge performance. Their in-house test shows the Intel system completing the task in approximately 61 seconds while the AMD based one finished it in roughly 64 seconds which is a delta of 6-7%.

     

    As AMD's results line up with those found with PCMark 8, they contend that PCMark 8 is a more fair and balanced indicator of overall performance while SYSmark is not and therefore should be discarded by any potential customers as a tool for evaluating a purchase. 

     

    amdinteltest.thumb.JPG.57191048d02a2763b

    Intel system using AMD in-house test: Test completed in ~61 seconds.

    amdinternaltest.thumb.JPG.b4b0576be9702f

    AMD system using AMD in-house test: Test completed in ~64 seconds.

     

    They also take the time to remind us that the FTC has required SYSmark published benchmarks to contain fine print that notes their benchmark may only be optimized for Intel. Of course, this may have something to do with the fact that AMD resigned from BAPco consortium. Finally, AMD notes that a transparent benchmark should meet very specific criteria which includes being realistic, unbiased, objective and transparent, all of which SYSmark is not apparently. 

     

    criteria.thumb.JPG.83070ca48ade93fb60255

     

    While it's fun to see these types of videos from AMD, they also highlight the fact that the company is facing an uphill battle on all fronts, whether it's CPU or GPU, and 2016 may be the year that makes or breaks them.

     

    Edited by Brian

    • Thumbs Up 1
      Report Article
    Sign in to follow this  


    User Feedback


    There are no comments to display.



    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!

    Register a new account

    Sign in

    Already have an account? Sign in here.

    Sign In Now

  • Similar Content

    • By Brian
      With AMD's long awaited Navi release, do you plan to purchase the 5700/XT?
    • By Brian
      Following the release of NVIDIAs new 436.02 driver which I mentioned in an earlier article here, I've decided to make a quick and dirty video showing off NVIDIAs new Sharpen filter which is part of their Game Filter feature. It works with the most popular APIs including DX 9, 11, 12 and Vulkan and can be set on a per-game basis with granular settings of 0-100 unlike AMDs RIS which is limited to Navi and lacks DX 11 support.
       
       
    • By Brian
      Following the release of NVIDIAs new 436.02 driver which I mentioned in an earlier article here, I've decided to make a quick and dirty video showing off NVIDIAs new Sharpen filter which is part of their Game Filter feature. It works with the most popular APIs including DX 9, 11, 12 and Vulkan and can be set on a per-game basis with granular settings of 0-100 unlike AMDs RIS which is limited to Navi and lacks DX 11 support.
       
       

      View full article
    • By Brian
      Following the release of NVIDIAs new 436.02 driver which I mentioned in an earlier article here, I've decided to make a quick and dirty video showing off NVIDIAs new Sharpen filter which is part of their Game Filter feature. It works with the most popular APIs including DX 9, 11, 12 and Vulkan and can be set on a per-game basis with granular settings of 0-100 unlike AMDs RIS which is limited to Navi and lacks DX 11 support.
       
       

      View full article
    • By Diky
      help me to unlock amd-v acer aspire one 725
      it's my vars file
      please..
      vars.rar
×

Important Information

By using this site, you agree to our Terms of Use. We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.