Jump to content
EwinRacing Flash Series Gaming Chairs
  • Sign in to follow this  

    AMD: Is SYSmark a Reliable Benchmark?


    Brian

    We all love drama between technology companies and the latest deliciousness comes courtesy of AMD. They have a 4 minute video on YouTube that questions whether or not SYSmark is a reliable, objective benchmark to use when evaluating performance between different systems. 

     

    AMD's video opens with John Hampton, Director Computer Client Products, talking about how it is very important in choosing the right benchmark when evaluating a purchase because if you choose the wrong one , you can end up overpaying for technology or getting a lesser performing PC. To emphasize his point, he indirectly mentions Volkswagen's diesel debacle and uses the latter case as an example of how even established organizations can be misleading. 

     

    We are then introduced to Tony Salinas, an AMD Engineering Manager, who runs through a couple tests in SYSmark using two notebooks, one that has an Intel i5 CPU and the other with an AMD FX CPU. SYSmark returns a score of 987 for the Intel system and 659 for the AMD one which is a delta of 50%. AMD notes that this is misleading and not reflective of real life performance. To prove this, they run a different benchmark called PCMark 8 on both systems and the results show the Intel i5 system scoring 4199 and the AMD equipped one 3908 which is a delta of 7%. AMD says this is a far more realistic indicator of true performance as PCMark 8 tests the CPU, GPU and video subcomponents rather than emphasizing the CPU like SYSmark does.

     

    And just to drive the point home some more, AMD created their own in-house test using Microsoft Office Suite where they run a custom script on both notebooks and then measure the start and end of a task with a time stamp to gauge performance. Their in-house test shows the Intel system completing the task in approximately 61 seconds while the AMD based one finished it in roughly 64 seconds which is a delta of 6-7%.

     

    As AMD's results line up with those found with PCMark 8, they contend that PCMark 8 is a more fair and balanced indicator of overall performance while SYSmark is not and therefore should be discarded by any potential customers as a tool for evaluating a purchase. 

     

    amdinteltest.thumb.JPG.57191048d02a2763b

    Intel system using AMD in-house test: Test completed in ~61 seconds.

    amdinternaltest.thumb.JPG.b4b0576be9702f

    AMD system using AMD in-house test: Test completed in ~64 seconds.

     

    They also take the time to remind us that the FTC has required SYSmark published benchmarks to contain fine print that notes their benchmark may only be optimized for Intel. Of course, this may have something to do with the fact that AMD resigned from BAPco consortium. Finally, AMD notes that a transparent benchmark should meet very specific criteria which includes being realistic, unbiased, objective and transparent, all of which SYSmark is not apparently. 

     

    criteria.thumb.JPG.83070ca48ade93fb60255

     

    While it's fun to see these types of videos from AMD, they also highlight the fact that the company is facing an uphill battle on all fronts, whether it's CPU or GPU, and 2016 may be the year that makes or breaks them.

     

    Edited by Brian

      Report Article
    Sign in to follow this  


    User Feedback




    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Paste as plain text instead

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Similar Content

    • By depmixels
      hello everyone, I have a MSI GT683R with a dying (pretty much dead actually) GTX560M in it.
       
      I am looking to upgrade it to a new GPU, I have found a AMD Firepro M6100. (I first wanted to upgrade to a GTX970M, but that's too expensive for now... and corona is also making things difficult) I have already ordered a second heatsink to modify because I didn't want to modify the original heatsink it came with.
       
      But, my question is. Does it even work in this system? I have heard of people getting it to work in the barebone variant of this system. But I am not sure if it would work in the 'fully loaded' variant.
       
      Also, my games are mostly RAM/CPU dependent and I am looking for a little extra power in this system. I have found a I7-2860qm and I want to upgrade to 32GB of RAM, is it possible on this system? the sticker says 'max. 16GB of RAM' But I have feeling it says that due to the limitation of the cpu that's already on this system (I7-2630QM, 16GB RAM max.)
    • By Brian
      Following the release of NVIDIAs new 436.02 driver which I mentioned in an earlier article here, I've decided to make a quick and dirty video showing off NVIDIAs new Sharpen filter which is part of their Game Filter feature. It works with the most popular APIs including DX 9, 11, 12 and Vulkan and can be set on a per-game basis with granular settings of 0-100 unlike AMDs RIS which is limited to Navi and lacks DX 11 support.
       
       

      View full article
    • By Brian
      Following the release of NVIDIAs new 436.02 driver which I mentioned in an earlier article here, I've decided to make a quick and dirty video showing off NVIDIAs new Sharpen filter which is part of their Game Filter feature. It works with the most popular APIs including DX 9, 11, 12 and Vulkan and can be set on a per-game basis with granular settings of 0-100 unlike AMDs RIS which is limited to Navi and lacks DX 11 support.
       
       
    • By Brian
      With AMD's long awaited Navi release, do you plan to purchase the 5700/XT?
    • By Brian
      Following the release of NVIDIAs new 436.02 driver which I mentioned in an earlier article here, I've decided to make a quick and dirty video showing off NVIDIAs new Sharpen filter which is part of their Game Filter feature. It works with the most popular APIs including DX 9, 11, 12 and Vulkan and can be set on a per-game basis with granular settings of 0-100 unlike AMDs RIS which is limited to Navi and lacks DX 11 support.
       
       

      View full article
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use. We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.