Jump to content
Latest News
  • Apologies for the downtime. We had to update our backend and theme.
  • We will continue pushing updates.
  • Apologies for the downtime. We had to update our backend and theme.
  • We will continue pushing updates.
  • Sign in to follow this  

    AMD: Is SYSmark a Reliable Benchmark?


    Brian

    We all love drama between technology companies and the latest deliciousness comes courtesy of AMD. They have a 4 minute video on YouTube that questions whether or not SYSmark is a reliable, objective benchmark to use when evaluating performance between different systems. 

     

    AMD's video opens with John Hampton, Director Computer Client Products, talking about how it is very important in choosing the right benchmark when evaluating a purchase because if you choose the wrong one , you can end up overpaying for technology or getting a lesser performing PC. To emphasize his point, he indirectly mentions Volkswagen's diesel debacle and uses the latter case as an example of how even established organizations can be misleading. 

     

    We are then introduced to Tony Salinas, an AMD Engineering Manager, who runs through a couple tests in SYSmark using two notebooks, one that has an Intel i5 CPU and the other with an AMD FX CPU. SYSmark returns a score of 987 for the Intel system and 659 for the AMD one which is a delta of 50%. AMD notes that this is misleading and not reflective of real life performance. To prove this, they run a different benchmark called PCMark 8 on both systems and the results show the Intel i5 system scoring 4199 and the AMD equipped one 3908 which is a delta of 7%. AMD says this is a far more realistic indicator of true performance as PCMark 8 tests the CPU, GPU and video subcomponents rather than emphasizing the CPU like SYSmark does.

     

    And just to drive the point home some more, AMD created their own in-house test using Microsoft Office Suite where they run a custom script on both notebooks and then measure the start and end of a task with a time stamp to gauge performance. Their in-house test shows the Intel system completing the task in approximately 61 seconds while the AMD based one finished it in roughly 64 seconds which is a delta of 6-7%.

     

    As AMD's results line up with those found with PCMark 8, they contend that PCMark 8 is a more fair and balanced indicator of overall performance while SYSmark is not and therefore should be discarded by any potential customers as a tool for evaluating a purchase. 

     

    amdinteltest.thumb.JPG.57191048d02a2763b

    Intel system using AMD in-house test: Test completed in ~61 seconds.

    amdinternaltest.thumb.JPG.b4b0576be9702f

    AMD system using AMD in-house test: Test completed in ~64 seconds.

     

    They also take the time to remind us that the FTC has required SYSmark published benchmarks to contain fine print that notes their benchmark may only be optimized for Intel. Of course, this may have something to do with the fact that AMD resigned from BAPco consortium. Finally, AMD notes that a transparent benchmark should meet very specific criteria which includes being realistic, unbiased, objective and transparent, all of which SYSmark is not apparently. 

     

    criteria.thumb.JPG.83070ca48ade93fb60255

     

    While it's fun to see these types of videos from AMD, they also highlight the fact that the company is facing an uphill battle on all fronts, whether it's CPU or GPU, and 2016 may be the year that makes or breaks them.

     

    Edited by Brian

      Report Article
    Sign in to follow this  


    User Feedback


    There are no comments to display.



    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!

    Register a new account

    Sign in

    Already have an account? Sign in here.

    Sign In Now


  • Similar Content

    • By Sarafan
      Hi everyone,
       
      I was looking into overclocking my 4800MQ, so I installed XTU. I'm more or less a beginner at this, however I noticed when I try to benchmark my CPU, the ''current limit throttling'' is almost always occurring. I've tried increasing the processor current limit and undervolting as well but it has no effect. Also, the package TDP doesn't seem to go above 39-40W...
       
      Could anyone help me with this? Why is my CPU throttling without reaching its limit?
       
       

    • By Rappid Rabbit
      i was wanting to upgrade my clevo p151sm1(not -a) that has a gtx 765m to a 970m or 965m and wondering if its possible to do before i go buying the gpu and have it not work (cpu is i5 4300m)
    • By Brian
      So now that we've had ample time to digest all the new AMD Vega 56/64 reviews and information, lets start a discussion about them. Performance wise, the Vega 56 more or less equals a GTX 1070 while the Vega 64 lines up with a GTX 1080. However, to many people's dismay, the Vega 64 is far too overpriced with the cheapest one currently available on Newegg being an XFX one for $689 which is nearly the same price as a GTX 1080 Ti but about 35-40% slower. 
       
      In addition, both the Vega 56 and 64 use more power than their counterparts and this especially applies to the Vega 64 with it nearly consuming twice as much power as the GTX 1080. Some of the reasons I've read over the internet from Vega buyers for their purchases are the ability to utilize their FreeSync monitors as well as some Linux uses. 
       
      I know our community here also utilizes desktop GPUs for eGPU uses and AMD does support eGPU now so with that in mind, do you plan to purchase a Vega 56 or 64 and if so, why? 
    • By Henrik9979
       
      Okay here is what's going. I have a alienware m18x r1 running an amd 8970m, I wanted to upgrade it to crossfire but I could see a 8970m was more expensive than a r9 m290x
      So I decided to buy a r9 m290x and see if I could make it work in my alienware and also run crossfire.
      Even though many shops refused to sell me one because the didn't think it would work in an alienware m18x r1 only in the r2.
       
      Here is the whole process.
       
      19/08/17 23:15
      No post bios showing when booting, so impossible to enter bios menu, but can boot into windows 10 with no problems.
       
      19/08/17 23:20
      Because I haven't deleted the old AMD 8970m the r9 m290x shows as a 8970m with no problems.
       
      19/08/17 23:34
      First performance test was a success. The r9 m290x changed p-state normally. The gpu fan start spinning normally. But because of no thermal paste, the test lasted 20 seconds because the temperature raised fast.
       
      20/08/17 00:00
      Created a backup of the vbios version
      015.032.000.004.044450
       
      20/08/17 00:10
      Flashed a new clevo vbios version 015.032.000.003.044465
      Caused the card to be corrupted and resulted the 8 beep code.
       
      20/08/17 00:35
      Finally managed to flash the back and return the graphics card to its original state.

      20/08/17 00:50
      Flashed a new dell vbios version 015.046.000.014.045579
      No change in behavior
       
      20/08/17 01:07
      After trying multiple vbios with no luck I finally found one.
      Dell vbios Version 015.041.000.000.044966
      Brings back the post bios screen and I can now enter the bios menu through the r9 m290x.
      Note: This vbios reduce the cards performance from 900 mhz to 850 mhz
       
      20/08/17 01:21
      After more testing I found one that is working with no limits.
      Clevo vbios version
      015.036.000.005.044618
      Brings back the post bios screen and I can now enter the bios menu through the r9 m290x.
      This will be the vbios I will keep at the moment.

      20/08/17 01:56
      I completely uninstalled the previous driver and installed the newest driver. The graphics card is recognized as a 8970m but works normal.

      21/08/17 20:15
      I have inserted my old 8970m in the secondary slot and will start testing crossfire.
       
      21/08/17 21:45
      I have found out that the fan for the secondary fan did not spin. The is a cable that have felt out. I will fix it now.

      21/08/17 22:00
      In my try to test crossfire compatibility, I installed the newest AMD driver 17.7.2 but as soon it installed the driver for the secondary card it caused black screen. Only booting the computer in safe mode brings the screen back.

      21/08/17 23:02
      After many frustrating hours I finally managed to get crossfire working with the r9 m290x as the primary card and my old 8970m as the secondary.
      I have flashed the same vbios on both cards so the r9 m290x shows up I device manager as a 8970m.
       
      I first installed AMD driver version 16.2.1
       
      Then installed AMD driver version 16.6.1 in order to play battlefield

      21/08/17 23:20
      First test run in battlefield 1

      21/08/17 23:40
      Battlefield 1 is flickering bad, this can maybe be solved with a new patch or driver.
      Other games I have tried is working perfect with crossfire on.


      Now what I would like to try is somehow force the r9 m290x driver to be installed and see if it will make it possible to run the latest AMD driver without getting a blackscreen.
       
      I have tried to edit the .inf file like you would do with nvidia but no luck.
      I have also tried to figure out how to edit the device id in the vbios, but I find it too complex.






























       
    • By d3nver
      Hi,
       
      I would like to ask you about Intel Rapid Storage Technology, since few weeks I have a problem with my RAID0 ( 2x 512GB SSD disks ) after I shut down Windows, and power on the laptop, I have a message that RAID is damaged and one of the disks is missing. So i figured out that I'll check it in BIOS settings, and in BIOS everything is OK, 2 DISKs are visible, RAID status is NORMAL, if I run Windows after BIOS, then everything works perfectly, but if I run windows in 1st place, there is always raid error, and one of the disks is missing. Have you met a similar problem, do you have any idea how to fix it? I have to admit that I had reinstall Windows, and it's not helping ( Windows 7 and 10 were tested ).
×

Important Information

By using this site, you agree to our Terms of Use.