Jump to content
  • Sign in to follow this  

    AMD: Is SYSmark a Reliable Benchmark?


    Brian

    We all love drama between technology companies and the latest deliciousness comes courtesy of AMD. They have a 4 minute video on YouTube that questions whether or not SYSmark is a reliable, objective benchmark to use when evaluating performance between different systems. 

     

    AMD's video opens with John Hampton, Director Computer Client Products, talking about how it is very important in choosing the right benchmark when evaluating a purchase because if you choose the wrong one , you can end up overpaying for technology or getting a lesser performing PC. To emphasize his point, he indirectly mentions Volkswagen's diesel debacle and uses the latter case as an example of how even established organizations can be misleading. 

     

    We are then introduced to Tony Salinas, an AMD Engineering Manager, who runs through a couple tests in SYSmark using two notebooks, one that has an Intel i5 CPU and the other with an AMD FX CPU. SYSmark returns a score of 987 for the Intel system and 659 for the AMD one which is a delta of 50%. AMD notes that this is misleading and not reflective of real life performance. To prove this, they run a different benchmark called PCMark 8 on both systems and the results show the Intel i5 system scoring 4199 and the AMD equipped one 3908 which is a delta of 7%. AMD says this is a far more realistic indicator of true performance as PCMark 8 tests the CPU, GPU and video subcomponents rather than emphasizing the CPU like SYSmark does.

     

    And just to drive the point home some more, AMD created their own in-house test using Microsoft Office Suite where they run a custom script on both notebooks and then measure the start and end of a task with a time stamp to gauge performance. Their in-house test shows the Intel system completing the task in approximately 61 seconds while the AMD based one finished it in roughly 64 seconds which is a delta of 6-7%.

     

    As AMD's results line up with those found with PCMark 8, they contend that PCMark 8 is a more fair and balanced indicator of overall performance while SYSmark is not and therefore should be discarded by any potential customers as a tool for evaluating a purchase. 

     

    amdinteltest.thumb.JPG.57191048d02a2763b

    Intel system using AMD in-house test: Test completed in ~61 seconds.

    amdinternaltest.thumb.JPG.b4b0576be9702f

    AMD system using AMD in-house test: Test completed in ~64 seconds.

     

    They also take the time to remind us that the FTC has required SYSmark published benchmarks to contain fine print that notes their benchmark may only be optimized for Intel. Of course, this may have something to do with the fact that AMD resigned from BAPco consortium. Finally, AMD notes that a transparent benchmark should meet very specific criteria which includes being realistic, unbiased, objective and transparent, all of which SYSmark is not apparently. 

     

    criteria.thumb.JPG.83070ca48ade93fb60255

     

    While it's fun to see these types of videos from AMD, they also highlight the fact that the company is facing an uphill battle on all fronts, whether it's CPU or GPU, and 2016 may be the year that makes or breaks them.

     

    Edited by Brian

      Report Article
    Sign in to follow this  


    User Feedback


    There are no comments to display.



    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!

    Register a new account

    Sign in

    Already have an account? Sign in here.

    Sign In Now


  • Similar Content

    • By Logan
      Hello guys,
       
      I've no idea where to post it, so this thread seems to be the most logical one, for me at least. 

      However here is the link with the news about their upcomming GPUs suited for gaming: 

      https://www.pcbuildersclub.com/2018/06/arctic-sound-intel-bestaetigt-dedizierte-gaming-grafikkarte-ab-2020/
    • By ruxik93
      So I'm a recently father of 1 and struggling military personnel. No need for more details. I'm building a "gaming desktop" out of parts I'm collecting out of other people's trash basically. Running on all 2012 standards. currently I'm using a AMD Athlon II x4 clocked at 2.6 GHz on a Pegatron M2N78-LA (Violet6) motherboard with 500Gb of space and a Zotac Nvidia GT 640. I'm really proud of this setup so far because the overall price of the desktop is currently sitting at $10 for the Arctic Silver to replace the old thermal paste. The main thing I'm wanting to know from this community is whether or not the AMD Phenom is a decent processor. On paper it looks fine, but i have never built with it before, therefore I'm uncertain. Also if anyone knows of a cheap cheap MOBO that is still high quality and has 4 DIMM slots and preferably at least AM3+.
    • By xerman
      Hello all! Im posting this here in hope to receive some orientation or help regargind my egpu project.
       
      I have my old and trusted Acer 5750G and I’m still using it everyday for work. I’m a photographer and it has worked quite well with some upgrades:
      -Upgraded i5 to i7 2630qm.
      -Upgraded ram, 8gb to 16 gb.
      -Upgraded HD to SSD.
       
      Some facts:
      – I have the unlocked bios so I was able to set the mpci port as “hot pluggable” and I can also deactivate the dedicated nvidia 630m from the bios itself.
      – I have bough this case [PCIe PCI-E EXP GDC External Laptop Video Card Dock / Laptop Docking Station (Mini PCI-E interface Version) ] that will arrive home in 10-15 days.
      – I have ordered a wifi usb card.
      I was thinking in getting a nvidia 1060 6gb and plug it to my old laptop using the mpci port. I ask for your advice and knoledge regarding this:
      1- Is this a good card choice?
      2- Will I face any problem with my setup or there is something important I should take into consideration?
      3- Will software that uses CUDA (photoshop and premiere, for example) get reinforced with the new card?
      4- How much processing power will get lost for the “small” port I will be using?
      Thanks a lot again, and sorry for my english mistakes!!
    • By Sarafan
      Hi everyone,
       
      I was looking into overclocking my 4800MQ, so I installed XTU. I'm more or less a beginner at this, however I noticed when I try to benchmark my CPU, the ''current limit throttling'' is almost always occurring. I've tried increasing the processor current limit and undervolting as well but it has no effect. Also, the package TDP doesn't seem to go above 39-40W...
       
      Could anyone help me with this? Why is my CPU throttling without reaching its limit?
       
       

×

Important Information

By using this site, you agree to our Terms of Use. We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.