• Sign in to follow this  
    Followers 0

    AMD: Is SYSmark a Reliable Benchmark?


    Brian

    We all love drama between technology companies and the latest deliciousness comes courtesy of AMD. They have a 4 minute video on YouTube that questions whether or not SYSmark is a reliable, objective benchmark to use when evaluating performance between different systems. 

     

    AMD's video opens with John Hampton, Director Computer Client Products, talking about how it is very important in choosing the right benchmark when evaluating a purchase because if you choose the wrong one , you can end up overpaying for technology or getting a lesser performing PC. To emphasize his point, he indirectly mentions Volkswagen's diesel debacle and uses the latter case as an example of how even established organizations can be misleading. 

     

    We are then introduced to Tony Salinas, an AMD Engineering Manager, who runs through a couple tests in SYSmark using two notebooks, one that has an Intel i5 CPU and the other with an AMD FX CPU. SYSmark returns a score of 987 for the Intel system and 659 for the AMD one which is a delta of 50%. AMD notes that this is misleading and not reflective of real life performance. To prove this, they run a different benchmark called PCMark 8 on both systems and the results show the Intel i5 system scoring 4199 and the AMD equipped one 3908 which is a delta of 7%. AMD says this is a far more realistic indicator of true performance as PCMark 8 tests the CPU, GPU and video subcomponents rather than emphasizing the CPU like SYSmark does.

     

    And just to drive the point home some more, AMD created their own in-house test using Microsoft Office Suite where they run a custom script on both notebooks and then measure the start and end of a task with a time stamp to gauge performance. Their in-house test shows the Intel system completing the task in approximately 61 seconds while the AMD based one finished it in roughly 64 seconds which is a delta of 6-7%.

     

    As AMD's results line up with those found with PCMark 8, they contend that PCMark 8 is a more fair and balanced indicator of overall performance while SYSmark is not and therefore should be discarded by any potential customers as a tool for evaluating a purchase. 

     

    amdinteltest.thumb.JPG.57191048d02a2763b

    Intel system using AMD in-house test: Test completed in ~61 seconds.

    amdinternaltest.thumb.JPG.b4b0576be9702f

    AMD system using AMD in-house test: Test completed in ~64 seconds.

     

    They also take the time to remind us that the FTC has required SYSmark published benchmarks to contain fine print that notes their benchmark may only be optimized for Intel. Of course, this may have something to do with the fact that AMD resigned from BAPco consortium. Finally, AMD notes that a transparent benchmark should meet very specific criteria which includes being realistic, unbiased, objective and transparent, all of which SYSmark is not apparently. 

     

    criteria.thumb.JPG.83070ca48ade93fb60255

     

    While it's fun to see these types of videos from AMD, they also highlight the fact that the company is facing an uphill battle on all fronts, whether it's CPU or GPU, and 2016 may be the year that makes or breaks them.

     

    Edited by Brian

    1 person likes this
    Sign in to follow this  
    Followers 0


    User Feedback


    There are no comments to display.



    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!


    Register a new account

    Sign in

    Already have an account? Sign in here.


    Sign In Now

  • Similar Content

    • By rusTORK
      I know, i know, i know... @svl7 said it's disabled, @octiceps said it's disabled and many other forum users said it's disabled.
       
      I am always want to double check everything and i did it this time too. And i would like to post here result of my research. But first thing first - my PC:
       
      Laptop Configuration: Lenovo Y500 SLI
       
      CPU: Intel i7-3630QM (2400-3400 MHz, Ivy Bridge, QuadCore)
      VGA: 2x 2048Mb NVIDIA GeForce GT650M (SLI Configuration)
      MB: Compal LA-8692P
      RAM: 2x 4Gb Ramaxel RMT3160ED58E9W1600 (11-11-11-28)
      HDD: 1TB Seagate Momentus 5400 (ST1000LM024 HN-M101MBB)
      SSD: 120 Gb Samsung 850 EVO (MGX S4LN062X01)
      Display: 15.6" LG\Philips LP156WF1-TLC1 (1920x1080)
      WIN: MS Windows 10 Pro (x64)
       
      Also i must say, that i have got UNLOCKED BIOS by @svl7. And for second VGA too.
       
      Research
       
      It's beginning from @geraldthread about his Ultrabay to PCI-E Adapter for Lenovo Y510p for useing Radeon Desktop VGAs as external VGA. It's performed well with Y510p, but there was zero info about how it perform on Y500 or will it perform at all (now we know that it's no, but it's another story). Unlocked BIOS didn't help with adapter and i decided to dig more deep in re-enabling integrated GPU in Intel CPU - Intel HD Graphics 4000. And new unlocked BIOS give me a lot of new options to play. But important thing is... some of them working, some of them no. So, here is what i am founded.
       
      First i go to new unlocked BIOS and saw there a lot new tabs.

       
      I go to Advanced => Video Configuration => Special Features


      This option already was Enabled (Switch Graphic Function)
       

      After that i go to Internal Graphic Device and Enable Internal Graphics Device.
       
      Then save changes and exit. Laptop is shutdown and after few seconds turn on again. I saw Lenovo loading screen and then nothing when loading complete. Windows didn't start.
      I am restarted laptop three times and it's started recovery mode. From recovery mode i am loaded Safe Mode and at that point i am finally was at Windows.
       
      My first way goes to Device Manager to see new device. And there was new device - Intel HD Graphics 4000.

       
      In safe mode windows can't access to it's current status, but there also was no error codes. First time there was no driver installed, but now it's even have last driver!

       
      After that i go to AIDA64 Engineer Edition and look what it's show me. It's saw iGPU!

       
      So, at this point i don't what to think about it. I can see iGPU in safe mode, but i can't boot with it in normal Windows. Is AIDA64 lie to me or even Device Manager?
       
      What do your think about it?
       
      P.S. Oh yeah, most menus on Russian language, but i hope your got the idea and trust me. =) It's no fake.
    • By danielxyz
      Is that possible use it without external display?
      It always mention
      Radeon Settings are currently not available.Please try again after connecting a display to AMD graphics and extending the display.
    • By Jamie Legends
      Hi,   I have a Clevo P170EM with an AMD 7970M.   Last year I tried to change the vBIOS of my 7970M, a friend of my tried to change it because he wanted to ''overlock'' the card. He said no worries I said okay do it, then later on he returned my laptop and bricked both my card and the normal BIOS. I had to repair the laptop trough a repair company in the city. They only could repair the BIOS by doing another BIOS on it. They said to try everything with the card but my laptop wouldn't accept it.   The problem:   After the Windows 10 installation I installed all the drivers from the manufacters site (http://www.eurocom.com/ec/drivers(226)ec). Including the SSD driver, then I FIRST installed and fully updated the Intel HD Graphics. After that I installed the AMD videocard drivers (crimsons edition), the weird part is, AMD autodetect sees my card and so does Windows. Then the driver ask me to restart my laptop, after restarting the Windows logo appears then the screen goes black with a blinking cursor left upper screen.   I believe it has someting to do with the vBIOS of the card and I also believe that the card is not bricked but just wrong BIOS.     I asked the manufacter and they say that the card may be bricked, when I ask for the BIOS they would not provide it for free (bastards). I asked for both the motherboard and AMD card BIOS, they said I have to pay for it.   Question:   Can someone provide information and files for the right vBIOS? I mean the vBIOS that is standard.   Greetz,   Jamie   P.s I have some pictures and screenshot of Windows and the BIOS detecting the graphic card, the weird thing is both OS and BIOS detect the card but when I install the drivers it goes black   P.s.s I already tried everything AMD support provided so I have no use for comments like ''Try unistall with DDU'' or try with second monitor etc.     As you can see I've disabled the card because when I enable, Windows freezes and screen goes black.        
    • By R3dziu
      Hi guys!
       
      I have a big problem-> I need to undervolt my GPU (MSI 7970M@DELL_BIOS).
      I am using this vBIOS: https://www.techpowerup.com/vgabios/132831/dell-hd7970m-2048-120629

      Stock VDDC on this GPU is 1.050V and when I changing this one to 0.975 in VBE7 it is ok-> I can save it and flash it. Computer succesfully restarts but when I check modded settings the VDDC is still on 1.050V
      I checked if the VBE7 seriously saving the VDDC to vBIOS but it is ok. I have no idead what i need to UV this card (i know it's possible...)
      Everything is changing (GPU, MEM MHz) but VDDC can't change.
       
      Please help me ;-)