ASRock.com Homepage
Forum Home Forum Home > Technical Support > Intel Motherboards
  New Posts New Posts RSS Feed - Samsung 950 pro m.2 raid 0 sleep problem
  FAQ FAQ  Forum Search Search  Events   Register Register  Login Login

Samsung 950 pro m.2 raid 0 sleep problem

 Post Reply Post Reply Page  123 4>
Author
Message
nme View Drop Down
Newbie
Newbie


Joined: 15 Apr 2016
Status: Offline
Points: 6
Post Options Post Options   Thanks (0) Thanks(0)   Quote nme Quote  Post ReplyReply Direct Link To This Post Topic: Samsung 950 pro m.2 raid 0 sleep problem
    Posted: 16 Apr 2016 at 9:38am
Hey guys and gals! I have an interesting dilemma that I have not been able to figure out. I have a pretty interesting system with an even more interesting problem. Here is what happens:

benchmarks:

After a clean boot I run ATTO disk benchmark or samsung magician on my samsung 950 pro 512 GB m.2 raid and get about 3 GB read and 3 GB write speeds. Great you say! Here is the problem... If i put the computer to sleep, and wake it back up then run the test I get about half of that speed at 1.5-1.6 GB read and write. Its like clockwork. Nothing to do with heat throttling because i can repeat this and it happens every time. There are also 4x 120mm fans on the side of my case lol.

It seems to me that there may be some sort of power setting or sleep setting that limits throughput. I haven't found a bios setting that makes sense though. All of the power settings i can think of (besides speedstep) are disabled. Also not sure if there is a setting for the type of sleep in this bios (s3, s4, s5 or whatever they are)

 Here is a list of things i have done:

-Disconnected all my other hard drives and CD drives leaving the raid as my only storage
-disconnected my only other pci device (7.1 sound card)
-disabled  hybrid sleep in windows power settings (computer wont actually wake after doing this, so it just makes it worse)
-updated bios to newly released 3.0 from 4/13/16. I believe i was at 2.6 or 2.8 before.
-disabled write caching buffer

Here are my specs

Windows 10 Pro 64-bit
Intel Core i7 6700k stock @ 4.00GHz 17 °C (im in a basement.. cpu has corsair h100i water cooler)
RAM 32.0GB DDR4 3200
ASRock Z170 Extreme7+ 26 °C
NVIDIA GeForce GTX 970 (Gigabyte) 25 °C
2x samsung 950 pro nvme m.2 drives in intel raid 0
uefi install, csm disabled
intel rst version 14.8.0.1042
1x 3 tb samsung hdd 
1x 3 tb wd greed backup drive
1x blu ray
1x dvd burner
asus xonar 7.1 sound card (pcie 1x)
12 total fans (4x120 side, 1x140 front, 1x120back, 1x120mm psu, 2x120mm on cpu radiator, 3 on video card)
seasonic 750 watt gold psu
corsair 600t white case

I use the sleep mode regularly and had no problems with my old setup (i7 3770k sata raid 940 pros).

any questions, comments or helpful feedback? I also take criticisms, sarcasm, and negativity!

Hope you guys can help!

Thanks
Mike


Edited by nme - 16 Apr 2016 at 9:39am
Back to Top
Grant Rogers View Drop Down
Newbie
Newbie


Joined: 07 Jul 2016
Status: Offline
Points: 7
Post Options Post Options   Thanks (0) Thanks(0)   Quote Grant Rogers Quote  Post ReplyReply Direct Link To This Post Posted: 10 Jul 2016 at 9:35pm
Hi Mike,

I have just stumbled across this message in search for an answer and have exactly the same problem as you and a similar system set-up.

My specifications:
Windows 10 Pro V1511
Intel Core i7 6700K stock @ 4.00Ghz H100i GTX
64GB RAM
ASRock Z170 OC Formula
2x Samsung 950 Pro NVME m.2 Intel Raid 0
CSM disabled
2x 6TB Hdds
1x Bluray writer
1600 watt PSU
Corsair 500R case

Fresh boot:
http://imgur.com/xc1sP3r

After sleep:
http://imgur.com/H4RCF9N

I have a strong suspicion this is being cased by the intel raid drivers.  They just don't seem to handle sleep properly.  I have also noticed in the event viewer I am getting event ID 129 storahci (Reset to device, \Device\RaidPort0, was issued.) when waking up from sleep.  I am going to report this to Intel and ASRock although I am not holding my breath.


Edited by Grant Rogers - 10 Jul 2016 at 9:36pm
Back to Top
parsec View Drop Down
Moderator Group
Moderator Group
Avatar

Joined: 04 May 2015
Location: USA
Status: Offline
Points: 4996
Post Options Post Options   Thanks (0) Thanks(0)   Quote parsec Quote  Post ReplyReply Direct Link To This Post Posted: 10 Jul 2016 at 11:11pm
A curious but obvious issue, I can't say I ever checked the performance of two 950 Pro's in RAID 0 after waking from Sleep when I had that setup a while ago.

I couldn't stand the failure of the RAID 0 array if the UEFI/BIOS was cleared, or the same failure after a UEFI update. Which is why I stopped using RAID 0 with these SSDs.

I don't know what is going on after waking from Sleep, but one thing I want you both to check is the following... Hmm, just remembered the Magician software does not like RAID mode, and I can't remember if this will work when the SSDs are in a RAID 0 array. I'll mention it anyway... Confused

On the main, Disk Drive screen of the Magician software, with one of the 950 Pro's selected (if possible) in the System Information area, the PCIe Slot information, looks like this with a single 950 Pro:



We want to confirm the Link Speed Current, and the Link Width Current, after waking from Sleep. 10Gbps is DMI3/PCIe 3.0 speed, and x4 is the lane connections, as you know.

If the Link Speed or Link Width changes, we then have a hint about what is happening.

I had a thought, put my Z170 Exteme7+ PC, with my single 256GB 950 Pro into Sleep mode, wake it, and see what I get. This is the result:



That's what it should be, so no problem after waking from Sleep on my system. You'll have to trust me on this, I would have posted the result regardless of what it was. I'm using RAID mode, but this is a single drive, no RAID array.

Since I imagine you both are using the M.2 slots, and Z170 systems use the chipset DMI3 lanes for the M.2 slots, you cannot try the UEFI option available for the PCIe slots. That is, setting the PCIe slots to Gen3 (PCIe 3.0) in Chipset Configuration. Z97 and X99 boards use the CPU's PCIe 3.0 lanes for the M.2 slots.

Originally posted by Grant Rogers Grant Rogers wrote:

Hi Mike,

I have just stumbled across this message in search for an answer and have exactly the same problem as you and a similar system set-up.
.
.
.
I have a strong suspicion this is being cased by the intel raid drivers.  They just don't seem to handle sleep properly.  I have also noticed in the event viewer I am getting event ID 129 storahci (Reset to device, \Device\RaidPort0, was issued.) when waking up from sleep.  I am going to report this to Intel and ASRock although I am not holding my breath.


That's an interesting event, but something is strange about it. storahci is the native Windows 10 AHCI driver. The Intel IRST driver is iaStorA.sys, which you can confirm in the Device Manager entry, under Storage Controllers.

Regardless, the reference to \Device\RaidPort0 seems to be related to this situation. You should check the Event Log for anything about iaStorA.sys, if you manually installed the IRST 14.6 or 14.8 version driver, which I believe you must have done.

We also have the Samsung NVMe driver to potentially add to the list of reasons for this issue. A question that I am unsure about is, when using these SSDs in RAID 0, is the Intel IRST driver in complete control, and the only one that is used? The Samsung NVMe driver not being used at all?

Or, is the Windows 10 native NVMe driver, whose name I cannot recall right now.

OHH great, more Windows Sleep issues... why am I one of the few that does not have any... Confused

I'll be thinking about this, and watching this thread.

Back to Top
parsec View Drop Down
Moderator Group
Moderator Group
Avatar

Joined: 04 May 2015
Location: USA
Status: Offline
Points: 4996
Post Options Post Options   Thanks (0) Thanks(0)   Quote parsec Quote  Post ReplyReply Direct Link To This Post Posted: 11 Jul 2016 at 11:33am
If you are feeling adventurous, you can try one of the Intel IRST beta drivers that this website somehow manages to get. I've used other non-officially released versions of IRST from this website, and they were fine.

http://www.station-drivers.com/index.php?option=com_remository&Itemid=353&func=select&id=103&lang=en

Notice they have IRST version 15 drivers for current chipsets like our Z170. Right now, Intel has an IRST version 15 driver available for the NUC mini board PC. Must be a big demand for that... Confused

Frankly, although I like Intel and IRST, the IRST software is loaded with bugs. I've seen several officially released versions going back to IRST 11 that were subsequently removed by Intel due to problems.

If we check the Relase Notes for IRST version 14.8.0.1042, we can find a few known issues related to your situation. For example:

4938878  PCIe link speed information is not updated in RST UI after exiting S3

May be a bit more than link speed information is not updated.

4938246  PCIe NVMe SSD 2DR0 (2-disk RAID 0) performance lower than pass-through single SSD

That inspires confidence. This is an old bug, that is also included in the Resolved Issues section.

We can also see other bugs related to NVMe SSD use.

Currently, if I attempt to install the IRST Windows software, the IRST UI will not install, the installation program just hangs indefinitely at the point (I assume) when the IRST UI is installed. I must kill the installation process. I get the 14.8.0.1042 driver installed, but no IRST UI. The... "SATA" mode is set to RAID in the UEFI, from day one of the Windows 10 installation, using a 950 Pro as the OS drive. Perhaps my configuration of the 950 Pro, an SM951 (AHCI version), and an 840 Pro, is a tortuous combination. Cool

I must give Intel credit, they have given us RAID with NMVe SSDs, which is a different protocol than SATA, and uses a different driver. IMO it is a miracle it works at all. Can we find such a capability anywhere else?

https://downloadmirror.intel.com/25165/eng/Release_Notes_14_8_PV.htm

Back to Top
clubfoot View Drop Down
Newbie
Newbie
Avatar

Joined: 28 Mar 2016
Location: Canada
Status: Offline
Points: 246
Post Options Post Options   Thanks (0) Thanks(0)   Quote clubfoot Quote  Post ReplyReply Direct Link To This Post Posted: 11 Jul 2016 at 12:37pm
I don't use sleep modes on my system but will test it later to see if I have the issue and report back tomorrow.

Parsec that clear CMOS is really f'd on this board,...that's why I stay away from it and have no issues with my RAID or bios updates.Smile
Back to Top
clubfoot View Drop Down
Newbie
Newbie
Avatar

Joined: 28 Mar 2016
Location: Canada
Status: Offline
Points: 246
Post Options Post Options   Thanks (1) Thanks(1)   Quote clubfoot Quote  Post ReplyReply Direct Link To This Post Posted: 12 Jul 2016 at 9:23am
I concur with your findings.  IRST version 15. write back cache disabled, BIOS loaded with defaults and balanced power plan in Os. I don't use sleep on my computer as it is used for gaming,...but good to know.

Before sleep:
CrystalDiskMark 5.1.2 x64 (C) 2007-2016 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

   Sequential Read (Q= 32,T= 1) :  3192.719 MB/s
  Sequential Write (Q= 32,T= 1) :  1916.382 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   820.143 MB/s [200230.2 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :   640.631 MB/s [156404.1 IOPS]
         Sequential Read (T= 1) :  3062.996 MB/s
        Sequential Write (T= 1) :  1923.757 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    45.345 MB/s [ 11070.6 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :   162.830 MB/s [ 39753.4 IOPS]

  Test : 1024 MiB [C: 36.8% (158.4/430.5 GiB)] (x5)  [Interval=5 sec]
  Date : 2016/07/11 20:38:37
    OS : Windows 10 Professional [10.0 Build 10586] (x64)

After sleep:
CrystalDiskMark 5.1.2 x64 (C) 2007-2016 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

   Sequential Read (Q= 32,T= 1) :  1637.564 MB/s
  Sequential Write (Q= 32,T= 1) :  1575.108 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   824.710 MB/s [201345.2 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :   662.792 MB/s [161814.5 IOPS]
         Sequential Read (T= 1) :  1606.940 MB/s
        Sequential Write (T= 1) :  1380.449 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    51.131 MB/s [ 12483.2 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :   140.071 MB/s [ 34197.0 IOPS]

  Test : 1024 MiB [C: 36.8% (158.4/430.5 GiB)] (x5)  [Interval=5 sec]
  Date : 2016/07/11 20:57:59
    OS : Windows 10 Professional [10.0 Build 10586] (x64)


Edited by clubfoot - 12 Jul 2016 at 9:24am
Back to Top
parsec View Drop Down
Moderator Group
Moderator Group
Avatar

Joined: 04 May 2015
Location: USA
Status: Offline
Points: 4996
Post Options Post Options   Thanks (0) Thanks(0)   Quote parsec Quote  Post ReplyReply Direct Link To This Post Posted: 12 Jul 2016 at 10:26am
Originally posted by clubfoot clubfoot wrote:

I concur with your findings.  IRST version 15. write back cache disabled, BIOS loaded with defaults and balanced power plan in Os. I don't use sleep on my computer as it is used for gaming,...but good to know.

Before sleep:
CrystalDiskMark 5.1.2 x64 (C) 2007-2016 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

   Sequential Read (Q= 32,T= 1) :  3192.719 MB/s
  Sequential Write (Q= 32,T= 1) :  1916.382 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   820.143 MB/s [200230.2 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :   640.631 MB/s [156404.1 IOPS]
         Sequential Read (T= 1) :  3062.996 MB/s
        Sequential Write (T= 1) :  1923.757 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    45.345 MB/s [ 11070.6 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :   162.830 MB/s [ 39753.4 IOPS]

  Test : 1024 MiB [C: 36.8% (158.4/430.5 GiB)] (x5)  [Interval=5 sec]
  Date : 2016/07/11 20:38:37
    OS : Windows 10 Professional [10.0 Build 10586] (x64)

After sleep:
CrystalDiskMark 5.1.2 x64 (C) 2007-2016 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

   Sequential Read (Q= 32,T= 1) :  1637.564 MB/s
  Sequential Write (Q= 32,T= 1) :  1575.108 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   824.710 MB/s [201345.2 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :   662.792 MB/s [161814.5 IOPS]
         Sequential Read (T= 1) :  1606.940 MB/s
        Sequential Write (T= 1) :  1380.449 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    51.131 MB/s [ 12483.2 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :   140.071 MB/s [ 34197.0 IOPS]

  Test : 1024 MiB [C: 36.8% (158.4/430.5 GiB)] (x5)  [Interval=5 sec]
  Date : 2016/07/11 20:57:59
    OS : Windows 10 Professional [10.0 Build 10586] (x64)


It looks like we have another data point where the wake from Sleep changes something that causes a performance loss for the 950 Pro in RAID 0.

But I find your before and after Crystal results (in text mode) easier to read than the screenshots, and I can analyze them better. Thanks for posting this Thumbs Up

Clearly the sequential, large file read and write speeds (with one file, or with a Queue depth of 32 files) are reduced by almost 50% for the Read speed, but not as bad for Write speed.

What is curious is the 4K small file results, (with one file, or with a Queue depth of 32 files) are either virtually identical for Q=32, and actually improved for single file 4K reads! The 4K random write takes a small hit in performance.

I'd really like to know what happens here, given these results. Confused

The reduced sequential file speeds imply a bandwidth reduction, but to not have that reflected in the 4K results is strange.

The increase in the 4K random read speed (Q=1) reminds me of the difference between one of these drives and two in RAID. In RAID 0, you loose some 4K random performance, which is normal and the biggest downside of RAID 0 performance. But a single 950 Pro should not be able to match the Q=32 4K results. So that is again, strange.

Do you see any difference in your CPU speed after waking from Sleep? Reduced CPU speed, or the loss of an OC is a classic wake from Sleep bug that many boards have. I do NOT see that on my ASRock Z170 Extreme7+ board, with an i5-6600K at 4.4GHz. I also do not see that happen on my ASRock X99 board.

So what is happening? Are the DMI3 lanes changing to DMI2 speeds? Are we loosing a DMI3 lane for some reason?

clubfoot, if you run the Magician software after waking from Sleep, what do you see about your 950 Pros, as I asked about in my earlier post with the Magician screenshot?

Also, I am not blaming the UEFI clear for the problem with the failure of the RAID 0 array of the PCIe NVMe SSDs. A RAID 0 array of SATA III SSDs will not be in a failed state after a UEFI clear. That has always been that way.

IF the PCIe Remapping option must be enabled, or the PCIe SSD RAID 0 array will fail when the PC POSTs, I also cannot call that a UEFI bug. The PCIe Remapping option is not something that should be enabled by default for the majority of users. If it was enabled by default, most users would need to disable it before normal operation of their SATA drives would happen.

Again, IF the PCIe Remapping option must be enabled, or the PCIe SSD RAID 0 array will fail during POST, that is a bad situation that may not be able to be solved with an IRST driver update. I have more theories, but they are no worth mentioning.
Back to Top
vacaloca View Drop Down
Newbie
Newbie


Joined: 05 May 2016
Status: Offline
Points: 36
Post Options Post Options   Thanks (0) Thanks(0)   Quote vacaloca Quote  Post ReplyReply Direct Link To This Post Posted: 12 Jul 2016 at 10:26am
My only guess would be to change the PCI Express Link State Power Management Settings in the power plan being used to off, perhaps try the same in BIOS if there is such an option to see if the issue is resolved. Otherwise, then yes, it sounds like faulty drivers.
Back to Top
clubfoot View Drop Down
Newbie
Newbie
Avatar

Joined: 28 Mar 2016
Location: Canada
Status: Offline
Points: 246
Post Options Post Options   Thanks (0) Thanks(0)   Quote clubfoot Quote  Post ReplyReply Direct Link To This Post Posted: 12 Jul 2016 at 11:07am
There is an option to lock the buses at GEN3,...but I'm thinking that is only for the PCI graphics bus as changing it to GEN3 lowers the graphics scores :( Is there a UEFI option to lock the DMI for the m.2s?

I've always enabled the remapping for my two m.2s,...are you saying I do not need to?

In my "normal" setup i.e. o/c at 4.5Ghz with C States disabled, Speed Step disabled,...my comp will not sleep :) Tomorrow I can retest the cpu speed drop from sleep to see if that is what is causing it.
Back to Top
parsec View Drop Down
Moderator Group
Moderator Group
Avatar

Joined: 04 May 2015
Location: USA
Status: Offline
Points: 4996
Post Options Post Options   Thanks (0) Thanks(0)   Quote parsec Quote  Post ReplyReply Direct Link To This Post Posted: 12 Jul 2016 at 5:43pm
Originally posted by vacaloca vacaloca wrote:

My only guess would be to change the PCI Express Link State Power Management Settings in the power plan being used to off, perhaps try the same in BIOS if there is such an option to see if the issue is resolved. Otherwise, then yes, it sounds like faulty drivers.


Good idea, if that would also apply to the DMI3 buss in the chipset, who knows if it does. A worthwhile experiment for this issue and in general. But, would the setting in the Power Plan match the actual setting in Windows after waking from Sleep. Confused

My Z170 Extreme7+ board and the Z170 OC Formula has two UEFI options that are similar to this Windows Power Plan setting.

One is the PCH DMI ASPM Support (speaking in acronyms.) PCH is the chipset, ASPM is Active State Power Management.

The other is DMI ASPM Support, which is ASPM support on the CPU side of the DMI link.

Both of these options are Disabled by default. I enabled them as a test, and the PCH temperature was reduced relative to being enabled, so they do seem to do what they should do.

Checking if they were enabled after waking from Sleep would not be simple, if even possible. The difference in PCH temperature would be a clue indicating they were enabled IMO.

Back to Top
 Post Reply Post Reply Page  123 4>
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.04
Copyright ©2001-2021 Web Wiz Ltd.

This page was generated in 0.203 seconds.