Re: iDRAC9 : Unable to set manual fan response after iDrac v3.34.34.34
[email protected] Fri, 17 Jan 2020 14:57:44 -0500 (EST)
| Newsgroups | gmane.linux.hardware.dell.poweredge |
|---|---|
| Message-ID | <alpine.LRH.2.21.2001171454330.77689@daltigoth.lasthome.solace.krynn> |
Unfortunately, yes, they are all running the latest firmwares. If I were to replace my H730P with an LSI HBA of the same gen (12G), would that inhibit the max-fan behaviour? It would still be the same drives (LD's and PD's) but behind a 3rd Party PCI-E and then I would be able to disable LFMMode on that one, right? Regards, Vincent On Fri, 17 Jan 2020, [email protected] wrote: > > Dell Customer Communication - Confidential > > > > The TSR on file shows the same three drives installed as your PERC CLI output. > > > > 0 Online Samsung SSD 860 2 TB > > 1 Online Samsung SSD 860 2 TB > > 4 Online Western Digital WD80EFZX 68U 8 TB > > > > Have you looked to see if Western Digital and Samsung have any firmware updates for the disks already? > > > > > > Regards, > > > > Chris Sumers > > Dell EMC | PG- International Product Support (IPS) Engineering > > Office + 1 512 728 4685 > > [email protected] > > Dell Technologies 200 Dell Way, RR5-3 IPS Lab, Round Rock, TX 78682 > > > > > > Please consider the environment before printing this email. > > > > Confidentiality Notice | This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential or proprietary > information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, immediately contact the sender by reply e-mail and > destroy all copies of the original message. > > > > -----Original Message----- > From: [email protected] <[email protected]> > Sent: Thursday, January 16, 2020 5:30 PM > To: Sumers, Chris > Cc: linux-poweredge-Lists > Subject: RE: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan response after iDrac v3.34.34.34 > > > > > > [EXTERNAL EMAIL] > > > > > > Chris, > > > > Thank you for your openness on this list. It's great to feel listened to. > > Can we tell if that TSR was with the Samsung 850 (no temp sensor) or with the Samsung 860? The latter does in fact have a temp sensor: > > > > # megaclisas-status > > [....] > > -- Disk information -- > > -- ID | Type | Drive Model | Size > > | Status | Speed | Temp | Slot ID | LSI ID > > c0u0p0 | SSD | S3YUNB0KC09340D Samsung SSD 860 EVO 2TB RVT03B6Q | 1.818 TB | Online, Spun Up | 6.0Gb/s | 21C | [32:0] | 0 > > c0u1p0 | HDD | R6GP40KY WDC WD80EFZX-68UW8N0 83.H0A83 | 7.276 TB | Online, Spun Up | 6.0Gb/s | 29C | [32:4] | 4 > > c0u2p0 | SSD | S3YUNB0KC09173D Samsung SSD 860 EVO 2TB RVT03B6Q | 1.818 TB | Online, Spun Up | 6.0Gb/s | 21C | [32:1] | 1 > > ^^^^===== > > > > Is it possible that your output is from an old TSR of mine? I wonder if the H730P properly detects the temperature on the 860 even though the megaraid_sas driver does detect it > properly. > > > > Regards, > > > > Vincent > > > > > > On Thu, 16 Jan 2020, [email protected] wrote: > > > > > Dell Customer Communication - Confidential > > > > > > Unfortunately, I agree with your assessment. I pulled the following content from the provided TSR the last time I was engaged on your issue. I had to go back and look again. > > > > > > The disks are driving an open loop response (not LFM) that cannot be adjusted. This is a baseline fan speed response for a no-drive-temp config per design. Agree there's > nothing else we can do here to mask this behavior. > > > > > > From the TSR: > > > ---------------------------------------------------------------------- > > > ---------- > > > OPEN LOOP CONTROL > > > -------------------------------------------------------------------------------- > > > ALG_TYPE ID# NAME FZ1 FZ2 | PSU1 PSU2 > > > OL_TYPE1 2 Baseline_Amb_Any 16.90 0.00 | 0.00 0.00 > > > OL_TYPE1 10 HDD_No_Sensor_OL_3_5 41.75 0.00 | 0.00 0.00 << thermal table fan response due to no HDD temp > > > OL_TYPE1 16 SSD_No_Sensor_OL_2_5 0.00 0.00 | 0.00 0.00 > > > OL_TYPE1 27 FAC_Restriction_Single Fan 0.00 0.00 | 0.00 0.00 > > > OL_TYPE1 28 FAC_Restriction_NonRDNPSU 0.00 0.00 | 0.00 0.00 > > > OL_OTHER 5 OPEN_LOOP_BASELINE 62.80 0.00 | 0.00 0.00 > > > > > > > > > Regards, > > > > > > Chris Sumers > > > Dell EMC | PG- International Product Support (IPS) Engineering Office > > > + 1 512 728 4685 [email protected] Dell Technologies 200 Dell Way, > > > RR5-3 IPS Lab, Round Rock, TX 78682 > > > > > > > > > Please consider the environment before printing this email. > > > > > > Confidentiality Notice | This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential or proprietary > information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, immediately contact the sender by reply e-mail and > destroy all copies of the original message. > > > > > > -----Original Message----- > > > From: [email protected] <[email protected]> > > > Sent: Thursday, January 16, 2020 4:31 PM > > > To: Sumers, Chris > > > Cc: linux-poweredge-Lists > > > Subject: RE: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan > > > response after iDrac v3.34.34.34 > > > > > > > > > [EXTERNAL EMAIL] > > > > > > > > > Here's what happens on an H730P (which has 3rd party SSDs behind it which causes high-rpm) on which I want to disable LFMMode: > > > > > > /admin1-> racadm set system.PCIeSlotLFM.2.LFMMode 1 > > > ERROR: PCI3022: Unable to adjust the Airflow Linear Flow per Minute (LFM) settings of the PCIe slot > > > because the LFM settings can be adjusted only for installed cards that are identified as third party cards. > > > > > > I'm still on 3.30.30.30 > > > > > > ,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'` > > > ^`'~*-, Vincent S. Cojot, Computer Engineering. STEP project. > > > _.,-*~'`^`'~*-,._.,-*~ Ecole Polytechnique de Montreal, Comite Micro-Informatique. _.,-*~'`^`'~*-,. > > > Linux Xview/OpenLook resources page _.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~' > > > http://step.polymtl.ca/~coyote _.,-*~'`^`'~*-,._ > > > [email protected] > > > > > > They cannot scare me with their empty spaces Between stars - on stars where no human race is I have it in me so much nearer home > > > To scare myself with my own desert places. - Robert Frost > > > > > > > > > > > > On Thu, 16 Jan 2020, [email protected] wrote: > > > > > >> Dell Customer Communication - Confidential > > >> > > >> Vincent, > > >> > > >> You are correct. The ipmi raw command that allows a user to bypass the Dell EMC multi-vector cooling algorithm was exposed in iDRAC9 releases prior to iDRAC9 3.43.34.34 > release. This command was not intended for public consumption on iDRAC9 and 14G PowerEdge servers. When it was detected that this command was exposed on Arev iDRAC firmware, > measures were taken to revoke that raw ipmi command starting in iDRAC9 3.34.34.34. > > >> > > >> If you are experiencing high PWM of the internal fan of your T440 due to presence of third-party cards, there are measures that you can take. The Dell EMC fan algorithm can > be disabled on a slot when the PCIe slot is occupied by a third party card. You can leverage the built-in racadm utility through an SSH session to the iDRAC to make these > changes. > > >> > > >> To confirm that the iDRAC detects the add-in card as a third-party card, leverage the system.PCIeSlotLFM.x.3rdPartyCard attribute. You will need to modify "x" with the > numerical value of your PCIe slot. > > >> > > >> racadm>>racadm get system.PCIeSlotLFM.3.3rdPartyCard > > >> [Key=system.Embedded.1#PCIeSlotLFM.3] > > >> 3rdPartyCard=Yes > > >> racadm>> > > >> > > >> If the value for this slot = yes, then you can disable the Dell EMC cooling algorithm for that slot. You will need to modify the sytem.PCIeSlotLFM.x.LFMMode value (x = slot > numerical value). > > >> > > >> racadm>>racadm set system.PCIeSlotLFM.3.LFMMode 1 > > >> [Key=system.Embedded.1#PCIeSlotLFM.3] > > >> Object value modified successfully > > >> > > >> racadm>>racadm get system.PCIeSlotLFM.3.LFMMode > > >> [Key=system.Embedded.1#PCIeSlotLFM.3] > > >> LFMMode=Disabled > > >> racadm>> > > >> > > >> > > >> Additional details on the Dell EMC multi-vector cooling with Dell EMC > > >> PowerEdge servers can be found in this whitepaper: > > >> https://downloads.dell.com/manuals/common/poweredge_pcie_cooling.pdf > > >> > > >> Additional details on racadm attribute registry can be found in the current Attribute Registry Guide: > > >> https://topics-cdn.dell.com/pdf/idrac9-lifecycle-controller-v4x-serie > > >> s > > >> _reference-guide_en-us.pdf > > >> > > >> Additional iDRAC9 whitepapers can be found here: > > >> https://www.dell.com/support/article/us/en/19/sln311300/support-for-i > > >> n tegrated-dell-remote-access-controller-9-idrac9?lang=en > > >> > > >> > > >> Regards, > > >> > > >> Chris Sumers > > >> Dell EMC | PG- International Product Support (IPS) Engineering Office > > >> + 1 512 728 4685 [email protected] Dell Technologies 200 Dell > > >> + Way, > > >> RR5-3 IPS Lab, Round Rock, TX 78682 > > >> > > >> > > >> Please consider the environment before printing this email. > > >> > > >> Confidentiality Notice | This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential or proprietary > information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, immediately contact the sender by reply e-mail and > destroy all copies of the original message. > > >> > > >> -----Original Message----- > > >> From: linux-poweredge-bounces-Lists > > >> <[email protected]> On Behalf Of > > >> [email protected] > > >> Sent: Monday, January 13, 2020 10:06 PM > > >> To: linux-poweredge-Lists > > >> Subject: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan response > > >> after iDrac v3.34.34.34 > > >> > > >> > > >> Hi everyone, > > >> > > >> Just FYI, on 14th Gen PowerEdge, with iDrac v3.34.34.34 and above, > > >> Dell Engineering knowingly removed the possibilty to control fan > > >> speed beyond what the iDRAC considers 'the right thing to do' for > > >> your machine (as of > > >> 3.34.34.34 and above, you no longer have a say in the matter). > > >> > > >> Please allow me to explain by giving an example: > > >> > > >> I own a nice T440 with dual 4110 Xeon silver and with mostly > > >> low-power > > >> components: > > >> - 384Gb RAM in 32Gb LRDIMM sticks. > > >> - PERC H730P with 2 * 2Tb Samsung 860, 1* 8Tb WD Red > > >> - NVidia 1660 GTX Ti > > >> - a quad-1G NIC > > >> - a NVMe drive on a Supermicro PCI-E adapter. > > >> - The box is running RHEL7 with a moderately conservative power profile. > > >> > > >> This box is somewhat low-power (110-154W under light load and 250W under heavy). > > >> I usually force the system fan to 1080rpm: > > >> # /usr/bin/ipmitool raw 0x30 0x30 0x01 0x00 # /usr/bin/ipmitool raw > > >> 0x30 0x30 0x02 0xff 0x0b > > >> > > >> ..unless the cpu temperatures go above 65C at which case the systems goes back to 'auto' on its own (thanks to a daemon): > > >> # /usr/bin/ipmitool raw 0x30 0x30 0x01 0x01 > > >> > > >> This works well and the cpus are usually between 32C and 35C on light > > >> load. I've never had any problem on either of my T440, T430 or T630 > > >> doing this. The script is here: [1] > > >> > > >> ..but because I'm using 3rd party components, the iDRAC -thinks- it -must- set the fan to the highest rpms possible to cool my system. When left to 'auto', the fan goes to > 3700-4300rpm and I feel like I'm standing on the bridge of an aircraft carrier. > > >> > > >> Dell support has been unable to help with my '3rd party components' to take the fans down (we've tried every BIOS setting). > > >> > > >> With 3.34.34.34 and above, the 'manual' fan speed is ignored and > > >> reports > > >> this: > > >> # /usr/bin/ipmitool -I open raw 0x30 0x30 0x01 0x00 Unable to send > > >> RAW command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x30 rsp=0xd4): > > >> Insufficient privilege level > > >> > > >> # /usr/bin/ipmitool -I open raw 0x30 0x30 0x02 0xff 0x0b Unable to > > >> send RAW command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x30 rsp=0xd4): > > >> Insufficient privilege level > > >> > > >> When contacted, an escalation manager at Dell suggested that I > > >> stopped using 3rd party components and that I should buy Workstations instead. > > >> He also confirmed that the removal of the 'ipmitool' 'feature' in > > >> iDRAC > > >> 3.34.34.34 was intentionnal because they 'had had many escalations because of this'. > > >> > > >> Other users on the Dell Community forums have reported similar issues > > >> with > > >> T340 and T640 systems. > > >> > > >> Consequently, I will probably be staying on 3.30.30.30 (the last > > >> working > > >> version) for as long as I can. > > >> > > >> Here is more information: > > >> [1], script (adjust for your machines): > > >> https://raw.githubusercontent.com/ElCoyote27/krynn-tools/master/dellf > > >> a > > >> nctl > > >> > > >> [2]: discussions: > > >> https://www.dell.com/community/Systems-Management-General/iDRAC9-Unab > > >> l > > >> e-to-set-manual-fan-response-after-iDrac-v3-34-34-34/m-p/7339941 > > >> https://www.reddit.com/r/homelab/comments/d0422n/to_anyone_considerin > > >> g > > >> _or_using_dell_14th_gen_for > > >> > > >> I used to be a big fan of Dell systems but this T440 will probably be my last. > > >> > > >> I hope this helps others. > > >> > > >> Regards, > > >> > > >> Vincent (Working but not speaking for RedHat/IBM) > > >> > > >> _______________________________________________ > > >> Linux-PowerEdge mailing list > > >> [email protected] > > >> https://lists.us.dell.com/mailman/listinfo/linux-poweredge > > >> > > > > > > _______________________________________________ Linux-PowerEdge mailing list [email protected] https://lists.us.dell.com/mailman/listinfo/linux-poweredge