Update via DSU leads to bricked PE720xd server. Help?

Ben <[email protected]>
Newsgroups gmane.linux.hardware.dell.poweredge
Message-ID <[email protected]>
Right, so I just switched to DSU and tried to do a firmware update on the 
NICs in my 720xd.  Here's what happened:

|-----------Dell System Updates-----------|
[ ] represents 'not selected'
[*] represents 'selected'
[-] represents 'Component already at repository version (cannot be 
selected)'
Choose:  q - Quit without update, c to Commit, <number> - To 
Select/Deselect, a - Select All, n - Select None

[*]1 Emulex LPe12002-M8 8Gb 2-port PCIe Fibre Channel Adapter
  Current Version : 01.03.01 Upgrade to : 01.06.01

[*]2 Emulex LPe12002-M8 8Gb 2-port PCIe Fibre Channel Adapter
  Current Version : 01.03.01 Upgrade to : 01.06.01

[*]3 PERC H710 Mini Controller 0 Firmware
  Current Version : 21.3.0-0009 Upgrade to : 21.3.2-0005

[*]4 BIOS
  Current Version : 2.2.2 Upgrade to : 2.5.2

[*]5 Firmware for  - Disk 0 in Backplane 1 of PERC H710 Mini Controller 0
  Current Version : YS0A Upgrade to : YS0C

[*]6 NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
  Current Version : 7.8.16 Upgrade to : 7.10.61

[*]7 NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
  Current Version : 7.8.16 Upgrade to : 7.10.61

[*]8 NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
  Current Version : 7.8.16 Upgrade to : 7.10.61

[*]9 NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
  Current Version : 7.8.16 Upgrade to : 7.10.61

[*]10  iDRAC
  Current Version : 1.46.45.00 Upgrade to : 2.21.21.21

[*]11 Dell 64 Bit uEFI Diagnostics, version 4247A0 Installer Revision 
14.05.00, 4247.1
  Current Version : 4247A0 Upgrade to : 4247A1

[-]12 12G Backplane Expander FW (Firmware)
  Current Version : 1.07 same as : 1.07

[*]13 OpenManage Server Administrator
  Current Version : 8.1.0 Upgrade to : 8.2

[-]14 Firmware for  - Disk 10 in Backplane 1 of PERC H710 Mini Controller 0
  Current Version : A008 same as : A008

[*]15 Power Supply
  Current Version : 07.12.52 Upgrade to : 09.13.59

[*]16 Power Supply
  Current Version : 07.12.52 Upgrade to : 09.13.59

Enter your choice : c
Installing Diagnostics_Application_D5TM2_LN_4247A1_4247.2...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...
..........................................
Running validation...

Dell 64 Bit uEFI Diagnostics, version 4247A0 Installer Revision 14.05.00, 
4247.1

The version of this Update Package is newer than the currently installed 
version.
Software application name: Dell 64 Bit uEFI Diagnostics, version 4247A0 
Installer Revision
14.05.00, 4247.1
Package version: 4247A1
Installed version: 4247A0


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
..................................................................................
The update completed successfully.
Installing Fibre-Channel_Firmware_R63G7_LN_01.06.01_A00-00...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...
.
Running validation...

Emulex LPe12002-M8 8Gb 2-port PCIe Fibre Channel Adapter

The version of this Update Package is newer than the currently installed 
version.
Software application name: Emulex LPe12002-M8 8Gb 2-port PCIe Fibre Channel 
Adapter
Package version: 01.06.01
Installed version: 01.03.01

Emulex LPe12002-M8 8Gb 2-port PCIe Fibre Channel Adapter

The version of this Update Package is newer than the currently installed 
version.
Software application name: Emulex LPe12002-M8 8Gb 2-port PCIe Fibre Channel 
Adapter
Package version: 01.06.01
Installed version: 01.03.01


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
........................................................
The system should be restarted for the update to take effect.
Installing SAS-RAID_Firmware_1TJRK_LN_21.3.2-0005_A07...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...
...
Running validation...

PERC H710 Mini Controller 0

The version of this Update Package is newer than the currently installed 
version.
Software application name: PERC H710 Mini Controller 0 Firmware
Package version: 21.3.2-0005
Installed version: 21.3.0-0009


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
.....................................................................................................................................
The system should be restarted for the update to take effect.
Installing SAS-Drive_Firmware_57G3N_LN_YS0C_A08...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...
........
Running validation...

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A

ST9300653SS

The version of this Update Package is newer than the currently installed 
version.
Software application name: ST9300653SS Firmware
Package version: YS0C
Installed version: YS0A


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
....................................................................................................................................................................
The update completed successfully.
Installing Network_Firmware_PVRHM_LN_7.10.61...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...
...
Running validation...

NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)

The version of this Update Package is newer than the currently installed 
version.
Software application name: NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
Package version: 7.10.61
Installed version: 7.8.16

NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)

The version of this Update Package is newer than the currently installed 
version.
Software application name: NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
Package version: 7.10.61
Installed version: 7.8.16

NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)

The version of this Update Package is newer than the currently installed 
version.
Software application name: NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
Package version: 7.10.61
Installed version: 7.8.16

NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)

The version of this Update Package is newer than the currently installed 
version.
Software application name: NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
Package version: 7.10.61
Installed version: 7.8.16


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
...............................................
Device: NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
   Application: NetXtreme BCM5720 Gigabit Ethernet PCIe (em1)
   Update failure. Firmware programming utility returned an error. Original 
firmware restored

Device: NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
   Application: NetXtreme BCM5720 Gigabit Ethernet PCIe (em2)
   Update failure. Failed to update family version in NVRAM.

Device: NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
   Application: NetXtreme BCM5720 Gigabit Ethernet PCIe (em3)
   Update failure. Firmware programming utility returned an error. Original 
firmware restored

Device: NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
   Application: NetXtreme BCM5720 Gigabit Ethernet PCIe (em4)
   Update failure. Failed to update family version in NVRAM.

Network_Firmware_PVRHM_LN_7.10.61 could not be installed
Installing 
iDRAC-with-Lifecycle-Controller_Firmware_VV01T_LN_2.21.21.21_A00...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...
................................
Running validation...

iDRAC

The version of this Update Package is newer than the currently installed 
version.
Software application name: iDRAC
Package version: 2.21.21.21
Installed version: 1.46.45.00


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
.............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
The update completed successfully.
Installing Power_Firmware_FR60C_LN_09.13.59...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...
....
Running validation...

Power Supply

The version of this Update Package is newer than the currently installed 
version.
Software application name: Power Supply
Package version: 09.13.59
Installed version: 07.12.52

Power Supply

The version of this Update Package is newer than the currently installed 
version.
Software application name: Power Supply
Package version: 09.13.59
Installed version: 07.12.52


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
..................................................................................
The system should be restarted for the update to take effect.
Installing BIOS_MKCTM_LN_2.5.2...
prelink: /bin/gzip: at least one of file's dependencies has changed since 
prelinking
Collecting inventory...

Running validation...

Server BIOS 12G

The version of this Update Package is newer than the currently installed 
version.
Software application name: BIOS
Package version: 2.5.2
Installed version: 2.2.2


Executing update...
WARNING: DO NOT STOP THIS PROCESS OR INSTALL OTHER DELL PRODUCTS WHILE 
UPDATE IS IN PROGRESS.
THESE ACTIONS MAY CAUSE YOUR SYSTEM TO BECOME UNSTABLE!
..........................................................................................
The system should be restarted for the update to take effect.


Fair enough on the Broadcom NICs.  It's rare I ever see a NIC firmware 
update work on a Dell server.  Anyway, given the other updates I rebooted 
the box.  This is what happened:

                                                 Entering Lifecycle Controller



Phoenix ROM BIOS PLUS Version 1.10 2.5.2
Copyright 1985-1988 Phoenix Technologies Ltd.
Copyright 1990-2014 Dell Inc.
All Rights Reserved

Dell System PowerEdge R720xd
www.dell.com


Two 2.90 GHz Eight-core Processors, Bus Speed:8.00 GT/s, L2/L3 Cache:2 MB/20 MB
System running at 2.90 GHz
System Memory Size: 192.0 GB, System Memory Speed: 1600 MHz, Voltage: 1.35V
Plug & Play Configuration Error:
Option ROM Checksum Error
Integrated NIC 1
  Bus#01/Dev#00/Func#0: Integrated NIC 1

Plug & Play Configuration Error:
Option ROM Checksum Error
Integrated NIC 2
  Bus#01/Dev#00/Func#1: Integrated NIC 2







Option ROM Shadow RAM Allocation error.
No shadow memory available for Option ROM.
Integrated NIC 4
  Bus#02/Dev#00/Func#1: Integrated NIC 4

Plug & Play Configuration Error:
Option ROM Shadow RAM Allocation error.
No shadow memory available for Option ROM.
Slot 4
  Bus#42/Dev#00/Func#0: Slot 4

Plug & Play Configuration Error:
Option ROM Shadow RAM Allocation error.
No shadow memory available for Option ROM.
Slot 4
  Bus#42/Dev#00/Func#1: Slot 4

Plug & Play Configuration Error:
Option ROM Shadow RAM Allocation error.
No shadow memory available for Option ROM.
Integrated RAID
  Bus#03/Dev#00/Func#0: Integrated RAID



CPLD version : 103

Management Engine Mode                : Active
Management Engine Firmware Version    : 0002.0001
                            Patch      : 0005
                            Build      : 0087
  Strike the F1 key to continue, F2 to run the system setup program


I hit F1 and it carried on (doing the BIOS update and a "Staged 
Update") then rebooted to do a power characterization and rebooted 
again.  Each time I got the Shadow/Option ROM messages.  I hit F1 again 
and it carried on until here:

Scanning for devices.  Please wait, this may take several minutes...


No boot device available.
Current boot mode is set to BIOS.
Please ensure compatible bootable media is available.
Use the system setup program to change the boot mode as needed.

Strike F1 to retry boot, F2 for system setup, F11 for BIOS boot manager.



So.  Now what?  I've tried going into the BIOS and looking for Option ROM 
things to fiddle with but I can't find anything.  How am I supposed to get 
this box going again?

Currently not terribly happy with DSU.  Or Dell in general considering that 
it appears you need to use DSU if you want the latest and greatest (although 
not all that great given they've bricked my server) firmwares.

Ben
-- 
Unix Support, UIS, University of Cambridge, England
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.