Saturday, June 14, 2008

Upgrading ROMMONs in 6500s/7600s with SUP720

The Supervisor Engine 720 (or the Supervisor Engine 720-10GE) ROMMONs consists of two modules:
- A resident module that is not changed during the upgrade procedure. This is the Gold region one.
- An upgradeable module that is updated during the upgrade procedure. This is the only module that you have to download from cisco.

There are three regions (including the Gold region) where versions of the ROMMON image can be stored. The ROMMON software upgrade feature allows you to have two upgraded ROMMON images (one in region F1, the second in region F2) in addition to the Gold ROMMON stored on the one-time programmable (OTP) EPROM section of the ROMMON. You can use the "upgrade rom-monitor slot X preference" command to select which ROMMON will be the preferred ROMMON the next time that the system is booted. You can change the preference as often as you like, but keep in mind that the changes do not take effect until you reset the system.

You can also disqualify a specific region of ROMMON and use the other region, or go back to using the Gold ROMMON stored in the OTP EPROM section, by using the "upgrade rom-monitor slot X invalidate" command.

If you're referring to the SUP720 module, you'll need to include "sp" or "rp" after the module number:


6509#upgrade rom-monitor slot 6 ?
rp upgrade the rommon of Router Processor
sp upgrade the rommon of Switch Processor



There are 3 main ROMMONs you can upgrade on this platform.

SUP720 SP ROMMON
This is the Supervisor Switch Processor ROMMON. You'll find the release notes here (latest version is 8.5(3)). You can check the running version using one of the following methods:

Check the logs while booting:

Jun 13 20:00:10: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor

System Bootstrap, Version 8.5(2)
Copyright (c) 1994-2007 by cisco Systems, Inc.
Cat6k-Sup720/SP processor with 1048576 Kbytes of main memory

Use "sh ver" on SP:

6509#remote command switch sh ver | i ROM
ROM: System Bootstrap, Version 8.5(2)
System returned to ROM by reload at 20:00:10 EET Fri Jun 13 2008

Use "sh mod" :

6509#sh mod 6
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
6 2 Supervisor Engine 720 (Active) WS-SUP720-3BXL XXXXXXXXXXX

Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
6 XXXX.XXXX.XXXX to XXXX.XXXX.XXXX 5.4 8.5(2) 12.2(33)SXH2 Ok

Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
6 Policy Feature Card 3 WS-F6K-PFC3BXL XXXXXXXXXXX 1.8 Ok
6 MSFC3 Daughterboard WS-SUP720 XXXXXXXXXXX 3.0 Ok

Mod Online Diag Status
---- -------------------
6 Pass



MSFC3 RP ROMMON
This is the MSFC3 Route Processor ROMMON. You'll find the release notes here (latest version is 12.2(17r)SX5). You can check the running version using one of the following methods:

Check the logs while booting:

00:00:06: %OIR-6-CONSOLE: Changing console ownership to route processor

System Bootstrap, Version 12.2(17r)SX5, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 2006 by cisco Systems, Inc.
Cat6k-Sup720/RP platform with 1048576 Kbytes of main memory

Use "sh ver"

6509#sh ver | i ROM
ROM: System Bootstrap, Version 12.2(17r)SX5, RELEASE SOFTWARE (fc1)
System returned to ROM by reload at 19:16:07 EET Fri Jun 13 2008 (SP by reload)



CEF720 modules ROMMON
This is the CEF720 ROMMON for modules like WS-X6748-GE-TX, WS-X6724-SFP, WS-X6748-SFP, WS-X6704-10GE . You'll find the release notes here (latest version is 12.2(18r)S1). You can check the running version using one of the following methods:

Use "sh ver" on module:

6509#remote command module 1 sh ver | i ROM
ROM: System Bootstrap, Version 12.2(18r)S1, RELEASE SOFTWARE (fc1)
System returned to ROM by power-on

Use "sh mod":

6509#sh mod 1
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 24 CEF720 24 port 1000mb SFP WS-X6724-SFP XXXXXXXXXXX

Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
1 XXXX.XXXX.XXXX to XXXX.XXXX.XXXX 3.1 12.2(18r)S1 12.2(33)SXH2 Ok

Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
1 Distributed Forwarding Card WS-F6700-DFC3BXL XXXXXXXXXXX 5.3 Ok

Mod Online Diag Status
---- -------------------
1 Pass



You can also find the version of all ROMMONs by using the command "sh mod version" and checking the "Fw:" line of each module:


6509#sh mod version
Mod Port Model Serial # Versions
---- ---- ------------------ ----------- -------------------------------------
1 24 WS-X6724-SFP XXXXXXXXXXX Hw : 3.1
Fw : 12.2(18r)S1
Sw : 12.2(33)SXH2a
Sw1: 8.7(0.22)H2A1
WS-F6700-DFC3BXL XXXXXXXXXXX Hw : 5.3
2 48 WS-X6748-GE-TX XXXXXXXXXXX Hw : 2.6
Fw : 12.2(18r)S1
Sw : 12.2(33)SXH2a
Sw1: 8.7(0.22)H2A1
WS-F6700-DFC3BXL XXXXXXXXXXX Hw : 5.3
6 2 WS-SUP720-3BXL XXXXXXXXXXX Hw : 5.4
Fw : 8.5(2)
Sw : 12.2(33)SXH2a
Sw1: 8.7(0.22)H2A1
WS-SUP720 XXXXXXXXXXX Hw : 3.0
Fw : 12.2(17r)SX5
Sw : 12.2(33)SXH2a
WS-F6K-PFC3BXL XXXXXXXXXXX Hw : 1.8
7 4 WS-X6704-10GE XXXXXXXXXXX Hw : 2.6
Fw : 12.2(18r)S1
Sw : 12.2(33)SXH2a
Sw1: 8.7(0.22)H2A1
WS-F6700-CFC XXXXXXXXXXX Hw : 4.0



Upgrading the ROMMON

You can upgrade all ROMMONs like every other file (i.e. IOS). You just need to have the ROMMON file somewhere accessible; i prefer putting all ROMMONs in bootflash.


6509#dir bootflash:
Directory of bootflash:/

1 -rwx 12949924 Jun 13 2008 19:02:15 +03:00 s72033-boot-mz.122-33.SXH2a.bin
2 -rw- 649832 Jun 13 2008 19:03:06 +03:00 c2lc-rm2.srec.122-18r.S1
4 -rw- 736475 Jun 13 2008 19:44:10 +03:00 c6ksup720-rm2.8-5-2.srec
5 -rw- 669827 Jun 13 2008 19:58:51 +03:00 c6msfc3-rm2.srec.122-17r.SX5

65536000 bytes total (49792824 bytes free)


c6ksup720-rm2.8-5-2.srec refers to the SUP720 SP ROMMON
c6msfc3-rm2.srec.122-17r.SX5 refers to the MSFC3 RP ROMMON
c2lc-rm2.srec.122-18r.S1 refers to the CEF720 modules ROMMON


NOTE : Always have "term mon" turned on when upgrading, so you can watch the various messages of the upgrade process.

The following is usually the default output, when you haven't upgraded the ROMMON.
The ROMMON from the Gold region is running and regions F1 and F2 do not have valid ROMMONs.


6509#sh rom-monitor slot 1
Region F1: INVALID
Region F2: INVALID
Currently running ROMMON from S (Gold) region


Ok, let's upgrade the ROMMON of module 1 now:


6509#upgrade rom-monitor slot 1 file bootflash:c2lc-rm2.srec.122-18r.S1
Copying bootflash:c2lc-rm2.srec.122-18r.S1 onto bootflash of dfc#1
Copy in progress...CCCCCCCCCC
Jun 13 14:24:29.109: DFC1: ROMMON image upgrade in progress
Jun 13 14:24:29.109: DFC1: ROMMON current update region unknown = 0
Jun 13 14:24:29.125: DFC1: Erasing flash
Jun 13 14:24:30.793: DFC1: Programming flash
Jun 13 14:24:32.285: DFC1: Verifying new image
Jun 13 14:24:32.489: DFC1: ROMMON image upgrade complete
The card must be reset for this to take effect


This is the output after you have upgraded the ROMMON (in region F1). The ROMMON from the Gold region is still running, but Region F1 has a ROMMON that will be used after you reset the module.


6509#sh rom-monitor slot 1
Region F1: FIRST_RUN, preferred
Region F2: INVALID
Currently running ROMMON from S (Gold) region


We reset the module

6509#hw-module module 1 reset


This is the output after you have upgraded the ROMMON (in region F1) and have reseted the module. The ROMMON from the F1 region is now running.


6509#sh rom-monitor slot 1
Region F1: APPROVED, preferred
Region F2: INVALID
Currently running ROMMON from F1 region


You can also check the logs while the various modules are powered on.

Module in slot 1 is powered on:


00:00:23: %SYS-DFC1-5-RESTART: System restarted --
Cisco IOS Software, c6lc2 Software (c6lc2-SP-M), Version 12.2(33)SXH2a, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Fri 25-Apr-08 08:07 by prod_rel_team
Jun 13 16:17:33.300: DFC1: Currently running ROMMON from F1 region
Jun 13 16:17:33.300: DFC1: ROMMON upgrade successful


If you upgrade again the ROMMON of this module, region F2 will be used automatically:


6509#sh rom-monitor slot 1
Region F1: APPROVED
Region F2: FIRST_RUN, preferred
Currently running ROMMON from F1 region


PS: You can download (as long as you have the appropriate access) all the ROMMONs from here.

Last Update : 06-Mar-2009

15 comments:

  1. Very handy article Tassos!

    Do you know if any of the new IOS code requires a certain ROMMON version to load?

    ReplyDelete
  2. Matt, updated rommons usually fix boot problems or support new hardware. But i have met cases that you need a specific rommon version in order to run a specific IOS/CatOS release. You'll find these requirements in the releases notes.

    ReplyDelete
  3. I see, thanks for your reply.

    Cheers

    ReplyDelete
  4. I upgraded the sp compfactflash after upgrading the ROMMON for the SUP 720 module with IOS and would like to display the upgrade. How can i verify that the upgrade was succesful

    ReplyDelete
  5. Anonymous, if you check the paragraph "SUP720 SP ROMMON" in the above post, you'll see that there are 3 methods to find the running rommon version of the SP.

    ReplyDelete
  6. Thanks. I'm able to find the ROMMONs for my Sup720 RP and SP under Switches > Cisco Catalyst 6509 Switch > IOS ROMMON Software or CatOS ROMMON Software respectively. However I can't actually find the download links for ROMMON for the CEF720 line card modules. Do you happen to know where it is? Any pointers are appreciated.

    ReplyDelete
  7. Jefferson, your best bet would be to look into the rommon release notes (link given above) for the latest version and then login into CCO and search for it (i.e. "c2lc-rm2.srec.122-18r.S1").

    As it seems, Cisco has put it under "Switches > Cisco Catalyst 6509-E Switch > Cisco Catalyst 6500 Series Virtual Switching Supervisor Engine 720 with 10GE uplinks > IOS ROMMON Software > 12.2(18r)S1", which is beyond any logic by me.

    ReplyDelete
  8. Tassos - Thanks. I was able to find it looking that way.

    ReplyDelete
  9. Hi Tassos, pretty good document; anyway, I have a problem when I try to upgrade the rommon on redundant (stand-by) supervisor. On a configuration with 2x SUP32 I can't upgrade the redundant's RP rommon zone. On a configuration with 2x SUP720 I can't upgrade the redundant's SP rommon zone. This is the error I got, on the first case:

    Router#$-monitor slot 1 rp file disk0:ROMMON/c6msfc2a-rm2.srec.122-17r.S6
    Copying disk0:ROMMON/c6msfc2a-rm2.srec.122-17r.S6 onto standby RP's bootdisk...
    %Error opening slavebootdisk:upg_rp_rommon.srec (No such device)
    rommon_upgrade_card : Failure for slot 33
    Unable to upgrade rommon on standby RP



    Do you have any idea? Thanks!

    ReplyDelete
  10. Me again. I digged a little bit more and I found out that in case of SUP720 there is a problem with the missing sup-bootflash/sup-bootdisk (in my particular case) which seems to be required in the SP rommon upgrading process. In case of SUP32 stand-by supervisor, I think it's a wrong hardcoded path (check of bootdisk), there is no bootdisk on SUP32, but bootflash or sup-bootdisk. Hope I'm not wrong.

    ReplyDelete
  11. This might be a simple question but, why should I upgrade my WS-6748-GE-Tx modules with the new ROMMON? How will it improve my switch and it's ability to move frames/packets? TY

    ReplyDelete
    Replies
    1. You might want to do that in order avoid future issues. It probably won't give any boost on packet forwarding.

      Delete
  12. guys , I have a problem in upgrade from MSFC2 to MSFC3
    I upgraded the SP rommon to 8.5(4) and RP to 17r SX7 but still can't see the MSFC3 card and the sup720 stuck , it's required H/W version 5 to work in properly way , so please advise because the MSFC3 is 3.2 now which is not work

    ReplyDelete
  13. Hi everyone when i am trying to upgrade rom ,seems some issue in line card ,getting below error

    any advise

    Router#sh rom-monitor slot 2
    DFC#2 is not online

    ReplyDelete

 
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Greece License.