Old switch need new IOS and CATOS

[carterhigginz]

I've got a pair of 6509 boxes that run like a pair of finely tuned Chevy 350's
Running IOS 12.1 on the MSFC and 6.5.8 on the Supervisor card - I think I'm using the correct terms.   

My questions are fairly simple ...
1. how much memory do need to upgrade to the latest version of IOS and CATOS (nvram and edo ram)?
2. does the supervisor card and the msfc share memory or do they each have their own memory?
3. can you recommend any places to purchase memory or other Cisco equipment on the cheap?
4. let me know if I missed anything important

Thanks
carterhigginz
UnixMonkey - trying to be a RouterMonkey

[notoriousBG]

hello, carterhigginz!

what modules are you running in your 6509 and what role do the switches play in your network?

can you do a "show mod" on you Catalyst 6509 & tell me if your Supervisor is a SUP1A/MSFC or SUP1A/MSFC2 for example? I need to know exacty what you have to make the recommendation.  If you feel comfortable, you could just paste the "show mod"

The answer to number two is that Supervisor and MSFC each have their own memory. but they can share flash on slot0:

Just for the heck of it though, lets say you have SUP1A/MSFC2... I would go with:

CatOS ver 8.1(3)  CAT6000-SUPK8.8-1-3.BIN
Minimum DRAM   128
Minimum Flash    16

IOS ver 12.1(23)E4 c6msfc2-jk2sv-mz.121-23.E4.bin
Minimum DRAM   128
Minimum Flash    16

There are caviots regarding the loading of a bootloader image from flash on slot0:

Also note that with software release 8.1(1) and later releases you need to use the Cisco IOS
Release 12.1(13)E4 or later version bootloader on the MSFC/MSFC2 to boot a Cisco IOS image reliably
from sup-slot0 or sup-bootflash. The Cisco IOS Release 12.1(19)E train bootloader, or bootloaders
earlier than Cisco IOS Release 12.1(13)E4, do not support booting the MSFC/MSFC2 from sup-slot0 or
sup-bootflash due to caveats CSCeb36759, CSCdz60980, and/or CSCdz31321

Also, To upgrade to 128-MB DRAM on the WS-X6K-SUP1A-MSFC, use the MEM-S1-128MB-UPG=
upgrade kit which also includes an MSFC2 upgrade.

Caviot on supported flash for SUP1:
64-MB linear Flash PC card (MEM-C6K-FLC64M=)—Only supported on Supervisor Engine 1. The
device name is slot0: and the card requires ROMMON software release 5.3(1) or later releases


If you're lite on flash, you should just order a bunch of MEM-C6K-FLC64M=

As far as memory... Safe would be Cisco.  I've also had great luck with http://www.memoryten.com/mm5/merchant.mvc but you will need to do research to find out what RAM/DRAM is needed (they won't quote Cisco Part Numbers).

Hit me back - with that "show mod" and I will get more specific.

Regards,
-noto

[notoriousBG]

One other thing - You said you had a "PAIR" of 6509's.  Make sure you back them both up (configs and images) before you do the upgrade and make sure to upgrade BOTH switches to the same versions on SUP/MSFC images.  Many flakey things can happen (Spanning Tree, HSRP/VRRP) If you don't keep the IOS versions synced.  Even if they are in an Active/Active config, still would play it safe.

-noto

[carterhigginz]

Here's the show mod from the first box:

(enable) show mod
Mod Slot Ports Module-Type               Model               Sub Status
--- ---- ----- ------------------------- ------------------- --- --------
1   1    2     1000BaseX Supervisor      WS-X6K-SUP1A-2GE    yes ok
15  1    1     Multilayer Switch Feature WS-F6K-MSFC2        no  ok
2   2    8     1000BaseX Ethernet        WS-X6408-GBIC       no  ok
3   3    8     1000BaseX Ethernet        WS-X6408A-GBIC      no  ok
4   4    16    1000BaseX Ethernet        WS-X6416-GBIC       no  ok
5   5    48    10/100BaseTX Ethernet     WS-X6248-RJ-45      no  ok
6   6    48    10/100BaseTX Ethernet     WS-X6248-RJ-45      no  ok
7   7    48    10/100BaseTX Ethernet     WS-X6248-RJ-45      no  ok
8   8    48    10/100BaseTX Ethernet     WS-X6248-RJ-45      no  ok
9   9    16    1000BaseT Ethernet        WS-X6316-GE-TX      no  ok

Mod Module-Name          Serial-Num
--- -------------------- -----------
1   EOS-3/25/2010        SAD05030S8J
15  EOS-2/28/2012        SAD05030MLR
2   EOS-3/31/2006        SAD03352588
3   No EOS Set           SAD050312RE
4   EOS-1/16/2011        SAD04480JUL
5   EOS-3/31/2006        SAD050108BZ
6   EOS-3/31/2006        SAD0501082H
7   EOS-3/31/2006        SAD050108NW
8   EOS-3/31/2006        SAD050108C1
9   EOS-7/31/2009        SAD071602X0

Mod MAC-Address(es)                        Hw     Fw         Sw
--- -------------------------------------- ------ ---------- -----------------
1   00-01-c9-6d-24-da to 00-01-c9-6d-24-db 7.0    5.3(1)     7.6(8)
    00-01-c9-6d-24-d8 to 00-01-c9-6d-24-d9
    00-d0-04-0c-a8-00 to 00-d0-04-0c-ab-ff
15  00-04-dd-a0-32-00 to 00-04-dd-a0-32-3f 1.2    12.1(19)E1 12.1(19)E1
2   00-0f-f7-10-0a-1c to 00-0f-f7-10-0a-23 2.7    5.4(2)     7.6(8)
3   00-01-c9-b0-71-c0 to 00-01-c9-b0-71-c7 1.3    5.4(2)     7.6(8)
4   00-02-fc-25-12-b4 to 00-02-fc-25-12-c3 1.2    5.4(2)     7.6(8)
5   00-02-7e-f5-72-c0 to 00-02-7e-f5-72-ef 1.4    5.4(2)     7.6(8)
6   00-02-7e-f5-72-00 to 00-02-7e-f5-72-2f 1.4    5.4(2)     7.6(8)
7   00-02-fc-43-ca-4c to 00-02-fc-43-ca-7b 1.4    5.4(2)     7.6(8)
8   00-02-7e-f5-71-70 to 00-02-7e-f5-71-9f 1.4    5.4(2)     7.6(8)
9   00-02-fc-be-10-98 to 00-02-fc-be-10-a7 1.3    5.4(2)     7.6(8)

Mod Sub-Type                Sub-Model           Sub-Serial  Sub-Hw Sub-Sw
--- ----------------------- ------------------- ----------- ------ ------
1   L3 Switching Engine     WS-F6K-PFC          SAD05030TUT 1.1


And from the SECOND one:

(enable) show mod
Mod Slot Ports Module-Type               Model               Sub Status
--- ---- ----- ------------------------- ------------------- --- --------
1   1    2     1000BaseX Supervisor      WS-X6K-SUP1A-2GE    yes ok
15  1    1     Multilayer Switch Feature WS-F6K-MSFC2        no  ok
3   3    8     1000BaseX Ethernet        WS-X6408-GBIC       no  ok
4   4    16    1000BaseX Ethernet        WS-X6416-GBIC       no  ok
5   5    48    10/100BaseTX Ethernet     WS-X6248-RJ-45      no  ok
6   6    48    10/100BaseTX Ethernet     WS-X6248-RJ-45      no  ok
7   7          Unknown Card                                  power-bad
8   8    48    10/100/1000BaseT Ethernet WS-X6148-GE-TX      no  ok
9   9    16    1000BaseT Ethernet        WS-X6316-GE-TX      no  ok

Mod Module-Name          Serial-Num
--- -------------------- -----------
1   EOS-3/25/2010        SAD050213JE
15  EOS-2/28/2012        SAD0503028T
3   EOS-3/31/2006        SAD03201667
4   EOS-1/16/2011        SAD05070HDW
5   EOS-3/31/2006        SAD03200784
6   EOS-3/31/2006        SAD03200265
7
8   No EOS Set           SAD080800TG
9   EOS-7/31/2009        SAD072404TT

Mod MAC-Address(es)                        Hw     Fw         Sw
--- -------------------------------------- ------ ---------- -----------------
1   00-02-7e-f5-ba-1a to 00-02-7e-f5-ba-1b 7.0    5.3(1)     7.6(8)
    00-02-7e-f5-ba-18 to 00-02-7e-f5-ba-19
    00-d0-79-91-90-00 to 00-d0-79-91-93-ff
15  00-04-dd-74-a3-c0 to 00-04-dd-74-a3-ff 1.2    12.1(19)E1 12.1(19)E1
3   00-d0-bb-10-b8-34 to 00-d0-bb-10-b8-3b 2.1    4.2(0.24)V 7.6(8)
4   00-01-97-23-df-e4 to 00-01-97-23-df-f3 1.2    5.4(2)     7.6(8)
5   00-d0-58-e9-82-a0 to 00-d0-58-e9-82-cf 1.1    4.2(0.24)V 7.6(8)
6   00-d0-58-a0-a9-48 to 00-d0-58-a0-a9-77 1.1    4.2(0.24)V 7.6(8)
7   unknown
8   00-0e-84-80-15-f4 to 00-0e-84-80-16-23 6.0    7.2(1)     7.6(8)
9   00-03-fe-ab-c1-e6 to 00-03-fe-ab-c1-f5 1.3    5.4(2)     7.6(8)

Mod Sub-Type                Sub-Model           Sub-Serial  Sub-Hw Sub-Sw
--- ----------------------- ------------------- ----------- ------ ------
1   L3 Switching Engine     WS-F6K-PFC          SAD05030B3F 1.1


Let me know what you think.
The card in slot 7 is the one I need to get working. aka needs a newer version of IOS or CATOS to make it sing the network song.

Here is the "show ver" from the second box as well.

WS-C6509 Software, Version NmpSW: 7.6(8)
Copyright (c) 1995-2004 by Cisco Systems
NMP S/W compiled on Jul 15 2004, 19:51:40

System Bootstrap Version: 5.3(1)
System Boot Image File is 'bootflash:cat6000-supk9.7-6-8.bin'
System Configuration register is 0x102

Hardware Version: 1.0  Model: WS-C6509  Serial #: SCA032100MC

PS1  Module: WS-CAC-1300W    Serial #: ACP03190082
PS2  Module: WS-CAC-1300W    Serial #: ACP03190076

Mod Port Model               Serial #    Versions
--- ---- ------------------- ----------- --------------------------------------
1   2    WS-X6K-SUP1A-2GE    SAD050213JE Hw : 7.0
                                         Fw : 5.3(1)
                                         Fw1: 5.4(2)
                                         Sw : 7.6(8)
                                         Sw1: 7.6(8)
         WS-F6K-PFC          SAD05030B3F Hw : 1.1
                                         Sw :
         WS-X6K-SUP1A-2GE    SAD050213JE Hw : 7.0
                                         Sw :
3   8    WS-X6408-GBIC       SAD03201667 Hw : 2.1
                                         Fw : 4.2(0.24)VAI78
                                         Sw : 7.6(8)
4   16   WS-X6416-GBIC       SAD05070HDW Hw : 1.2
                                         Fw : 5.4(2)
                                         Sw : 7.6(8)
5   48   WS-X6248-RJ-45      SAD03200784 Hw : 1.1
                                         Fw : 4.2(0.24)VAI78
                                         Sw : 7.6(8)
6   48   WS-X6248-RJ-45      SAD03200265 Hw : 1.1
                                         Fw : 4.2(0.24)VAI78
                                         Sw : 7.6(8)
8   48   WS-X6148-GE-TX      SAD080800TG Hw : 6.0
                                         Fw : 7.2(1)
                                         Sw : 7.6(8)
9   16   WS-X6316-GE-TX      SAD072404TT Hw : 1.3
                                         Fw : 5.4(2)
                                         Sw : 7.6(8)
15  1    WS-F6K-MSFC2        SAD0503028T Hw : 1.2
                                         Fw : 12.1(19)E1
                                         Sw : 12.1(19)E1

       DRAM                    FLASH                   NVRAM
Module Total   Used    Free    Total   Used    Free    Total Used  Free
------ ------- ------- ------- ------- ------- ------- ----- ----- -----
1       65408K  47562K  17846K  16384K  11104K   5280K  512K  392K  120K

[notoriousBG]

hello, carterhigginz!

Thank you for the information in your follow up message! I've changed my recommendations slightly.  You should do your own due diligence on this matter but hopefully this info will help.

Your ROMMON version is 5.3(1) which is the min. that you need.  For the CatOS on your Sup1A-2GE, you will definitely want to upgrade. I would consider a 8x version and a E4 version of IOS on the MSFC so you can boot from Sup-Slot0:

Here are some things to think about regarding your current situation:

The card in slot 7 has a status of "power-bad" If the status is power-bad, the switch is able to see a card but unable to allocate power. This situation is possible if the Supervisor Engine is not able to access the serial PROM (SPROM) contents on the module in order to determine the identification of the line card. Issue the show idprom module slot command in order to verify if the SPROM is readable. If SPROM is not accessible, you can reset the module.
 
Make sure that the module is properly seated and that you have completely screwed down the module. If the module still does not come online, issue the hw-module slot slot number reset command. If the module still does not come online, try the module in a spare slot, swap the module with the slot of a module that works, or try the module in a different chassis. Upgrading CatOS may also resolve this error condition.

With the above considerations - I think you could safely upgrade your CatOS to 8.1(3) "CAT6000-SUPK8.8-1-3.BIN"

You may be able to continue to use the 12.1(19)E1 IOS on your MSFC2's however, I suggest updating to 12.1(23)E4.

Here are some links that my be of use to you:
Catalyst 6500 Series Supervisor Engine 1A And 2
http://www.cisco.com/en/US/products/hw/modules/ps2797/products_data_sheet09186a00800887fd.html

Moving Files and Images Between a CatOS Switch and TFTP Server via SNMP
http://www.cisco.com/en/US/tech/tk648/tk362/technologies_tech_note09186a0080094aa3.shtml

Memory & Flash Upgrade Notes:
http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/hardware/Config_Notes/78_14357.html

Release Notes for Catalyst 6500 Series Software Release 8.x
http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/catos/8.x/release/notes/OL_4498.html

How to Upgrade Software Images on Catalyst Switch Layer 3 Modules
http://www.cisco.com/en/US/products/hw/switches/ps700/products_tech_note09186a00801347e2.shtml

Catalyst 6500 Series Switch Supervisor Engine NMP Boot ROM Upgrade Installation Note at this URL:
http://www.cisco.com/univercd/cc/td/doc/product/lan/cat6000/cfgnotes/78_10142.htm

One last thing - You should consider upgrading to a Sup720.  You need to upgrade to 2500W or better power supplies I believe - and possibly even the Fan Tray would need an upgrade to a high speed fan tray.  I just want to throw that on the table as you may find it more difficult in the future to accommodate some of the newer line cards in your current configuration.  Just a though?
 
Hope this helps Higginz!

Let us know how it goes!

[notoriousBG]

Here is a memory option for you Higginz

http://cgi.ebay.com/128MB-2x64MB-Cisco-Systems-Catalyst-6000-MSFC-3rd-par_W0QQitemZ320179965529QQihZ011QQcategoryZ31573QQrdZ1QQssPageNameZWD1VQQtrksidZp1638.m118.l1247QQcmdZViewItem

Specifications:

    * 128MB 2pcs 64MB SODIMM.
    * This module is manufactured by MemoryTen. This kit is in stock and can ship today.
    * MEM-MSFC-128MB=, MEM-S1-128MB=.

Part Number:

    * MEM-MSFC-128MB-MT
    * 2:AIE



# Find the correct memory for your machine, visit the Memory Configurator on our website.
# Need additional assistance? Free Tech Support!
Email ebay@memoryten.com
# Call direct at 408.350.0357
# Send fax to 408.588.1236
# Open Monday to Friday 8:00AM to 5:00PM PST
# Our address is:
MemoryTen
2800 Bowers Ave
Santa Clara, CA 95051
USA

[notoriousBG]

Higginz,

Thanks for emailing me the "show env power"! CatOS compatibility may be only half of the problem.  It looks as if your verry close to exhausting availible power on your 6509.  You can see that the WS-X6316-GE-TX is a power hog.  You could replace that with WS-X6148-GE-TX and be better off with your current power supplies.  Another option would be to buy some 2500W power supplies - you can get them on ebay for under $150.00 on "buy it now".  If you could get a maintenance window, maybe you could pull the module in slot 9, power cycle the switch and see if module 7 comes up.  If the microcode on your new gig card is truely incompatible with your CatOS version then you will need to go forward with your upgrade.

Regards,
-noto

>(enable) sh env power
>
>PS1 Capacity: 1153.32 Watts (27.46 Amps @42V)
>PS2 Capacity: 1153.32 Watts (27.46 Amps @42V)
>PS Configuration : PS1 and PS2 in Redundant Configuration.
>Total Power Available: 1153.32 Watts (27.46 Amps @42V)
>Total Power Available for Line Card Usage: 1153.32 Watts (27.46 Amps @42V)
>Total Power Drawn From the System: 1025.22 Watts (24.41 Amps @42V)
>Remaining Power in the System: 128.10 Watts ( 3.05 Amps @42V)
>Configured Default Inline Power allocation per port: 7.00 Watts (0.16 Amps @42V)
>
>Slot power Requirement/Usage :
>Slot Card Type           PowerRequested PowerAllocated CardStatus
>                       Watts   A @42V Watts   A @42V
>---- ------------------- ------- ------ ------- ------ ----------
>1    WS-X6K-SUP1A-2GE    138.60   3.30  138.60   3.30  ok
>2                          0.00   0.00  138.60   3.30  none
>3    WS-X6408-GBIC        84.00   2.00   84.00   2.00  ok
>4    WS-X6416-GBIC       118.02   2.81  118.02   2.81  ok
>5    WS-X6248-RJ-45      112.98   2.69  112.98   2.69  ok
>6    WS-X6248-RJ-45      112.98   2.69  112.98   2.69  ok
>7                          0.00   0.00    0.00   0.00  power-bad
>8    WS-X6148-GE-TX      103.74   2.47  103.74   2.47  ok
>9    WS-X6316-GE-TX      216.30   5.15  216.30   5.15  ok

[notoriousBG]

Ok - check it out, was playing arround in the lab and had a bright idea  turn of power supply redundancy to rule out whether or not power is the only issue.

@ the enable prompt on your switch, type "set power redundancy disable" This will effectivley double your available power.  You may need to do a reset on your module in slot 7 "reset 7".

Chech out the following:

Console> (enable) set power redundancy ena
Power supply redundancy enabled.
Console> (enable) sh env power
PS1 Capacity: 1153.32 Watts (27.46 Amps @42V)
PS2 Capacity: 1153.32 Watts (27.46 Amps @42V)
PS Configuration : PS1 and PS2 in Redundant Configuration.
Total Power Available: 1153.32 Watts (27.46 Amps @42V)
Total Power Available for Line Card Usage: 1153.32 Watts (27.46 Amps @42V)
Total Power Drawn From the System: 377.58 Watts ( 8.99 Amps @42V)
Remaining Power in the System: 775.74 Watts (18.47 Amps @42V)
Configured Default Inline Power allocation per port: 7.00 Watts (0.16 Amps @42V)

Slot power Requirement/Usage :

Slot Card Type           PowerRequested PowerAllocated CardStatus
                         Watts   A @42V Watts   A @42V
---- ------------------- ------- ------ ------- ------ ----------
1    WS-X6K-SUP1A-2GE    138.60   3.30  138.60   3.30  ok
2                          0.00   0.00  138.60   3.30  none
4    WS-X6348-RJ-45      100.38   2.39  100.38   2.39  ok

Slot Inline Power Requirement/Usage :

Slot CardType            Total Allocated   Max H/W Supported  Max H/W Supported
                         To Module (Watts) Per Module (Watts) Per Port (Watts)
---- ------------------- ----------------- ------------------ -----------------

Console> (enable)

Now disable redundancy:

Console> (enable) set power redundancy dis
Power supply redundancy disabled.
Console> (enable) sh env power
PS1 Capacity: 1153.32 Watts (27.46 Amps @42V)
PS2 Capacity: 1153.32 Watts (27.46 Amps @42V)
PS Configuration : PS1 and PS2 in Non-Redundant Configuration.
Total Power Available: 2306.64 Watts (54.92 Amps @42V)
Total Power Available for Line Card Usage: 2306.64 Watts (54.92 Amps @42V)
Total Power Drawn From the System: 377.58 Watts ( 8.99 Amps @42V)
Remaining Power in the System: 1929.06 Watts (45.93 Amps @42V)
Configured Default Inline Power allocation per port: 7.00 Watts (0.16 Amps @42V)

Slot power Requirement/Usage :

Slot Card Type           PowerRequested PowerAllocated CardStatus
                         Watts   A @42V Watts   A @42V
---- ------------------- ------- ------ ------- ------ ----------
1    WS-X6K-SUP1A-2GE    138.60   3.30  138.60   3.30  ok
2                          0.00   0.00  138.60   3.30  none
4    WS-X6348-RJ-45      100.38   2.39  100.38   2.39  ok

Slot Inline Power Requirement/Usage :

Slot CardType            Total Allocated   Max H/W Supported  Max H/W Supported
                         To Module (Watts) Per Module (Watts) Per Port (Watts)
---- ------------------- ----------------- ------------------ -----------------

Console> (enable)

Regards,
-noto

[carterhigginz]

I tried the power redundancy thingy and still no luck at getting the little baby off the ground.
I've started to poke around more on the www.cisco.com and found the following doc:

http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/prod_end-of-life_notice0900aecd802e87bb.html

Basically this new card needs CatOS 8.4(1)
So - now for the research to get this installed and working on two switches, and hopefully it can co-exist with the current IOS.

Thanks Monkey - I'll keep you posted.

[notoriousBG]

Good job - you got it narrowd down to CatOS.  I take it your Module is a WS-X6148A-GE-TX?  Didn't see a minimum IOS specified for that card? But I did notice that recommended CatOS is 8.4(5) on software advisor, 128 DRAM and 16 Flash for that, the min. CatOS was 8.4(1).

Just remember to back everything up before you upgrade

Regards,
-noto