How replace a C7000 Virtual Connect VC1/10 with a Flex-10 with VC Defined MAC & WWNs

So I recently had to upgrade a single C7000 enclosure from two VC1/10 modules with two 20 port 8Gb fiber cards to two Flex-10 modules with the two 20 port 8Gb fiber cards. We also wanted to upgrade the VC modules to 4.10. I was able to successfully by following this runbook. In this case, the customer had VC defined MAC and WWNs and wanted to ensure that they all stayed the same when we re-created the server profiles, see the note at the bottom in regards to that. This procedure also required an enclosure downtime for all blades in the enclosure we worked on.

Pre-Downtime

1. Document via screen shot all server profiles, including multiple VLAN configurations

** Without this you will be HOSERED during the server profile rebuild. If booting from SAN make sure to get the WWNs and LUNs for the boot nodes.

2. Document via screen shot all assigned WWN and MAC addresses, including HP Pre-defined Ranges
3. Design new uplink configurations, active/active, active/passive, ensure free ports, etc.
4. Ensure a backup of the VC configuration is taken

– In VC Manager: Domain Settings > Backup/Restore
– Backup configuration
– Done

Downtime GO:

1. Ensure all Blades are powered off
2. Upgrade OA to 4.01

– Browse to OA interface
– Enclosure Information > Active Onboard Administrator > Firmware Update
– Upload the appropriate BIN file
– Ensure successful login

3. Run VC Healthcheck and document states

– vcsu -a healthcheck -i 10.X.X.X -u OAadministrator -p OApassword
– Document via screen shot health state

4. Unassign all server profiles from all servers
5. Delete the virtual connect domain

– In VC Manager
– Domain Settings > Configuration
– Delete Domain button
– Enter domain name
– wait 180 seconds

6. Power down modules from OA
7. Remove VC1/10 Modules from interconnect bays 1 & 2
8. Populate Flex-10 Modules in interconnect bays 1 & 2
9. Initialize Flex-10 Modules, assign them interconnect bay IP addresses in the OA
10. Navigate to the VC Module and begin the domain wizard setup

– Import the enclosure, choose new VC domain
– Name the VC domain
– Finish

11. Initiate the Networking Wizard

– Use VC defined MAC addresses, ensure that HP Predefined 1 sets are chosen
– Do not create any networks at the present Time
– Finish Wizard

12. Initiate the FC Wizard

– Use VC defined WWNs, ensure that HP Predefined 1 sets are chosen
– Define Fabric, Finish Wizard

13. Define networks, Define fabrics
14. Create and apply server profiles
15. Power server and Test Connectivity
16. Upgrade VC to 4.10

– vcsu -a update -i 10.X.X.X -u OAadministrator -p OApassword -l C:\vcfwall410.bin -vcu VCAdministrator -vcp VCpassword

– Ensure that any dependent modules (FC cards) are updated to match

– Wait for completion

17. Upgrade server firmwares

1. Mount the HP_Service_Pack_for_Proliant_2013.09.0-0_744345-001_spp_2013.09.0-SPP2013090.2013_0830.30.iso to the blade, boot to it and run the firmware update

18. Boot blades and ensure connectivity

** On step 14, we had to make dummy profiles that filled in MAC addresses and WWNs for profiles that had been deleted in-between the existing ones. You wouldn’t have to worry about this as long as you re-made the server profiles in the exact same order as they were originally made. Don’t worry if you accidentally get it out of order, just removing the NIC/HBA from the server profile will put the incorrectly used MAC/WWN back into the pool and will be used next.

** As a side note, HP doesn’t ever recommend using HP Pre-defined set #1, because its ranges can get stomped on if someone sets up another enclosure on #1 without checking first. In this case we didn’t have a choice.

pfSense LAN Party QoS 1.3 – Individually Limited TCP Streams

I recently posted the some updated config files for the pfSense QoS box.  For those of you who want to read the old post, here is the permalink.

https://elgwhoppo.com/2012/11/17/using-pfsense-for-qos-at-a-lan-party-nerfing-the-steam-downloads-and-http-traffic/

Here are the updated config files:
TrafficShaperBackup-LANPartyConfig-v1.3.xml
FirewallRulesBackup-LANPartyConfig-v1.3.xml

Last time we had a LAN party, we had a small problem. The problem was that folks who legitimately needed HTTP for things like signing into Steam and the TF2 Item Server, were fighting over an HTTP queue that was way full and dropping thousands of packets per second, mostly because a few people had very large download streams going. So I am going to try to solve contention in the subprime queue with a TCP traffic limiter on each IP address that gets a DHCP address. I made 2 rules on the LAN interface for every IP in the range 10.0.0.50-10.0.0.254. If you don’t like that IP range, well then it should be easy enough for you to do a find and replace on the firewall rule config download.

Rule #1 (Disabled by Default): Sad Panda Penalty Box: Limits all traffic from that particular IP address to 200Kbps/100Kbps

Rule #2 TCP Download Ceiling: Limits all TCP traffic from that particular IP address to 500Kbps/250Kbps

Capture

With these 410 different rules in place, you ensure that anyone who gets a DHCP address is at individually limited to .5Mbps TCP download speed, which can be controlled with the limiter config. Also, you now have a method of identifying who is sucking up all the bandwidth, and putting them in the bandwidth naughty corner. Check out the embedded Vimeo demonstration for a better look at what’s up.

Recoverpoint 4.0 Join Cluster Wizard: Cluster is Not Clean

During a Recoverpoint 4.0 P1 setup, we ran into a weird error that didn’t have much description or help online. During the part of the wizard where the clusters are configured and we’re joining them together, the error message we were receiving was:

Unable to execute command. Cluster is not clean

clusternotclean

 

After working with EMC, it appears that we licensed the RPAs before we should have. To fix the problem we removed the licenses from all RPAs, re-ran the Join Cluster wizard, then added the licenses back in and everything was kosher. Funny that the first thing that pops up when you log into the RPA Web interface is a wizard asking for licenses, methinks a note there would be helpful.

 

 

vBrownBag

I recently gave a talk on ProfessionalVMware.com ‘s vBrownBag series. Here’s the vimeo. Try not to listen to the 1000 UMs that I use. I really love the vBrownBag community, there’s nothing like a bunch of geeks to talk tech with. And nothing will make you learn your subject matter more than presenting!

Designing Virtual Connect for vSphere 5.x Joe Clark (@elgwhoppo) ProfessionalVMware #vBrownBag US from ProfessionalVMware on Vimeo.