! config set clibanner "BES-53248 Reference Configuration File v1.8X2 for Cluster/HA/RDMA Switch : BES-53248 Filename : BES-53248-RCF-v1.8-Cluster.txt Date : 11-01-2021 Version : v1.8 Port Usage: Ports 01 - 16: 10/25GbE Cluster Node Ports, base config Ports 17 - 48: 10/25GbE Cluster Node Ports, with licenses Ports 49 - 54: 40/100GbE Cluster Node Ports, with licenses, added right to left Ports 55 - 56: 100GbE Cluster ISL Ports, base config NOTE: - The 48 SFP28/SFP+ ports are organized into 4-port groups in terms of port speed: Ports 1-4, 5-8, 9-12, 13-16, 17-20, 21-24, 25-28, 29-32, 33-36, 37-40, 41-44, 45-48 The port speed should be the same (10GbE or 25GbE) across all ports in a 4-port group - If additional licenses are purchased, follow the 'Additional Node Ports activated with Licenses' section for instructions - If SSH is active, it will have to be re-enabled manually after 'erase startup-config' command has been executed and the switch rebooted" exit ! ! Global Parameters vlan database vlan 17 vlan 18 exit ! no ip telnet server enable configure cut-through mode no port-channel resilient-hashing logging persistent 4 isdp run isdp timer 5 no isdp advertise-v2 spanning-tree bpduguard snmp-server community "cshm1!" ro errdisable recovery cause link-flap errdisable recovery interval 30 ! class-map match-any RDMA match ip dscp 16 match cos 2 exit class-map match-any HA match ip dscp 40 match cos 5 exit class-map match-any CLUSTER match ip dscp 0 match cos 0 exit ! ! Polciy map for Cluster/HA/RDMA traffic for all interface speeds policy-map CLUSTER in class RDMA assign-queue 2 police-simple rate-percent 60 64 conform-action transmit violate-action transmit exit class HA assign-queue 5 police-simple rate-percent 60 64 conform-action transmit violate-action transmit exit class CLUSTER assign-queue 0 police-simple rate-percent 60 64 conform-action transmit violate-action transmit exit exit ! Policy map and Class map definitions for 25GbE interfaces ! !policy-map WRED_25G in !class HA !assign-queue 5 !police-simple rate-percent 60 64 conform-action transmit violate-action transmit !exit !class CLUSTER !assign-queue 0 !police-simple rate-percent 60 64 conform-action transmit violate-action transmit !exit !exit ! ! Policy Map and Class MAP defintions for 100GbE interfaces when supported ! !policy-map CLUSTER in !class HA !assign-queue 5 !police-simple rate-percent 60 64 conform-action transmit violate-action transmit !exit !class CLUSTER !assign-queue 0 !police-simple rate-percent 60 64 conform-action transmit violate-action transmit !exit !exit ! ! Map dot1p priority values to CoS ! classofservice trust dot1p classofservice dot1p-mapping 0 0 classofservice dot1p-mapping 2 2 classofservice dot1p-mapping 5 5 ! ! identify WRED thresholds and enable ECN ! random-detect queue-parms 0 min-thresh 12 70 50 50 max-thresh 13 100 100 100 drop-prob 100 5 10 50 ecn random-detect queue-parms 2 min-thresh 90 70 50 50 max-thresh 100 100 100 100 drop-prob 3 5 10 50 ecn random-detect queue-parms 5 min-thresh 90 70 50 50 max-thresh 100 100 100 100 drop-prob 3 5 10 50 ecn cos-queue min-bandwidth 28 0 28 0 0 43 0 0 cos-queue random-detect 0 2 5 !cos-queue min-bandwidth 40 0 0 0 0 60 0 0 !cos-queue random-detect 0 5 ! port-channel name 1/1 Cluster-ISL interface 0/55 addport 1/1 exit interface 0/56 addport 1/1 exit ! interface 0/1-0/16 no shutdown description "10/25GbE Node Port" service-policy in CLUSTER spanning-tree edgeport mtu 9216 switchport mode trunk switchport trunk allowed vlan 1,17-18 datacenter-bridging priority-flow-control mode on priority-flow-control priority 2 no-drop priority-flow-control priority 5 no-drop exit exit ! interface 0/55-0/56 no shutdown description "Cluster ISL Port" service-policy in CLUSTER mtu 9216 switchport mode trunk datacenter-bridging priority-flow-control mode on priority-flow-control priority 2 no-drop exit exit ! ! interface 1/1 no shutdown description "Cluster ISL" service-policy in CLUSTER no port-channel static port-channel load-balance 7 mtu 9216 switchport mode trunk exit ! ! !===== Additional Node Ports activated with Licenses === !Instructions: ! (1) Apply licenses purchased and reboot the switch ! (2) Run 'show port all | exclude Detach', and note the interfaces between 0/16 and 0/55. ! These are the interfaces activated with licenses ! (3) Uncomment the applicable node port license block below, including the 2 exit commands ! (4) Uncomment only one of the speed commands for 40/100GbE ports, as applicable ! ! ! 8-port 10/25GbE node port license block ! !interface 0/17-0/24 !no shutdown !description "10/25GbE Node Port" !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/25-0/32 !no shutdown !description "10/25GbE Node Port" !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/33-0/40 !no shutdown !description "10/25GbE Node Port" !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/41-0/48 !no shutdown !description "10/25GbE Node Port" !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! ! 2-port or 6-port 40/100GbE node port license block ! !interface 0/49 !no shutdown !description "40/100GbE Node Port" !speed 100G full-duplex !speed 40G full-duplex !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/50 !no shutdown !description "40/100GbE Node Port" !speed 100G full-duplex !speed 40G full-duplex !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/51 !no shutdown !description "40/100GbE Node Port" !speed 100G full-duplex !speed 40G full-duplex !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/52 !no shutdown !description "40/100GbE Node Port" !speed 100G full-duplex !speed 40G full-duplex !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/53 !no shutdown !description "40/100GbE Node Port" !speed 100G full-duplex !speed 40G full-duplex !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit ! !interface 0/54 !no shutdown !description "40/100GbE Node Port" !speed 100G full-duplex !speed 40G full-duplex !service-policy in CLUSTER !spanning-tree edgeport !mtu 9216 !switchport mode trunk !switchport trunk allowed vlan 1,17-18 !datacenter-bridging !priority-flow-control mode on !priority-flow-control priority 2 no-drop !priority-flow-control priority 5 no-drop !exit !exit !