ESXi / Cisco Switch - Help please!!

[Database]

OK, I am obviously missing something here. Forgive my ignorance, I'm not a Cisco guru. I am trying to setup a separate test subnet on a single ESXi Host creating a new vswitch and vlan. The switch is a Cisco 3750. The host has 8 NICs in the following configuration.

1x - Management Network (vlan 100)
3x - VM network (vlan 50)
2x - iSCSI (vlan 110)
1x - vMotion (vlan 120)
1x - Available, this is the NIC I am attempting to use. (vlan 172)

I've configured a new vlan, vlan 172. Subnet will be 172.16.5.0/24, I've given the vlan an IP of 172.16.5.1. I can ping that address from other vlans, so that all seems fine.

I am trying to configure that 1 available NIC on the host to connect to a port on the switch and provide access to that vlan. No matter what I've done the NIC in vSphere shows as down/disconnected. It shows as up/up on the switch and I have link lights on both ends. I've tried configuring the port as both a trunk port and access port. I've tried with both auto negotiate and hard coded.

How should I be configuring the port on the Cisco switch in this configuration? My initial thought was:

description ESX02 TestNetwork
switchport access vlan 172
switchport mode access
speed 1000
duplex full

After looking at the way the ports are configured for the production VM Network, I tried mimicking that configuration minus the channel-group stuff, I'm not sure if I need that or not, I would assume not since it is a single port.

This is how I have that port configured now, but still cannot get the link to come alive on the ESXi side.

interface GigabitEthernet2/0/20
description ESX02 Test Network
switchport access vlan 172
switchport trunk encapsulation dot1q
switchport mode trunk
switchport nonegotiate
speed 1000
duplex full
spanning-tree portfast trunk
spanning-tree bpdufilter enable


Here is what the other VM Network ports look like on the switch, but again, there are 3 ports used for that from each host.

description ESX02 VMnetwork
switchport access vlan 50
switchport trunk encapsulation dot1q
switchport mode trunk
switchport nonegotiate
speed 1000
duplex full
channel-group 5 mode on
spanning-tree portfast trunk
spanning-tree bpdufilter enable


Any guidance? Thanks!

 

[bds1904]

you know your 172.168.5.0/24 network is a public ip network address right?

only 172.16.0.0-172.31.255.255 are private

 

[Database]

you know your 172.168.5.0/24 network is a public ip network address right?

only 172.16.0.0-172.31.255.255 are private

No, I didn't even think about that, just assigned the IP the client requested (they have their own team). I can fix that real quick, but I don't think that is the issue... I should still see a connection on the ESXi side. And hell without looking it may be set to 172.16.5.0

 

[NetJunkie]

You have a hardware problem...NIC..cable..switchport. Misconfig on any of that won't cause the port to actually go down.

 

[Database]

You have a hardware problem...NIC..cable..switchport. Misconfig on any of that won't cause the port to actually go down.

Why does the switch say its fine? Up/up
I'll try a different port/cable tomorrow.

 

[QHalo]

Up/up would suggest a layer 3 issue. That IP range is completely wrong. Someone fat fingered something.

 

[Database]

Up/up would suggest a layer 3 issue. That IP range is completely wrong. Someone fat fingered something.

The range is fixed, same issue.

He is a sh int on that port. It also is auto negotiating to 100/full which is weird, so maybe something is up with the port. I've tried manually setting both 100/full and 1000/full on both ends with same result.

3750s#sh int gi2/0/20
GigabitEthernet2/0/20 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 0025.46ac.e494 (bia 0025.46ac.e494)
Description: ESX02 TestNetwork
MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 100Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:51, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
0 input packets with dribble condition detected
46487 packets output, 14042061 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 PAUSE output
0 output buffer failures, 0 output buffers swapped out


And just for fun... vlan info:

Vlan172 is up, line protocol is up
Hardware is EtherSVI, address is 0025.46ac.e848 (bia 0025.46ac.e848)
Internet address is 172.16.5.1/24
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 0/255
Encapsulation ARPA, loopback not set
Keepalive not supported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 10:58:01, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
2 packets output, 128 bytes, 0 underruns
0 output errors, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

 

[Database]

Sigh... got this resolved. I went out onsite today and the client had plugged the cable into the DRAC port on the back of the server instead of the available NIC. Makes sense now. All is working. I just need to get the ISP to add a route on their router for that network and all should be good.

Thanks for the help all.

 

[QHalo]

............................................________
....................................,.-'"...................``~.,
.............................,.-"..................................."-.,
.........................,/...............................................":,
.....................,?......................................................,
.................../...........................................................,}
................./......................................................,:`^`..}
.............../...................................................,:"........./
..............?.....__.........................................:`.........../
............./__.(....."~-,_..............................,:`........../
.........../(_...."~,_........"~,_....................,:`........_/
..........{.._$;_......"=,_......."-,_.......,.-~-,},.~";/....}
...........((.....*~_......."=-._......";,,./`..../"............../
...,,,___.`~,......"~.,....................`.....}............../
............(....`=-,,.......`........................(......;_,,-"
............/.`~,......`-...................................../
.............`~.*-,.....................................|,./.....,__
,,_..........}.>-._...................................|..............`=~-,
.....`=~-,__......`,.................................
...................`=~-,,.,...............................
................................`:,,...........................`..............__
.....................................`=-,...................,%`>--==``
........................................_..........._,-%.......`
...................................,

layer 8 issue