Current Events > Alright... my network engineering brain is broken on this problem

Topic List
Page List: 1
CableZL
09/30/20 4:35:30 PM
#1:


Basic diagram
SW1: Cisco 3750X port gig 2/0/4 <----> SW7: Cisco 3750X Port gig 1/0/3

SW7 is bouncing

SW1 claims SW7 is drawing power over ethernet and granting it, then the port goes down and comes back up.

WTF


---
... Copied to Clipboard!
Mezcla
09/30/20 4:36:18 PM
#2:


have you tried turning it on and off again?

wait no of course you have.

are you sure its plugged in?

---
Sig
... Copied to Clipboard!
CableZL
09/30/20 4:38:13 PM
#3:


Mezcla posted...
have you tried turning it on and off again?

wait no of course you have.

are you sure its plugged in?
Yeah, it's plugged in... From what I understand, a switch of this model should never try to get power over ethernet from another device.

Can't reboot the device without causing a ~5 - 15 minute outage for certain devices at a store

---
... Copied to Clipboard!
BlazinBlue88
09/30/20 4:40:35 PM
#4:


When you say SW7 is bouncing do you mean the connection or the entire switch? Entire switch might be a power supply issue.

---
... Copied to Clipboard!
eston
09/30/20 4:40:57 PM
#5:


... Copied to Clipboard!
CableZL
09/30/20 4:41:11 PM
#6:


Probably gonna let the on call guy look into it more. Unless it's a bad ethernet cable between the two switches, that's the only thing I can think of... Not sure why a cable would cause a switch to grant power on its own, though

---
... Copied to Clipboard!
Shinnokxz
09/30/20 4:42:06 PM
#7:


Same, my first instinct is bad cable
... Copied to Clipboard!
CableZL
09/30/20 4:44:49 PM
#8:


BlazinBlue88 posted...
When you say SW7 is bouncing do you mean the connection or the entire switch? Entire switch might be a power supply issue.

The power to SW7 is stable, but the connection between SW1 and SW7 is going down over and over

CDP Neighbor info on SW1 port 2/0/4:

Device ID Local Intrfce Holdtme Capability Platform Port ID
SW7
Gig 2/0/4 128 S I WS-C3750X Gig 1/0/3
  • Basically, SW1 sees SW7 connected on its own port gig 2/0/4. The port on SW7 is gig 1/0/3.


Log:

Sep 30 15:30:48.252: %ILPOWER-7-DETECT: Interface Gi2/0/4: Power Device detected: IEEE PD
  • SW1 detecting that SW7 is requesting power over ethernet
Sep 30 15:30:48.688: %ILPOWER-5-POWER_GRANTED: Interface Gi2/0/4: Power granted
  • SW1 is granting power over ethernet to SW7
Sep 30 15:30:49.301: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi2/0/4: PD removed
Sep 30 15:30:50.400: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to down

Sep 30 15:30:51.431: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to down
  • Port goes down
Sep 30 15:30:54.434: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to up
Sep 30 15:30:56.506: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to up
  • Port comes back up


And that just repeats

---
... Copied to Clipboard!
BlazinBlue88
09/30/20 4:54:35 PM
#9:


CableZL posted...
The power to SW7 is stable, but the connection between SW1 and SW7 is going down over and over

CDP Neighbor info on SW1 port 2/0/4:

Device ID Local Intrfce Holdtme Capability Platform Port ID
SW7
Gig 2/0/4 128 S I WS-C3750X Gig 1/0/3
* Basically, SW1 sees SW7 connected on its own port gig 2/0/4. The port on SW7 is gig 1/0/3.

Log:

Sep 30 15:30:48.252: %ILPOWER-7-DETECT: Interface Gi2/0/4: Power Device detected: IEEE PD
* SW1 detecting that SW7 is requesting power over ethernet
Sep 30 15:30:48.688: %ILPOWER-5-POWER_GRANTED: Interface Gi2/0/4: Power granted
* SW1 is granting power over ethernet to SW7
Sep 30 15:30:49.301: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi2/0/4: PD removed
Sep 30 15:30:50.400: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to down

Sep 30 15:30:51.431: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to down
* Port goes down
Sep 30 15:30:54.434: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to up
Sep 30 15:30:56.506: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to up
* Port comes back up

And that just repeats
Yeah then I'd go with the other user and accuse the eth cable.

---
... Copied to Clipboard!
CableZL
09/30/20 4:59:16 PM
#10:


It's stable now. I'm checking with the on call guy to see if they replaced the cable. That's the only plausible cause, imo. I just never imagined this kind of thing would happen because of a bad cable.


---
... Copied to Clipboard!
Solid Sonic
09/30/20 5:02:17 PM
#11:


Shinnokxz posted...
Same, my first instinct is bad cable

Layer 1, baby, always worth a look. It's the hardest thing to actually understand from the point of someone who doesn't interact with it full time. If all you can see are the readouts from a switch but can't figure it out on the endpoints, you could be looking at a media issue and that is hard to see.

---
"It feels like I'm always wrong."
"Nah, that's not true...I mean you just made that statement, didn't you?"
... Copied to Clipboard!
Questionmarktarius
09/30/20 5:05:09 PM
#12:


Solid Sonic posted...
Layer 1, baby, always worth a look.
Mysterious power request and then the port shutting off implies a short somewhere.
... Copied to Clipboard!
CableZL
09/30/20 5:07:20 PM
#13:


Solid Sonic posted...
Layer 1, baby, always worth a look. It's the hardest thing to actually understand from the point of someone who doesn't interact with it full time. If all you can see are the readouts from a switch but can't figure it out on the endpoints, you could be looking at a media issue and that is hard to see.

Yeah, I would say that I have a number of layer 1 knowledge gaps because I learned networking by reading Cisco books for certification exams... Up to CCNP Route/Switch, it didn't cover much about layer 1 at all.

---
... Copied to Clipboard!
BlazinBlue88
09/30/20 5:17:12 PM
#14:


CableZL posted...
Yeah, I would say that I have a number of layer 1 knowledge gaps because I learned networking by reading Cisco books for certification exams... Up to CCNP Route/Switch, it didn't cover much about layer 1 at all.
We all have gaps somewhere. Hard to get that knowledge without getting the hands on experience.

---
... Copied to Clipboard!
Poop2
09/30/20 5:23:33 PM
#15:


could it just be a hardware failure somehwere?
... Copied to Clipboard!
Solid Sonic
09/30/20 5:27:19 PM
#16:


BlazinBlue88 posted...
We all have gaps somewhere. Hard to get that knowledge without getting the hands on experience.

I always panic that people will see through my facade and realize I'm operating out of my ass.

---
"It feels like I'm always wrong."
"Nah, that's not true...I mean you just made that statement, didn't you?"
... Copied to Clipboard!
CableZL
09/30/20 5:31:30 PM
#17:


Poop2 posted...
could it just be a hardware failure somehwere?
I'm hoping the hardware failure is just the cable. Seems to be fine right now, but I'm not the one who stabilized it.

---
... Copied to Clipboard!
Topic List
Page List: 1