Re: [c-nsp] Fun problem affecting only even-numbered ports

[Tim Stevenson]

At 09:00 AM 10/28/2010, Mack McBride uttered:

The 6748-SFP use one Rohini for even and one Rohini for odd ports 
not consecutive, IIRC.

This could vary by revision.  I don't have one handy to check against.
The Janus and SSA are for ports 1-24 and 25-48.


It's even/odd all the way back to the fabric on the 6748-SFP, one 
janus/SSA handles odd ports, the other even ports.


Tim



There are four Rohini on the board, two connected to each Janus/SSA pair.

You can use 'sh int  cap | inc Ports" to list the ports.
And 'sh asic slot " to list the asics.

This is example output of a 6724 which is consecutive.

#sh int Gi1/1 cap | inc Ports
  Ports-in-ASIC (Sub-port ASIC) : 1-24 (1-12)

The first port list is the Janus and SSA.  The second is the Rohini.

#sh asic-version slot 1
Module in slot 1 has 3 type(s) of ASICs
ASIC Name  Count  Version
JANUS  1  (1.0)
  SSA  1  (9.0)
   ROHINI  2  (1.5)

Mack

-Original Message-
From: cisco-nsp-boun...@puck.nether.net 
[<mailto:cisco-nsp-boun...@puck.nether.net>mailto:cisco-nsp-boun...@puck.nether.net] 
On Behalf Of Benjamin Lovell

Sent: Thursday, October 28, 2010 9:38 AM
To: John Neiberger
Cc: cisco-nsp@puck.nether.net
Subject: Re: [c-nsp] Fun problem affecting only even-numbered ports

Nothing that I can think of. One Super Santa Anna and Janus run ports
1-24 and another pair of them run ports 25-48. One Rohini runs each
consecutive group of 12 ports. The only thing I could guess at is the
path take across the switchbar fabric but I don't recall how we select
FPOE right now.

-Ben

On Oct 27, 2010, at 12:54 PM, John Neiberger wrote:

> This is a good one. I'm working with TAC on it, but I thought i'd
> share it here, too, just because it's so unusual. We're seeing
> intermittent drops on a multicast video stream and we haven't been
> able to determine why. This is the second time we've seen this bizarre
> behavior. At the urging of the TAC engineer, we tried moving receivers
> to different ports and noticed that we only see the drops when the
> receiver is connected to even-numbered interfaces! Odd-numbered
> interfaces are not affected.
>
> This is on a 7600 with SUP 720-3BXL and a 6748 linecard. What part of
> the 6748 linecard architecture is responsible for a behavior
> difference between odd- and even-numbered ports? This is a WS-6748-SFP
> with a DFC-3BXL.
>
> Any thoughts?
> ___
> cisco-nsp mailing list  cisco-nsp@puck.nether.net
> 
<https://puck.nether.net/mailman/listinfo/cisco-nsp>https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at 
<http://puck.nether.net/pipermail/cisco-nsp/>http://puck.nether.net/pipermail/cisco-nsp/


___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
<https://puck.nether.net/mailman/listinfo/cisco-nsp>https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at 
<http://puck.nether.net/pipermail/cisco-nsp/>http://puck.nether.net/pipermail/cisco-nsp/


___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
<https://puck.nether.net/mailman/listinfo/cisco-nsp>https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at 
<http://puck.nether.net/pipermail/cisco-nsp/>http://puck.nether.net/pipermail/cisco-nsp/





Tim Stevenson, tstev...@cisco.com
Routing & Switching CCIE #5561
Distinguished Technical Marketing Engineer, Cisco Nexus 7000
Cisco - http://www.cisco.com
IP Phone: 408-526-6759

The contents of this message may be *Cisco Confidential*
and are intended for the specified recipients only.


___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: [c-nsp] Fun problem affecting only even-numbered ports

[Benjamin Lovell]

Ahh. I was looking at the block diagram for the GE-TX and just assumed  
it was the same for SFP.


Thanx for the correction.

-Ben

On Oct 28, 2010, at 12:10 PM, Tim Stevenson wrote:

On the fiber (SFP) card, ports are indeed mapped in groups of 12  
consecutive odd/12 consecutive even ports per rohini, with 24 odd  
ports on one janus & 24 even ports on the other.


I'd guess you're just running out of replication bandwidth. A bit  
more detail about the traffic pattern etc would help. How many L3  
replications are occurring here, and for what input rate? Ingress or  
egress replication?


As a general rule you should spread the receivers as evenly as  
possible among odd & even ports to spread the replication load.


Hope that helps,
Tim

At 08:37 AM 10/28/2010, Ben Lovell (belovell) uttered:


Nothing that I can think of. One Super Santa Anna and Janus run ports
1-24 and another pair of them run ports 25-48. One Rohini runs each
consecutive group of 12 ports. The only thing I could guess at is the
path take across the switchbar fabric but I don't recall how we  
select

FPOE right now.

-Ben

On Oct 27, 2010, at 12:54 PM, John Neiberger wrote:

> This is a good one. I'm working with TAC on it, but I thought i'd
> share it here, too, just because it's so unusual. We're seeing
> intermittent drops on a multicast video stream and we haven't been
> able to determine why. This is the second time we've seen this  
bizarre
> behavior. At the urging of the TAC engineer, we tried moving  
receivers

> to different ports and noticed that we only see the drops when the
> receiver is connected to even-numbered interfaces! Odd-numbered
> interfaces are not affected.
>
> This is on a 7600 with SUP 720-3BXL and a 6748 linecard. What  
part of

> the 6748 linecard architecture is responsible for a behavior
> difference between odd- and even-numbered ports? This is a  
WS-6748-SFP

> with a DFC-3BXL.
>
> Any thoughts?
> ___
> cisco-nsp mailing list  cisco-nsp@puck.nether.net
> https:// 
puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http:// 
puck.nether.net/pipermail/cisco-nsp/


___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https:// 
puck.nether.net/mailman/listinfo/cisco-nsp
archive at http:// 
puck.nether.net/pipermail/cisco-nsp/





Tim Stevenson, tstev...@cisco.com
Routing & Switching CCIE #5561
Distinguished Technical Marketing Engineer, Cisco Nexus 7000
Cisco - http://www.cisco.com
IP Phone: 408-526-6759

The contents of this message may be *Cisco Confidential*
and are intended for the specified recipients only.



___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: [c-nsp] Fun problem affecting only even-numbered ports

[John Neiberger]

On Thu, Oct 28, 2010 at 10:10 AM, Tim Stevenson  wrote:
> On the fiber (SFP) card, ports are indeed mapped in groups of 12 consecutive
> odd/12 consecutive even ports per rohini, with 24 odd ports on one janus &
> 24 even ports on the other.
>
> I'd guess you're just running out of replication bandwidth. A bit more
> detail about the traffic pattern etc would help. How many L3 replications
> are occurring here, and for what input rate? Ingress or egress replication?
>
> As a general rule you should spread the receivers as evenly as possible
> among odd & even ports to spread the replication load.
>
> Hope that helps,
> Tim

Tim,

We haven't been able to find any drops on the Janus or fabric for this
module. I'd have to tally up the total amount of traffic on this
blade, but my guess is that we're seeing close to 3 or 4 Gbps of
multicast video crossing through that module. I'll verify that later
and let you know.

John
___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: [c-nsp] Fun problem affecting only even-numbered ports

[Jim Getker (getker)]

Actually on this card one Janus handles the even ports, and the other
handles the odd ports.

Jim

-Original Message-
From: cisco-nsp-boun...@puck.nether.net
[mailto:cisco-nsp-boun...@puck.nether.net] On Behalf Of Ben Lovell
(belovell)
Sent: Thursday, October 28, 2010 11:38 AM
To: John Neiberger
Cc: cisco-nsp@puck.nether.net
Subject: Re: [c-nsp] Fun problem affecting only even-numbered ports

Nothing that I can think of. One Super Santa Anna and Janus run ports  
1-24 and another pair of them run ports 25-48. One Rohini runs each  
consecutive group of 12 ports. The only thing I could guess at is the  
path take across the switchbar fabric but I don't recall how we select  
FPOE right now.

-Ben

On Oct 27, 2010, at 12:54 PM, John Neiberger wrote:

> This is a good one. I'm working with TAC on it, but I thought i'd
> share it here, too, just because it's so unusual. We're seeing
> intermittent drops on a multicast video stream and we haven't been
> able to determine why. This is the second time we've seen this bizarre
> behavior. At the urging of the TAC engineer, we tried moving receivers
> to different ports and noticed that we only see the drops when the
> receiver is connected to even-numbered interfaces! Odd-numbered
> interfaces are not affected.
>
> This is on a 7600 with SUP 720-3BXL and a 6748 linecard. What part of
> the 6748 linecard architecture is responsible for a behavior
> difference between odd- and even-numbered ports? This is a WS-6748-SFP
> with a DFC-3BXL.
>
> Any thoughts?
> ___
> cisco-nsp mailing list  cisco-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/

___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: [c-nsp] Fun problem affecting only even-numbered ports

[Keegan Holley]

Must be haunted.  Try it again after Halloween.


On Wed, Oct 27, 2010 at 12:54 PM, John Neiberger wrote:

> This is a good one. I'm working with TAC on it, but I thought i'd
> share it here, too, just because it's so unusual. We're seeing
> intermittent drops on a multicast video stream and we haven't been
> able to determine why. This is the second time we've seen this bizarre
> behavior. At the urging of the TAC engineer, we tried moving receivers
> to different ports and noticed that we only see the drops when the
> receiver is connected to even-numbered interfaces! Odd-numbered
> interfaces are not affected.
>
> This is on a 7600 with SUP 720-3BXL and a 6748 linecard. What part of
> the 6748 linecard architecture is responsible for a behavior
> difference between odd- and even-numbered ports? This is a WS-6748-SFP
> with a DFC-3BXL.
>
> Any thoughts?
> ___
> cisco-nsp mailing list  cisco-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/
>
>
>
___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: [c-nsp] Fun problem affecting only even-numbered ports

[Mack McBride]

The 6748-SFP use one Rohini for even and one Rohini for odd ports not 
consecutive, IIRC.
This could vary by revision.  I don't have one handy to check against.
The Janus and SSA are for ports 1-24 and 25-48.
There are four Rohini on the board, two connected to each Janus/SSA pair.

You can use 'sh int  cap | inc Ports" to list the ports.
And 'sh asic slot " to list the asics.

This is example output of a 6724 which is consecutive.

#sh int Gi1/1 cap | inc Ports
  Ports-in-ASIC (Sub-port ASIC) : 1-24 (1-12)

The first port list is the Janus and SSA.  The second is the Rohini.

#sh asic-version slot 1
Module in slot 1 has 3 type(s) of ASICs
ASIC Name  Count  Version
JANUS  1  (1.0)
  SSA  1  (9.0)
   ROHINI  2  (1.5)

Mack

-Original Message-
From: cisco-nsp-boun...@puck.nether.net 
[mailto:cisco-nsp-boun...@puck.nether.net] On Behalf Of Benjamin Lovell
Sent: Thursday, October 28, 2010 9:38 AM
To: John Neiberger
Cc: cisco-nsp@puck.nether.net
Subject: Re: [c-nsp] Fun problem affecting only even-numbered ports

Nothing that I can think of. One Super Santa Anna and Janus run ports  
1-24 and another pair of them run ports 25-48. One Rohini runs each  
consecutive group of 12 ports. The only thing I could guess at is the  
path take across the switchbar fabric but I don't recall how we select  
FPOE right now.

-Ben

On Oct 27, 2010, at 12:54 PM, John Neiberger wrote:

> This is a good one. I'm working with TAC on it, but I thought i'd
> share it here, too, just because it's so unusual. We're seeing
> intermittent drops on a multicast video stream and we haven't been
> able to determine why. This is the second time we've seen this bizarre
> behavior. At the urging of the TAC engineer, we tried moving receivers
> to different ports and noticed that we only see the drops when the
> receiver is connected to even-numbered interfaces! Odd-numbered
> interfaces are not affected.
>
> This is on a 7600 with SUP 720-3BXL and a 6748 linecard. What part of
> the 6748 linecard architecture is responsible for a behavior
> difference between odd- and even-numbered ports? This is a WS-6748-SFP
> with a DFC-3BXL.
>
> Any thoughts?
> ___
> cisco-nsp mailing list  cisco-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/

___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: [c-nsp] Fun problem affecting only even-numbered ports

[Tim Stevenson]

On the fiber (SFP) card, ports are indeed mapped in groups of 12 
consecutive odd/12 consecutive even ports per rohini, with 24 odd 
ports on one janus & 24 even ports on the other.


I'd guess you're just running out of replication bandwidth. A bit 
more detail about the traffic pattern etc would help. How many L3 
replications are occurring here, and for what input rate? Ingress or 
egress replication?


As a general rule you should spread the receivers as evenly as 
possible among odd & even ports to spread the replication load.


Hope that helps,
Tim

At 08:37 AM 10/28/2010, Ben Lovell (belovell) uttered:


Nothing that I can think of. One Super Santa Anna and Janus run ports
1-24 and another pair of them run ports 25-48. One Rohini runs each
consecutive group of 12 ports. The only thing I could guess at is the
path take across the switchbar fabric but I don't recall how we select
FPOE right now.

-Ben

On Oct 27, 2010, at 12:54 PM, John Neiberger wrote:

> This is a good one. I'm working with TAC on it, but I thought i'd
> share it here, too, just because it's so unusual. We're seeing
> intermittent drops on a multicast video stream and we haven't been
> able to determine why. This is the second time we've seen this bizarre
> behavior. At the urging of the TAC engineer, we tried moving receivers
> to different ports and noticed that we only see the drops when the
> receiver is connected to even-numbered interfaces! Odd-numbered
> interfaces are not affected.
>
> This is on a 7600 with SUP 720-3BXL and a 6748 linecard. What part of
> the 6748 linecard architecture is responsible for a behavior
> difference between odd- and even-numbered ports? This is a WS-6748-SFP
> with a DFC-3BXL.
>
> Any thoughts?
> ___
> cisco-nsp mailing list  cisco-nsp@puck.nether.net
> 
https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at 
http://puck.nether.net/pipermail/cisco-nsp/


___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at 
http://puck.nether.net/pipermail/cisco-nsp/





Tim Stevenson, tstev...@cisco.com
Routing & Switching CCIE #5561
Distinguished Technical Marketing Engineer, Cisco Nexus 7000
Cisco - http://www.cisco.com
IP Phone: 408-526-6759

The contents of this message may be *Cisco Confidential*
and are intended for the specified recipients only.


___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: [c-nsp] Fun problem affecting only even-numbered ports

[Benjamin Lovell]

Nothing that I can think of. One Super Santa Anna and Janus run ports  
1-24 and another pair of them run ports 25-48. One Rohini runs each  
consecutive group of 12 ports. The only thing I could guess at is the  
path take across the switchbar fabric but I don't recall how we select  
FPOE right now.


-Ben

On Oct 27, 2010, at 12:54 PM, John Neiberger wrote:


This is a good one. I'm working with TAC on it, but I thought i'd
share it here, too, just because it's so unusual. We're seeing
intermittent drops on a multicast video stream and we haven't been
able to determine why. This is the second time we've seen this bizarre
behavior. At the urging of the TAC engineer, we tried moving receivers
to different ports and noticed that we only see the drops when the
receiver is connected to even-numbered interfaces! Odd-numbered
interfaces are not affected.

This is on a 7600 with SUP 720-3BXL and a 6748 linecard. What part of
the 6748 linecard architecture is responsible for a behavior
difference between odd- and even-numbered ports? This is a WS-6748-SFP
with a DFC-3BXL.

Any thoughts?
___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/


___
cisco-nsp mailing list  cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/