Hi All,
I am having a strange issue on an SRX340 Cluster pair - with strange unknown traffic egressing out of a Reth interface that is configured as a trunk port on an ethernet switch - with a few vlans added as members :
(some information has been sensitised)
redundant-ether-options {
redundancy-group 1;
}
unit 0 {
family ethernet-switching {
interface-mode trunk;
vlan {
members [ CORE-DMZSL7SZ00 CORE-DMZSL7SZ08 TRANSIT-EFTS-XXX-117 CORE-TRANSIT-XXX-YYY CORE-TRANSIT-XXX-ZZZ ];
}
CORE-DMZSL7SZ00 {
vlan-id 1385;
l3-interface irb.1385;
}
CORE-DMZSL7SZ08 {
vlan-id 1022;
l3-interface irb.1022;
}
TRANSIT-EFTS-XXX-117 {
vlan-id 117;
l3-interface irb.117;
}
CORE-TRANSIT-XXX-YYY {
vlan-id 1896;
l3-interface irb.1896;
}
CORE-TRANSIT-XXX-ZZZ {
vlan-id 1895;
l3-interface irb.1895;
}
The issue I am facing is that there is a discrepancy between the sum of the traffic of the attached vlans compared to the interface itself, by a considerable order. The traffic rate seems to steadly increase until it plateaus at around 850mpbs - whereapon our upstream provider complains.
Reth2 Interface :
frwl-a-hre-a Seconds: 2 Time: 12:39:15
Delay: 0/0/30
Interface: reth2, Enabled, Link is Up
Encapsulation: Ethernet, Speed: 1000mbps
Traffic statistics: Current delta
Input bytes: 1045155938 (29432 bps) [7977]
Output bytes: 2857182432517 (71683848 bps) [17967992]
Input packets: 1842470 (33 pps) [72]
Output packets: 44342101615 (139500 pps) [278501]
Error statistics:
Input errors: 0 [0]
Input drops: 0 [0]
Input framing errors: 0 [0]
Carrier transitions: 0 [0]
Output errors: 0 [0]
Output drops: 0 [0]
irb.1385 Interface :
frwl-a-hre-a Seconds: 2 Time: 12:41:47
Delay: 6/6/14
Interface: irb.1385, Enabled, Link is Up
Flags: SNMP-Traps 0x4000
Encapsulation: ENET2
Local statistics: Current delta
Input bytes: 0 [0]
Output bytes: 0 [0]
Input packets: 0 [0]
Output packets: 0 [0]
Remote statistics:
Input bytes: 0 (0 bps) [0]
Output bytes: 0 (0 bps) [0]
Input packets: 0 (0 pps) [0]
Output packets: 0 (0 pps) [0]
Traffic statistics:
Input bytes: 0 [0]
Output bytes: 0 [0]
Input packets: 0 [0]
Output packets: 0 [0]
irb.1022 Interface :
frwl-a-hre-a Seconds: 2 Time: 12:40:35
Delay: 5/5/15
Interface: irb.1022, Enabled, Link is Up
Flags: SNMP-Traps 0x4000
Encapsulation: ENET2
Local statistics: Current delta
Input bytes: 7751464 [0]
Output bytes: 44702558 [530]
Input packets: 54476 [0]
Output packets: 179808 [2]
Remote statistics:
Input bytes: 1258830365 (152 bps) [40]
Output bytes: 541960551 (360 bps) [91]
Input packets: 2306811 (0 pps) [1]
Output packets: 2071016 (0 pps) [1]
Traffic statistics:
Input bytes: 1266581829 [40]
Output bytes: 586663109 [621]
Input packets: 2361287 [1]
Output packets: 2250824 [3]
irb.117 Interface:
frwl-a-hre-a Seconds: 1 Time: 12:41:16
Delay: 9/8/9
Interface: irb.117, Enabled, Link is Up
Flags: SNMP-Traps 0x4004000
Encapsulation: ENET2
Local statistics: Current delta
Input bytes: 0 [0]
Output bytes: 0 [0]
Input packets: 0 [0]
Output packets: 0 [0]
Remote statistics:
Input bytes: 0 (0 bps) [0]
Output bytes: 0 (0 bps) [0]
Input packets: 0 (0 pps) [0]
Output packets: 0 (0 pps) [0]
Traffic statistics:
Input bytes: 0 [0]
Output bytes: 0 [0]
Input packets: 0 [0]
Output packets: 0 [0]
irb.1895 Iterface :
frwl-a-hre-a Seconds: 2 Time: 12:43:31
Delay: 6/6/59
Interface: irb.1895, Enabled, Link is Up
Flags: SNMP-Traps 0x4000
Encapsulation: ENET2
Local statistics: Current delta
Input bytes: 0 [0]
Output bytes: 1016784 [0]
Input packets: 0 [0]
Output packets: 22104 [0]
Remote statistics:
Input bytes: 97140 (0 bps) [0]
Output bytes: 0 (0 bps) [0]
Input packets: 1291 (0 pps) [0]
Output packets: 0 (0 pps) [0]
Traffic statistics:
Input bytes: 97140 [0]
Output bytes: 1016784 [0]
Input packets: 1291 [0]
Output packets: 22104 [0]
irb.1896 Interface :
frwl-a-hre-a Seconds: 3 Time: 12:43:53
Delay: 17/6/17
Interface: irb.1896, Enabled, Link is Up
Flags: SNMP-Traps 0x4000
Encapsulation: ENET2
Local statistics: Current delta
Input bytes: 0 [0]
Output bytes: 1016600 [46]
Input packets: 0 [0]
Output packets: 22100 [1]
Remote statistics:
Input bytes: 4944 (0 bps) [0]
Output bytes: 64 (0 bps) [0]
Input packets: 81 (0 pps) [0]
Output packets: 1 (0 pps) [0]
Traffic statistics:
Input bytes: 4944 [0]
Output bytes: 1016664 [46]
Input packets: 81 [0]
Output packets: 22101 [1]
From these statistics it can clearly be seen that irb.1022 is the only vlan with any real traffic on it - however that particular vlan is rate limited to 2mpbs by the provider, and the average bps of the vlan is around 200000 - 700000 bps, with the other 4 vlans having miniscule traffic.
However the bps rate on the Reth2 interface - at present is around 74325336 bps - and if left will continue to rise to around 812358480 bps on average - and will remain so, until the interface is disabled and brought back up again, where it will start off low and continually climb again.
There is no other configurations on the Reth2 interface - especially any L3 interfaces so I am extremely confused as to what is generating this traffic.
I have tried to run a pcap on Reth2 - however since there is no L3 interface, there are no packets to capture.
I have supplied some screenshots showing the issue at it worst.
I have tried manually failing over the cluster to node1 - and the issue persists even while node1 being active.
The cluser was recently upgraded to firmware 15.1X49-D140.2
Any assistance with this issue would be greatly appreciated.
Kind regards,
Liam