~ [ source navigation ] ~ [ diff markup ] ~ [ identifier search ] ~

TOMOYO Linux Cross Reference
Linux/tools/testing/selftests/net/pmtu.sh

Version: ~ [ linux-6.11.5 ] ~ [ linux-6.10.14 ] ~ [ linux-6.9.12 ] ~ [ linux-6.8.12 ] ~ [ linux-6.7.12 ] ~ [ linux-6.6.58 ] ~ [ linux-6.5.13 ] ~ [ linux-6.4.16 ] ~ [ linux-6.3.13 ] ~ [ linux-6.2.16 ] ~ [ linux-6.1.114 ] ~ [ linux-6.0.19 ] ~ [ linux-5.19.17 ] ~ [ linux-5.18.19 ] ~ [ linux-5.17.15 ] ~ [ linux-5.16.20 ] ~ [ linux-5.15.169 ] ~ [ linux-5.14.21 ] ~ [ linux-5.13.19 ] ~ [ linux-5.12.19 ] ~ [ linux-5.11.22 ] ~ [ linux-5.10.228 ] ~ [ linux-5.9.16 ] ~ [ linux-5.8.18 ] ~ [ linux-5.7.19 ] ~ [ linux-5.6.19 ] ~ [ linux-5.5.19 ] ~ [ linux-5.4.284 ] ~ [ linux-5.3.18 ] ~ [ linux-5.2.21 ] ~ [ linux-5.1.21 ] ~ [ linux-5.0.21 ] ~ [ linux-4.20.17 ] ~ [ linux-4.19.322 ] ~ [ linux-4.18.20 ] ~ [ linux-4.17.19 ] ~ [ linux-4.16.18 ] ~ [ linux-4.15.18 ] ~ [ linux-4.14.336 ] ~ [ linux-4.13.16 ] ~ [ linux-4.12.14 ] ~ [ linux-4.11.12 ] ~ [ linux-4.10.17 ] ~ [ linux-4.9.337 ] ~ [ linux-4.4.302 ] ~ [ linux-3.10.108 ] ~ [ linux-2.6.32.71 ] ~ [ linux-2.6.0 ] ~ [ linux-2.4.37.11 ] ~ [ unix-v6-master ] ~ [ ccs-tools-1.8.9 ] ~ [ policy-sample ] ~
Architecture: ~ [ i386 ] ~ [ alpha ] ~ [ m68k ] ~ [ mips ] ~ [ ppc ] ~ [ sparc ] ~ [ sparc64 ] ~

Diff markup

Differences between /tools/testing/selftests/net/pmtu.sh (Architecture mips) and /tools/testing/selftests/net/pmtu.sh (Architecture alpha)


  1 #!/bin/bash                                         1 #!/bin/bash
  2 # SPDX-License-Identifier: GPL-2.0                  2 # SPDX-License-Identifier: GPL-2.0
  3 #                                                   3 #
  4 # Check that route PMTU values match expectati      4 # Check that route PMTU values match expectations, and that initial device MTU
  5 # values are assigned correctly                     5 # values are assigned correctly
  6 #                                                   6 #
  7 # Tests currently implemented:                      7 # Tests currently implemented:
  8 #                                                   8 #
  9 # - pmtu_ipv4                                       9 # - pmtu_ipv4
 10 #       Set up two namespaces, A and B, with t     10 #       Set up two namespaces, A and B, with two paths between them over routers
 11 #       R1 and R2 (also implemented with names     11 #       R1 and R2 (also implemented with namespaces), with different MTUs:
 12 #                                                  12 #
 13 #         segment a_r1    segment b_r1             13 #         segment a_r1    segment b_r1          a_r1: 2000
 14 #       .--------------R1--------------.           14 #       .--------------R1--------------.        b_r1: 1400
 15 #       A                               B          15 #       A                               B       a_r2: 2000
 16 #       '--------------R2--------------'           16 #       '--------------R2--------------'        b_r2: 1500
 17 #         segment a_r2    segment b_r2             17 #         segment a_r2    segment b_r2
 18 #                                                  18 #
 19 #       Check that PMTU exceptions with the co     19 #       Check that PMTU exceptions with the correct PMTU are created. Then
 20 #       decrease and increase the MTU of the l     20 #       decrease and increase the MTU of the local link for one of the paths,
 21 #       A to R1, checking that route exception     21 #       A to R1, checking that route exception PMTU changes accordingly over
 22 #       this path. Also check that locked exce     22 #       this path. Also check that locked exceptions are created when an ICMP
 23 #       message advertising a PMTU smaller tha     23 #       message advertising a PMTU smaller than net.ipv4.route.min_pmtu is
 24 #       received                                   24 #       received
 25 #                                                  25 #
 26 # - pmtu_ipv6                                      26 # - pmtu_ipv6
 27 #       Same as pmtu_ipv4, except for locked P     27 #       Same as pmtu_ipv4, except for locked PMTU tests, using IPv6
 28 #                                                  28 #
 29 # - pmtu_ipv4_dscp_icmp_exception                  29 # - pmtu_ipv4_dscp_icmp_exception
 30 #       Set up the same network topology as pm     30 #       Set up the same network topology as pmtu_ipv4, but use non-default
 31 #       routing table in A. A fib-rule is used     31 #       routing table in A. A fib-rule is used to jump to this routing table
 32 #       based on DSCP. Send ICMPv4 packets wit     32 #       based on DSCP. Send ICMPv4 packets with the expected DSCP value and
 33 #       verify that ECN doesn't interfere with     33 #       verify that ECN doesn't interfere with the creation of PMTU exceptions.
 34 #                                                  34 #
 35 # - pmtu_ipv4_dscp_udp_exception                   35 # - pmtu_ipv4_dscp_udp_exception
 36 #       Same as pmtu_ipv4_dscp_icmp_exception,     36 #       Same as pmtu_ipv4_dscp_icmp_exception, but use UDP instead of ICMP.
 37 #                                                  37 #
 38 # - pmtu_ipv4_vxlan4_exception                     38 # - pmtu_ipv4_vxlan4_exception
 39 #       Set up the same network topology as pm     39 #       Set up the same network topology as pmtu_ipv4, create a VXLAN tunnel
 40 #       over IPv4 between A and B, routed via      40 #       over IPv4 between A and B, routed via R1. On the link between R1 and B,
 41 #       set a MTU lower than the VXLAN MTU and     41 #       set a MTU lower than the VXLAN MTU and the MTU on the link between A and
 42 #       R1. Send IPv4 packets, exceeding the M     42 #       R1. Send IPv4 packets, exceeding the MTU between R1 and B, over VXLAN
 43 #       from A to B and check that the PMTU ex     43 #       from A to B and check that the PMTU exception is created with the right
 44 #       value on A                                 44 #       value on A
 45 #                                                  45 #
 46 # - pmtu_ipv6_vxlan4_exception                     46 # - pmtu_ipv6_vxlan4_exception
 47 #       Same as pmtu_ipv4_vxlan4_exception, bu     47 #       Same as pmtu_ipv4_vxlan4_exception, but send IPv6 packets from A to B
 48 #                                                  48 #
 49 # - pmtu_ipv4_vxlan6_exception                     49 # - pmtu_ipv4_vxlan6_exception
 50 #       Same as pmtu_ipv4_vxlan4_exception, bu     50 #       Same as pmtu_ipv4_vxlan4_exception, but use IPv6 transport from A to B
 51 #                                                  51 #
 52 # - pmtu_ipv6_vxlan6_exception                     52 # - pmtu_ipv6_vxlan6_exception
 53 #       Same as pmtu_ipv4_vxlan6_exception, bu     53 #       Same as pmtu_ipv4_vxlan6_exception, but send IPv6 packets from A to B
 54 #                                                  54 #
 55 # - pmtu_ipv4_geneve4_exception                    55 # - pmtu_ipv4_geneve4_exception
 56 #       Same as pmtu_ipv4_vxlan4_exception, bu     56 #       Same as pmtu_ipv4_vxlan4_exception, but using a GENEVE tunnel instead of
 57 #       VXLAN                                      57 #       VXLAN
 58 #                                                  58 #
 59 # - pmtu_ipv6_geneve4_exception                    59 # - pmtu_ipv6_geneve4_exception
 60 #       Same as pmtu_ipv6_vxlan4_exception, bu     60 #       Same as pmtu_ipv6_vxlan4_exception, but using a GENEVE tunnel instead of
 61 #       VXLAN                                      61 #       VXLAN
 62 #                                                  62 #
 63 # - pmtu_ipv4_geneve6_exception                    63 # - pmtu_ipv4_geneve6_exception
 64 #       Same as pmtu_ipv4_vxlan6_exception, bu     64 #       Same as pmtu_ipv4_vxlan6_exception, but using a GENEVE tunnel instead of
 65 #       VXLAN                                      65 #       VXLAN
 66 #                                                  66 #
 67 # - pmtu_ipv6_geneve6_exception                    67 # - pmtu_ipv6_geneve6_exception
 68 #       Same as pmtu_ipv6_vxlan6_exception, bu     68 #       Same as pmtu_ipv6_vxlan6_exception, but using a GENEVE tunnel instead of
 69 #       VXLAN                                      69 #       VXLAN
 70 #                                                  70 #
 71 # - pmtu_ipv{4,6}_br_vxlan{4,6}_exception          71 # - pmtu_ipv{4,6}_br_vxlan{4,6}_exception
 72 #       Set up three namespaces, A, B, and C,      72 #       Set up three namespaces, A, B, and C, with routing between A and B over
 73 #       R1. R2 is unused in these tests. A has     73 #       R1. R2 is unused in these tests. A has a veth connection to C, and is
 74 #       connected to B via a VXLAN endpoint, w     74 #       connected to B via a VXLAN endpoint, which is directly bridged to C.
 75 #       MTU on the B-R1 link is lower than oth     75 #       MTU on the B-R1 link is lower than other MTUs.
 76 #                                                  76 #
 77 #       Check that both C and A are able to co     77 #       Check that both C and A are able to communicate with B over the VXLAN
 78 #       tunnel, and that PMTU exceptions with      78 #       tunnel, and that PMTU exceptions with the correct values are created.
 79 #                                                  79 #
 80 #                         segment a_r1    segm     80 #                         segment a_r1    segment b_r1            b_r1: 4000
 81 #                       .--------------R1-----     81 #                       .--------------R1--------------.    everything
 82 #          C---veth     A                          82 #          C---veth     A                               B         else: 5000
 83 #               ' bridge                           83 #               ' bridge                                |
 84 #                   '---- - - - - - VXLAN - -      84 #                   '---- - - - - - VXLAN - - - - - - - '
 85 #                                                  85 #
 86 # - pmtu_ipv{4,6}_br_geneve{4,6}_exception         86 # - pmtu_ipv{4,6}_br_geneve{4,6}_exception
 87 #       Same as pmtu_ipv{4,6}_br_vxlan{4,6}_ex     87 #       Same as pmtu_ipv{4,6}_br_vxlan{4,6}_exception, with a GENEVE tunnel
 88 #       instead.                                   88 #       instead.
 89 #                                                  89 #
 90 # - pmtu_ipv{4,6}_ovs_vxlan{4,6}_exception         90 # - pmtu_ipv{4,6}_ovs_vxlan{4,6}_exception
 91 #       Set up two namespaces, B, and C, with      91 #       Set up two namespaces, B, and C, with routing between the init namespace
 92 #       and B over R1. A and R2 are unused in      92 #       and B over R1. A and R2 are unused in these tests. The init namespace
 93 #       has a veth connection to C, and is con     93 #       has a veth connection to C, and is connected to B via a VXLAN endpoint,
 94 #       which is handled by Open vSwitch and b     94 #       which is handled by Open vSwitch and bridged to C. MTU on the B-R1 link
 95 #       is lower than other MTUs.                  95 #       is lower than other MTUs.
 96 #                                                  96 #
 97 #       Check that C is able to communicate wi     97 #       Check that C is able to communicate with B over the VXLAN tunnel, and
 98 #       that PMTU exceptions with the correct      98 #       that PMTU exceptions with the correct values are created.
 99 #                                                  99 #
100 #                         segment a_r1    segm    100 #                         segment a_r1    segment b_r1            b_r1: 4000
101 #                       .--------------R1-----    101 #                       .--------------R1--------------.    everything
102 #          C---veth    init                       102 #          C---veth    init                             B         else: 5000
103 #               '- ovs                            103 #               '- ovs                                  |
104 #                   '---- - - - - - VXLAN - -     104 #                   '---- - - - - - VXLAN - - - - - - - '
105 #                                                 105 #
106 # - pmtu_ipv{4,6}_ovs_geneve{4,6}_exception       106 # - pmtu_ipv{4,6}_ovs_geneve{4,6}_exception
107 #       Same as pmtu_ipv{4,6}_ovs_vxlan{4,6}_e    107 #       Same as pmtu_ipv{4,6}_ovs_vxlan{4,6}_exception, with a GENEVE tunnel
108 #       instead.                                  108 #       instead.
109 #                                                 109 #
110 # - pmtu_ipv{4,6}_fou{4,6}_exception              110 # - pmtu_ipv{4,6}_fou{4,6}_exception
111 #       Same as pmtu_ipv4_vxlan4, but using a     111 #       Same as pmtu_ipv4_vxlan4, but using a direct IPv4/IPv6 encapsulation
112 #       (FoU) over IPv4/IPv6, instead of VXLAN    112 #       (FoU) over IPv4/IPv6, instead of VXLAN
113 #                                                 113 #
114 # - pmtu_ipv{4,6}_fou{4,6}_exception              114 # - pmtu_ipv{4,6}_fou{4,6}_exception
115 #       Same as pmtu_ipv4_vxlan4, but using a     115 #       Same as pmtu_ipv4_vxlan4, but using a generic UDP IPv4/IPv6
116 #       encapsulation (GUE) over IPv4/IPv6, in    116 #       encapsulation (GUE) over IPv4/IPv6, instead of VXLAN
117 #                                                 117 #
118 # - pmtu_ipv{4,6}_ipv{4,6}_exception              118 # - pmtu_ipv{4,6}_ipv{4,6}_exception
119 #       Same as pmtu_ipv4_vxlan4, but using a     119 #       Same as pmtu_ipv4_vxlan4, but using a IPv4/IPv6 tunnel over IPv4/IPv6,
120 #       instead of VXLAN                          120 #       instead of VXLAN
121 #                                                 121 #
122 # - pmtu_vti4_exception                           122 # - pmtu_vti4_exception
123 #       Set up vti tunnel on top of veth, with    123 #       Set up vti tunnel on top of veth, with xfrm states and policies, in two
124 #       namespaces with matching endpoints. Ch    124 #       namespaces with matching endpoints. Check that route exception is not
125 #       created if link layer MTU is not excee    125 #       created if link layer MTU is not exceeded, then exceed it and check that
126 #       exception is created with the expected    126 #       exception is created with the expected PMTU. The approach described
127 #       below for IPv6 doesn't apply here, bec    127 #       below for IPv6 doesn't apply here, because, on IPv4, administrative MTU
128 #       changes alone won't affect PMTU           128 #       changes alone won't affect PMTU
129 #                                                 129 #
130 # - pmtu_vti4_udp_exception                       130 # - pmtu_vti4_udp_exception
131 #       Same as pmtu_vti4_exception, but using    131 #       Same as pmtu_vti4_exception, but using ESP-in-UDP
132 #                                                 132 #
133 # - pmtu_vti4_udp_routed_exception                133 # - pmtu_vti4_udp_routed_exception
134 #       Set up vti tunnel on top of veth conne    134 #       Set up vti tunnel on top of veth connected through routing namespace and
135 #       add xfrm states and policies with ESP-    135 #       add xfrm states and policies with ESP-in-UDP encapsulation. Check that
136 #       route exception is not created if link    136 #       route exception is not created if link layer MTU is not exceeded, then
137 #       lower MTU on second part of routed env    137 #       lower MTU on second part of routed environment and check that exception
138 #       is created with the expected PMTU.        138 #       is created with the expected PMTU.
139 #                                                 139 #
140 # - pmtu_vti6_exception                           140 # - pmtu_vti6_exception
141 #       Set up vti6 tunnel on top of veth, wit    141 #       Set up vti6 tunnel on top of veth, with xfrm states and policies, in two
142 #       namespaces with matching endpoints. Ch    142 #       namespaces with matching endpoints. Check that route exception is
143 #       created by exceeding link layer MTU wi    143 #       created by exceeding link layer MTU with ping to other endpoint. Then
144 #       decrease and increase MTU of tunnel, c    144 #       decrease and increase MTU of tunnel, checking that route exception PMTU
145 #       changes accordingly                       145 #       changes accordingly
146 #                                                 146 #
147 # - pmtu_vti6_udp_exception                       147 # - pmtu_vti6_udp_exception
148 #       Same as pmtu_vti6_exception, but using    148 #       Same as pmtu_vti6_exception, but using ESP-in-UDP
149 #                                                 149 #
150 # - pmtu_vti6_udp_routed_exception                150 # - pmtu_vti6_udp_routed_exception
151 #       Same as pmtu_vti6_udp_routed_exception    151 #       Same as pmtu_vti6_udp_routed_exception but with routing between vti
152 #       endpoints                                 152 #       endpoints
153 #                                                 153 #
154 # - pmtu_vti4_default_mtu                         154 # - pmtu_vti4_default_mtu
155 #       Set up vti4 tunnel on top of veth, in     155 #       Set up vti4 tunnel on top of veth, in two namespaces with matching
156 #       endpoints. Check that MTU assigned to     156 #       endpoints. Check that MTU assigned to vti interface is the MTU of the
157 #       lower layer (veth) minus additional lo    157 #       lower layer (veth) minus additional lower layer headers (zero, for veth)
158 #       minus IPv4 header length                  158 #       minus IPv4 header length
159 #                                                 159 #
160 # - pmtu_vti6_default_mtu                         160 # - pmtu_vti6_default_mtu
161 #       Same as above, for IPv6                   161 #       Same as above, for IPv6
162 #                                                 162 #
163 # - pmtu_vti4_link_add_mtu                        163 # - pmtu_vti4_link_add_mtu
164 #       Set up vti4 interface passing MTU valu    164 #       Set up vti4 interface passing MTU value at link creation, check MTU is
165 #       configured, and that link is not creat    165 #       configured, and that link is not created with invalid MTU values
166 #                                                 166 #
167 # - pmtu_vti6_link_add_mtu                        167 # - pmtu_vti6_link_add_mtu
168 #       Same as above, for IPv6                   168 #       Same as above, for IPv6
169 #                                                 169 #
170 # - pmtu_vti6_link_change_mtu                     170 # - pmtu_vti6_link_change_mtu
171 #       Set up two dummy interfaces with diffe    171 #       Set up two dummy interfaces with different MTUs, create a vti6 tunnel
172 #       and check that configured MTU is used     172 #       and check that configured MTU is used on link creation and changes, and
173 #       that MTU is properly calculated instea    173 #       that MTU is properly calculated instead when MTU is not configured from
174 #       userspace                                 174 #       userspace
175 #                                                 175 #
176 # - cleanup_ipv4_exception                        176 # - cleanup_ipv4_exception
177 #       Similar to pmtu_ipv4_vxlan4_exception,    177 #       Similar to pmtu_ipv4_vxlan4_exception, but explicitly generate PMTU
178 #       exceptions on multiple CPUs and check     178 #       exceptions on multiple CPUs and check that the veth device tear-down
179 #       happens in a timely manner                179 #       happens in a timely manner
180 #                                                 180 #
181 # - cleanup_ipv6_exception                        181 # - cleanup_ipv6_exception
182 #       Same as above, but use IPv6 transport     182 #       Same as above, but use IPv6 transport from A to B
183 #                                                 183 #
184 # - list_flush_ipv4_exception                     184 # - list_flush_ipv4_exception
185 #       Using the same topology as in pmtu_ipv    185 #       Using the same topology as in pmtu_ipv4, create exceptions, and check
186 #       they are shown when listing exception     186 #       they are shown when listing exception caches, gone after flushing them
187 #                                                 187 #
188 # - list_flush_ipv6_exception                     188 # - list_flush_ipv6_exception
189 #       Using the same topology as in pmtu_ipv    189 #       Using the same topology as in pmtu_ipv6, create exceptions, and check
190 #       they are shown when listing exception     190 #       they are shown when listing exception caches, gone after flushing them
191 #                                                 191 #
192 # - pmtu_ipv4_route_change                        192 # - pmtu_ipv4_route_change
193 #       Use the same topology as in pmtu_ipv4,    193 #       Use the same topology as in pmtu_ipv4, but issue a route replacement
194 #       command and delete the corresponding d    194 #       command and delete the corresponding device afterward. This tests for
195 #       proper cleanup of the PMTU exceptions     195 #       proper cleanup of the PMTU exceptions by the route replacement path.
196 #       Device unregistration should complete     196 #       Device unregistration should complete successfully
197 #                                                 197 #
198 # - pmtu_ipv6_route_change                        198 # - pmtu_ipv6_route_change
199 #       Same as above but with IPv6               199 #       Same as above but with IPv6
200                                                   200 
201 source lib.sh                                     201 source lib.sh
202 source net_helper.sh                              202 source net_helper.sh
203                                                   203 
204 PAUSE_ON_FAIL=no                                  204 PAUSE_ON_FAIL=no
205 VERBOSE=0                                         205 VERBOSE=0
206 TRACING=0                                         206 TRACING=0
207                                                   207 
208 # Some systems don't have a ping6 binary anymo    208 # Some systems don't have a ping6 binary anymore
209 which ping6 > /dev/null 2>&1 && ping6=$(which     209 which ping6 > /dev/null 2>&1 && ping6=$(which ping6) || ping6=$(which ping)
210                                                   210 
211 #               Name                              211 #               Name                          Description                  re-run with nh
212 tests="                                           212 tests="
213         pmtu_ipv4_exception             ipv4:     213         pmtu_ipv4_exception             ipv4: PMTU exceptions                   1
214         pmtu_ipv6_exception             ipv6:     214         pmtu_ipv6_exception             ipv6: PMTU exceptions                   1
215         pmtu_ipv4_dscp_icmp_exception   ICMPv4    215         pmtu_ipv4_dscp_icmp_exception   ICMPv4 with DSCP and ECN: PMTU exceptions       1
216         pmtu_ipv4_dscp_udp_exception    UDPv4     216         pmtu_ipv4_dscp_udp_exception    UDPv4 with DSCP and ECN: PMTU exceptions        1
217         pmtu_ipv4_vxlan4_exception      IPv4 o    217         pmtu_ipv4_vxlan4_exception      IPv4 over vxlan4: PMTU exceptions       1
218         pmtu_ipv6_vxlan4_exception      IPv6 o    218         pmtu_ipv6_vxlan4_exception      IPv6 over vxlan4: PMTU exceptions       1
219         pmtu_ipv4_vxlan6_exception      IPv4 o    219         pmtu_ipv4_vxlan6_exception      IPv4 over vxlan6: PMTU exceptions       1
220         pmtu_ipv6_vxlan6_exception      IPv6 o    220         pmtu_ipv6_vxlan6_exception      IPv6 over vxlan6: PMTU exceptions       1
221         pmtu_ipv4_geneve4_exception     IPv4 o    221         pmtu_ipv4_geneve4_exception     IPv4 over geneve4: PMTU exceptions      1
222         pmtu_ipv6_geneve4_exception     IPv6 o    222         pmtu_ipv6_geneve4_exception     IPv6 over geneve4: PMTU exceptions      1
223         pmtu_ipv4_geneve6_exception     IPv4 o    223         pmtu_ipv4_geneve6_exception     IPv4 over geneve6: PMTU exceptions      1
224         pmtu_ipv6_geneve6_exception     IPv6 o    224         pmtu_ipv6_geneve6_exception     IPv6 over geneve6: PMTU exceptions      1
225         pmtu_ipv4_br_vxlan4_exception   IPv4,     225         pmtu_ipv4_br_vxlan4_exception   IPv4, bridged vxlan4: PMTU exceptions   1
226         pmtu_ipv6_br_vxlan4_exception   IPv6,     226         pmtu_ipv6_br_vxlan4_exception   IPv6, bridged vxlan4: PMTU exceptions   1
227         pmtu_ipv4_br_vxlan6_exception   IPv4,     227         pmtu_ipv4_br_vxlan6_exception   IPv4, bridged vxlan6: PMTU exceptions   1
228         pmtu_ipv6_br_vxlan6_exception   IPv6,     228         pmtu_ipv6_br_vxlan6_exception   IPv6, bridged vxlan6: PMTU exceptions   1
229         pmtu_ipv4_br_geneve4_exception  IPv4,     229         pmtu_ipv4_br_geneve4_exception  IPv4, bridged geneve4: PMTU exceptions  1
230         pmtu_ipv6_br_geneve4_exception  IPv6,     230         pmtu_ipv6_br_geneve4_exception  IPv6, bridged geneve4: PMTU exceptions  1
231         pmtu_ipv4_br_geneve6_exception  IPv4,     231         pmtu_ipv4_br_geneve6_exception  IPv4, bridged geneve6: PMTU exceptions  1
232         pmtu_ipv6_br_geneve6_exception  IPv6,     232         pmtu_ipv6_br_geneve6_exception  IPv6, bridged geneve6: PMTU exceptions  1
233         pmtu_ipv4_ovs_vxlan4_exception  IPv4,     233         pmtu_ipv4_ovs_vxlan4_exception  IPv4, OVS vxlan4: PMTU exceptions       1
234         pmtu_ipv6_ovs_vxlan4_exception  IPv6,     234         pmtu_ipv6_ovs_vxlan4_exception  IPv6, OVS vxlan4: PMTU exceptions       1
235         pmtu_ipv4_ovs_vxlan6_exception  IPv4,     235         pmtu_ipv4_ovs_vxlan6_exception  IPv4, OVS vxlan6: PMTU exceptions       1
236         pmtu_ipv6_ovs_vxlan6_exception  IPv6,     236         pmtu_ipv6_ovs_vxlan6_exception  IPv6, OVS vxlan6: PMTU exceptions       1
237         pmtu_ipv4_ovs_geneve4_exception IPv4,     237         pmtu_ipv4_ovs_geneve4_exception IPv4, OVS geneve4: PMTU exceptions      1
238         pmtu_ipv6_ovs_geneve4_exception IPv6,     238         pmtu_ipv6_ovs_geneve4_exception IPv6, OVS geneve4: PMTU exceptions      1
239         pmtu_ipv4_ovs_geneve6_exception IPv4,     239         pmtu_ipv4_ovs_geneve6_exception IPv4, OVS geneve6: PMTU exceptions      1
240         pmtu_ipv6_ovs_geneve6_exception IPv6,     240         pmtu_ipv6_ovs_geneve6_exception IPv6, OVS geneve6: PMTU exceptions      1
241         pmtu_ipv4_fou4_exception        IPv4 o    241         pmtu_ipv4_fou4_exception        IPv4 over fou4: PMTU exceptions         1
242         pmtu_ipv6_fou4_exception        IPv6 o    242         pmtu_ipv6_fou4_exception        IPv6 over fou4: PMTU exceptions         1
243         pmtu_ipv4_fou6_exception        IPv4 o    243         pmtu_ipv4_fou6_exception        IPv4 over fou6: PMTU exceptions         1
244         pmtu_ipv6_fou6_exception        IPv6 o    244         pmtu_ipv6_fou6_exception        IPv6 over fou6: PMTU exceptions         1
245         pmtu_ipv4_gue4_exception        IPv4 o    245         pmtu_ipv4_gue4_exception        IPv4 over gue4: PMTU exceptions         1
246         pmtu_ipv6_gue4_exception        IPv6 o    246         pmtu_ipv6_gue4_exception        IPv6 over gue4: PMTU exceptions         1
247         pmtu_ipv4_gue6_exception        IPv4 o    247         pmtu_ipv4_gue6_exception        IPv4 over gue6: PMTU exceptions         1
248         pmtu_ipv6_gue6_exception        IPv6 o    248         pmtu_ipv6_gue6_exception        IPv6 over gue6: PMTU exceptions         1
249         pmtu_ipv4_ipv4_exception        IPv4 o    249         pmtu_ipv4_ipv4_exception        IPv4 over IPv4: PMTU exceptions         1
250         pmtu_ipv6_ipv4_exception        IPv6 o    250         pmtu_ipv6_ipv4_exception        IPv6 over IPv4: PMTU exceptions         1
251         pmtu_ipv4_ipv6_exception        IPv4 o    251         pmtu_ipv4_ipv6_exception        IPv4 over IPv6: PMTU exceptions         1
252         pmtu_ipv6_ipv6_exception        IPv6 o    252         pmtu_ipv6_ipv6_exception        IPv6 over IPv6: PMTU exceptions         1
253         pmtu_vti6_exception             vti6:     253         pmtu_vti6_exception             vti6: PMTU exceptions                   0
254         pmtu_vti4_exception             vti4:     254         pmtu_vti4_exception             vti4: PMTU exceptions                   0
255         pmtu_vti6_udp_exception         vti6:     255         pmtu_vti6_udp_exception         vti6: PMTU exceptions (ESP-in-UDP)      0
256         pmtu_vti4_udp_exception         vti4:     256         pmtu_vti4_udp_exception         vti4: PMTU exceptions (ESP-in-UDP)      0
257         pmtu_vti6_udp_routed_exception  vti6:     257         pmtu_vti6_udp_routed_exception  vti6: PMTU exceptions, routed (ESP-in-UDP)      0
258         pmtu_vti4_udp_routed_exception  vti4:     258         pmtu_vti4_udp_routed_exception  vti4: PMTU exceptions, routed (ESP-in-UDP)      0
259         pmtu_vti4_default_mtu           vti4:     259         pmtu_vti4_default_mtu           vti4: default MTU assignment            0
260         pmtu_vti6_default_mtu           vti6:     260         pmtu_vti6_default_mtu           vti6: default MTU assignment            0
261         pmtu_vti4_link_add_mtu          vti4:     261         pmtu_vti4_link_add_mtu          vti4: MTU setting on link creation      0
262         pmtu_vti6_link_add_mtu          vti6:     262         pmtu_vti6_link_add_mtu          vti6: MTU setting on link creation      0
263         pmtu_vti6_link_change_mtu       vti6:     263         pmtu_vti6_link_change_mtu       vti6: MTU changes on link changes       0
264         cleanup_ipv4_exception          ipv4:     264         cleanup_ipv4_exception          ipv4: cleanup of cached exceptions      1
265         cleanup_ipv6_exception          ipv6:     265         cleanup_ipv6_exception          ipv6: cleanup of cached exceptions      1
266         list_flush_ipv4_exception       ipv4:     266         list_flush_ipv4_exception       ipv4: list and flush cached exceptions  1
267         list_flush_ipv6_exception       ipv6:     267         list_flush_ipv6_exception       ipv6: list and flush cached exceptions  1
268         pmtu_ipv4_route_change          ipv4:     268         pmtu_ipv4_route_change          ipv4: PMTU exception w/route replace    1
269         pmtu_ipv6_route_change          ipv6:     269         pmtu_ipv6_route_change          ipv6: PMTU exception w/route replace    1"
270                                                   270 
271 # Addressing and routing for tests with router    271 # Addressing and routing for tests with routers: four network segments, with
272 # index SEGMENT between 1 and 4, a common pref    272 # index SEGMENT between 1 and 4, a common prefix (PREFIX4 or PREFIX6) and an
273 # identifier ID, which is 1 for hosts (A and B    273 # identifier ID, which is 1 for hosts (A and B), 2 for routers (R1 and R2).
274 # Addresses are:                                  274 # Addresses are:
275 # - IPv4: PREFIX4.SEGMENT.ID (/24)                275 # - IPv4: PREFIX4.SEGMENT.ID (/24)
276 # - IPv6: PREFIX6:SEGMENT::ID (/64)               276 # - IPv6: PREFIX6:SEGMENT::ID (/64)
277 prefix4="10.0"                                    277 prefix4="10.0"
278 prefix6="fc00"                                    278 prefix6="fc00"
279 a_r1=1                                            279 a_r1=1
280 a_r2=2                                            280 a_r2=2
281 b_r1=3                                            281 b_r1=3
282 b_r2=4                                            282 b_r2=4
283 #       ns      peer    segment                   283 #       ns      peer    segment
284 routing_addrs="                                   284 routing_addrs="
285         A       R1      ${a_r1}                   285         A       R1      ${a_r1}
286         A       R2      ${a_r2}                   286         A       R2      ${a_r2}
287         B       R1      ${b_r1}                   287         B       R1      ${b_r1}
288         B       R2      ${b_r2}                   288         B       R2      ${b_r2}
289 "                                                 289 "
290 # Traffic from A to B goes through R1 by defau    290 # Traffic from A to B goes through R1 by default, and through R2, if destined to
291 # B's address on the b_r2 segment.                291 # B's address on the b_r2 segment.
292 # Traffic from B to A goes through R1.            292 # Traffic from B to A goes through R1.
293 #       ns      destination             gatewa    293 #       ns      destination             gateway
294 routes="                                          294 routes="
295         A       default                 ${pref    295         A       default                 ${prefix4}.${a_r1}.2
296         A       ${prefix4}.${b_r2}.1    ${pref    296         A       ${prefix4}.${b_r2}.1    ${prefix4}.${a_r2}.2
297         B       default                 ${pref    297         B       default                 ${prefix4}.${b_r1}.2
298                                                   298 
299         A       default                 ${pref    299         A       default                 ${prefix6}:${a_r1}::2
300         A       ${prefix6}:${b_r2}::1   ${pref    300         A       ${prefix6}:${b_r2}::1   ${prefix6}:${a_r2}::2
301         B       default                 ${pref    301         B       default                 ${prefix6}:${b_r1}::2
302 "                                                 302 "
303 USE_NH="no"                                       303 USE_NH="no"
304 #       ns      family  nh id      destination    304 #       ns      family  nh id      destination          gateway
305 nexthops="                                        305 nexthops="
306         A       4       41      ${prefix4}.${a    306         A       4       41      ${prefix4}.${a_r1}.2    veth_A-R1
307         A       4       42      ${prefix4}.${a    307         A       4       42      ${prefix4}.${a_r2}.2    veth_A-R2
308         B       4       41      ${prefix4}.${b    308         B       4       41      ${prefix4}.${b_r1}.2    veth_B-R1
309                                                   309 
310         A       6       61      ${prefix6}:${a    310         A       6       61      ${prefix6}:${a_r1}::2   veth_A-R1
311         A       6       62      ${prefix6}:${a    311         A       6       62      ${prefix6}:${a_r2}::2   veth_A-R2
312         B       6       61      ${prefix6}:${b    312         B       6       61      ${prefix6}:${b_r1}::2   veth_B-R1
313 "                                                 313 "
314                                                   314 
315 # nexthop id correlates to id in nexthops conf    315 # nexthop id correlates to id in nexthops config above
316 #       ns    family    prefix                    316 #       ns    family    prefix                  nh id
317 routes_nh="                                       317 routes_nh="
318         A       4       default                   318         A       4       default                 41
319         A       4       ${prefix4}.${b_r2}.1      319         A       4       ${prefix4}.${b_r2}.1    42
320         B       4       default                   320         B       4       default                 41
321                                                   321 
322         A       6       default                   322         A       6       default                 61
323         A       6       ${prefix6}:${b_r2}::1     323         A       6       ${prefix6}:${b_r2}::1   62
324         B       6       default                   324         B       6       default                 61
325 "                                                 325 "
326                                                   326 
327 policy_mark=0x04                                  327 policy_mark=0x04
328 rt_table=main                                     328 rt_table=main
329                                                   329 
330 veth4_a_addr="192.168.1.1"                        330 veth4_a_addr="192.168.1.1"
331 veth4_b_addr="192.168.1.2"                        331 veth4_b_addr="192.168.1.2"
332 veth4_c_addr="192.168.2.10"                       332 veth4_c_addr="192.168.2.10"
333 veth4_mask="24"                                   333 veth4_mask="24"
334 veth6_a_addr="fd00:1::a"                          334 veth6_a_addr="fd00:1::a"
335 veth6_b_addr="fd00:1::b"                          335 veth6_b_addr="fd00:1::b"
336 veth6_c_addr="fd00:2::c"                          336 veth6_c_addr="fd00:2::c"
337 veth6_mask="64"                                   337 veth6_mask="64"
338                                                   338 
339 tunnel4_a_addr="192.168.2.1"                      339 tunnel4_a_addr="192.168.2.1"
340 tunnel4_b_addr="192.168.2.2"                      340 tunnel4_b_addr="192.168.2.2"
341 tunnel4_mask="24"                                 341 tunnel4_mask="24"
342 tunnel6_a_addr="fd00:2::a"                        342 tunnel6_a_addr="fd00:2::a"
343 tunnel6_b_addr="fd00:2::b"                        343 tunnel6_b_addr="fd00:2::b"
344 tunnel6_mask="64"                                 344 tunnel6_mask="64"
345                                                   345 
346 dummy6_0_prefix="fc00:1000::"                     346 dummy6_0_prefix="fc00:1000::"
347 dummy6_1_prefix="fc00:1001::"                     347 dummy6_1_prefix="fc00:1001::"
348 dummy6_mask="64"                                  348 dummy6_mask="64"
349                                                   349 
350 err_buf=                                          350 err_buf=
351 tcpdump_pids=                                     351 tcpdump_pids=
352 nettest_pids=                                     352 nettest_pids=
353 socat_pids=                                       353 socat_pids=
354 tmpoutfile=                                       354 tmpoutfile=
355                                                   355 
356 err() {                                           356 err() {
357         err_buf="${err_buf}${1}                   357         err_buf="${err_buf}${1}
358 "                                                 358 "
359 }                                                 359 }
360                                                   360 
361 err_flush() {                                     361 err_flush() {
362         echo -n "${err_buf}"                      362         echo -n "${err_buf}"
363         err_buf=                                  363         err_buf=
364 }                                                 364 }
365                                                   365 
366 run_cmd() {                                       366 run_cmd() {
367         cmd="$*"                                  367         cmd="$*"
368                                                   368 
369         if [ "$VERBOSE" = "1" ]; then             369         if [ "$VERBOSE" = "1" ]; then
370                 printf "    COMMAND: $cmd\n"      370                 printf "    COMMAND: $cmd\n"
371         fi                                        371         fi
372                                                   372 
373         out="$($cmd 2>&1)"                        373         out="$($cmd 2>&1)"
374         rc=$?                                     374         rc=$?
375         if [ "$VERBOSE" = "1" -a -n "$out" ];     375         if [ "$VERBOSE" = "1" -a -n "$out" ]; then
376                 echo "    $out"                   376                 echo "    $out"
377                 echo                              377                 echo
378         fi                                        378         fi
379                                                   379 
380         return $rc                                380         return $rc
381 }                                                 381 }
382                                                   382 
383 run_cmd_bg() {                                    383 run_cmd_bg() {
384         cmd="$*"                                  384         cmd="$*"
385                                                   385 
386         if [ "$VERBOSE" = "1" ]; then             386         if [ "$VERBOSE" = "1" ]; then
387                 printf "    COMMAND: %s &\n" "    387                 printf "    COMMAND: %s &\n" "${cmd}"
388         fi                                        388         fi
389                                                   389 
390         $cmd 2>&1 &                               390         $cmd 2>&1 &
391 }                                                 391 }
392                                                   392 
393 # Find the auto-generated name for this namesp    393 # Find the auto-generated name for this namespace
394 nsname() {                                        394 nsname() {
395         eval echo \$NS_$1                         395         eval echo \$NS_$1
396 }                                                 396 }
397                                                   397 
398 setup_fou_or_gue() {                              398 setup_fou_or_gue() {
399         outer="${1}"                              399         outer="${1}"
400         inner="${2}"                              400         inner="${2}"
401         encap="${3}"                              401         encap="${3}"
402                                                   402 
403         if [ "${outer}" = "4" ]; then             403         if [ "${outer}" = "4" ]; then
404                 modprobe fou || return $ksft_s    404                 modprobe fou || return $ksft_skip
405                 a_addr="${prefix4}.${a_r1}.1"     405                 a_addr="${prefix4}.${a_r1}.1"
406                 b_addr="${prefix4}.${b_r1}.1"     406                 b_addr="${prefix4}.${b_r1}.1"
407                 if [ "${inner}" = "4" ]; then     407                 if [ "${inner}" = "4" ]; then
408                         type="ipip"               408                         type="ipip"
409                         ipproto="4"               409                         ipproto="4"
410                 else                              410                 else
411                         type="sit"                411                         type="sit"
412                         ipproto="41"              412                         ipproto="41"
413                 fi                                413                 fi
414         else                                      414         else
415                 modprobe fou6 || return $ksft_    415                 modprobe fou6 || return $ksft_skip
416                 a_addr="${prefix6}:${a_r1}::1"    416                 a_addr="${prefix6}:${a_r1}::1"
417                 b_addr="${prefix6}:${b_r1}::1"    417                 b_addr="${prefix6}:${b_r1}::1"
418                 if [ "${inner}" = "4" ]; then     418                 if [ "${inner}" = "4" ]; then
419                         type="ip6tnl"             419                         type="ip6tnl"
420                         mode="mode ipip6"         420                         mode="mode ipip6"
421                         ipproto="4 -6"            421                         ipproto="4 -6"
422                 else                              422                 else
423                         type="ip6tnl"             423                         type="ip6tnl"
424                         mode="mode ip6ip6"        424                         mode="mode ip6ip6"
425                         ipproto="41 -6"           425                         ipproto="41 -6"
426                 fi                                426                 fi
427         fi                                        427         fi
428                                                   428 
429         run_cmd ${ns_a} ip fou add port 5555 i    429         run_cmd ${ns_a} ip fou add port 5555 ipproto ${ipproto} || return $ksft_skip
430         run_cmd ${ns_a} ip link add ${encap}_a    430         run_cmd ${ns_a} ip link add ${encap}_a type ${type} ${mode} local ${a_addr} remote ${b_addr} encap ${encap} encap-sport auto encap-dport 5556 || return $ksft_skip
431                                                   431 
432         run_cmd ${ns_b} ip fou add port 5556 i    432         run_cmd ${ns_b} ip fou add port 5556 ipproto ${ipproto}
433         run_cmd ${ns_b} ip link add ${encap}_b    433         run_cmd ${ns_b} ip link add ${encap}_b type ${type} ${mode} local ${b_addr} remote ${a_addr} encap ${encap} encap-sport auto encap-dport 5555
434                                                   434 
435         if [ "${inner}" = "4" ]; then             435         if [ "${inner}" = "4" ]; then
436                 run_cmd ${ns_a} ip addr add ${    436                 run_cmd ${ns_a} ip addr add ${tunnel4_a_addr}/${tunnel4_mask} dev ${encap}_a
437                 run_cmd ${ns_b} ip addr add ${    437                 run_cmd ${ns_b} ip addr add ${tunnel4_b_addr}/${tunnel4_mask} dev ${encap}_b
438         else                                      438         else
439                 run_cmd ${ns_a} ip addr add ${    439                 run_cmd ${ns_a} ip addr add ${tunnel6_a_addr}/${tunnel6_mask} dev ${encap}_a
440                 run_cmd ${ns_b} ip addr add ${    440                 run_cmd ${ns_b} ip addr add ${tunnel6_b_addr}/${tunnel6_mask} dev ${encap}_b
441         fi                                        441         fi
442                                                   442 
443         run_cmd ${ns_a} ip link set ${encap}_a    443         run_cmd ${ns_a} ip link set ${encap}_a up
444         run_cmd ${ns_b} ip link set ${encap}_b    444         run_cmd ${ns_b} ip link set ${encap}_b up
445 }                                                 445 }
446                                                   446 
447 setup_fou44() {                                   447 setup_fou44() {
448         setup_fou_or_gue 4 4 fou                  448         setup_fou_or_gue 4 4 fou
449 }                                                 449 }
450                                                   450 
451 setup_fou46() {                                   451 setup_fou46() {
452         setup_fou_or_gue 4 6 fou                  452         setup_fou_or_gue 4 6 fou
453 }                                                 453 }
454                                                   454 
455 setup_fou64() {                                   455 setup_fou64() {
456         setup_fou_or_gue 6 4 fou                  456         setup_fou_or_gue 6 4 fou
457 }                                                 457 }
458                                                   458 
459 setup_fou66() {                                   459 setup_fou66() {
460         setup_fou_or_gue 6 6 fou                  460         setup_fou_or_gue 6 6 fou
461 }                                                 461 }
462                                                   462 
463 setup_gue44() {                                   463 setup_gue44() {
464         setup_fou_or_gue 4 4 gue                  464         setup_fou_or_gue 4 4 gue
465 }                                                 465 }
466                                                   466 
467 setup_gue46() {                                   467 setup_gue46() {
468         setup_fou_or_gue 4 6 gue                  468         setup_fou_or_gue 4 6 gue
469 }                                                 469 }
470                                                   470 
471 setup_gue64() {                                   471 setup_gue64() {
472         setup_fou_or_gue 6 4 gue                  472         setup_fou_or_gue 6 4 gue
473 }                                                 473 }
474                                                   474 
475 setup_gue66() {                                   475 setup_gue66() {
476         setup_fou_or_gue 6 6 gue                  476         setup_fou_or_gue 6 6 gue
477 }                                                 477 }
478                                                   478 
479 setup_ipvX_over_ipvY() {                          479 setup_ipvX_over_ipvY() {
480         inner=${1}                                480         inner=${1}
481         outer=${2}                                481         outer=${2}
482                                                   482 
483         if [ "${outer}" -eq 4 ]; then             483         if [ "${outer}" -eq 4 ]; then
484                 a_addr="${prefix4}.${a_r1}.1"     484                 a_addr="${prefix4}.${a_r1}.1"
485                 b_addr="${prefix4}.${b_r1}.1"     485                 b_addr="${prefix4}.${b_r1}.1"
486                 if [ "${inner}" -eq 4 ]; then     486                 if [ "${inner}" -eq 4 ]; then
487                         type="ipip"               487                         type="ipip"
488                         mode="ipip"               488                         mode="ipip"
489                 else                              489                 else
490                         type="sit"                490                         type="sit"
491                         mode="ip6ip"              491                         mode="ip6ip"
492                 fi                                492                 fi
493         else                                      493         else
494                 a_addr="${prefix6}:${a_r1}::1"    494                 a_addr="${prefix6}:${a_r1}::1"
495                 b_addr="${prefix6}:${b_r1}::1"    495                 b_addr="${prefix6}:${b_r1}::1"
496                 type="ip6tnl"                     496                 type="ip6tnl"
497                 if [ "${inner}" -eq 4 ]; then     497                 if [ "${inner}" -eq 4 ]; then
498                         mode="ipip6"              498                         mode="ipip6"
499                 else                              499                 else
500                         mode="ip6ip6"             500                         mode="ip6ip6"
501                 fi                                501                 fi
502         fi                                        502         fi
503                                                   503 
504         run_cmd ${ns_a} ip link add ip_a type     504         run_cmd ${ns_a} ip link add ip_a type ${type} local ${a_addr} remote ${b_addr} mode ${mode} || return $ksft_skip
505         run_cmd ${ns_b} ip link add ip_b type     505         run_cmd ${ns_b} ip link add ip_b type ${type} local ${b_addr} remote ${a_addr} mode ${mode}
506                                                   506 
507         run_cmd ${ns_a} ip link set ip_a up       507         run_cmd ${ns_a} ip link set ip_a up
508         run_cmd ${ns_b} ip link set ip_b up       508         run_cmd ${ns_b} ip link set ip_b up
509                                                   509 
510         if [ "${inner}" = "4" ]; then             510         if [ "${inner}" = "4" ]; then
511                 run_cmd ${ns_a} ip addr add ${    511                 run_cmd ${ns_a} ip addr add ${tunnel4_a_addr}/${tunnel4_mask} dev ip_a
512                 run_cmd ${ns_b} ip addr add ${    512                 run_cmd ${ns_b} ip addr add ${tunnel4_b_addr}/${tunnel4_mask} dev ip_b
513         else                                      513         else
514                 run_cmd ${ns_a} ip addr add ${    514                 run_cmd ${ns_a} ip addr add ${tunnel6_a_addr}/${tunnel6_mask} dev ip_a
515                 run_cmd ${ns_b} ip addr add ${    515                 run_cmd ${ns_b} ip addr add ${tunnel6_b_addr}/${tunnel6_mask} dev ip_b
516         fi                                        516         fi
517 }                                                 517 }
518                                                   518 
519 setup_ip4ip4() {                                  519 setup_ip4ip4() {
520         setup_ipvX_over_ipvY 4 4                  520         setup_ipvX_over_ipvY 4 4
521 }                                                 521 }
522                                                   522 
523 setup_ip6ip4() {                                  523 setup_ip6ip4() {
524         setup_ipvX_over_ipvY 6 4                  524         setup_ipvX_over_ipvY 6 4
525 }                                                 525 }
526                                                   526 
527 setup_ip4ip6() {                                  527 setup_ip4ip6() {
528         setup_ipvX_over_ipvY 4 6                  528         setup_ipvX_over_ipvY 4 6
529 }                                                 529 }
530                                                   530 
531 setup_ip6ip6() {                                  531 setup_ip6ip6() {
532         setup_ipvX_over_ipvY 6 6                  532         setup_ipvX_over_ipvY 6 6
533 }                                                 533 }
534                                                   534 
535 setup_namespaces() {                              535 setup_namespaces() {
536         setup_ns NS_A NS_B NS_C NS_R1 NS_R2       536         setup_ns NS_A NS_B NS_C NS_R1 NS_R2
537         for n in ${NS_A} ${NS_B} ${NS_C} ${NS_    537         for n in ${NS_A} ${NS_B} ${NS_C} ${NS_R1} ${NS_R2}; do
538                 # Disable DAD, so that we don'    538                 # Disable DAD, so that we don't have to wait to use the
539                 # configured IPv6 addresses       539                 # configured IPv6 addresses
540                 ip netns exec ${n} sysctl -q n    540                 ip netns exec ${n} sysctl -q net/ipv6/conf/default/accept_dad=0
541         done                                      541         done
542         ns_a="ip netns exec ${NS_A}"              542         ns_a="ip netns exec ${NS_A}"
543         ns_b="ip netns exec ${NS_B}"              543         ns_b="ip netns exec ${NS_B}"
544         ns_c="ip netns exec ${NS_C}"              544         ns_c="ip netns exec ${NS_C}"
545         ns_r1="ip netns exec ${NS_R1}"            545         ns_r1="ip netns exec ${NS_R1}"
546         ns_r2="ip netns exec ${NS_R2}"            546         ns_r2="ip netns exec ${NS_R2}"
547 }                                                 547 }
548                                                   548 
549 setup_veth() {                                    549 setup_veth() {
550         run_cmd ${ns_a} ip link add veth_a typ    550         run_cmd ${ns_a} ip link add veth_a type veth peer name veth_b || return 1
551         run_cmd ${ns_a} ip link set veth_b net    551         run_cmd ${ns_a} ip link set veth_b netns ${NS_B}
552                                                   552 
553         run_cmd ${ns_a} ip addr add ${veth4_a_    553         run_cmd ${ns_a} ip addr add ${veth4_a_addr}/${veth4_mask} dev veth_a
554         run_cmd ${ns_b} ip addr add ${veth4_b_    554         run_cmd ${ns_b} ip addr add ${veth4_b_addr}/${veth4_mask} dev veth_b
555                                                   555 
556         run_cmd ${ns_a} ip addr add ${veth6_a_    556         run_cmd ${ns_a} ip addr add ${veth6_a_addr}/${veth6_mask} dev veth_a
557         run_cmd ${ns_b} ip addr add ${veth6_b_    557         run_cmd ${ns_b} ip addr add ${veth6_b_addr}/${veth6_mask} dev veth_b
558                                                   558 
559         run_cmd ${ns_a} ip link set veth_a up     559         run_cmd ${ns_a} ip link set veth_a up
560         run_cmd ${ns_b} ip link set veth_b up     560         run_cmd ${ns_b} ip link set veth_b up
561 }                                                 561 }
562                                                   562 
563 setup_vti() {                                     563 setup_vti() {
564         proto=${1}                                564         proto=${1}
565         veth_a_addr="${2}"                        565         veth_a_addr="${2}"
566         veth_b_addr="${3}"                        566         veth_b_addr="${3}"
567         vti_a_addr="${4}"                         567         vti_a_addr="${4}"
568         vti_b_addr="${5}"                         568         vti_b_addr="${5}"
569         vti_mask=${6}                             569         vti_mask=${6}
570                                                   570 
571         [ ${proto} -eq 6 ] && vti_type="vti6"     571         [ ${proto} -eq 6 ] && vti_type="vti6" || vti_type="vti"
572                                                   572 
573         run_cmd ${ns_a} ip link add vti${proto    573         run_cmd ${ns_a} ip link add vti${proto}_a type ${vti_type} local ${veth_a_addr} remote ${veth_b_addr} key 10 || return 1
574         run_cmd ${ns_b} ip link add vti${proto    574         run_cmd ${ns_b} ip link add vti${proto}_b type ${vti_type} local ${veth_b_addr} remote ${veth_a_addr} key 10
575                                                   575 
576         run_cmd ${ns_a} ip addr add ${vti_a_ad    576         run_cmd ${ns_a} ip addr add ${vti_a_addr}/${vti_mask} dev vti${proto}_a
577         run_cmd ${ns_b} ip addr add ${vti_b_ad    577         run_cmd ${ns_b} ip addr add ${vti_b_addr}/${vti_mask} dev vti${proto}_b
578                                                   578 
579         run_cmd ${ns_a} ip link set vti${proto    579         run_cmd ${ns_a} ip link set vti${proto}_a up
580         run_cmd ${ns_b} ip link set vti${proto    580         run_cmd ${ns_b} ip link set vti${proto}_b up
581 }                                                 581 }
582                                                   582 
583 setup_vti4() {                                    583 setup_vti4() {
584         setup_vti 4 ${veth4_a_addr} ${veth4_b_    584         setup_vti 4 ${veth4_a_addr} ${veth4_b_addr} ${tunnel4_a_addr} ${tunnel4_b_addr} ${tunnel4_mask}
585 }                                                 585 }
586                                                   586 
587 setup_vti6() {                                    587 setup_vti6() {
588         setup_vti 6 ${veth6_a_addr} ${veth6_b_    588         setup_vti 6 ${veth6_a_addr} ${veth6_b_addr} ${tunnel6_a_addr} ${tunnel6_b_addr} ${tunnel6_mask}
589 }                                                 589 }
590                                                   590 
591 setup_vti4routed() {                              591 setup_vti4routed() {
592         setup_vti 4 ${prefix4}.${a_r1}.1 ${pre    592         setup_vti 4 ${prefix4}.${a_r1}.1 ${prefix4}.${b_r1}.1 ${tunnel4_a_addr} ${tunnel4_b_addr} ${tunnel4_mask}
593 }                                                 593 }
594                                                   594 
595 setup_vti6routed() {                              595 setup_vti6routed() {
596         setup_vti 6 ${prefix6}:${a_r1}::1 ${pr    596         setup_vti 6 ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1 ${tunnel6_a_addr} ${tunnel6_b_addr} ${tunnel6_mask}
597 }                                                 597 }
598                                                   598 
599 setup_vxlan_or_geneve() {                         599 setup_vxlan_or_geneve() {
600         type="${1}"                               600         type="${1}"
601         a_addr="${2}"                             601         a_addr="${2}"
602         b_addr="${3}"                             602         b_addr="${3}"
603         opts="${4}"                               603         opts="${4}"
604         br_if_a="${5}"                            604         br_if_a="${5}"
605                                                   605 
606         if [ "${type}" = "vxlan" ]; then          606         if [ "${type}" = "vxlan" ]; then
607                 opts="${opts} ttl 64 dstport 4    607                 opts="${opts} ttl 64 dstport 4789"
608                 opts_a="local ${a_addr}"          608                 opts_a="local ${a_addr}"
609                 opts_b="local ${b_addr}"          609                 opts_b="local ${b_addr}"
610         else                                      610         else
611                 opts_a=""                         611                 opts_a=""
612                 opts_b=""                         612                 opts_b=""
613         fi                                        613         fi
614                                                   614 
615         run_cmd ${ns_a} ip link add ${type}_a     615         run_cmd ${ns_a} ip link add ${type}_a type ${type} id 1 ${opts_a} remote ${b_addr} ${opts} || return 1
616         run_cmd ${ns_b} ip link add ${type}_b     616         run_cmd ${ns_b} ip link add ${type}_b type ${type} id 1 ${opts_b} remote ${a_addr} ${opts}
617                                                   617 
618         if [ -n "${br_if_a}" ]; then              618         if [ -n "${br_if_a}" ]; then
619                 run_cmd ${ns_a} ip addr add ${    619                 run_cmd ${ns_a} ip addr add ${tunnel4_a_addr}/${tunnel4_mask} dev ${br_if_a}
620                 run_cmd ${ns_a} ip addr add ${    620                 run_cmd ${ns_a} ip addr add ${tunnel6_a_addr}/${tunnel6_mask} dev ${br_if_a}
621                 run_cmd ${ns_a} ip link set ${    621                 run_cmd ${ns_a} ip link set ${type}_a master ${br_if_a}
622         else                                      622         else
623                 run_cmd ${ns_a} ip addr add ${    623                 run_cmd ${ns_a} ip addr add ${tunnel4_a_addr}/${tunnel4_mask} dev ${type}_a
624                 run_cmd ${ns_a} ip addr add ${    624                 run_cmd ${ns_a} ip addr add ${tunnel6_a_addr}/${tunnel6_mask} dev ${type}_a
625         fi                                        625         fi
626                                                   626 
627         run_cmd ${ns_b} ip addr add ${tunnel4_    627         run_cmd ${ns_b} ip addr add ${tunnel4_b_addr}/${tunnel4_mask} dev ${type}_b
628         run_cmd ${ns_b} ip addr add ${tunnel6_    628         run_cmd ${ns_b} ip addr add ${tunnel6_b_addr}/${tunnel6_mask} dev ${type}_b
629                                                   629 
630         run_cmd ${ns_a} ip link set ${type}_a     630         run_cmd ${ns_a} ip link set ${type}_a up
631         run_cmd ${ns_b} ip link set ${type}_b     631         run_cmd ${ns_b} ip link set ${type}_b up
632 }                                                 632 }
633                                                   633 
634 setup_geneve4() {                                 634 setup_geneve4() {
635         setup_vxlan_or_geneve geneve ${prefix4    635         setup_vxlan_or_geneve geneve ${prefix4}.${a_r1}.1  ${prefix4}.${b_r1}.1  "df set"
636 }                                                 636 }
637                                                   637 
638 setup_vxlan4() {                                  638 setup_vxlan4() {
639         setup_vxlan_or_geneve vxlan  ${prefix4    639         setup_vxlan_or_geneve vxlan  ${prefix4}.${a_r1}.1  ${prefix4}.${b_r1}.1  "df set"
640 }                                                 640 }
641                                                   641 
642 setup_geneve6() {                                 642 setup_geneve6() {
643         setup_vxlan_or_geneve geneve ${prefix6    643         setup_vxlan_or_geneve geneve ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1 ""
644 }                                                 644 }
645                                                   645 
646 setup_vxlan6() {                                  646 setup_vxlan6() {
647         setup_vxlan_or_geneve vxlan  ${prefix6    647         setup_vxlan_or_geneve vxlan  ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1 ""
648 }                                                 648 }
649                                                   649 
650 setup_bridged_geneve4() {                         650 setup_bridged_geneve4() {
651         setup_vxlan_or_geneve geneve ${prefix4    651         setup_vxlan_or_geneve geneve ${prefix4}.${a_r1}.1  ${prefix4}.${b_r1}.1  "df set" "br0"
652 }                                                 652 }
653                                                   653 
654 setup_bridged_vxlan4() {                          654 setup_bridged_vxlan4() {
655         setup_vxlan_or_geneve vxlan  ${prefix4    655         setup_vxlan_or_geneve vxlan  ${prefix4}.${a_r1}.1  ${prefix4}.${b_r1}.1  "df set" "br0"
656 }                                                 656 }
657                                                   657 
658 setup_bridged_geneve6() {                         658 setup_bridged_geneve6() {
659         setup_vxlan_or_geneve geneve ${prefix6    659         setup_vxlan_or_geneve geneve ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1 "" "br0"
660 }                                                 660 }
661                                                   661 
662 setup_bridged_vxlan6() {                          662 setup_bridged_vxlan6() {
663         setup_vxlan_or_geneve vxlan  ${prefix6    663         setup_vxlan_or_geneve vxlan  ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1 "" "br0"
664 }                                                 664 }
665                                                   665 
666 setup_xfrm() {                                    666 setup_xfrm() {
667         proto=${1}                                667         proto=${1}
668         veth_a_addr="${2}"                        668         veth_a_addr="${2}"
669         veth_b_addr="${3}"                        669         veth_b_addr="${3}"
670         encap=${4}                                670         encap=${4}
671                                                   671 
672         run_cmd ${ns_a} ip -${proto} xfrm stat    672         run_cmd ${ns_a} ip -${proto} xfrm state add src ${veth_a_addr} dst ${veth_b_addr} spi 0x1000 proto esp aead 'rfc4106(gcm(aes))' 0x0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f 128 mode tunnel ${encap} || return 1
673         run_cmd ${ns_a} ip -${proto} xfrm stat    673         run_cmd ${ns_a} ip -${proto} xfrm state add src ${veth_b_addr} dst ${veth_a_addr} spi 0x1001 proto esp aead 'rfc4106(gcm(aes))' 0x0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f 128 mode tunnel ${encap}
674         run_cmd ${ns_a} ip -${proto} xfrm poli    674         run_cmd ${ns_a} ip -${proto} xfrm policy add dir out mark 10 tmpl src ${veth_a_addr} dst ${veth_b_addr} proto esp mode tunnel
675         run_cmd ${ns_a} ip -${proto} xfrm poli    675         run_cmd ${ns_a} ip -${proto} xfrm policy add dir in mark 10 tmpl src ${veth_b_addr} dst ${veth_a_addr} proto esp mode tunnel
676                                                   676 
677         run_cmd ${ns_b} ip -${proto} xfrm stat    677         run_cmd ${ns_b} ip -${proto} xfrm state add src ${veth_a_addr} dst ${veth_b_addr} spi 0x1000 proto esp aead 'rfc4106(gcm(aes))' 0x0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f 128 mode tunnel ${encap}
678         run_cmd ${ns_b} ip -${proto} xfrm stat    678         run_cmd ${ns_b} ip -${proto} xfrm state add src ${veth_b_addr} dst ${veth_a_addr} spi 0x1001 proto esp aead 'rfc4106(gcm(aes))' 0x0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f 128 mode tunnel ${encap}
679         run_cmd ${ns_b} ip -${proto} xfrm poli    679         run_cmd ${ns_b} ip -${proto} xfrm policy add dir out mark 10 tmpl src ${veth_b_addr} dst ${veth_a_addr} proto esp mode tunnel
680         run_cmd ${ns_b} ip -${proto} xfrm poli    680         run_cmd ${ns_b} ip -${proto} xfrm policy add dir in mark 10 tmpl src ${veth_a_addr} dst ${veth_b_addr} proto esp mode tunnel
681 }                                                 681 }
682                                                   682 
683 setup_nettest_xfrm() {                            683 setup_nettest_xfrm() {
684         if ! which nettest >/dev/null; then       684         if ! which nettest >/dev/null; then
685                 PATH=$PWD:$PATH                   685                 PATH=$PWD:$PATH
686                 if ! which nettest >/dev/null;    686                 if ! which nettest >/dev/null; then
687                         echo "'nettest' comman    687                         echo "'nettest' command not found; skipping tests"
688                         return 1                  688                         return 1
689                 fi                                689                 fi
690         fi                                        690         fi
691                                                   691 
692         [ ${1} -eq 6 ] && proto="-6" || proto=    692         [ ${1} -eq 6 ] && proto="-6" || proto=""
693         port=${2}                                 693         port=${2}
694                                                   694 
695         run_cmd_bg "${ns_a}" nettest "${proto}    695         run_cmd_bg "${ns_a}" nettest "${proto}" -q -D -s -x -p "${port}" -t 5
696         nettest_pids="${nettest_pids} $!"         696         nettest_pids="${nettest_pids} $!"
697                                                   697 
698         run_cmd_bg "${ns_b}" nettest "${proto}    698         run_cmd_bg "${ns_b}" nettest "${proto}" -q -D -s -x -p "${port}" -t 5
699         nettest_pids="${nettest_pids} $!"         699         nettest_pids="${nettest_pids} $!"
700 }                                                 700 }
701                                                   701 
702 setup_xfrm4() {                                   702 setup_xfrm4() {
703         setup_xfrm 4 ${veth4_a_addr} ${veth4_b    703         setup_xfrm 4 ${veth4_a_addr} ${veth4_b_addr}
704 }                                                 704 }
705                                                   705 
706 setup_xfrm6() {                                   706 setup_xfrm6() {
707         setup_xfrm 6 ${veth6_a_addr} ${veth6_b    707         setup_xfrm 6 ${veth6_a_addr} ${veth6_b_addr}
708 }                                                 708 }
709                                                   709 
710 setup_xfrm4udp() {                                710 setup_xfrm4udp() {
711         setup_xfrm 4 ${veth4_a_addr} ${veth4_b    711         setup_xfrm 4 ${veth4_a_addr} ${veth4_b_addr} "encap espinudp 4500 4500 0.0.0.0" && \
712                 setup_nettest_xfrm 4 4500         712                 setup_nettest_xfrm 4 4500
713 }                                                 713 }
714                                                   714 
715 setup_xfrm6udp() {                                715 setup_xfrm6udp() {
716         setup_xfrm 6 ${veth6_a_addr} ${veth6_b    716         setup_xfrm 6 ${veth6_a_addr} ${veth6_b_addr} "encap espinudp 4500 4500 0.0.0.0" && \
717                 setup_nettest_xfrm 6 4500         717                 setup_nettest_xfrm 6 4500
718 }                                                 718 }
719                                                   719 
720 setup_xfrm4udprouted() {                          720 setup_xfrm4udprouted() {
721         setup_xfrm 4 ${prefix4}.${a_r1}.1 ${pr    721         setup_xfrm 4 ${prefix4}.${a_r1}.1 ${prefix4}.${b_r1}.1 "encap espinudp 4500 4500 0.0.0.0" && \
722                 setup_nettest_xfrm 4 4500         722                 setup_nettest_xfrm 4 4500
723 }                                                 723 }
724                                                   724 
725 setup_xfrm6udprouted() {                          725 setup_xfrm6udprouted() {
726         setup_xfrm 6 ${prefix6}:${a_r1}::1 ${p    726         setup_xfrm 6 ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1 "encap espinudp 4500 4500 0.0.0.0" && \
727                 setup_nettest_xfrm 6 4500         727                 setup_nettest_xfrm 6 4500
728 }                                                 728 }
729                                                   729 
730 setup_routing_old() {                             730 setup_routing_old() {
731         for i in ${routes}; do                    731         for i in ${routes}; do
732                 [ "${ns}" = "" ]        && ns=    732                 [ "${ns}" = "" ]        && ns="${i}"            && continue
733                 [ "${addr}" = "" ]      && add    733                 [ "${addr}" = "" ]      && addr="${i}"          && continue
734                 [ "${gw}" = "" ]        && gw=    734                 [ "${gw}" = "" ]        && gw="${i}"
735                                                   735 
736                 ns_name="$(nsname ${ns})"         736                 ns_name="$(nsname ${ns})"
737                                                   737 
738                 ip -n "${ns_name}" route add "    738                 ip -n "${ns_name}" route add "${addr}" table "${rt_table}" via "${gw}"
739                                                   739 
740                 ns=""; addr=""; gw=""             740                 ns=""; addr=""; gw=""
741         done                                      741         done
742 }                                                 742 }
743                                                   743 
744 setup_routing_new() {                             744 setup_routing_new() {
745         for i in ${nexthops}; do                  745         for i in ${nexthops}; do
746                 [ "${ns}" = "" ]        && ns=    746                 [ "${ns}" = "" ]        && ns="${i}"            && continue
747                 [ "${fam}" = "" ]       && fam    747                 [ "${fam}" = "" ]       && fam="${i}"           && continue
748                 [ "${nhid}" = "" ]      && nhi    748                 [ "${nhid}" = "" ]      && nhid="${i}"          && continue
749                 [ "${gw}" = "" ]        && gw=    749                 [ "${gw}" = "" ]        && gw="${i}"            && continue
750                 [ "${dev}" = "" ]       && dev    750                 [ "${dev}" = "" ]       && dev="${i}"
751                                                   751 
752                 ns_name="$(nsname ${ns})"         752                 ns_name="$(nsname ${ns})"
753                                                   753 
754                 ip -n ${ns_name} -${fam} nexth    754                 ip -n ${ns_name} -${fam} nexthop add id ${nhid} via ${gw} dev ${dev}
755                                                   755 
756                 ns=""; fam=""; nhid=""; gw="";    756                 ns=""; fam=""; nhid=""; gw=""; dev=""
757                                                   757 
758         done                                      758         done
759                                                   759 
760         for i in ${routes_nh}; do                 760         for i in ${routes_nh}; do
761                 [ "${ns}" = "" ]        && ns=    761                 [ "${ns}" = "" ]        && ns="${i}"            && continue
762                 [ "${fam}" = "" ]       && fam    762                 [ "${fam}" = "" ]       && fam="${i}"           && continue
763                 [ "${addr}" = "" ]      && add    763                 [ "${addr}" = "" ]      && addr="${i}"          && continue
764                 [ "${nhid}" = "" ]      && nhi    764                 [ "${nhid}" = "" ]      && nhid="${i}"
765                                                   765 
766                 ns_name="$(nsname ${ns})"         766                 ns_name="$(nsname ${ns})"
767                                                   767 
768                 ip -n "${ns_name}" -"${fam}" r    768                 ip -n "${ns_name}" -"${fam}" route add "${addr}" table "${rt_table}" nhid "${nhid}"
769                                                   769 
770                 ns=""; fam=""; addr=""; nhid="    770                 ns=""; fam=""; addr=""; nhid=""
771         done                                      771         done
772 }                                                 772 }
773                                                   773 
774 setup_routing() {                                 774 setup_routing() {
775         for i in ${NS_R1} ${NS_R2}; do            775         for i in ${NS_R1} ${NS_R2}; do
776                 ip netns exec ${i} sysctl -q n    776                 ip netns exec ${i} sysctl -q net/ipv4/ip_forward=1
777                 ip netns exec ${i} sysctl -q n    777                 ip netns exec ${i} sysctl -q net/ipv6/conf/all/forwarding=1
778         done                                      778         done
779                                                   779 
780         for i in ${routing_addrs}; do             780         for i in ${routing_addrs}; do
781                 [ "${ns}" = "" ]        && ns=    781                 [ "${ns}" = "" ]        && ns="${i}"            && continue
782                 [ "${peer}" = "" ]      && pee    782                 [ "${peer}" = "" ]      && peer="${i}"          && continue
783                 [ "${segment}" = "" ]   && seg    783                 [ "${segment}" = "" ]   && segment="${i}"
784                                                   784 
785                 ns_name="$(nsname ${ns})"         785                 ns_name="$(nsname ${ns})"
786                 peer_name="$(nsname ${peer})"     786                 peer_name="$(nsname ${peer})"
787                 if="veth_${ns}-${peer}"           787                 if="veth_${ns}-${peer}"
788                 ifpeer="veth_${peer}-${ns}"       788                 ifpeer="veth_${peer}-${ns}"
789                                                   789 
790                 # Create veth links               790                 # Create veth links
791                 ip link add ${if} up netns ${n    791                 ip link add ${if} up netns ${ns_name} type veth peer name ${ifpeer} netns ${peer_name} || return 1
792                 ip -n ${peer_name} link set de    792                 ip -n ${peer_name} link set dev ${ifpeer} up
793                                                   793 
794                 # Add addresses                   794                 # Add addresses
795                 ip -n ${ns_name}   addr add ${    795                 ip -n ${ns_name}   addr add ${prefix4}.${segment}.1/24  dev ${if}
796                 ip -n ${ns_name}   addr add ${    796                 ip -n ${ns_name}   addr add ${prefix6}:${segment}::1/64 dev ${if}
797                                                   797 
798                 ip -n ${peer_name} addr add ${    798                 ip -n ${peer_name} addr add ${prefix4}.${segment}.2/24  dev ${ifpeer}
799                 ip -n ${peer_name} addr add ${    799                 ip -n ${peer_name} addr add ${prefix6}:${segment}::2/64 dev ${ifpeer}
800                                                   800 
801                 ns=""; peer=""; segment=""        801                 ns=""; peer=""; segment=""
802         done                                      802         done
803                                                   803 
804         if [ "$USE_NH" = "yes" ]; then            804         if [ "$USE_NH" = "yes" ]; then
805                 setup_routing_new                 805                 setup_routing_new
806         else                                      806         else
807                 setup_routing_old                 807                 setup_routing_old
808         fi                                        808         fi
809                                                   809 
810         return 0                                  810         return 0
811 }                                                 811 }
812                                                   812 
813 setup_policy_routing() {                          813 setup_policy_routing() {
814         setup_routing                             814         setup_routing
815                                                   815 
816         ip -netns "${NS_A}" -4 rule add dsfiel    816         ip -netns "${NS_A}" -4 rule add dsfield "${policy_mark}" \
817                 table "${rt_table}"               817                 table "${rt_table}"
818                                                   818 
819         # Set the IPv4 Don't Fragment bit with    819         # Set the IPv4 Don't Fragment bit with tc, since socat doesn't seem to
820         # have an option do to it.                820         # have an option do to it.
821         tc -netns "${NS_A}" qdisc replace dev     821         tc -netns "${NS_A}" qdisc replace dev veth_A-R1 root prio
822         tc -netns "${NS_A}" qdisc replace dev     822         tc -netns "${NS_A}" qdisc replace dev veth_A-R2 root prio
823         tc -netns "${NS_A}" filter add dev vet    823         tc -netns "${NS_A}" filter add dev veth_A-R1                      \
824                 protocol ipv4 flower ip_proto     824                 protocol ipv4 flower ip_proto udp                         \
825                 action pedit ex munge ip df se    825                 action pedit ex munge ip df set 0x40 pipe csum ip and udp
826         tc -netns "${NS_A}" filter add dev vet    826         tc -netns "${NS_A}" filter add dev veth_A-R2                      \
827                 protocol ipv4 flower ip_proto     827                 protocol ipv4 flower ip_proto udp                         \
828                 action pedit ex munge ip df se    828                 action pedit ex munge ip df set 0x40 pipe csum ip and udp
829 }                                                 829 }
830                                                   830 
831 setup_bridge() {                                  831 setup_bridge() {
832         run_cmd ${ns_a} ip link add br0 type b    832         run_cmd ${ns_a} ip link add br0 type bridge || return $ksft_skip
833         run_cmd ${ns_a} ip link set br0 up        833         run_cmd ${ns_a} ip link set br0 up
834                                                   834 
835         run_cmd ${ns_c} ip link add veth_C-A t    835         run_cmd ${ns_c} ip link add veth_C-A type veth peer name veth_A-C
836         run_cmd ${ns_c} ip link set veth_A-C n    836         run_cmd ${ns_c} ip link set veth_A-C netns ${NS_A}
837                                                   837 
838         run_cmd ${ns_a} ip link set veth_A-C u    838         run_cmd ${ns_a} ip link set veth_A-C up
839         run_cmd ${ns_c} ip link set veth_C-A u    839         run_cmd ${ns_c} ip link set veth_C-A up
840         run_cmd ${ns_c} ip addr add ${veth4_c_    840         run_cmd ${ns_c} ip addr add ${veth4_c_addr}/${veth4_mask} dev veth_C-A
841         run_cmd ${ns_c} ip addr add ${veth6_c_    841         run_cmd ${ns_c} ip addr add ${veth6_c_addr}/${veth6_mask} dev veth_C-A
842         run_cmd ${ns_a} ip link set veth_A-C m    842         run_cmd ${ns_a} ip link set veth_A-C master br0
843 }                                                 843 }
844                                                   844 
845 setup_ovs_via_internal_utility() {                845 setup_ovs_via_internal_utility() {
846         type="${1}"                               846         type="${1}"
847         a_addr="${2}"                             847         a_addr="${2}"
848         b_addr="${3}"                             848         b_addr="${3}"
849         dport="${4}"                              849         dport="${4}"
850                                                   850 
851         run_cmd python3 ./openvswitch/ovs-dpct    851         run_cmd python3 ./openvswitch/ovs-dpctl.py add-if ovs_br0 ${type}_a -t ${type} || return 1
852                                                   852 
853         ports=$(python3 ./openvswitch/ovs-dpct    853         ports=$(python3 ./openvswitch/ovs-dpctl.py show)
854         br0_port=$(echo "$ports" | grep -E "\s    854         br0_port=$(echo "$ports" | grep -E "\sovs_br0" | sed -e 's@port @@' | cut -d: -f1 | xargs)
855         type_a_port=$(echo "$ports" | grep ${t    855         type_a_port=$(echo "$ports" | grep ${type}_a | sed -e 's@port @@' | cut -d: -f1 | xargs)
856         veth_a_port=$(echo "$ports" | grep vet    856         veth_a_port=$(echo "$ports" | grep veth_A | sed -e 's@port @@' | cut -d: -f1 | xargs)
857                                                   857 
858         v4_a_tun="${prefix4}.${a_r1}.1"           858         v4_a_tun="${prefix4}.${a_r1}.1"
859         v4_b_tun="${prefix4}.${b_r1}.1"           859         v4_b_tun="${prefix4}.${b_r1}.1"
860                                                   860 
861         v6_a_tun="${prefix6}:${a_r1}::1"          861         v6_a_tun="${prefix6}:${a_r1}::1"
862         v6_b_tun="${prefix6}:${b_r1}::1"          862         v6_b_tun="${prefix6}:${b_r1}::1"
863                                                   863 
864         if [ "${v4_a_tun}" = "${a_addr}" ]; th    864         if [ "${v4_a_tun}" = "${a_addr}" ]; then
865                 run_cmd python3 ./openvswitch/    865                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
866                     "recirc_id(0),in_port(${ve    866                     "recirc_id(0),in_port(${veth_a_port}),eth(),eth_type(0x0800),ipv4()" \
867                     "set(tunnel(tun_id=1,dst=$    867                     "set(tunnel(tun_id=1,dst=${v4_b_tun},ttl=64,tp_dst=${dport},flags(df|csum))),${type_a_port}"
868                 run_cmd python3 ./openvswitch/    868                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
869                     "recirc_id(0),in_port(${ve    869                     "recirc_id(0),in_port(${veth_a_port}),eth(),eth_type(0x86dd),ipv6()" \
870                     "set(tunnel(tun_id=1,dst=$    870                     "set(tunnel(tun_id=1,dst=${v4_b_tun},ttl=64,tp_dst=${dport},flags(df|csum))),${type_a_port}"
871                 run_cmd python3 ./openvswitch/    871                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
872                     "recirc_id(0),tunnel(tun_i    872                     "recirc_id(0),tunnel(tun_id=1,src=${v4_b_tun},dst=${v4_a_tun}),in_port(${type_a_port}),eth(),eth_type(0x0800),ipv4()" \
873                     "${veth_a_port}"              873                     "${veth_a_port}"
874                 run_cmd python3 ./openvswitch/    874                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
875                     "recirc_id(0),tunnel(tun_i    875                     "recirc_id(0),tunnel(tun_id=1,src=${v4_b_tun},dst=${v4_a_tun}),in_port(${type_a_port}),eth(),eth_type(0x86dd),ipv6()" \
876                     "${veth_a_port}"              876                     "${veth_a_port}"
877                 run_cmd python3 ./openvswitch/    877                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
878                     "recirc_id(0),tunnel(tun_i    878                     "recirc_id(0),tunnel(tun_id=1,src=${v4_b_tun},dst=${v4_a_tun}),in_port(${type_a_port}),eth(),eth_type(0x0806),arp()" \
879                     "${veth_a_port}"              879                     "${veth_a_port}"
880                 run_cmd python3 ./openvswitch/    880                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
881                     "recirc_id(0),in_port(${ve    881                     "recirc_id(0),in_port(${veth_a_port}),eth(),eth_type(0x0806),arp(sip=${veth4_c_addr},tip=${tunnel4_b_addr})" \
882                     "set(tunnel(tun_id=1,dst=$    882                     "set(tunnel(tun_id=1,dst=${v4_b_tun},ttl=64,tp_dst=${dport},flags(df|csum))),${type_a_port}"
883         else                                      883         else
884                 run_cmd python3 ./openvswitch/    884                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
885                     "recirc_id(0),in_port(${ve    885                     "recirc_id(0),in_port(${veth_a_port}),eth(),eth_type(0x0800),ipv4()" \
886                     "set(tunnel(tun_id=1,ipv6_    886                     "set(tunnel(tun_id=1,ipv6_dst=${v6_b_tun},ttl=64,tp_dst=${dport},flags(df|csum))),${type_a_port}"
887                 run_cmd python3 ./openvswitch/    887                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
888                     "recirc_id(0),in_port(${ve    888                     "recirc_id(0),in_port(${veth_a_port}),eth(),eth_type(0x86dd),ipv6()" \
889                     "set(tunnel(tun_id=1,ipv6_    889                     "set(tunnel(tun_id=1,ipv6_dst=${v6_b_tun},ttl=64,tp_dst=${dport},flags(df|csum))),${type_a_port}"
890                 run_cmd python3 ./openvswitch/    890                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
891                     "recirc_id(0),tunnel(tun_i    891                     "recirc_id(0),tunnel(tun_id=1,ipv6_src=${v6_b_tun},ipv6_dst=${v6_a_tun}),in_port(${type_a_port}),eth(),eth_type(0x0800),ipv4()" \
892                     "${veth_a_port}"              892                     "${veth_a_port}"
893                 run_cmd python3 ./openvswitch/    893                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
894                     "recirc_id(0),tunnel(tun_i    894                     "recirc_id(0),tunnel(tun_id=1,ipv6_src=${v6_b_tun},ipv6_dst=${v6_a_tun}),in_port(${type_a_port}),eth(),eth_type(0x86dd),ipv6()" \
895                     "${veth_a_port}"              895                     "${veth_a_port}"
896                 run_cmd python3 ./openvswitch/    896                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
897                     "recirc_id(0),tunnel(tun_i    897                     "recirc_id(0),tunnel(tun_id=1,ipv6_src=${v6_b_tun},ipv6_dst=${v6_a_tun}),in_port(${type_a_port}),eth(),eth_type(0x0806),arp()" \
898                     "${veth_a_port}"              898                     "${veth_a_port}"
899                 run_cmd python3 ./openvswitch/    899                 run_cmd python3 ./openvswitch/ovs-dpctl.py add-flow ovs_br0 \
900                     "recirc_id(0),in_port(${ve    900                     "recirc_id(0),in_port(${veth_a_port}),eth(),eth_type(0x0806),arp(sip=${veth4_c_addr},tip=${tunnel4_b_addr})" \
901                     "set(tunnel(tun_id=1,ipv6_    901                     "set(tunnel(tun_id=1,ipv6_dst=${v6_b_tun},ttl=64,tp_dst=${dport},flags(df|csum))),${type_a_port}"
902         fi                                        902         fi
903 }                                                 903 }
904                                                   904 
905 setup_ovs_via_vswitchd() {                        905 setup_ovs_via_vswitchd() {
906         type="${1}"                               906         type="${1}"
907         b_addr="${2}"                             907         b_addr="${2}"
908                                                   908 
909         run_cmd ovs-vsctl add-port ovs_br0 ${t    909         run_cmd ovs-vsctl add-port ovs_br0 ${type}_a -- \
910                 set interface ${type}_a type=$    910                 set interface ${type}_a type=${type} \
911                 options:remote_ip=${b_addr} op    911                 options:remote_ip=${b_addr} options:key=1 options:csum=true || return 1
912 }                                                 912 }
913                                                   913 
914 setup_ovs_vxlan_or_geneve() {                     914 setup_ovs_vxlan_or_geneve() {
915         type="${1}"                               915         type="${1}"
916         a_addr="${2}"                             916         a_addr="${2}"
917         b_addr="${3}"                             917         b_addr="${3}"
918         dport="6081"                              918         dport="6081"
919                                                   919 
920         if [ "${type}" = "vxlan" ]; then          920         if [ "${type}" = "vxlan" ]; then
921                 dport="4789"                      921                 dport="4789"
922                 opts="${opts} ttl 64 dstport 4    922                 opts="${opts} ttl 64 dstport 4789"
923                 opts_b="local ${b_addr}"          923                 opts_b="local ${b_addr}"
924         fi                                        924         fi
925                                                   925 
926         setup_ovs_via_internal_utility "${type    926         setup_ovs_via_internal_utility "${type}" "${a_addr}" "${b_addr}" \
927                                        "${dpor    927                                        "${dport}" || \
928             setup_ovs_via_vswitchd "${type}" "    928             setup_ovs_via_vswitchd "${type}" "${b_addr}" || return 1
929                                                   929 
930         run_cmd ${ns_b} ip link add ${type}_b     930         run_cmd ${ns_b} ip link add ${type}_b type ${type} id 1 ${opts_b} remote ${a_addr} ${opts} || return 1
931                                                   931 
932         run_cmd ${ns_b} ip addr add ${tunnel4_    932         run_cmd ${ns_b} ip addr add ${tunnel4_b_addr}/${tunnel4_mask} dev ${type}_b
933         run_cmd ${ns_b} ip addr add ${tunnel6_    933         run_cmd ${ns_b} ip addr add ${tunnel6_b_addr}/${tunnel6_mask} dev ${type}_b
934                                                   934 
935         run_cmd ip link set ${type}_a up          935         run_cmd ip link set ${type}_a up
936         run_cmd ${ns_b} ip link set ${type}_b     936         run_cmd ${ns_b} ip link set ${type}_b up
937 }                                                 937 }
938                                                   938 
939 setup_ovs_geneve4() {                             939 setup_ovs_geneve4() {
940         setup_ovs_vxlan_or_geneve geneve ${pre    940         setup_ovs_vxlan_or_geneve geneve ${prefix4}.${a_r1}.1  ${prefix4}.${b_r1}.1
941 }                                                 941 }
942                                                   942 
943 setup_ovs_vxlan4() {                              943 setup_ovs_vxlan4() {
944         setup_ovs_vxlan_or_geneve vxlan  ${pre    944         setup_ovs_vxlan_or_geneve vxlan  ${prefix4}.${a_r1}.1  ${prefix4}.${b_r1}.1
945 }                                                 945 }
946                                                   946 
947 setup_ovs_geneve6() {                             947 setup_ovs_geneve6() {
948         setup_ovs_vxlan_or_geneve geneve ${pre    948         setup_ovs_vxlan_or_geneve geneve ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1
949 }                                                 949 }
950                                                   950 
951 setup_ovs_vxlan6() {                              951 setup_ovs_vxlan6() {
952         setup_ovs_vxlan_or_geneve vxlan  ${pre    952         setup_ovs_vxlan_or_geneve vxlan  ${prefix6}:${a_r1}::1 ${prefix6}:${b_r1}::1
953 }                                                 953 }
954                                                   954 
955 setup_ovs_br_internal() {                         955 setup_ovs_br_internal() {
956         run_cmd python3 ./openvswitch/ovs-dpct    956         run_cmd python3 ./openvswitch/ovs-dpctl.py add-dp ovs_br0 || \
957                 return 1                          957                 return 1
958 }                                                 958 }
959                                                   959 
960 setup_ovs_br_vswitchd() {                         960 setup_ovs_br_vswitchd() {
961         run_cmd ovs-vsctl add-br ovs_br0 || re    961         run_cmd ovs-vsctl add-br ovs_br0 || return 1
962 }                                                 962 }
963                                                   963 
964 setup_ovs_add_if() {                              964 setup_ovs_add_if() {
965         ifname="${1}"                             965         ifname="${1}"
966         run_cmd python3 ./openvswitch/ovs-dpct    966         run_cmd python3 ./openvswitch/ovs-dpctl.py add-if ovs_br0 \
967                 "${ifname}" || \                  967                 "${ifname}" || \
968                 run_cmd ovs-vsctl add-port ovs    968                 run_cmd ovs-vsctl add-port ovs_br0 "${ifname}"
969 }                                                 969 }
970                                                   970 
971 setup_ovs_bridge() {                              971 setup_ovs_bridge() {
972         setup_ovs_br_internal || setup_ovs_br_    972         setup_ovs_br_internal || setup_ovs_br_vswitchd || return $ksft_skip
973         run_cmd ip link set ovs_br0 up            973         run_cmd ip link set ovs_br0 up
974                                                   974 
975         run_cmd ${ns_c} ip link add veth_C-A t    975         run_cmd ${ns_c} ip link add veth_C-A type veth peer name veth_A-C
976         run_cmd ${ns_c} ip link set veth_A-C n    976         run_cmd ${ns_c} ip link set veth_A-C netns 1
977                                                   977 
978         run_cmd         ip link set veth_A-C u    978         run_cmd         ip link set veth_A-C up
979         run_cmd ${ns_c} ip link set veth_C-A u    979         run_cmd ${ns_c} ip link set veth_C-A up
980         run_cmd ${ns_c} ip addr add ${veth4_c_    980         run_cmd ${ns_c} ip addr add ${veth4_c_addr}/${veth4_mask} dev veth_C-A
981         run_cmd ${ns_c} ip addr add ${veth6_c_    981         run_cmd ${ns_c} ip addr add ${veth6_c_addr}/${veth6_mask} dev veth_C-A
982         setup_ovs_add_if veth_A-C                 982         setup_ovs_add_if veth_A-C
983                                                   983 
984         # Move veth_A-R1 to init                  984         # Move veth_A-R1 to init
985         run_cmd ${ns_a} ip link set veth_A-R1     985         run_cmd ${ns_a} ip link set veth_A-R1 netns 1
986         run_cmd ip addr add ${prefix4}.${a_r1}    986         run_cmd ip addr add ${prefix4}.${a_r1}.1/${veth4_mask} dev veth_A-R1
987         run_cmd ip addr add ${prefix6}:${a_r1}    987         run_cmd ip addr add ${prefix6}:${a_r1}::1/${veth6_mask} dev veth_A-R1
988         run_cmd ip link set veth_A-R1 up          988         run_cmd ip link set veth_A-R1 up
989         run_cmd ip route add ${prefix4}.${b_r1    989         run_cmd ip route add ${prefix4}.${b_r1}.1 via ${prefix4}.${a_r1}.2
990         run_cmd ip route add ${prefix6}:${b_r1    990         run_cmd ip route add ${prefix6}:${b_r1}::1 via ${prefix6}:${a_r1}::2
991 }                                                 991 }
992                                                   992 
993 setup() {                                         993 setup() {
994         [ "$(id -u)" -ne 0 ] && echo "  need t    994         [ "$(id -u)" -ne 0 ] && echo "  need to run as root" && return $ksft_skip
995                                                   995 
996         for arg do                                996         for arg do
997                 eval setup_${arg} || { echo "     997                 eval setup_${arg} || { echo "  ${arg} not supported"; return 1; }
998         done                                      998         done
999 }                                                 999 }
1000                                                  1000 
1001 trace() {                                        1001 trace() {
1002         [ $TRACING -eq 0 ] && return             1002         [ $TRACING -eq 0 ] && return
1003                                                  1003 
1004         for arg do                               1004         for arg do
1005                 [ "${ns_cmd}" = "" ] && ns_cm    1005                 [ "${ns_cmd}" = "" ] && ns_cmd="${arg}" && continue
1006                 ${ns_cmd} tcpdump --immediate    1006                 ${ns_cmd} tcpdump --immediate-mode -s 0 -i "${arg}" -w "${name}_${arg}.pcap" 2> /dev/null &
1007                 tcpdump_pids="${tcpdump_pids}    1007                 tcpdump_pids="${tcpdump_pids} $!"
1008                 ns_cmd=                          1008                 ns_cmd=
1009         done                                     1009         done
1010         sleep 1                                  1010         sleep 1
1011 }                                                1011 }
1012                                                  1012 
1013 cleanup_del_ovs_internal() {                     1013 cleanup_del_ovs_internal() {
1014         # squelch the output of the del-if co    1014         # squelch the output of the del-if commands since it can be wordy
1015         python3 ./openvswitch/ovs-dpctl.py de    1015         python3 ./openvswitch/ovs-dpctl.py del-if ovs_br0 -d true vxlan_a       >/dev/null      2>&1
1016         python3 ./openvswitch/ovs-dpctl.py de    1016         python3 ./openvswitch/ovs-dpctl.py del-if ovs_br0 -d true geneve_a      >/dev/null      2>&1
1017         python3 ./openvswitch/ovs-dpctl.py de    1017         python3 ./openvswitch/ovs-dpctl.py del-dp ovs_br0                       >/dev/null      2>&1
1018 }                                                1018 }
1019                                                  1019 
1020 cleanup_del_ovs_vswitchd() {                     1020 cleanup_del_ovs_vswitchd() {
1021         ovs-vsctl --if-exists del-port vxlan_    1021         ovs-vsctl --if-exists del-port vxlan_a  2>/dev/null
1022         ovs-vsctl --if-exists del-br ovs_br0     1022         ovs-vsctl --if-exists del-br ovs_br0    2>/dev/null
1023 }                                                1023 }
1024                                                  1024 
1025 cleanup() {                                      1025 cleanup() {
1026         for pid in ${tcpdump_pids}; do           1026         for pid in ${tcpdump_pids}; do
1027                 kill ${pid}                      1027                 kill ${pid}
1028         done                                     1028         done
1029         tcpdump_pids=                            1029         tcpdump_pids=
1030                                                  1030 
1031         for pid in ${nettest_pids}; do           1031         for pid in ${nettest_pids}; do
1032                 kill ${pid}                      1032                 kill ${pid}
1033         done                                     1033         done
1034         nettest_pids=                            1034         nettest_pids=
1035                                                  1035 
1036         for pid in ${socat_pids}; do             1036         for pid in ${socat_pids}; do
1037                 kill "${pid}"                    1037                 kill "${pid}"
1038         done                                     1038         done
1039         socat_pids=                              1039         socat_pids=
1040                                                  1040 
1041         cleanup_all_ns                           1041         cleanup_all_ns
1042                                                  1042 
1043         ip link del veth_A-C            2>/de    1043         ip link del veth_A-C            2>/dev/null
1044         ip link del veth_A-R1           2>/de    1044         ip link del veth_A-R1           2>/dev/null
1045         cleanup_del_ovs_internal                 1045         cleanup_del_ovs_internal
1046         cleanup_del_ovs_vswitchd                 1046         cleanup_del_ovs_vswitchd
1047         rm -f "$tmpoutfile"                      1047         rm -f "$tmpoutfile"
1048 }                                                1048 }
1049                                                  1049 
1050 mtu() {                                          1050 mtu() {
1051         ns_cmd="${1}"                            1051         ns_cmd="${1}"
1052         dev="${2}"                               1052         dev="${2}"
1053         mtu="${3}"                               1053         mtu="${3}"
1054                                                  1054 
1055         ${ns_cmd} ip link set dev ${dev} mtu     1055         ${ns_cmd} ip link set dev ${dev} mtu ${mtu}
1056 }                                                1056 }
1057                                                  1057 
1058 mtu_parse() {                                    1058 mtu_parse() {
1059         input="${1}"                             1059         input="${1}"
1060                                                  1060 
1061         next=0                                   1061         next=0
1062         for i in ${input}; do                    1062         for i in ${input}; do
1063                 [ ${next} -eq 1 -a "${i}" = "    1063                 [ ${next} -eq 1 -a "${i}" = "lock" ] && next=2 && continue
1064                 [ ${next} -eq 1 ] && echo "${    1064                 [ ${next} -eq 1 ] && echo "${i}" && return
1065                 [ ${next} -eq 2 ] && echo "lo    1065                 [ ${next} -eq 2 ] && echo "lock ${i}" && return
1066                 [ "${i}" = "mtu" ] && next=1     1066                 [ "${i}" = "mtu" ] && next=1
1067         done                                     1067         done
1068 }                                                1068 }
1069                                                  1069 
1070 link_get() {                                     1070 link_get() {
1071         ns_cmd="${1}"                            1071         ns_cmd="${1}"
1072         name="${2}"                              1072         name="${2}"
1073                                                  1073 
1074         ${ns_cmd} ip link show dev "${name}"     1074         ${ns_cmd} ip link show dev "${name}"
1075 }                                                1075 }
1076                                                  1076 
1077 link_get_mtu() {                                 1077 link_get_mtu() {
1078         ns_cmd="${1}"                            1078         ns_cmd="${1}"
1079         name="${2}"                              1079         name="${2}"
1080                                                  1080 
1081         mtu_parse "$(link_get "${ns_cmd}" ${n    1081         mtu_parse "$(link_get "${ns_cmd}" ${name})"
1082 }                                                1082 }
1083                                                  1083 
1084 route_get_dst_exception() {                      1084 route_get_dst_exception() {
1085         ns_cmd="${1}"                            1085         ns_cmd="${1}"
1086         dst="${2}"                               1086         dst="${2}"
1087         dsfield="${3}"                           1087         dsfield="${3}"
1088                                                  1088 
1089         if [ -z "${dsfield}" ]; then             1089         if [ -z "${dsfield}" ]; then
1090                 dsfield=0                        1090                 dsfield=0
1091         fi                                       1091         fi
1092                                                  1092 
1093         ${ns_cmd} ip route get "${dst}" dsfie    1093         ${ns_cmd} ip route get "${dst}" dsfield "${dsfield}"
1094 }                                                1094 }
1095                                                  1095 
1096 route_get_dst_pmtu_from_exception() {            1096 route_get_dst_pmtu_from_exception() {
1097         ns_cmd="${1}"                            1097         ns_cmd="${1}"
1098         dst="${2}"                               1098         dst="${2}"
1099         dsfield="${3}"                           1099         dsfield="${3}"
1100                                                  1100 
1101         mtu_parse "$(route_get_dst_exception     1101         mtu_parse "$(route_get_dst_exception "${ns_cmd}" "${dst}" "${dsfield}")"
1102 }                                                1102 }
1103                                                  1103 
1104 check_pmtu_value() {                             1104 check_pmtu_value() {
1105         expected="${1}"                          1105         expected="${1}"
1106         value="${2}"                             1106         value="${2}"
1107         event="${3}"                             1107         event="${3}"
1108                                                  1108 
1109         [ "${expected}" = "any" ] && [ -n "${    1109         [ "${expected}" = "any" ] && [ -n "${value}" ] && return 0
1110         [ "${value}" = "${expected}" ] && ret    1110         [ "${value}" = "${expected}" ] && return 0
1111         [ -z "${value}" ] &&    err "  PMTU e    1111         [ -z "${value}" ] &&    err "  PMTU exception wasn't created after ${event}" && return 1
1112         [ -z "${expected}" ] && err "  PMTU e    1112         [ -z "${expected}" ] && err "  PMTU exception shouldn't exist after ${event}" && return 1
1113         err "  found PMTU exception with inco    1113         err "  found PMTU exception with incorrect MTU ${value}, expected ${expected}, after ${event}"
1114         return 1                                 1114         return 1
1115 }                                                1115 }
1116                                                  1116 
1117 test_pmtu_ipvX() {                               1117 test_pmtu_ipvX() {
1118         family=${1}                              1118         family=${1}
1119                                                  1119 
1120         setup namespaces routing || return $k    1120         setup namespaces routing || return $ksft_skip
1121         trace "${ns_a}"  veth_A-R1    "${ns_r    1121         trace "${ns_a}"  veth_A-R1    "${ns_r1}" veth_R1-A \
1122               "${ns_r1}" veth_R1-B    "${ns_b    1122               "${ns_r1}" veth_R1-B    "${ns_b}"  veth_B-R1 \
1123               "${ns_a}"  veth_A-R2    "${ns_r    1123               "${ns_a}"  veth_A-R2    "${ns_r2}" veth_R2-A \
1124               "${ns_r2}" veth_R2-B    "${ns_b    1124               "${ns_r2}" veth_R2-B    "${ns_b}"  veth_B-R2
1125                                                  1125 
1126         if [ ${family} -eq 4 ]; then             1126         if [ ${family} -eq 4 ]; then
1127                 ping=ping                        1127                 ping=ping
1128                 dst1="${prefix4}.${b_r1}.1"      1128                 dst1="${prefix4}.${b_r1}.1"
1129                 dst2="${prefix4}.${b_r2}.1"      1129                 dst2="${prefix4}.${b_r2}.1"
1130         else                                     1130         else
1131                 ping=${ping6}                    1131                 ping=${ping6}
1132                 dst1="${prefix6}:${b_r1}::1"     1132                 dst1="${prefix6}:${b_r1}::1"
1133                 dst2="${prefix6}:${b_r2}::1"     1133                 dst2="${prefix6}:${b_r2}::1"
1134         fi                                       1134         fi
1135                                                  1135 
1136         # Set up initial MTU values              1136         # Set up initial MTU values
1137         mtu "${ns_a}"  veth_A-R1 2000            1137         mtu "${ns_a}"  veth_A-R1 2000
1138         mtu "${ns_r1}" veth_R1-A 2000            1138         mtu "${ns_r1}" veth_R1-A 2000
1139         mtu "${ns_r1}" veth_R1-B 1400            1139         mtu "${ns_r1}" veth_R1-B 1400
1140         mtu "${ns_b}"  veth_B-R1 1400            1140         mtu "${ns_b}"  veth_B-R1 1400
1141                                                  1141 
1142         mtu "${ns_a}"  veth_A-R2 2000            1142         mtu "${ns_a}"  veth_A-R2 2000
1143         mtu "${ns_r2}" veth_R2-A 2000            1143         mtu "${ns_r2}" veth_R2-A 2000
1144         mtu "${ns_r2}" veth_R2-B 1500            1144         mtu "${ns_r2}" veth_R2-B 1500
1145         mtu "${ns_b}"  veth_B-R2 1500            1145         mtu "${ns_b}"  veth_B-R2 1500
1146                                                  1146 
1147         # Create route exceptions                1147         # Create route exceptions
1148         run_cmd ${ns_a} ${ping} -q -M want -i    1148         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s 1800 ${dst1}
1149         run_cmd ${ns_a} ${ping} -q -M want -i    1149         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s 1800 ${dst2}
1150                                                  1150 
1151         # Check that exceptions have been cre    1151         # Check that exceptions have been created with the correct PMTU
1152         pmtu_1="$(route_get_dst_pmtu_from_exc    1152         pmtu_1="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst1})"
1153         check_pmtu_value "1400" "${pmtu_1}" "    1153         check_pmtu_value "1400" "${pmtu_1}" "exceeding MTU" || return 1
1154         pmtu_2="$(route_get_dst_pmtu_from_exc    1154         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
1155         check_pmtu_value "1500" "${pmtu_2}" "    1155         check_pmtu_value "1500" "${pmtu_2}" "exceeding MTU" || return 1
1156                                                  1156 
1157         # Decrease local MTU below PMTU, chec    1157         # Decrease local MTU below PMTU, check for PMTU decrease in route exception
1158         mtu "${ns_a}"  veth_A-R1 1300            1158         mtu "${ns_a}"  veth_A-R1 1300
1159         mtu "${ns_r1}" veth_R1-A 1300            1159         mtu "${ns_r1}" veth_R1-A 1300
1160         pmtu_1="$(route_get_dst_pmtu_from_exc    1160         pmtu_1="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst1})"
1161         check_pmtu_value "1300" "${pmtu_1}" "    1161         check_pmtu_value "1300" "${pmtu_1}" "decreasing local MTU" || return 1
1162         # Second exception shouldn't be modif    1162         # Second exception shouldn't be modified
1163         pmtu_2="$(route_get_dst_pmtu_from_exc    1163         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
1164         check_pmtu_value "1500" "${pmtu_2}" "    1164         check_pmtu_value "1500" "${pmtu_2}" "changing local MTU on a link not on this path" || return 1
1165                                                  1165 
1166         # Increase MTU, check for PMTU increa    1166         # Increase MTU, check for PMTU increase in route exception
1167         mtu "${ns_a}"  veth_A-R1 1700            1167         mtu "${ns_a}"  veth_A-R1 1700
1168         mtu "${ns_r1}" veth_R1-A 1700            1168         mtu "${ns_r1}" veth_R1-A 1700
1169         pmtu_1="$(route_get_dst_pmtu_from_exc    1169         pmtu_1="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst1})"
1170         check_pmtu_value "1700" "${pmtu_1}" "    1170         check_pmtu_value "1700" "${pmtu_1}" "increasing local MTU" || return 1
1171         # Second exception shouldn't be modif    1171         # Second exception shouldn't be modified
1172         pmtu_2="$(route_get_dst_pmtu_from_exc    1172         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
1173         check_pmtu_value "1500" "${pmtu_2}" "    1173         check_pmtu_value "1500" "${pmtu_2}" "changing local MTU on a link not on this path" || return 1
1174                                                  1174 
1175         # Skip PMTU locking tests for IPv6       1175         # Skip PMTU locking tests for IPv6
1176         [ $family -eq 6 ] && return 0            1176         [ $family -eq 6 ] && return 0
1177                                                  1177 
1178         # Decrease remote MTU on path via R2,    1178         # Decrease remote MTU on path via R2, get new exception
1179         mtu "${ns_r2}" veth_R2-B 400             1179         mtu "${ns_r2}" veth_R2-B 400
1180         mtu "${ns_b}"  veth_B-R2 400             1180         mtu "${ns_b}"  veth_B-R2 400
1181         run_cmd ${ns_a} ${ping} -q -M want -i    1181         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s 1400 ${dst2}
1182         pmtu_2="$(route_get_dst_pmtu_from_exc    1182         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
1183         check_pmtu_value "lock 552" "${pmtu_2    1183         check_pmtu_value "lock 552" "${pmtu_2}" "exceeding MTU, with MTU < min_pmtu" || return 1
1184                                                  1184 
1185         # Decrease local MTU below PMTU          1185         # Decrease local MTU below PMTU
1186         mtu "${ns_a}"  veth_A-R2 500             1186         mtu "${ns_a}"  veth_A-R2 500
1187         mtu "${ns_r2}" veth_R2-A 500             1187         mtu "${ns_r2}" veth_R2-A 500
1188         pmtu_2="$(route_get_dst_pmtu_from_exc    1188         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
1189         check_pmtu_value "500" "${pmtu_2}" "d    1189         check_pmtu_value "500" "${pmtu_2}" "decreasing local MTU" || return 1
1190                                                  1190 
1191         # Increase local MTU                     1191         # Increase local MTU
1192         mtu "${ns_a}"  veth_A-R2 1500            1192         mtu "${ns_a}"  veth_A-R2 1500
1193         mtu "${ns_r2}" veth_R2-A 1500            1193         mtu "${ns_r2}" veth_R2-A 1500
1194         pmtu_2="$(route_get_dst_pmtu_from_exc    1194         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
1195         check_pmtu_value "1500" "${pmtu_2}" "    1195         check_pmtu_value "1500" "${pmtu_2}" "increasing local MTU" || return 1
1196                                                  1196 
1197         # Get new exception                      1197         # Get new exception
1198         run_cmd ${ns_a} ${ping} -q -M want -i    1198         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s 1400 ${dst2}
1199         pmtu_2="$(route_get_dst_pmtu_from_exc    1199         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
1200         check_pmtu_value "lock 552" "${pmtu_2    1200         check_pmtu_value "lock 552" "${pmtu_2}" "exceeding MTU, with MTU < min_pmtu" || return 1
1201 }                                                1201 }
1202                                                  1202 
1203 test_pmtu_ipv4_exception() {                     1203 test_pmtu_ipv4_exception() {
1204         test_pmtu_ipvX 4                         1204         test_pmtu_ipvX 4
1205 }                                                1205 }
1206                                                  1206 
1207 test_pmtu_ipv6_exception() {                     1207 test_pmtu_ipv6_exception() {
1208         test_pmtu_ipvX 6                         1208         test_pmtu_ipvX 6
1209 }                                                1209 }
1210                                                  1210 
1211 test_pmtu_ipv4_dscp_icmp_exception() {           1211 test_pmtu_ipv4_dscp_icmp_exception() {
1212         rt_table=100                             1212         rt_table=100
1213                                                  1213 
1214         setup namespaces policy_routing || re    1214         setup namespaces policy_routing || return $ksft_skip
1215         trace "${ns_a}"  veth_A-R1    "${ns_r    1215         trace "${ns_a}"  veth_A-R1    "${ns_r1}" veth_R1-A \
1216               "${ns_r1}" veth_R1-B    "${ns_b    1216               "${ns_r1}" veth_R1-B    "${ns_b}"  veth_B-R1 \
1217               "${ns_a}"  veth_A-R2    "${ns_r    1217               "${ns_a}"  veth_A-R2    "${ns_r2}" veth_R2-A \
1218               "${ns_r2}" veth_R2-B    "${ns_b    1218               "${ns_r2}" veth_R2-B    "${ns_b}"  veth_B-R2
1219                                                  1219 
1220         # Set up initial MTU values              1220         # Set up initial MTU values
1221         mtu "${ns_a}"  veth_A-R1 2000            1221         mtu "${ns_a}"  veth_A-R1 2000
1222         mtu "${ns_r1}" veth_R1-A 2000            1222         mtu "${ns_r1}" veth_R1-A 2000
1223         mtu "${ns_r1}" veth_R1-B 1400            1223         mtu "${ns_r1}" veth_R1-B 1400
1224         mtu "${ns_b}"  veth_B-R1 1400            1224         mtu "${ns_b}"  veth_B-R1 1400
1225                                                  1225 
1226         mtu "${ns_a}"  veth_A-R2 2000            1226         mtu "${ns_a}"  veth_A-R2 2000
1227         mtu "${ns_r2}" veth_R2-A 2000            1227         mtu "${ns_r2}" veth_R2-A 2000
1228         mtu "${ns_r2}" veth_R2-B 1500            1228         mtu "${ns_r2}" veth_R2-B 1500
1229         mtu "${ns_b}"  veth_B-R2 1500            1229         mtu "${ns_b}"  veth_B-R2 1500
1230                                                  1230 
1231         len=$((2000 - 20 - 8)) # Fills MTU of    1231         len=$((2000 - 20 - 8)) # Fills MTU of veth_A-R1
1232                                                  1232 
1233         dst1="${prefix4}.${b_r1}.1"              1233         dst1="${prefix4}.${b_r1}.1"
1234         dst2="${prefix4}.${b_r2}.1"              1234         dst2="${prefix4}.${b_r2}.1"
1235                                                  1235 
1236         # Create route exceptions                1236         # Create route exceptions
1237         dsfield=${policy_mark} # No ECN bit s    1237         dsfield=${policy_mark} # No ECN bit set (Not-ECT)
1238         run_cmd "${ns_a}" ping -q -M want -Q     1238         run_cmd "${ns_a}" ping -q -M want -Q "${dsfield}" -c 1 -w 1 -s "${len}" "${dst1}"
1239                                                  1239 
1240         dsfield=$(printf "%#x" $((policy_mark    1240         dsfield=$(printf "%#x" $((policy_mark + 0x02))) # ECN=2 (ECT(0))
1241         run_cmd "${ns_a}" ping -q -M want -Q     1241         run_cmd "${ns_a}" ping -q -M want -Q "${dsfield}" -c 1 -w 1 -s "${len}" "${dst2}"
1242                                                  1242 
1243         # Check that exceptions have been cre    1243         # Check that exceptions have been created with the correct PMTU
1244         pmtu_1="$(route_get_dst_pmtu_from_exc    1244         pmtu_1="$(route_get_dst_pmtu_from_exception "${ns_a}" "${dst1}" "${policy_mark}")"
1245         check_pmtu_value "1400" "${pmtu_1}" "    1245         check_pmtu_value "1400" "${pmtu_1}" "exceeding MTU" || return 1
1246                                                  1246 
1247         pmtu_2="$(route_get_dst_pmtu_from_exc    1247         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" "${dst2}" "${policy_mark}")"
1248         check_pmtu_value "1500" "${pmtu_2}" "    1248         check_pmtu_value "1500" "${pmtu_2}" "exceeding MTU" || return 1
1249 }                                                1249 }
1250                                                  1250 
1251 test_pmtu_ipv4_dscp_udp_exception() {            1251 test_pmtu_ipv4_dscp_udp_exception() {
1252         rt_table=100                             1252         rt_table=100
1253                                                  1253 
1254         if ! which socat > /dev/null 2>&1; th    1254         if ! which socat > /dev/null 2>&1; then
1255                 echo "'socat' command not fou    1255                 echo "'socat' command not found; skipping tests"
1256                 return $ksft_skip                1256                 return $ksft_skip
1257         fi                                       1257         fi
1258                                                  1258 
1259         setup namespaces policy_routing || re    1259         setup namespaces policy_routing || return $ksft_skip
1260         trace "${ns_a}"  veth_A-R1    "${ns_r    1260         trace "${ns_a}"  veth_A-R1    "${ns_r1}" veth_R1-A \
1261               "${ns_r1}" veth_R1-B    "${ns_b    1261               "${ns_r1}" veth_R1-B    "${ns_b}"  veth_B-R1 \
1262               "${ns_a}"  veth_A-R2    "${ns_r    1262               "${ns_a}"  veth_A-R2    "${ns_r2}" veth_R2-A \
1263               "${ns_r2}" veth_R2-B    "${ns_b    1263               "${ns_r2}" veth_R2-B    "${ns_b}"  veth_B-R2
1264                                                  1264 
1265         # Set up initial MTU values              1265         # Set up initial MTU values
1266         mtu "${ns_a}"  veth_A-R1 2000            1266         mtu "${ns_a}"  veth_A-R1 2000
1267         mtu "${ns_r1}" veth_R1-A 2000            1267         mtu "${ns_r1}" veth_R1-A 2000
1268         mtu "${ns_r1}" veth_R1-B 1400            1268         mtu "${ns_r1}" veth_R1-B 1400
1269         mtu "${ns_b}"  veth_B-R1 1400            1269         mtu "${ns_b}"  veth_B-R1 1400
1270                                                  1270 
1271         mtu "${ns_a}"  veth_A-R2 2000            1271         mtu "${ns_a}"  veth_A-R2 2000
1272         mtu "${ns_r2}" veth_R2-A 2000            1272         mtu "${ns_r2}" veth_R2-A 2000
1273         mtu "${ns_r2}" veth_R2-B 1500            1273         mtu "${ns_r2}" veth_R2-B 1500
1274         mtu "${ns_b}"  veth_B-R2 1500            1274         mtu "${ns_b}"  veth_B-R2 1500
1275                                                  1275 
1276         len=$((2000 - 20 - 8)) # Fills MTU of    1276         len=$((2000 - 20 - 8)) # Fills MTU of veth_A-R1
1277                                                  1277 
1278         dst1="${prefix4}.${b_r1}.1"              1278         dst1="${prefix4}.${b_r1}.1"
1279         dst2="${prefix4}.${b_r2}.1"              1279         dst2="${prefix4}.${b_r2}.1"
1280                                                  1280 
1281         # Create route exceptions                1281         # Create route exceptions
1282         run_cmd_bg "${ns_b}" socat UDP-LISTEN    1282         run_cmd_bg "${ns_b}" socat UDP-LISTEN:50000 OPEN:/dev/null,wronly=1
1283         socat_pids="${socat_pids} $!"            1283         socat_pids="${socat_pids} $!"
1284                                                  1284 
1285         dsfield=${policy_mark} # No ECN bit s    1285         dsfield=${policy_mark} # No ECN bit set (Not-ECT)
1286         run_cmd "${ns_a}" socat OPEN:/dev/zer    1286         run_cmd "${ns_a}" socat OPEN:/dev/zero,rdonly=1,readbytes="${len}" \
1287                 UDP:"${dst1}":50000,tos="${ds    1287                 UDP:"${dst1}":50000,tos="${dsfield}"
1288                                                  1288 
1289         dsfield=$(printf "%#x" $((policy_mark    1289         dsfield=$(printf "%#x" $((policy_mark + 0x02))) # ECN=2 (ECT(0))
1290         run_cmd "${ns_a}" socat OPEN:/dev/zer    1290         run_cmd "${ns_a}" socat OPEN:/dev/zero,rdonly=1,readbytes="${len}" \
1291                 UDP:"${dst2}":50000,tos="${ds    1291                 UDP:"${dst2}":50000,tos="${dsfield}"
1292                                                  1292 
1293         # Check that exceptions have been cre    1293         # Check that exceptions have been created with the correct PMTU
1294         pmtu_1="$(route_get_dst_pmtu_from_exc    1294         pmtu_1="$(route_get_dst_pmtu_from_exception "${ns_a}" "${dst1}" "${policy_mark}")"
1295         check_pmtu_value "1400" "${pmtu_1}" "    1295         check_pmtu_value "1400" "${pmtu_1}" "exceeding MTU" || return 1
1296         pmtu_2="$(route_get_dst_pmtu_from_exc    1296         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" "${dst2}" "${policy_mark}")"
1297         check_pmtu_value "1500" "${pmtu_2}" "    1297         check_pmtu_value "1500" "${pmtu_2}" "exceeding MTU" || return 1
1298 }                                                1298 }
1299                                                  1299 
1300 test_pmtu_ipvX_over_vxlanY_or_geneveY_excepti    1300 test_pmtu_ipvX_over_vxlanY_or_geneveY_exception() {
1301         type=${1}                                1301         type=${1}
1302         family=${2}                              1302         family=${2}
1303         outer_family=${3}                        1303         outer_family=${3}
1304         ll_mtu=4000                              1304         ll_mtu=4000
1305                                                  1305 
1306         if [ ${outer_family} -eq 4 ]; then       1306         if [ ${outer_family} -eq 4 ]; then
1307                 setup namespaces routing ${ty    1307                 setup namespaces routing ${type}4 || return $ksft_skip
1308                 #                      IPv4 h    1308                 #                      IPv4 header   UDP header   VXLAN/GENEVE header   Ethernet header
1309                 exp_mtu=$((${ll_mtu} - 20        1309                 exp_mtu=$((${ll_mtu} - 20          - 8          - 8                   - 14))
1310         else                                     1310         else
1311                 setup namespaces routing ${ty    1311                 setup namespaces routing ${type}6 || return $ksft_skip
1312                 #                      IPv6 h    1312                 #                      IPv6 header   UDP header   VXLAN/GENEVE header   Ethernet header
1313                 exp_mtu=$((${ll_mtu} - 40        1313                 exp_mtu=$((${ll_mtu} - 40          - 8          - 8                   - 14))
1314         fi                                       1314         fi
1315                                                  1315 
1316         trace "${ns_a}" ${type}_a    "${ns_b}    1316         trace "${ns_a}" ${type}_a    "${ns_b}"  ${type}_b \
1317               "${ns_a}" veth_A-R1    "${ns_r1    1317               "${ns_a}" veth_A-R1    "${ns_r1}" veth_R1-A \
1318               "${ns_b}" veth_B-R1    "${ns_r1    1318               "${ns_b}" veth_B-R1    "${ns_r1}" veth_R1-B
1319                                                  1319 
1320         if [ ${family} -eq 4 ]; then             1320         if [ ${family} -eq 4 ]; then
1321                 ping=ping                        1321                 ping=ping
1322                 dst=${tunnel4_b_addr}            1322                 dst=${tunnel4_b_addr}
1323         else                                     1323         else
1324                 ping=${ping6}                    1324                 ping=${ping6}
1325                 dst=${tunnel6_b_addr}            1325                 dst=${tunnel6_b_addr}
1326         fi                                       1326         fi
1327                                                  1327 
1328         # Create route exception by exceeding    1328         # Create route exception by exceeding link layer MTU
1329         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu}    1329         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu} + 1000))
1330         mtu "${ns_r1}" veth_R1-A $((${ll_mtu}    1330         mtu "${ns_r1}" veth_R1-A $((${ll_mtu} + 1000))
1331         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}       1331         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}
1332         mtu "${ns_r1}" veth_R1-B ${ll_mtu}       1332         mtu "${ns_r1}" veth_R1-B ${ll_mtu}
1333                                                  1333 
1334         mtu "${ns_a}" ${type}_a $((${ll_mtu}     1334         mtu "${ns_a}" ${type}_a $((${ll_mtu} + 1000))
1335         mtu "${ns_b}" ${type}_b $((${ll_mtu}     1335         mtu "${ns_b}" ${type}_b $((${ll_mtu} + 1000))
1336         run_cmd ${ns_a} ${ping} -q -M want -i    1336         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s $((${ll_mtu} + 500)) ${dst}
1337                                                  1337 
1338         # Check that exception was created       1338         # Check that exception was created
1339         pmtu="$(route_get_dst_pmtu_from_excep    1339         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst})"
1340         check_pmtu_value ${exp_mtu} "${pmtu}"    1340         check_pmtu_value ${exp_mtu} "${pmtu}" "exceeding link layer MTU on ${type} interface"
1341 }                                                1341 }
1342                                                  1342 
1343 test_pmtu_ipv4_vxlan4_exception() {              1343 test_pmtu_ipv4_vxlan4_exception() {
1344         test_pmtu_ipvX_over_vxlanY_or_geneveY    1344         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception vxlan  4 4
1345 }                                                1345 }
1346                                                  1346 
1347 test_pmtu_ipv6_vxlan4_exception() {              1347 test_pmtu_ipv6_vxlan4_exception() {
1348         test_pmtu_ipvX_over_vxlanY_or_geneveY    1348         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception vxlan  6 4
1349 }                                                1349 }
1350                                                  1350 
1351 test_pmtu_ipv4_geneve4_exception() {             1351 test_pmtu_ipv4_geneve4_exception() {
1352         test_pmtu_ipvX_over_vxlanY_or_geneveY    1352         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception geneve 4 4
1353 }                                                1353 }
1354                                                  1354 
1355 test_pmtu_ipv6_geneve4_exception() {             1355 test_pmtu_ipv6_geneve4_exception() {
1356         test_pmtu_ipvX_over_vxlanY_or_geneveY    1356         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception geneve 6 4
1357 }                                                1357 }
1358                                                  1358 
1359 test_pmtu_ipv4_vxlan6_exception() {              1359 test_pmtu_ipv4_vxlan6_exception() {
1360         test_pmtu_ipvX_over_vxlanY_or_geneveY    1360         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception vxlan  4 6
1361 }                                                1361 }
1362                                                  1362 
1363 test_pmtu_ipv6_vxlan6_exception() {              1363 test_pmtu_ipv6_vxlan6_exception() {
1364         test_pmtu_ipvX_over_vxlanY_or_geneveY    1364         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception vxlan  6 6
1365 }                                                1365 }
1366                                                  1366 
1367 test_pmtu_ipv4_geneve6_exception() {             1367 test_pmtu_ipv4_geneve6_exception() {
1368         test_pmtu_ipvX_over_vxlanY_or_geneveY    1368         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception geneve 4 6
1369 }                                                1369 }
1370                                                  1370 
1371 test_pmtu_ipv6_geneve6_exception() {             1371 test_pmtu_ipv6_geneve6_exception() {
1372         test_pmtu_ipvX_over_vxlanY_or_geneveY    1372         test_pmtu_ipvX_over_vxlanY_or_geneveY_exception geneve 6 6
1373 }                                                1373 }
1374                                                  1374 
1375 test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY    1375 test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception() {
1376         type=${1}                                1376         type=${1}
1377         family=${2}                              1377         family=${2}
1378         outer_family=${3}                        1378         outer_family=${3}
1379         ll_mtu=4000                              1379         ll_mtu=4000
1380                                                  1380 
1381         if [ ${outer_family} -eq 4 ]; then       1381         if [ ${outer_family} -eq 4 ]; then
1382                 setup namespaces routing brid    1382                 setup namespaces routing bridge bridged_${type}4 || return $ksft_skip
1383                 #                      IPv4 h    1383                 #                      IPv4 header   UDP header   VXLAN/GENEVE header   Ethernet header
1384                 exp_mtu=$((${ll_mtu} - 20        1384                 exp_mtu=$((${ll_mtu} - 20          - 8          - 8                   - 14))
1385         else                                     1385         else
1386                 setup namespaces routing brid    1386                 setup namespaces routing bridge bridged_${type}6 || return $ksft_skip
1387                 #                      IPv6 h    1387                 #                      IPv6 header   UDP header   VXLAN/GENEVE header   Ethernet header
1388                 exp_mtu=$((${ll_mtu} - 40        1388                 exp_mtu=$((${ll_mtu} - 40          - 8          - 8                   - 14))
1389         fi                                       1389         fi
1390                                                  1390 
1391         trace "${ns_a}" ${type}_a    "${ns_b}    1391         trace "${ns_a}" ${type}_a    "${ns_b}"  ${type}_b \
1392               "${ns_a}" veth_A-R1    "${ns_r1    1392               "${ns_a}" veth_A-R1    "${ns_r1}" veth_R1-A \
1393               "${ns_b}" veth_B-R1    "${ns_r1    1393               "${ns_b}" veth_B-R1    "${ns_r1}" veth_R1-B \
1394               "${ns_a}" br0          "${ns_a}    1394               "${ns_a}" br0          "${ns_a}"  veth-A-C  \
1395               "${ns_c}" veth_C-A                 1395               "${ns_c}" veth_C-A
1396                                                  1396 
1397         if [ ${family} -eq 4 ]; then             1397         if [ ${family} -eq 4 ]; then
1398                 ping=ping                        1398                 ping=ping
1399                 dst=${tunnel4_b_addr}            1399                 dst=${tunnel4_b_addr}
1400         else                                     1400         else
1401                 ping=${ping6}                    1401                 ping=${ping6}
1402                 dst=${tunnel6_b_addr}            1402                 dst=${tunnel6_b_addr}
1403         fi                                       1403         fi
1404                                                  1404 
1405         # Create route exception by exceeding    1405         # Create route exception by exceeding link layer MTU
1406         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu}    1406         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu} + 1000))
1407         mtu "${ns_a}"  br0       $((${ll_mtu}    1407         mtu "${ns_a}"  br0       $((${ll_mtu} + 1000))
1408         mtu "${ns_a}"  veth_A-C  $((${ll_mtu}    1408         mtu "${ns_a}"  veth_A-C  $((${ll_mtu} + 1000))
1409         mtu "${ns_c}"  veth_C-A  $((${ll_mtu}    1409         mtu "${ns_c}"  veth_C-A  $((${ll_mtu} + 1000))
1410         mtu "${ns_r1}" veth_R1-A $((${ll_mtu}    1410         mtu "${ns_r1}" veth_R1-A $((${ll_mtu} + 1000))
1411         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}       1411         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}
1412         mtu "${ns_r1}" veth_R1-B ${ll_mtu}       1412         mtu "${ns_r1}" veth_R1-B ${ll_mtu}
1413                                                  1413 
1414         mtu "${ns_a}" ${type}_a $((${ll_mtu}     1414         mtu "${ns_a}" ${type}_a $((${ll_mtu} + 1000))
1415         mtu "${ns_b}" ${type}_b $((${ll_mtu}     1415         mtu "${ns_b}" ${type}_b $((${ll_mtu} + 1000))
1416                                                  1416 
1417         run_cmd ${ns_c} ${ping} -q -M want -i    1417         run_cmd ${ns_c} ${ping} -q -M want -i 0.1 -c 10 -s $((${ll_mtu} + 500)) ${dst} || return 1
1418         run_cmd ${ns_a} ${ping} -q -M want -i    1418         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1  -s $((${ll_mtu} + 500)) ${dst} || return 1
1419                                                  1419 
1420         # Check that exceptions were created     1420         # Check that exceptions were created
1421         pmtu="$(route_get_dst_pmtu_from_excep    1421         pmtu="$(route_get_dst_pmtu_from_exception "${ns_c}" ${dst})"
1422         check_pmtu_value ${exp_mtu} "${pmtu}"    1422         check_pmtu_value ${exp_mtu} "${pmtu}" "exceeding link layer MTU on bridged ${type} interface"
1423         pmtu="$(route_get_dst_pmtu_from_excep    1423         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst})"
1424         check_pmtu_value ${exp_mtu} "${pmtu}"    1424         check_pmtu_value ${exp_mtu} "${pmtu}" "exceeding link layer MTU on locally bridged ${type} interface"
1425                                                  1425 
1426         tmpoutfile=$(mktemp)                     1426         tmpoutfile=$(mktemp)
1427                                                  1427 
1428         # Flush Exceptions, retry with TCP       1428         # Flush Exceptions, retry with TCP
1429         run_cmd ${ns_a} ip route flush cached    1429         run_cmd ${ns_a} ip route flush cached ${dst}
1430         run_cmd ${ns_b} ip route flush cached    1430         run_cmd ${ns_b} ip route flush cached ${dst}
1431         run_cmd ${ns_c} ip route flush cached    1431         run_cmd ${ns_c} ip route flush cached ${dst}
1432                                                  1432 
1433         for target in "${ns_a}" "${ns_c}" ; d    1433         for target in "${ns_a}" "${ns_c}" ; do
1434                 if [ ${family} -eq 4 ]; then     1434                 if [ ${family} -eq 4 ]; then
1435                         TCPDST=TCP:${dst}:500    1435                         TCPDST=TCP:${dst}:50000
1436                 else                             1436                 else
1437                         TCPDST="TCP:[${dst}]:    1437                         TCPDST="TCP:[${dst}]:50000"
1438                 fi                               1438                 fi
1439                 ${ns_b} socat -T 3 -u -6 TCP-    1439                 ${ns_b} socat -T 3 -u -6 TCP-LISTEN:50000,reuseaddr STDOUT > $tmpoutfile &
1440                 local socat_pid=$!               1440                 local socat_pid=$!
1441                                                  1441 
1442                 wait_local_port_listen ${NS_B    1442                 wait_local_port_listen ${NS_B} 50000 tcp
1443                                                  1443 
1444                 dd if=/dev/zero status=none b    1444                 dd if=/dev/zero status=none bs=1M count=1 | ${target} socat -T 3 -u STDIN $TCPDST,connect-timeout=3
1445                                                  1445 
1446                 wait ${socat_pid}                1446                 wait ${socat_pid}
1447                 size=$(du -sb $tmpoutfile)       1447                 size=$(du -sb $tmpoutfile)
1448                 size=${size%%/tmp/*}             1448                 size=${size%%/tmp/*}
1449                                                  1449 
1450                 [ $size -ne 1048576 ] && err     1450                 [ $size -ne 1048576 ] && err "File size $size mismatches exepcted value in locally bridged vxlan test" && return 1
1451         done                                     1451         done
1452                                                  1452 
1453         rm -f "$tmpoutfile"                      1453         rm -f "$tmpoutfile"
1454                                                  1454 
1455         # Check that exceptions were created     1455         # Check that exceptions were created
1456         pmtu="$(route_get_dst_pmtu_from_excep    1456         pmtu="$(route_get_dst_pmtu_from_exception "${ns_c}" ${dst})"
1457         check_pmtu_value ${exp_mtu} "${pmtu}"    1457         check_pmtu_value ${exp_mtu} "${pmtu}" "tcp: exceeding link layer MTU on bridged ${type} interface"
1458         pmtu="$(route_get_dst_pmtu_from_excep    1458         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst})"
1459         check_pmtu_value ${exp_mtu} "${pmtu}"    1459         check_pmtu_value ${exp_mtu} "${pmtu}" "tcp exceeding link layer MTU on locally bridged ${type} interface"
1460 }                                                1460 }
1461                                                  1461 
1462 test_pmtu_ipv4_br_vxlan4_exception() {           1462 test_pmtu_ipv4_br_vxlan4_exception() {
1463         test_pmtu_ipvX_over_bridged_vxlanY_or    1463         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception vxlan  4 4
1464 }                                                1464 }
1465                                                  1465 
1466 test_pmtu_ipv6_br_vxlan4_exception() {           1466 test_pmtu_ipv6_br_vxlan4_exception() {
1467         test_pmtu_ipvX_over_bridged_vxlanY_or    1467         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception vxlan  6 4
1468 }                                                1468 }
1469                                                  1469 
1470 test_pmtu_ipv4_br_geneve4_exception() {          1470 test_pmtu_ipv4_br_geneve4_exception() {
1471         test_pmtu_ipvX_over_bridged_vxlanY_or    1471         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception geneve 4 4
1472 }                                                1472 }
1473                                                  1473 
1474 test_pmtu_ipv6_br_geneve4_exception() {          1474 test_pmtu_ipv6_br_geneve4_exception() {
1475         test_pmtu_ipvX_over_bridged_vxlanY_or    1475         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception geneve 6 4
1476 }                                                1476 }
1477                                                  1477 
1478 test_pmtu_ipv4_br_vxlan6_exception() {           1478 test_pmtu_ipv4_br_vxlan6_exception() {
1479         test_pmtu_ipvX_over_bridged_vxlanY_or    1479         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception vxlan  4 6
1480 }                                                1480 }
1481                                                  1481 
1482 test_pmtu_ipv6_br_vxlan6_exception() {           1482 test_pmtu_ipv6_br_vxlan6_exception() {
1483         test_pmtu_ipvX_over_bridged_vxlanY_or    1483         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception vxlan  6 6
1484 }                                                1484 }
1485                                                  1485 
1486 test_pmtu_ipv4_br_geneve6_exception() {          1486 test_pmtu_ipv4_br_geneve6_exception() {
1487         test_pmtu_ipvX_over_bridged_vxlanY_or    1487         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception geneve 4 6
1488 }                                                1488 }
1489                                                  1489 
1490 test_pmtu_ipv6_br_geneve6_exception() {          1490 test_pmtu_ipv6_br_geneve6_exception() {
1491         test_pmtu_ipvX_over_bridged_vxlanY_or    1491         test_pmtu_ipvX_over_bridged_vxlanY_or_geneveY_exception geneve 6 6
1492 }                                                1492 }
1493                                                  1493 
1494 test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exc    1494 test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception() {
1495         type=${1}                                1495         type=${1}
1496         family=${2}                              1496         family=${2}
1497         outer_family=${3}                        1497         outer_family=${3}
1498         ll_mtu=4000                              1498         ll_mtu=4000
1499                                                  1499 
1500         if [ "${type}" = "vxlan" ]; then         1500         if [ "${type}" = "vxlan" ]; then
1501                 tun_a="vxlan_sys_4789"           1501                 tun_a="vxlan_sys_4789"
1502         elif [ "${type}" = "geneve" ]; then      1502         elif [ "${type}" = "geneve" ]; then
1503                 tun_a="genev_sys_6081"           1503                 tun_a="genev_sys_6081"
1504         fi                                       1504         fi
1505                                                  1505 
1506         if [ ${outer_family} -eq 4 ]; then       1506         if [ ${outer_family} -eq 4 ]; then
1507                 setup namespaces routing ovs_    1507                 setup namespaces routing ovs_bridge ovs_${type}4 || return $ksft_skip
1508                 #                      IPv4 h    1508                 #                      IPv4 header   UDP header   VXLAN/GENEVE header   Ethernet header
1509                 exp_mtu=$((${ll_mtu} - 20        1509                 exp_mtu=$((${ll_mtu} - 20          - 8          - 8                   - 14))
1510         else                                     1510         else
1511                 setup namespaces routing ovs_    1511                 setup namespaces routing ovs_bridge ovs_${type}6 || return $ksft_skip
1512                 #                      IPv6 h    1512                 #                      IPv6 header   UDP header   VXLAN/GENEVE header   Ethernet header
1513                 exp_mtu=$((${ll_mtu} - 40        1513                 exp_mtu=$((${ll_mtu} - 40          - 8          - 8                   - 14))
1514         fi                                       1514         fi
1515                                                  1515 
1516         trace ""        ${type}_a    "${ns_b}    1516         trace ""        ${type}_a    "${ns_b}"  ${type}_b \
1517               ""        veth_A-R1    "${ns_r1    1517               ""        veth_A-R1    "${ns_r1}" veth_R1-A \
1518               "${ns_b}" veth_B-R1    "${ns_r1    1518               "${ns_b}" veth_B-R1    "${ns_r1}" veth_R1-B \
1519               ""        ovs_br0      ""          1519               ""        ovs_br0      ""         veth-A_C  \
1520               "${ns_c}" veth_C-A     ""          1520               "${ns_c}" veth_C-A     ""         "${tun_a}"
1521                                                  1521 
1522         if [ ${family} -eq 4 ]; then             1522         if [ ${family} -eq 4 ]; then
1523                 ping=ping                        1523                 ping=ping
1524                 dst=${tunnel4_b_addr}            1524                 dst=${tunnel4_b_addr}
1525         else                                     1525         else
1526                 ping=${ping6}                    1526                 ping=${ping6}
1527                 dst=${tunnel6_b_addr}            1527                 dst=${tunnel6_b_addr}
1528         fi                                       1528         fi
1529                                                  1529 
1530         # Create route exception by exceeding    1530         # Create route exception by exceeding link layer MTU
1531         mtu ""         veth_A-R1 $((${ll_mtu}    1531         mtu ""         veth_A-R1 $((${ll_mtu} + 1000))
1532         mtu ""         ovs_br0   $((${ll_mtu}    1532         mtu ""         ovs_br0   $((${ll_mtu} + 1000))
1533         mtu ""         veth_A-C  $((${ll_mtu}    1533         mtu ""         veth_A-C  $((${ll_mtu} + 1000))
1534         mtu "${ns_c}"  veth_C-A  $((${ll_mtu}    1534         mtu "${ns_c}"  veth_C-A  $((${ll_mtu} + 1000))
1535         mtu "${ns_r1}" veth_R1-A $((${ll_mtu}    1535         mtu "${ns_r1}" veth_R1-A $((${ll_mtu} + 1000))
1536         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}       1536         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}
1537         mtu "${ns_r1}" veth_R1-B ${ll_mtu}       1537         mtu "${ns_r1}" veth_R1-B ${ll_mtu}
1538                                                  1538 
1539         mtu ""        ${tun_a}  $((${ll_mtu}     1539         mtu ""        ${tun_a}  $((${ll_mtu} + 1000)) 2>/dev/null || \
1540                 mtu ""        ${type}_a  $(($    1540                 mtu ""        ${type}_a  $((${ll_mtu} + 1000)) 2>/dev/null
1541         mtu "${ns_b}" ${type}_b  $((${ll_mtu}    1541         mtu "${ns_b}" ${type}_b  $((${ll_mtu} + 1000))
1542                                                  1542 
1543         run_cmd ${ns_c} ${ping} -q -M want -i    1543         run_cmd ${ns_c} ${ping} -q -M want -i 0.1 -c 20 -s $((${ll_mtu} + 500)) ${dst} || return 1
1544                                                  1544 
1545         # Check that exceptions were created     1545         # Check that exceptions were created
1546         pmtu="$(route_get_dst_pmtu_from_excep    1546         pmtu="$(route_get_dst_pmtu_from_exception "${ns_c}" ${dst})"
1547         check_pmtu_value ${exp_mtu} "${pmtu}"    1547         check_pmtu_value ${exp_mtu} "${pmtu}" "exceeding link layer MTU on Open vSwitch ${type} interface"
1548 }                                                1548 }
1549                                                  1549 
1550 test_pmtu_ipv4_ovs_vxlan4_exception() {          1550 test_pmtu_ipv4_ovs_vxlan4_exception() {
1551         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1551         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception vxlan  4 4
1552 }                                                1552 }
1553                                                  1553 
1554 test_pmtu_ipv6_ovs_vxlan4_exception() {          1554 test_pmtu_ipv6_ovs_vxlan4_exception() {
1555         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1555         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception vxlan  6 4
1556 }                                                1556 }
1557                                                  1557 
1558 test_pmtu_ipv4_ovs_geneve4_exception() {         1558 test_pmtu_ipv4_ovs_geneve4_exception() {
1559         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1559         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception geneve 4 4
1560 }                                                1560 }
1561                                                  1561 
1562 test_pmtu_ipv6_ovs_geneve4_exception() {         1562 test_pmtu_ipv6_ovs_geneve4_exception() {
1563         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1563         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception geneve 6 4
1564 }                                                1564 }
1565                                                  1565 
1566 test_pmtu_ipv4_ovs_vxlan6_exception() {          1566 test_pmtu_ipv4_ovs_vxlan6_exception() {
1567         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1567         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception vxlan  4 6
1568 }                                                1568 }
1569                                                  1569 
1570 test_pmtu_ipv6_ovs_vxlan6_exception() {          1570 test_pmtu_ipv6_ovs_vxlan6_exception() {
1571         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1571         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception vxlan  6 6
1572 }                                                1572 }
1573                                                  1573 
1574 test_pmtu_ipv4_ovs_geneve6_exception() {         1574 test_pmtu_ipv4_ovs_geneve6_exception() {
1575         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1575         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception geneve 4 6
1576 }                                                1576 }
1577                                                  1577 
1578 test_pmtu_ipv6_ovs_geneve6_exception() {         1578 test_pmtu_ipv6_ovs_geneve6_exception() {
1579         test_pmtu_ipvX_over_ovs_vxlanY_or_gen    1579         test_pmtu_ipvX_over_ovs_vxlanY_or_geneveY_exception geneve 6 6
1580 }                                                1580 }
1581                                                  1581 
1582 test_pmtu_ipvX_over_fouY_or_gueY() {             1582 test_pmtu_ipvX_over_fouY_or_gueY() {
1583         inner_family=${1}                        1583         inner_family=${1}
1584         outer_family=${2}                        1584         outer_family=${2}
1585         encap=${3}                               1585         encap=${3}
1586         ll_mtu=4000                              1586         ll_mtu=4000
1587                                                  1587 
1588         setup namespaces routing ${encap}${ou    1588         setup namespaces routing ${encap}${outer_family}${inner_family} || return $ksft_skip
1589         trace "${ns_a}" ${encap}_a   "${ns_b}    1589         trace "${ns_a}" ${encap}_a   "${ns_b}"  ${encap}_b \
1590               "${ns_a}" veth_A-R1    "${ns_r1    1590               "${ns_a}" veth_A-R1    "${ns_r1}" veth_R1-A \
1591               "${ns_b}" veth_B-R1    "${ns_r1    1591               "${ns_b}" veth_B-R1    "${ns_r1}" veth_R1-B
1592                                                  1592 
1593         if [ ${inner_family} -eq 4 ]; then       1593         if [ ${inner_family} -eq 4 ]; then
1594                 ping=ping                        1594                 ping=ping
1595                 dst=${tunnel4_b_addr}            1595                 dst=${tunnel4_b_addr}
1596         else                                     1596         else
1597                 ping=${ping6}                    1597                 ping=${ping6}
1598                 dst=${tunnel6_b_addr}            1598                 dst=${tunnel6_b_addr}
1599         fi                                       1599         fi
1600                                                  1600 
1601         if [ "${encap}" = "gue" ]; then          1601         if [ "${encap}" = "gue" ]; then
1602                 encap_overhead=4                 1602                 encap_overhead=4
1603         else                                     1603         else
1604                 encap_overhead=0                 1604                 encap_overhead=0
1605         fi                                       1605         fi
1606                                                  1606 
1607         if [ ${outer_family} -eq 4 ]; then       1607         if [ ${outer_family} -eq 4 ]; then
1608                 #                      IPv4 h    1608                 #                      IPv4 header   UDP header
1609                 exp_mtu=$((${ll_mtu} - 20        1609                 exp_mtu=$((${ll_mtu} - 20          - 8         - ${encap_overhead}))
1610         else                                     1610         else
1611                 #                      IPv6 h    1611                 #                      IPv6 header   Option 4   UDP header
1612                 exp_mtu=$((${ll_mtu} - 40        1612                 exp_mtu=$((${ll_mtu} - 40          - 8        - 8       - ${encap_overhead}))
1613         fi                                       1613         fi
1614                                                  1614 
1615         # Create route exception by exceeding    1615         # Create route exception by exceeding link layer MTU
1616         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu}    1616         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu} + 1000))
1617         mtu "${ns_r1}" veth_R1-A $((${ll_mtu}    1617         mtu "${ns_r1}" veth_R1-A $((${ll_mtu} + 1000))
1618         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}       1618         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}
1619         mtu "${ns_r1}" veth_R1-B ${ll_mtu}       1619         mtu "${ns_r1}" veth_R1-B ${ll_mtu}
1620                                                  1620 
1621         mtu "${ns_a}" ${encap}_a $((${ll_mtu}    1621         mtu "${ns_a}" ${encap}_a $((${ll_mtu} + 1000))
1622         mtu "${ns_b}" ${encap}_b $((${ll_mtu}    1622         mtu "${ns_b}" ${encap}_b $((${ll_mtu} + 1000))
1623         run_cmd ${ns_a} ${ping} -q -M want -i    1623         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s $((${ll_mtu} + 500)) ${dst}
1624                                                  1624 
1625         # Check that exception was created       1625         # Check that exception was created
1626         pmtu="$(route_get_dst_pmtu_from_excep    1626         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst})"
1627         check_pmtu_value ${exp_mtu} "${pmtu}"    1627         check_pmtu_value ${exp_mtu} "${pmtu}" "exceeding link layer MTU on ${encap} interface"
1628 }                                                1628 }
1629                                                  1629 
1630 test_pmtu_ipv4_fou4_exception() {                1630 test_pmtu_ipv4_fou4_exception() {
1631         test_pmtu_ipvX_over_fouY_or_gueY 4 4     1631         test_pmtu_ipvX_over_fouY_or_gueY 4 4 fou
1632 }                                                1632 }
1633                                                  1633 
1634 test_pmtu_ipv6_fou4_exception() {                1634 test_pmtu_ipv6_fou4_exception() {
1635         test_pmtu_ipvX_over_fouY_or_gueY 6 4     1635         test_pmtu_ipvX_over_fouY_or_gueY 6 4 fou
1636 }                                                1636 }
1637                                                  1637 
1638 test_pmtu_ipv4_fou6_exception() {                1638 test_pmtu_ipv4_fou6_exception() {
1639         test_pmtu_ipvX_over_fouY_or_gueY 4 6     1639         test_pmtu_ipvX_over_fouY_or_gueY 4 6 fou
1640 }                                                1640 }
1641                                                  1641 
1642 test_pmtu_ipv6_fou6_exception() {                1642 test_pmtu_ipv6_fou6_exception() {
1643         test_pmtu_ipvX_over_fouY_or_gueY 6 6     1643         test_pmtu_ipvX_over_fouY_or_gueY 6 6 fou
1644 }                                                1644 }
1645                                                  1645 
1646 test_pmtu_ipv4_gue4_exception() {                1646 test_pmtu_ipv4_gue4_exception() {
1647         test_pmtu_ipvX_over_fouY_or_gueY 4 4     1647         test_pmtu_ipvX_over_fouY_or_gueY 4 4 gue
1648 }                                                1648 }
1649                                                  1649 
1650 test_pmtu_ipv6_gue4_exception() {                1650 test_pmtu_ipv6_gue4_exception() {
1651         test_pmtu_ipvX_over_fouY_or_gueY 6 4     1651         test_pmtu_ipvX_over_fouY_or_gueY 6 4 gue
1652 }                                                1652 }
1653                                                  1653 
1654 test_pmtu_ipv4_gue6_exception() {                1654 test_pmtu_ipv4_gue6_exception() {
1655         test_pmtu_ipvX_over_fouY_or_gueY 4 6     1655         test_pmtu_ipvX_over_fouY_or_gueY 4 6 gue
1656 }                                                1656 }
1657                                                  1657 
1658 test_pmtu_ipv6_gue6_exception() {                1658 test_pmtu_ipv6_gue6_exception() {
1659         test_pmtu_ipvX_over_fouY_or_gueY 6 6     1659         test_pmtu_ipvX_over_fouY_or_gueY 6 6 gue
1660 }                                                1660 }
1661                                                  1661 
1662 test_pmtu_ipvX_over_ipvY_exception() {           1662 test_pmtu_ipvX_over_ipvY_exception() {
1663         inner=${1}                               1663         inner=${1}
1664         outer=${2}                               1664         outer=${2}
1665         ll_mtu=4000                              1665         ll_mtu=4000
1666                                                  1666 
1667         setup namespaces routing ip${inner}ip    1667         setup namespaces routing ip${inner}ip${outer} || return $ksft_skip
1668                                                  1668 
1669         trace "${ns_a}" ip_a         "${ns_b}    1669         trace "${ns_a}" ip_a         "${ns_b}"  ip_b  \
1670               "${ns_a}" veth_A-R1    "${ns_r1    1670               "${ns_a}" veth_A-R1    "${ns_r1}" veth_R1-A \
1671               "${ns_b}" veth_B-R1    "${ns_r1    1671               "${ns_b}" veth_B-R1    "${ns_r1}" veth_R1-B
1672                                                  1672 
1673         if [ ${inner} -eq 4 ]; then              1673         if [ ${inner} -eq 4 ]; then
1674                 ping=ping                        1674                 ping=ping
1675                 dst=${tunnel4_b_addr}            1675                 dst=${tunnel4_b_addr}
1676         else                                     1676         else
1677                 ping=${ping6}                    1677                 ping=${ping6}
1678                 dst=${tunnel6_b_addr}            1678                 dst=${tunnel6_b_addr}
1679         fi                                       1679         fi
1680                                                  1680 
1681         if [ ${outer} -eq 4 ]; then              1681         if [ ${outer} -eq 4 ]; then
1682                 #                      IPv4 h    1682                 #                      IPv4 header
1683                 exp_mtu=$((${ll_mtu} - 20))      1683                 exp_mtu=$((${ll_mtu} - 20))
1684         else                                     1684         else
1685                 #                      IPv6 h    1685                 #                      IPv6 header   Option 4
1686                 exp_mtu=$((${ll_mtu} - 40        1686                 exp_mtu=$((${ll_mtu} - 40          - 8))
1687         fi                                       1687         fi
1688                                                  1688 
1689         # Create route exception by exceeding    1689         # Create route exception by exceeding link layer MTU
1690         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu}    1690         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu} + 1000))
1691         mtu "${ns_r1}" veth_R1-A $((${ll_mtu}    1691         mtu "${ns_r1}" veth_R1-A $((${ll_mtu} + 1000))
1692         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}       1692         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}
1693         mtu "${ns_r1}" veth_R1-B ${ll_mtu}       1693         mtu "${ns_r1}" veth_R1-B ${ll_mtu}
1694                                                  1694 
1695         mtu "${ns_a}" ip_a $((${ll_mtu} + 100    1695         mtu "${ns_a}" ip_a $((${ll_mtu} + 1000)) || return
1696         mtu "${ns_b}" ip_b $((${ll_mtu} + 100    1696         mtu "${ns_b}" ip_b $((${ll_mtu} + 1000)) || return
1697         run_cmd ${ns_a} ${ping} -q -M want -i    1697         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s $((${ll_mtu} + 500)) ${dst}
1698                                                  1698 
1699         # Check that exception was created       1699         # Check that exception was created
1700         pmtu="$(route_get_dst_pmtu_from_excep    1700         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst})"
1701         check_pmtu_value ${exp_mtu} "${pmtu}"    1701         check_pmtu_value ${exp_mtu} "${pmtu}" "exceeding link layer MTU on ip${inner}ip${outer} interface"
1702 }                                                1702 }
1703                                                  1703 
1704 test_pmtu_ipv4_ipv4_exception() {                1704 test_pmtu_ipv4_ipv4_exception() {
1705         test_pmtu_ipvX_over_ipvY_exception 4     1705         test_pmtu_ipvX_over_ipvY_exception 4 4
1706 }                                                1706 }
1707                                                  1707 
1708 test_pmtu_ipv6_ipv4_exception() {                1708 test_pmtu_ipv6_ipv4_exception() {
1709         test_pmtu_ipvX_over_ipvY_exception 6     1709         test_pmtu_ipvX_over_ipvY_exception 6 4
1710 }                                                1710 }
1711                                                  1711 
1712 test_pmtu_ipv4_ipv6_exception() {                1712 test_pmtu_ipv4_ipv6_exception() {
1713         test_pmtu_ipvX_over_ipvY_exception 4     1713         test_pmtu_ipvX_over_ipvY_exception 4 6
1714 }                                                1714 }
1715                                                  1715 
1716 test_pmtu_ipv6_ipv6_exception() {                1716 test_pmtu_ipv6_ipv6_exception() {
1717         test_pmtu_ipvX_over_ipvY_exception 6     1717         test_pmtu_ipvX_over_ipvY_exception 6 6
1718 }                                                1718 }
1719                                                  1719 
1720 test_pmtu_vti4_exception() {                     1720 test_pmtu_vti4_exception() {
1721         setup namespaces veth vti4 xfrm4 || r    1721         setup namespaces veth vti4 xfrm4 || return $ksft_skip
1722         trace "${ns_a}" veth_a    "${ns_b}" v    1722         trace "${ns_a}" veth_a    "${ns_b}" veth_b \
1723               "${ns_a}" vti4_a    "${ns_b}" v    1723               "${ns_a}" vti4_a    "${ns_b}" vti4_b
1724                                                  1724 
1725         veth_mtu=1500                            1725         veth_mtu=1500
1726         vti_mtu=$((veth_mtu - 20))               1726         vti_mtu=$((veth_mtu - 20))
1727                                                  1727 
1728         #                                SPI     1728         #                                SPI   SN   IV  ICV   pad length   next header
1729         esp_payload_rfc4106=$((vti_mtu - 4       1729         esp_payload_rfc4106=$((vti_mtu - 4   - 4  - 8 - 16  - 1          - 1))
1730         ping_payload=$((esp_payload_rfc4106 -    1730         ping_payload=$((esp_payload_rfc4106 - 28))
1731                                                  1731 
1732         mtu "${ns_a}" veth_a ${veth_mtu}         1732         mtu "${ns_a}" veth_a ${veth_mtu}
1733         mtu "${ns_b}" veth_b ${veth_mtu}         1733         mtu "${ns_b}" veth_b ${veth_mtu}
1734         mtu "${ns_a}" vti4_a ${vti_mtu}          1734         mtu "${ns_a}" vti4_a ${vti_mtu}
1735         mtu "${ns_b}" vti4_b ${vti_mtu}          1735         mtu "${ns_b}" vti4_b ${vti_mtu}
1736                                                  1736 
1737         # Send DF packet without exceeding li    1737         # Send DF packet without exceeding link layer MTU, check that no
1738         # exception is created                   1738         # exception is created
1739         run_cmd ${ns_a} ping -q -M want -i 0.    1739         run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s ${ping_payload} ${tunnel4_b_addr}
1740         pmtu="$(route_get_dst_pmtu_from_excep    1740         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel4_b_addr})"
1741         check_pmtu_value "" "${pmtu}" "sendin    1741         check_pmtu_value "" "${pmtu}" "sending packet smaller than PMTU (IP payload length ${esp_payload_rfc4106})" || return 1
1742                                                  1742 
1743         # Now exceed link layer MTU by one by    1743         # Now exceed link layer MTU by one byte, check that exception is created
1744         # with the right PMTU value              1744         # with the right PMTU value
1745         run_cmd ${ns_a} ping -q -M want -i 0.    1745         run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s $((ping_payload + 1)) ${tunnel4_b_addr}
1746         pmtu="$(route_get_dst_pmtu_from_excep    1746         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel4_b_addr})"
1747         check_pmtu_value "${esp_payload_rfc41    1747         check_pmtu_value "${esp_payload_rfc4106}" "${pmtu}" "exceeding PMTU (IP payload length $((esp_payload_rfc4106 + 1)))"
1748 }                                                1748 }
1749                                                  1749 
1750 test_pmtu_vti6_exception() {                     1750 test_pmtu_vti6_exception() {
1751         setup namespaces veth vti6 xfrm6 || r    1751         setup namespaces veth vti6 xfrm6 || return $ksft_skip
1752         trace "${ns_a}" veth_a    "${ns_b}" v    1752         trace "${ns_a}" veth_a    "${ns_b}" veth_b \
1753               "${ns_a}" vti6_a    "${ns_b}" v    1753               "${ns_a}" vti6_a    "${ns_b}" vti6_b
1754         fail=0                                   1754         fail=0
1755                                                  1755 
1756         # Create route exception by exceeding    1756         # Create route exception by exceeding link layer MTU
1757         mtu "${ns_a}" veth_a 4000                1757         mtu "${ns_a}" veth_a 4000
1758         mtu "${ns_b}" veth_b 4000                1758         mtu "${ns_b}" veth_b 4000
1759         mtu "${ns_a}" vti6_a 5000                1759         mtu "${ns_a}" vti6_a 5000
1760         mtu "${ns_b}" vti6_b 5000                1760         mtu "${ns_b}" vti6_b 5000
1761         run_cmd ${ns_a} ${ping6} -q -i 0.1 -w    1761         run_cmd ${ns_a} ${ping6} -q -i 0.1 -w 1 -s 60000 ${tunnel6_b_addr}
1762                                                  1762 
1763         # Check that exception was created       1763         # Check that exception was created
1764         pmtu="$(route_get_dst_pmtu_from_excep    1764         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1765         check_pmtu_value any "${pmtu}" "creat    1765         check_pmtu_value any "${pmtu}" "creating tunnel exceeding link layer MTU" || return 1
1766                                                  1766 
1767         # Decrease tunnel MTU, check for PMTU    1767         # Decrease tunnel MTU, check for PMTU decrease in route exception
1768         mtu "${ns_a}" vti6_a 3000                1768         mtu "${ns_a}" vti6_a 3000
1769         pmtu="$(route_get_dst_pmtu_from_excep    1769         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1770         check_pmtu_value "3000" "${pmtu}" "de    1770         check_pmtu_value "3000" "${pmtu}" "decreasing tunnel MTU" || fail=1
1771                                                  1771 
1772         # Increase tunnel MTU, check for PMTU    1772         # Increase tunnel MTU, check for PMTU increase in route exception
1773         mtu "${ns_a}" vti6_a 9000                1773         mtu "${ns_a}" vti6_a 9000
1774         pmtu="$(route_get_dst_pmtu_from_excep    1774         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1775         check_pmtu_value "9000" "${pmtu}" "in    1775         check_pmtu_value "9000" "${pmtu}" "increasing tunnel MTU" || fail=1
1776                                                  1776 
1777         return ${fail}                           1777         return ${fail}
1778 }                                                1778 }
1779                                                  1779 
1780 test_pmtu_vti4_udp_exception() {                 1780 test_pmtu_vti4_udp_exception() {
1781         setup namespaces veth vti4 xfrm4udp |    1781         setup namespaces veth vti4 xfrm4udp || return $ksft_skip
1782         trace "${ns_a}" veth_a    "${ns_b}" v    1782         trace "${ns_a}" veth_a    "${ns_b}" veth_b \
1783               "${ns_a}" vti4_a    "${ns_b}" v    1783               "${ns_a}" vti4_a    "${ns_b}" vti4_b
1784                                                  1784 
1785         veth_mtu=1500                            1785         veth_mtu=1500
1786         vti_mtu=$((veth_mtu - 20))               1786         vti_mtu=$((veth_mtu - 20))
1787                                                  1787 
1788         #                                UDP     1788         #                                UDP   SPI   SN   IV  ICV   pad length   next header
1789         esp_payload_rfc4106=$((vti_mtu - 8       1789         esp_payload_rfc4106=$((vti_mtu - 8   - 4   - 4  - 8 - 16  - 1          - 1))
1790         ping_payload=$((esp_payload_rfc4106 -    1790         ping_payload=$((esp_payload_rfc4106 - 28))
1791                                                  1791 
1792         mtu "${ns_a}" veth_a ${veth_mtu}         1792         mtu "${ns_a}" veth_a ${veth_mtu}
1793         mtu "${ns_b}" veth_b ${veth_mtu}         1793         mtu "${ns_b}" veth_b ${veth_mtu}
1794         mtu "${ns_a}" vti4_a ${vti_mtu}          1794         mtu "${ns_a}" vti4_a ${vti_mtu}
1795         mtu "${ns_b}" vti4_b ${vti_mtu}          1795         mtu "${ns_b}" vti4_b ${vti_mtu}
1796                                                  1796 
1797         # Send DF packet without exceeding li    1797         # Send DF packet without exceeding link layer MTU, check that no
1798         # exception is created                   1798         # exception is created
1799         run_cmd ${ns_a} ping -q -M want -i 0.    1799         run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s ${ping_payload} ${tunnel4_b_addr}
1800         pmtu="$(route_get_dst_pmtu_from_excep    1800         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel4_b_addr})"
1801         check_pmtu_value "" "${pmtu}" "sendin    1801         check_pmtu_value "" "${pmtu}" "sending packet smaller than PMTU (IP payload length ${esp_payload_rfc4106})" || return 1
1802                                                  1802 
1803         # Now exceed link layer MTU by one by    1803         # Now exceed link layer MTU by one byte, check that exception is created
1804         # with the right PMTU value              1804         # with the right PMTU value
1805         run_cmd ${ns_a} ping -q -M want -i 0.    1805         run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s $((ping_payload + 1)) ${tunnel4_b_addr}
1806         pmtu="$(route_get_dst_pmtu_from_excep    1806         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel4_b_addr})"
1807         check_pmtu_value "${esp_payload_rfc41    1807         check_pmtu_value "${esp_payload_rfc4106}" "${pmtu}" "exceeding PMTU (IP payload length $((esp_payload_rfc4106 + 1)))"
1808 }                                                1808 }
1809                                                  1809 
1810 test_pmtu_vti6_udp_exception() {                 1810 test_pmtu_vti6_udp_exception() {
1811         setup namespaces veth vti6 xfrm6udp |    1811         setup namespaces veth vti6 xfrm6udp || return $ksft_skip
1812         trace "${ns_a}" veth_a    "${ns_b}" v    1812         trace "${ns_a}" veth_a    "${ns_b}" veth_b \
1813               "${ns_a}" vti6_a    "${ns_b}" v    1813               "${ns_a}" vti6_a    "${ns_b}" vti6_b
1814         fail=0                                   1814         fail=0
1815                                                  1815 
1816         # Create route exception by exceeding    1816         # Create route exception by exceeding link layer MTU
1817         mtu "${ns_a}" veth_a 4000                1817         mtu "${ns_a}" veth_a 4000
1818         mtu "${ns_b}" veth_b 4000                1818         mtu "${ns_b}" veth_b 4000
1819         mtu "${ns_a}" vti6_a 5000                1819         mtu "${ns_a}" vti6_a 5000
1820         mtu "${ns_b}" vti6_b 5000                1820         mtu "${ns_b}" vti6_b 5000
1821         run_cmd ${ns_a} ${ping6} -q -i 0.1 -w    1821         run_cmd ${ns_a} ${ping6} -q -i 0.1 -w 1 -s 60000 ${tunnel6_b_addr}
1822                                                  1822 
1823         # Check that exception was created       1823         # Check that exception was created
1824         pmtu="$(route_get_dst_pmtu_from_excep    1824         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1825         check_pmtu_value any "${pmtu}" "creat    1825         check_pmtu_value any "${pmtu}" "creating tunnel exceeding link layer MTU" || return 1
1826                                                  1826 
1827         # Decrease tunnel MTU, check for PMTU    1827         # Decrease tunnel MTU, check for PMTU decrease in route exception
1828         mtu "${ns_a}" vti6_a 3000                1828         mtu "${ns_a}" vti6_a 3000
1829         pmtu="$(route_get_dst_pmtu_from_excep    1829         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1830         check_pmtu_value "3000" "${pmtu}" "de    1830         check_pmtu_value "3000" "${pmtu}" "decreasing tunnel MTU" || fail=1
1831                                                  1831 
1832         # Increase tunnel MTU, check for PMTU    1832         # Increase tunnel MTU, check for PMTU increase in route exception
1833         mtu "${ns_a}" vti6_a 9000                1833         mtu "${ns_a}" vti6_a 9000
1834         pmtu="$(route_get_dst_pmtu_from_excep    1834         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1835         check_pmtu_value "9000" "${pmtu}" "in    1835         check_pmtu_value "9000" "${pmtu}" "increasing tunnel MTU" || fail=1
1836                                                  1836 
1837         return ${fail}                           1837         return ${fail}
1838 }                                                1838 }
1839                                                  1839 
1840 test_pmtu_vti4_udp_routed_exception() {          1840 test_pmtu_vti4_udp_routed_exception() {
1841         setup namespaces routing vti4routed x    1841         setup namespaces routing vti4routed xfrm4udprouted || return $ksft_skip
1842         trace "${ns_a}" veth_A-R1    "${ns_b}    1842         trace "${ns_a}" veth_A-R1    "${ns_b}" veth_B-R1 \
1843               "${ns_a}" vti4_a       "${ns_b}    1843               "${ns_a}" vti4_a       "${ns_b}" vti4_b
1844                                                  1844 
1845         veth_mtu=1500                            1845         veth_mtu=1500
1846         vti_mtu=$((veth_mtu - 20))               1846         vti_mtu=$((veth_mtu - 20))
1847                                                  1847 
1848         #                                UDP     1848         #                                UDP   SPI   SN   IV  ICV   pad length   next header
1849         esp_payload_rfc4106=$((vti_mtu - 8       1849         esp_payload_rfc4106=$((vti_mtu - 8   - 4   - 4  - 8 - 16  - 1          - 1))
1850         ping_payload=$((esp_payload_rfc4106 -    1850         ping_payload=$((esp_payload_rfc4106 - 28))
1851                                                  1851 
1852         mtu "${ns_a}"  veth_A-R1 ${veth_mtu}     1852         mtu "${ns_a}"  veth_A-R1 ${veth_mtu}
1853         mtu "${ns_r1}" veth_R1-A ${veth_mtu}     1853         mtu "${ns_r1}" veth_R1-A ${veth_mtu}
1854         mtu "${ns_b}"  veth_B-R1 ${veth_mtu}     1854         mtu "${ns_b}"  veth_B-R1 ${veth_mtu}
1855         mtu "${ns_r1}" veth_R1-B ${veth_mtu}     1855         mtu "${ns_r1}" veth_R1-B ${veth_mtu}
1856                                                  1856 
1857         mtu "${ns_a}" vti4_a ${vti_mtu}          1857         mtu "${ns_a}" vti4_a ${vti_mtu}
1858         mtu "${ns_b}" vti4_b ${vti_mtu}          1858         mtu "${ns_b}" vti4_b ${vti_mtu}
1859                                                  1859 
1860         # Send DF packet without exceeding li    1860         # Send DF packet without exceeding link layer MTU, check that no
1861         # exception is created                   1861         # exception is created
1862         run_cmd ${ns_a} ping -q -M want -i 0.    1862         run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s ${ping_payload} ${tunnel4_b_addr}
1863         pmtu="$(route_get_dst_pmtu_from_excep    1863         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel4_b_addr})"
1864         check_pmtu_value "" "${pmtu}" "sendin    1864         check_pmtu_value "" "${pmtu}" "sending packet smaller than PMTU (IP payload length ${esp_payload_rfc4106})" || return 1
1865                                                  1865 
1866         # Now decrease link layer MTU by 8 by    1866         # Now decrease link layer MTU by 8 bytes on R1, check that exception is created
1867         # with the right PMTU value              1867         # with the right PMTU value
1868         mtu "${ns_r1}" veth_R1-B $((veth_mtu     1868         mtu "${ns_r1}" veth_R1-B $((veth_mtu - 8))
1869         run_cmd ${ns_a} ping -q -M want -i 0.    1869         run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s $((ping_payload)) ${tunnel4_b_addr}
1870         pmtu="$(route_get_dst_pmtu_from_excep    1870         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel4_b_addr})"
1871         check_pmtu_value "$((esp_payload_rfc4    1871         check_pmtu_value "$((esp_payload_rfc4106 - 8))" "${pmtu}" "exceeding PMTU (IP payload length $((esp_payload_rfc4106)))"
1872 }                                                1872 }
1873                                                  1873 
1874 test_pmtu_vti6_udp_routed_exception() {          1874 test_pmtu_vti6_udp_routed_exception() {
1875         setup namespaces routing vti6routed x    1875         setup namespaces routing vti6routed xfrm6udprouted || return $ksft_skip
1876         trace "${ns_a}" veth_A-R1    "${ns_b}    1876         trace "${ns_a}" veth_A-R1    "${ns_b}" veth_B-R1 \
1877               "${ns_a}" vti6_a       "${ns_b}    1877               "${ns_a}" vti6_a       "${ns_b}" vti6_b
1878                                                  1878 
1879         veth_mtu=1500                            1879         veth_mtu=1500
1880         vti_mtu=$((veth_mtu - 40))               1880         vti_mtu=$((veth_mtu - 40))
1881                                                  1881 
1882         #                                UDP     1882         #                                UDP   SPI   SN   IV  ICV   pad length   next header
1883         esp_payload_rfc4106=$((vti_mtu - 8       1883         esp_payload_rfc4106=$((vti_mtu - 8   - 4   - 4  - 8 - 16  - 1          - 1))
1884         ping_payload=$((esp_payload_rfc4106 -    1884         ping_payload=$((esp_payload_rfc4106 - 48))
1885                                                  1885 
1886         mtu "${ns_a}"  veth_A-R1 ${veth_mtu}     1886         mtu "${ns_a}"  veth_A-R1 ${veth_mtu}
1887         mtu "${ns_r1}" veth_R1-A ${veth_mtu}     1887         mtu "${ns_r1}" veth_R1-A ${veth_mtu}
1888         mtu "${ns_b}"  veth_B-R1 ${veth_mtu}     1888         mtu "${ns_b}"  veth_B-R1 ${veth_mtu}
1889         mtu "${ns_r1}" veth_R1-B ${veth_mtu}     1889         mtu "${ns_r1}" veth_R1-B ${veth_mtu}
1890                                                  1890 
1891         # mtu "${ns_a}" vti6_a ${vti_mtu}        1891         # mtu "${ns_a}" vti6_a ${vti_mtu}
1892         # mtu "${ns_b}" vti6_b ${vti_mtu}        1892         # mtu "${ns_b}" vti6_b ${vti_mtu}
1893                                                  1893 
1894         run_cmd ${ns_a} ${ping6} -q -M want -    1894         run_cmd ${ns_a} ${ping6} -q -M want -i 0.1 -w 1 -s ${ping_payload} ${tunnel6_b_addr}
1895                                                  1895 
1896         # Check that exception was not create    1896         # Check that exception was not created
1897         pmtu="$(route_get_dst_pmtu_from_excep    1897         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1898         check_pmtu_value "" "${pmtu}" "sendin    1898         check_pmtu_value "" "${pmtu}" "sending packet smaller than PMTU (IP payload length ${esp_payload_rfc4106})" || return 1
1899                                                  1899 
1900         # Now decrease link layer MTU by 8 by    1900         # Now decrease link layer MTU by 8 bytes on R1, check that exception is created
1901         # with the right PMTU value              1901         # with the right PMTU value
1902         mtu "${ns_r1}" veth_R1-B $((veth_mtu     1902         mtu "${ns_r1}" veth_R1-B $((veth_mtu - 8))
1903         run_cmd ${ns_a} ${ping6} -q -M want -    1903         run_cmd ${ns_a} ${ping6} -q -M want -i 0.1 -w 1 -s $((ping_payload)) ${tunnel6_b_addr}
1904         pmtu="$(route_get_dst_pmtu_from_excep    1904         pmtu="$(route_get_dst_pmtu_from_exception "${ns_a}" ${tunnel6_b_addr})"
1905         check_pmtu_value "$((esp_payload_rfc4    1905         check_pmtu_value "$((esp_payload_rfc4106 - 8))" "${pmtu}" "exceeding PMTU (IP payload length $((esp_payload_rfc4106)))"
1906                                                  1906 
1907 }                                                1907 }
1908                                                  1908 
1909 test_pmtu_vti4_default_mtu() {                   1909 test_pmtu_vti4_default_mtu() {
1910         setup namespaces veth vti4 || return     1910         setup namespaces veth vti4 || return $ksft_skip
1911                                                  1911 
1912         # Check that MTU of vti device is MTU    1912         # Check that MTU of vti device is MTU of veth minus IPv4 header length
1913         veth_mtu="$(link_get_mtu "${ns_a}" ve    1913         veth_mtu="$(link_get_mtu "${ns_a}" veth_a)"
1914         vti4_mtu="$(link_get_mtu "${ns_a}" vt    1914         vti4_mtu="$(link_get_mtu "${ns_a}" vti4_a)"
1915         if [ $((veth_mtu - vti4_mtu)) -ne 20     1915         if [ $((veth_mtu - vti4_mtu)) -ne 20 ]; then
1916                 err "  vti MTU ${vti4_mtu} is    1916                 err "  vti MTU ${vti4_mtu} is not veth MTU ${veth_mtu} minus IPv4 header length"
1917                 return 1                         1917                 return 1
1918         fi                                       1918         fi
1919 }                                                1919 }
1920                                                  1920 
1921 test_pmtu_vti6_default_mtu() {                   1921 test_pmtu_vti6_default_mtu() {
1922         setup namespaces veth vti6 || return     1922         setup namespaces veth vti6 || return $ksft_skip
1923                                                  1923 
1924         # Check that MTU of vti device is MTU    1924         # Check that MTU of vti device is MTU of veth minus IPv6 header length
1925         veth_mtu="$(link_get_mtu "${ns_a}" ve    1925         veth_mtu="$(link_get_mtu "${ns_a}" veth_a)"
1926         vti6_mtu="$(link_get_mtu "${ns_a}" vt    1926         vti6_mtu="$(link_get_mtu "${ns_a}" vti6_a)"
1927         if [ $((veth_mtu - vti6_mtu)) -ne 40     1927         if [ $((veth_mtu - vti6_mtu)) -ne 40 ]; then
1928                 err "  vti MTU ${vti6_mtu} is    1928                 err "  vti MTU ${vti6_mtu} is not veth MTU ${veth_mtu} minus IPv6 header length"
1929                 return 1                         1929                 return 1
1930         fi                                       1930         fi
1931 }                                                1931 }
1932                                                  1932 
1933 test_pmtu_vti4_link_add_mtu() {                  1933 test_pmtu_vti4_link_add_mtu() {
1934         setup namespaces || return $ksft_skip    1934         setup namespaces || return $ksft_skip
1935                                                  1935 
1936         run_cmd ${ns_a} ip link add vti4_a ty    1936         run_cmd ${ns_a} ip link add vti4_a type vti local ${veth4_a_addr} remote ${veth4_b_addr} key 10
1937         [ $? -ne 0 ] && err "  vti not suppor    1937         [ $? -ne 0 ] && err "  vti not supported" && return $ksft_skip
1938         run_cmd ${ns_a} ip link del vti4_a       1938         run_cmd ${ns_a} ip link del vti4_a
1939                                                  1939 
1940         fail=0                                   1940         fail=0
1941                                                  1941 
1942         min=68                                   1942         min=68
1943         max=$((65535 - 20))                      1943         max=$((65535 - 20))
1944         # Check invalid values first             1944         # Check invalid values first
1945         for v in $((min - 1)) $((max + 1)); d    1945         for v in $((min - 1)) $((max + 1)); do
1946                 run_cmd ${ns_a} ip link add v    1946                 run_cmd ${ns_a} ip link add vti4_a mtu ${v} type vti local ${veth4_a_addr} remote ${veth4_b_addr} key 10
1947                 # This can fail, or MTU can b    1947                 # This can fail, or MTU can be adjusted to a proper value
1948                 [ $? -ne 0 ] && continue         1948                 [ $? -ne 0 ] && continue
1949                 mtu="$(link_get_mtu "${ns_a}"    1949                 mtu="$(link_get_mtu "${ns_a}" vti4_a)"
1950                 if [ ${mtu} -lt ${min} -o ${m    1950                 if [ ${mtu} -lt ${min} -o ${mtu} -gt ${max} ]; then
1951                         err "  vti tunnel cre    1951                         err "  vti tunnel created with invalid MTU ${mtu}"
1952                         fail=1                   1952                         fail=1
1953                 fi                               1953                 fi
1954                 run_cmd ${ns_a} ip link del v    1954                 run_cmd ${ns_a} ip link del vti4_a
1955         done                                     1955         done
1956                                                  1956 
1957         # Now check valid values                 1957         # Now check valid values
1958         for v in ${min} 1300 ${max}; do          1958         for v in ${min} 1300 ${max}; do
1959                 run_cmd ${ns_a} ip link add v    1959                 run_cmd ${ns_a} ip link add vti4_a mtu ${v} type vti local ${veth4_a_addr} remote ${veth4_b_addr} key 10
1960                 mtu="$(link_get_mtu "${ns_a}"    1960                 mtu="$(link_get_mtu "${ns_a}" vti4_a)"
1961                 run_cmd ${ns_a} ip link del v    1961                 run_cmd ${ns_a} ip link del vti4_a
1962                 if [ "${mtu}" != "${v}" ]; th    1962                 if [ "${mtu}" != "${v}" ]; then
1963                         err "  vti MTU ${mtu}    1963                         err "  vti MTU ${mtu} doesn't match configured value ${v}"
1964                         fail=1                   1964                         fail=1
1965                 fi                               1965                 fi
1966         done                                     1966         done
1967                                                  1967 
1968         return ${fail}                           1968         return ${fail}
1969 }                                                1969 }
1970                                                  1970 
1971 test_pmtu_vti6_link_add_mtu() {                  1971 test_pmtu_vti6_link_add_mtu() {
1972         setup namespaces || return $ksft_skip    1972         setup namespaces || return $ksft_skip
1973                                                  1973 
1974         run_cmd ${ns_a} ip link add vti6_a ty    1974         run_cmd ${ns_a} ip link add vti6_a type vti6 local ${veth6_a_addr} remote ${veth6_b_addr} key 10
1975         [ $? -ne 0 ] && err "  vti6 not suppo    1975         [ $? -ne 0 ] && err "  vti6 not supported" && return $ksft_skip
1976         run_cmd ${ns_a} ip link del vti6_a       1976         run_cmd ${ns_a} ip link del vti6_a
1977                                                  1977 
1978         fail=0                                   1978         fail=0
1979                                                  1979 
1980         min=68                  # vti6 can ca    1980         min=68                  # vti6 can carry IPv4 packets too
1981         max=$((65535 - 40))                      1981         max=$((65535 - 40))
1982         # Check invalid values first             1982         # Check invalid values first
1983         for v in $((min - 1)) $((max + 1)); d    1983         for v in $((min - 1)) $((max + 1)); do
1984                 run_cmd ${ns_a} ip link add v    1984                 run_cmd ${ns_a} ip link add vti6_a mtu ${v} type vti6 local ${veth6_a_addr} remote ${veth6_b_addr} key 10
1985                 # This can fail, or MTU can b    1985                 # This can fail, or MTU can be adjusted to a proper value
1986                 [ $? -ne 0 ] && continue         1986                 [ $? -ne 0 ] && continue
1987                 mtu="$(link_get_mtu "${ns_a}"    1987                 mtu="$(link_get_mtu "${ns_a}" vti6_a)"
1988                 if [ ${mtu} -lt ${min} -o ${m    1988                 if [ ${mtu} -lt ${min} -o ${mtu} -gt ${max} ]; then
1989                         err "  vti6 tunnel cr    1989                         err "  vti6 tunnel created with invalid MTU ${v}"
1990                         fail=1                   1990                         fail=1
1991                 fi                               1991                 fi
1992                 run_cmd ${ns_a} ip link del v    1992                 run_cmd ${ns_a} ip link del vti6_a
1993         done                                     1993         done
1994                                                  1994 
1995         # Now check valid values                 1995         # Now check valid values
1996         for v in 68 1280 1300 $((65535 - 40))    1996         for v in 68 1280 1300 $((65535 - 40)); do
1997                 run_cmd ${ns_a} ip link add v    1997                 run_cmd ${ns_a} ip link add vti6_a mtu ${v} type vti6 local ${veth6_a_addr} remote ${veth6_b_addr} key 10
1998                 mtu="$(link_get_mtu "${ns_a}"    1998                 mtu="$(link_get_mtu "${ns_a}" vti6_a)"
1999                 run_cmd ${ns_a} ip link del v    1999                 run_cmd ${ns_a} ip link del vti6_a
2000                 if [ "${mtu}" != "${v}" ]; th    2000                 if [ "${mtu}" != "${v}" ]; then
2001                         err "  vti6 MTU ${mtu    2001                         err "  vti6 MTU ${mtu} doesn't match configured value ${v}"
2002                         fail=1                   2002                         fail=1
2003                 fi                               2003                 fi
2004         done                                     2004         done
2005                                                  2005 
2006         return ${fail}                           2006         return ${fail}
2007 }                                                2007 }
2008                                                  2008 
2009 test_pmtu_vti6_link_change_mtu() {               2009 test_pmtu_vti6_link_change_mtu() {
2010         setup namespaces || return $ksft_skip    2010         setup namespaces || return $ksft_skip
2011                                                  2011 
2012         run_cmd ${ns_a} ip link add dummy0 mt    2012         run_cmd ${ns_a} ip link add dummy0 mtu 1500 type dummy
2013         [ $? -ne 0 ] && err "  dummy not supp    2013         [ $? -ne 0 ] && err "  dummy not supported" && return $ksft_skip
2014         run_cmd ${ns_a} ip link add dummy1 mt    2014         run_cmd ${ns_a} ip link add dummy1 mtu 3000 type dummy
2015         run_cmd ${ns_a} ip link set dummy0 up    2015         run_cmd ${ns_a} ip link set dummy0 up
2016         run_cmd ${ns_a} ip link set dummy1 up    2016         run_cmd ${ns_a} ip link set dummy1 up
2017                                                  2017 
2018         run_cmd ${ns_a} ip addr add ${dummy6_    2018         run_cmd ${ns_a} ip addr add ${dummy6_0_prefix}1/${dummy6_mask} dev dummy0
2019         run_cmd ${ns_a} ip addr add ${dummy6_    2019         run_cmd ${ns_a} ip addr add ${dummy6_1_prefix}1/${dummy6_mask} dev dummy1
2020                                                  2020 
2021         fail=0                                   2021         fail=0
2022                                                  2022 
2023         # Create vti6 interface bound to devi    2023         # Create vti6 interface bound to device, passing MTU, check it
2024         run_cmd ${ns_a} ip link add vti6_a mt    2024         run_cmd ${ns_a} ip link add vti6_a mtu 1300 type vti6 remote ${dummy6_0_prefix}2 local ${dummy6_0_prefix}1
2025         mtu="$(link_get_mtu "${ns_a}" vti6_a)    2025         mtu="$(link_get_mtu "${ns_a}" vti6_a)"
2026         if [ ${mtu} -ne 1300 ]; then             2026         if [ ${mtu} -ne 1300 ]; then
2027                 err "  vti6 MTU ${mtu} doesn'    2027                 err "  vti6 MTU ${mtu} doesn't match configured value 1300"
2028                 fail=1                           2028                 fail=1
2029         fi                                       2029         fi
2030                                                  2030 
2031         # Move to another device with differe    2031         # Move to another device with different MTU, without passing MTU, check
2032         # MTU is adjusted                        2032         # MTU is adjusted
2033         run_cmd ${ns_a} ip link set vti6_a ty    2033         run_cmd ${ns_a} ip link set vti6_a type vti6 remote ${dummy6_1_prefix}2 local ${dummy6_1_prefix}1
2034         mtu="$(link_get_mtu "${ns_a}" vti6_a)    2034         mtu="$(link_get_mtu "${ns_a}" vti6_a)"
2035         if [ ${mtu} -ne $((3000 - 40)) ]; the    2035         if [ ${mtu} -ne $((3000 - 40)) ]; then
2036                 err "  vti MTU ${mtu} is not     2036                 err "  vti MTU ${mtu} is not dummy MTU 3000 minus IPv6 header length"
2037                 fail=1                           2037                 fail=1
2038         fi                                       2038         fi
2039                                                  2039 
2040         # Move it back, passing MTU, check MT    2040         # Move it back, passing MTU, check MTU is not overridden
2041         run_cmd ${ns_a} ip link set vti6_a mt    2041         run_cmd ${ns_a} ip link set vti6_a mtu 1280 type vti6 remote ${dummy6_0_prefix}2 local ${dummy6_0_prefix}1
2042         mtu="$(link_get_mtu "${ns_a}" vti6_a)    2042         mtu="$(link_get_mtu "${ns_a}" vti6_a)"
2043         if [ ${mtu} -ne 1280 ]; then             2043         if [ ${mtu} -ne 1280 ]; then
2044                 err "  vti6 MTU ${mtu} doesn'    2044                 err "  vti6 MTU ${mtu} doesn't match configured value 1280"
2045                 fail=1                           2045                 fail=1
2046         fi                                       2046         fi
2047                                                  2047 
2048         return ${fail}                           2048         return ${fail}
2049 }                                                2049 }
2050                                                  2050 
2051 check_command() {                                2051 check_command() {
2052         cmd=${1}                                 2052         cmd=${1}
2053                                                  2053 
2054         if ! which ${cmd} > /dev/null 2>&1; t    2054         if ! which ${cmd} > /dev/null 2>&1; then
2055                 err "  missing required comma    2055                 err "  missing required command: '${cmd}'"
2056                 return 1                         2056                 return 1
2057         fi                                       2057         fi
2058         return 0                                 2058         return 0
2059 }                                                2059 }
2060                                                  2060 
2061 check_running() {                                2061 check_running() {
2062         pid=${1}                                 2062         pid=${1}
2063         cmd=${2}                                 2063         cmd=${2}
2064                                                  2064 
2065         [ "$(cat /proc/${pid}/cmdline 2>/dev/    2065         [ "$(cat /proc/${pid}/cmdline 2>/dev/null | tr -d '\0')" = "{cmd}" ]
2066 }                                                2066 }
2067                                                  2067 
2068 test_cleanup_vxlanX_exception() {                2068 test_cleanup_vxlanX_exception() {
2069         outer="${1}"                             2069         outer="${1}"
2070         encap="vxlan"                            2070         encap="vxlan"
2071         ll_mtu=4000                              2071         ll_mtu=4000
2072                                                  2072 
2073         check_command taskset || return $ksft    2073         check_command taskset || return $ksft_skip
2074         cpu_list=$(grep -m 2 processor /proc/    2074         cpu_list=$(grep -m 2 processor /proc/cpuinfo | cut -d ' ' -f 2)
2075                                                  2075 
2076         setup namespaces routing ${encap}${ou    2076         setup namespaces routing ${encap}${outer} || return $ksft_skip
2077         trace "${ns_a}" ${encap}_a   "${ns_b}    2077         trace "${ns_a}" ${encap}_a   "${ns_b}"  ${encap}_b \
2078               "${ns_a}" veth_A-R1    "${ns_r1    2078               "${ns_a}" veth_A-R1    "${ns_r1}" veth_R1-A \
2079               "${ns_b}" veth_B-R1    "${ns_r1    2079               "${ns_b}" veth_B-R1    "${ns_r1}" veth_R1-B
2080                                                  2080 
2081         # Create route exception by exceeding    2081         # Create route exception by exceeding link layer MTU
2082         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu}    2082         mtu "${ns_a}"  veth_A-R1 $((${ll_mtu} + 1000))
2083         mtu "${ns_r1}" veth_R1-A $((${ll_mtu}    2083         mtu "${ns_r1}" veth_R1-A $((${ll_mtu} + 1000))
2084         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}       2084         mtu "${ns_b}"  veth_B-R1 ${ll_mtu}
2085         mtu "${ns_r1}" veth_R1-B ${ll_mtu}       2085         mtu "${ns_r1}" veth_R1-B ${ll_mtu}
2086                                                  2086 
2087         mtu "${ns_a}" ${encap}_a $((${ll_mtu}    2087         mtu "${ns_a}" ${encap}_a $((${ll_mtu} + 1000))
2088         mtu "${ns_b}" ${encap}_b $((${ll_mtu}    2088         mtu "${ns_b}" ${encap}_b $((${ll_mtu} + 1000))
2089                                                  2089 
2090         # Fill exception cache for multiple C    2090         # Fill exception cache for multiple CPUs (2)
2091         # we can always use inner IPv4 for th    2091         # we can always use inner IPv4 for that
2092         for cpu in ${cpu_list}; do               2092         for cpu in ${cpu_list}; do
2093                 run_cmd taskset --cpu-list ${    2093                 run_cmd taskset --cpu-list ${cpu} ${ns_a} ping -q -M want -i 0.1 -w 1 -s $((${ll_mtu} + 500)) ${tunnel4_b_addr}
2094         done                                     2094         done
2095                                                  2095 
2096         ${ns_a} ip link del dev veth_A-R1 &      2096         ${ns_a} ip link del dev veth_A-R1 &
2097         iplink_pid=$!                            2097         iplink_pid=$!
2098         for i in $(seq 1 20); do                 2098         for i in $(seq 1 20); do
2099                 check_running ${iplink_pid} "    2099                 check_running ${iplink_pid} "iplinkdeldevveth_A-R1" || return 0
2100                 sleep 0.1                        2100                 sleep 0.1
2101         done                                     2101         done
2102         err "  can't delete veth device in a     2102         err "  can't delete veth device in a timely manner, PMTU dst likely leaked"
2103         return 1                                 2103         return 1
2104 }                                                2104 }
2105                                                  2105 
2106 test_cleanup_ipv6_exception() {                  2106 test_cleanup_ipv6_exception() {
2107         test_cleanup_vxlanX_exception 6          2107         test_cleanup_vxlanX_exception 6
2108 }                                                2108 }
2109                                                  2109 
2110 test_cleanup_ipv4_exception() {                  2110 test_cleanup_ipv4_exception() {
2111         test_cleanup_vxlanX_exception 4          2111         test_cleanup_vxlanX_exception 4
2112 }                                                2112 }
2113                                                  2113 
2114 run_test() {                                     2114 run_test() {
2115         (                                        2115         (
2116         tname="$1"                               2116         tname="$1"
2117         tdesc="$2"                               2117         tdesc="$2"
2118                                                  2118 
2119         unset IFS                                2119         unset IFS
2120                                                  2120 
2121         # Since cleanup() relies on variables    2121         # Since cleanup() relies on variables modified by this subshell, it
2122         # has to run in this context.            2122         # has to run in this context.
2123         trap cleanup EXIT                        2123         trap cleanup EXIT
2124                                                  2124 
2125         if [ "$VERBOSE" = "1" ]; then            2125         if [ "$VERBOSE" = "1" ]; then
2126                 printf "\n###################    2126                 printf "\n##########################################################################\n\n"
2127         fi                                       2127         fi
2128                                                  2128 
2129         eval test_${tname}                       2129         eval test_${tname}
2130         ret=$?                                   2130         ret=$?
2131                                                  2131 
2132         if [ $ret -eq 0 ]; then                  2132         if [ $ret -eq 0 ]; then
2133                 printf "TEST: %-60s  [ OK ]\n    2133                 printf "TEST: %-60s  [ OK ]\n" "${tdesc}"
2134         elif [ $ret -eq 1 ]; then                2134         elif [ $ret -eq 1 ]; then
2135                 printf "TEST: %-60s  [FAIL]\n    2135                 printf "TEST: %-60s  [FAIL]\n" "${tdesc}"
2136                 if [ "${PAUSE_ON_FAIL}" = "ye    2136                 if [ "${PAUSE_ON_FAIL}" = "yes" ]; then
2137                         echo                     2137                         echo
2138                         echo "Pausing. Hit en    2138                         echo "Pausing. Hit enter to continue"
2139                         read a                   2139                         read a
2140                 fi                               2140                 fi
2141                 err_flush                        2141                 err_flush
2142                 exit 1                           2142                 exit 1
2143         elif [ $ret -eq $ksft_skip ]; then       2143         elif [ $ret -eq $ksft_skip ]; then
2144                 printf "TEST: %-60s  [SKIP]\n    2144                 printf "TEST: %-60s  [SKIP]\n" "${tdesc}"
2145                 err_flush                        2145                 err_flush
2146         fi                                       2146         fi
2147                                                  2147 
2148         return $ret                              2148         return $ret
2149         )                                        2149         )
2150         ret=$?                                   2150         ret=$?
2151         case $ret in                             2151         case $ret in
2152                 0)                               2152                 0)
2153                         all_skipped=false        2153                         all_skipped=false
2154                         [ $exitcode -eq $ksft    2154                         [ $exitcode -eq $ksft_skip ] && exitcode=0
2155                 ;;                               2155                 ;;
2156                 $ksft_skip)                      2156                 $ksft_skip)
2157                         [ $all_skipped = true    2157                         [ $all_skipped = true ] && exitcode=$ksft_skip
2158                 ;;                               2158                 ;;
2159                 *)                               2159                 *)
2160                         all_skipped=false        2160                         all_skipped=false
2161                         exitcode=1               2161                         exitcode=1
2162                 ;;                               2162                 ;;
2163         esac                                     2163         esac
2164                                                  2164 
2165         return $ret                              2165         return $ret
2166 }                                                2166 }
2167                                                  2167 
2168 run_test_nh() {                                  2168 run_test_nh() {
2169         tname="$1"                               2169         tname="$1"
2170         tdesc="$2"                               2170         tdesc="$2"
2171                                                  2171 
2172         USE_NH=yes                               2172         USE_NH=yes
2173         run_test "${tname}" "${tdesc} - nexth    2173         run_test "${tname}" "${tdesc} - nexthop objects"
2174         USE_NH=no                                2174         USE_NH=no
2175 }                                                2175 }
2176                                                  2176 
2177 test_list_flush_ipv4_exception() {               2177 test_list_flush_ipv4_exception() {
2178         setup namespaces routing || return $k    2178         setup namespaces routing || return $ksft_skip
2179         trace "${ns_a}"  veth_A-R1    "${ns_r    2179         trace "${ns_a}"  veth_A-R1    "${ns_r1}" veth_R1-A \
2180               "${ns_r1}" veth_R1-B    "${ns_b    2180               "${ns_r1}" veth_R1-B    "${ns_b}"  veth_B-R1 \
2181               "${ns_a}"  veth_A-R2    "${ns_r    2181               "${ns_a}"  veth_A-R2    "${ns_r2}" veth_R2-A \
2182               "${ns_r2}" veth_R2-B    "${ns_b    2182               "${ns_r2}" veth_R2-B    "${ns_b}"  veth_B-R2
2183                                                  2183 
2184         dst_prefix1="${prefix4}.${b_r1}."        2184         dst_prefix1="${prefix4}.${b_r1}."
2185         dst2="${prefix4}.${b_r2}.1"              2185         dst2="${prefix4}.${b_r2}.1"
2186                                                  2186 
2187         # Set up initial MTU values              2187         # Set up initial MTU values
2188         mtu "${ns_a}"  veth_A-R1 2000            2188         mtu "${ns_a}"  veth_A-R1 2000
2189         mtu "${ns_r1}" veth_R1-A 2000            2189         mtu "${ns_r1}" veth_R1-A 2000
2190         mtu "${ns_r1}" veth_R1-B 1500            2190         mtu "${ns_r1}" veth_R1-B 1500
2191         mtu "${ns_b}"  veth_B-R1 1500            2191         mtu "${ns_b}"  veth_B-R1 1500
2192                                                  2192 
2193         mtu "${ns_a}"  veth_A-R2 2000            2193         mtu "${ns_a}"  veth_A-R2 2000
2194         mtu "${ns_r2}" veth_R2-A 2000            2194         mtu "${ns_r2}" veth_R2-A 2000
2195         mtu "${ns_r2}" veth_R2-B 1500            2195         mtu "${ns_r2}" veth_R2-B 1500
2196         mtu "${ns_b}"  veth_B-R2 1500            2196         mtu "${ns_b}"  veth_B-R2 1500
2197                                                  2197 
2198         fail=0                                   2198         fail=0
2199                                                  2199 
2200         # Add 100 addresses for veth endpoint    2200         # Add 100 addresses for veth endpoint on B reached by default A route
2201         for i in $(seq 100 199); do              2201         for i in $(seq 100 199); do
2202                 run_cmd ${ns_b} ip addr add "    2202                 run_cmd ${ns_b} ip addr add "${dst_prefix1}${i}" dev veth_B-R1
2203         done                                     2203         done
2204                                                  2204 
2205         # Create 100 cached route exceptions     2205         # Create 100 cached route exceptions for path via R1, one via R2. Note
2206         # that with IPv4 we need to actually     2206         # that with IPv4 we need to actually cause a route lookup that matches
2207         # the exception caused by ICMP, in or    2207         # the exception caused by ICMP, in order to actually have a cached
2208         # route, so we need to ping each dest    2208         # route, so we need to ping each destination twice
2209         for i in $(seq 100 199); do              2209         for i in $(seq 100 199); do
2210                 run_cmd ${ns_a} ping -q -M wa    2210                 run_cmd ${ns_a} ping -q -M want -i 0.1 -c 2 -s 1800 "${dst_prefix1}${i}"
2211         done                                     2211         done
2212         run_cmd ${ns_a} ping -q -M want -i 0.    2212         run_cmd ${ns_a} ping -q -M want -i 0.1 -c 2 -s 1800 "${dst2}"
2213                                                  2213 
2214         if [ "$(${ns_a} ip -oneline route lis    2214         if [ "$(${ns_a} ip -oneline route list cache | wc -l)" -ne 101 ]; then
2215                 err "  can't list cached exce    2215                 err "  can't list cached exceptions"
2216                 fail=1                           2216                 fail=1
2217         fi                                       2217         fi
2218                                                  2218 
2219         run_cmd ${ns_a} ip route flush cache     2219         run_cmd ${ns_a} ip route flush cache
2220         pmtu1="$(route_get_dst_pmtu_from_exce    2220         pmtu1="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst_prefix}1)"
2221         pmtu2="$(route_get_dst_pmtu_from_exce    2221         pmtu2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst_prefix}2)"
2222         if [ -n "${pmtu1}" ] || [ -n "${pmtu2    2222         if [ -n "${pmtu1}" ] || [ -n "${pmtu2}" ] || \
2223            [ -n "$(${ns_a} ip route list cach    2223            [ -n "$(${ns_a} ip route list cache)" ]; then
2224                 err "  can't flush cached exc    2224                 err "  can't flush cached exceptions"
2225                 fail=1                           2225                 fail=1
2226         fi                                       2226         fi
2227                                                  2227 
2228         return ${fail}                           2228         return ${fail}
2229 }                                                2229 }
2230                                                  2230 
2231 test_list_flush_ipv6_exception() {               2231 test_list_flush_ipv6_exception() {
2232         setup namespaces routing || return $k    2232         setup namespaces routing || return $ksft_skip
2233         trace "${ns_a}"  veth_A-R1    "${ns_r    2233         trace "${ns_a}"  veth_A-R1    "${ns_r1}" veth_R1-A \
2234               "${ns_r1}" veth_R1-B    "${ns_b    2234               "${ns_r1}" veth_R1-B    "${ns_b}"  veth_B-R1 \
2235               "${ns_a}"  veth_A-R2    "${ns_r    2235               "${ns_a}"  veth_A-R2    "${ns_r2}" veth_R2-A \
2236               "${ns_r2}" veth_R2-B    "${ns_b    2236               "${ns_r2}" veth_R2-B    "${ns_b}"  veth_B-R2
2237                                                  2237 
2238         dst_prefix1="${prefix6}:${b_r1}::"       2238         dst_prefix1="${prefix6}:${b_r1}::"
2239         dst2="${prefix6}:${b_r2}::1"             2239         dst2="${prefix6}:${b_r2}::1"
2240                                                  2240 
2241         # Set up initial MTU values              2241         # Set up initial MTU values
2242         mtu "${ns_a}"  veth_A-R1 2000            2242         mtu "${ns_a}"  veth_A-R1 2000
2243         mtu "${ns_r1}" veth_R1-A 2000            2243         mtu "${ns_r1}" veth_R1-A 2000
2244         mtu "${ns_r1}" veth_R1-B 1500            2244         mtu "${ns_r1}" veth_R1-B 1500
2245         mtu "${ns_b}"  veth_B-R1 1500            2245         mtu "${ns_b}"  veth_B-R1 1500
2246                                                  2246 
2247         mtu "${ns_a}"  veth_A-R2 2000            2247         mtu "${ns_a}"  veth_A-R2 2000
2248         mtu "${ns_r2}" veth_R2-A 2000            2248         mtu "${ns_r2}" veth_R2-A 2000
2249         mtu "${ns_r2}" veth_R2-B 1500            2249         mtu "${ns_r2}" veth_R2-B 1500
2250         mtu "${ns_b}"  veth_B-R2 1500            2250         mtu "${ns_b}"  veth_B-R2 1500
2251                                                  2251 
2252         fail=0                                   2252         fail=0
2253                                                  2253 
2254         # Add 100 addresses for veth endpoint    2254         # Add 100 addresses for veth endpoint on B reached by default A route
2255         for i in $(seq 100 199); do              2255         for i in $(seq 100 199); do
2256                 run_cmd ${ns_b} ip addr add "    2256                 run_cmd ${ns_b} ip addr add "${dst_prefix1}${i}" dev veth_B-R1
2257         done                                     2257         done
2258                                                  2258 
2259         # Create 100 cached route exceptions     2259         # Create 100 cached route exceptions for path via R1, one via R2
2260         for i in $(seq 100 199); do              2260         for i in $(seq 100 199); do
2261                 run_cmd ${ns_a} ping -q -M wa    2261                 run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s 1800 "${dst_prefix1}${i}"
2262         done                                     2262         done
2263         run_cmd ${ns_a} ping -q -M want -i 0.    2263         run_cmd ${ns_a} ping -q -M want -i 0.1 -w 1 -s 1800 "${dst2}"
2264         if [ "$(${ns_a} ip -oneline -6 route     2264         if [ "$(${ns_a} ip -oneline -6 route list cache | wc -l)" -ne 101 ]; then
2265                 err "  can't list cached exce    2265                 err "  can't list cached exceptions"
2266                 fail=1                           2266                 fail=1
2267         fi                                       2267         fi
2268                                                  2268 
2269         run_cmd ${ns_a} ip -6 route flush cac    2269         run_cmd ${ns_a} ip -6 route flush cache
2270         pmtu1="$(route_get_dst_pmtu_from_exce    2270         pmtu1="$(route_get_dst_pmtu_from_exception "${ns_a}" "${dst_prefix1}100")"
2271         pmtu2="$(route_get_dst_pmtu_from_exce    2271         pmtu2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
2272         if [ -n "${pmtu1}" ] || [ -n "${pmtu2    2272         if [ -n "${pmtu1}" ] || [ -n "${pmtu2}" ] || \
2273            [ -n "$(${ns_a} ip -6 route list c    2273            [ -n "$(${ns_a} ip -6 route list cache)" ]; then
2274                 err "  can't flush cached exc    2274                 err "  can't flush cached exceptions"
2275                 fail=1                           2275                 fail=1
2276         fi                                       2276         fi
2277                                                  2277 
2278         return ${fail}                           2278         return ${fail}
2279 }                                                2279 }
2280                                                  2280 
2281 test_pmtu_ipvX_route_change() {                  2281 test_pmtu_ipvX_route_change() {
2282         family=${1}                              2282         family=${1}
2283                                                  2283 
2284         setup namespaces routing || return 2     2284         setup namespaces routing || return 2
2285         trace "${ns_a}"  veth_A-R1    "${ns_r    2285         trace "${ns_a}"  veth_A-R1    "${ns_r1}" veth_R1-A \
2286               "${ns_r1}" veth_R1-B    "${ns_b    2286               "${ns_r1}" veth_R1-B    "${ns_b}"  veth_B-R1 \
2287               "${ns_a}"  veth_A-R2    "${ns_r    2287               "${ns_a}"  veth_A-R2    "${ns_r2}" veth_R2-A \
2288               "${ns_r2}" veth_R2-B    "${ns_b    2288               "${ns_r2}" veth_R2-B    "${ns_b}"  veth_B-R2
2289                                                  2289 
2290         if [ ${family} -eq 4 ]; then             2290         if [ ${family} -eq 4 ]; then
2291                 ping=ping                        2291                 ping=ping
2292                 dst1="${prefix4}.${b_r1}.1"      2292                 dst1="${prefix4}.${b_r1}.1"
2293                 dst2="${prefix4}.${b_r2}.1"      2293                 dst2="${prefix4}.${b_r2}.1"
2294                 gw="${prefix4}.${a_r1}.2"        2294                 gw="${prefix4}.${a_r1}.2"
2295         else                                     2295         else
2296                 ping=${ping6}                    2296                 ping=${ping6}
2297                 dst1="${prefix6}:${b_r1}::1"     2297                 dst1="${prefix6}:${b_r1}::1"
2298                 dst2="${prefix6}:${b_r2}::1"     2298                 dst2="${prefix6}:${b_r2}::1"
2299                 gw="${prefix6}:${a_r1}::2"       2299                 gw="${prefix6}:${a_r1}::2"
2300         fi                                       2300         fi
2301                                                  2301 
2302         # Set up initial MTU values              2302         # Set up initial MTU values
2303         mtu "${ns_a}"  veth_A-R1 2000            2303         mtu "${ns_a}"  veth_A-R1 2000
2304         mtu "${ns_r1}" veth_R1-A 2000            2304         mtu "${ns_r1}" veth_R1-A 2000
2305         mtu "${ns_r1}" veth_R1-B 1400            2305         mtu "${ns_r1}" veth_R1-B 1400
2306         mtu "${ns_b}"  veth_B-R1 1400            2306         mtu "${ns_b}"  veth_B-R1 1400
2307                                                  2307 
2308         mtu "${ns_a}"  veth_A-R2 2000            2308         mtu "${ns_a}"  veth_A-R2 2000
2309         mtu "${ns_r2}" veth_R2-A 2000            2309         mtu "${ns_r2}" veth_R2-A 2000
2310         mtu "${ns_r2}" veth_R2-B 1500            2310         mtu "${ns_r2}" veth_R2-B 1500
2311         mtu "${ns_b}"  veth_B-R2 1500            2311         mtu "${ns_b}"  veth_B-R2 1500
2312                                                  2312 
2313         # Create route exceptions                2313         # Create route exceptions
2314         run_cmd ${ns_a} ${ping} -q -M want -i    2314         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s 1800 ${dst1}
2315         run_cmd ${ns_a} ${ping} -q -M want -i    2315         run_cmd ${ns_a} ${ping} -q -M want -i 0.1 -w 1 -s 1800 ${dst2}
2316                                                  2316 
2317         # Check that exceptions have been cre    2317         # Check that exceptions have been created with the correct PMTU
2318         pmtu_1="$(route_get_dst_pmtu_from_exc    2318         pmtu_1="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst1})"
2319         check_pmtu_value "1400" "${pmtu_1}" "    2319         check_pmtu_value "1400" "${pmtu_1}" "exceeding MTU" || return 1
2320         pmtu_2="$(route_get_dst_pmtu_from_exc    2320         pmtu_2="$(route_get_dst_pmtu_from_exception "${ns_a}" ${dst2})"
2321         check_pmtu_value "1500" "${pmtu_2}" "    2321         check_pmtu_value "1500" "${pmtu_2}" "exceeding MTU" || return 1
2322                                                  2322 
2323         # Replace the route from A to R1         2323         # Replace the route from A to R1
2324         run_cmd ${ns_a} ip route change defau    2324         run_cmd ${ns_a} ip route change default via ${gw}
2325                                                  2325 
2326         # Delete the device in A                 2326         # Delete the device in A
2327         run_cmd ${ns_a} ip link del "veth_A-R    2327         run_cmd ${ns_a} ip link del "veth_A-R1"
2328 }                                                2328 }
2329                                                  2329 
2330 test_pmtu_ipv4_route_change() {                  2330 test_pmtu_ipv4_route_change() {
2331         test_pmtu_ipvX_route_change 4            2331         test_pmtu_ipvX_route_change 4
2332 }                                                2332 }
2333                                                  2333 
2334 test_pmtu_ipv6_route_change() {                  2334 test_pmtu_ipv6_route_change() {
2335         test_pmtu_ipvX_route_change 6            2335         test_pmtu_ipvX_route_change 6
2336 }                                                2336 }
2337                                                  2337 
2338 usage() {                                        2338 usage() {
2339         echo                                     2339         echo
2340         echo "$0 [OPTIONS] [TEST]..."            2340         echo "$0 [OPTIONS] [TEST]..."
2341         echo "If no TEST argument is given, a    2341         echo "If no TEST argument is given, all tests will be run."
2342         echo                                     2342         echo
2343         echo "Options"                           2343         echo "Options"
2344         echo "  --trace: capture traffic to T    2344         echo "  --trace: capture traffic to TEST_INTERFACE.pcap"
2345         echo                                     2345         echo
2346         echo "Available tests${tests}"           2346         echo "Available tests${tests}"
2347         exit 1                                   2347         exit 1
2348 }                                                2348 }
2349                                                  2349 
2350 #############################################    2350 ################################################################################
2351 #                                                2351 #
2352 exitcode=0                                       2352 exitcode=0
2353 desc=0                                           2353 desc=0
2354 all_skipped=true                                 2354 all_skipped=true
2355                                                  2355 
2356 while getopts :ptv o                             2356 while getopts :ptv o
2357 do                                               2357 do
2358         case $o in                               2358         case $o in
2359         p) PAUSE_ON_FAIL=yes;;                   2359         p) PAUSE_ON_FAIL=yes;;
2360         v) VERBOSE=1;;                           2360         v) VERBOSE=1;;
2361         t) if which tcpdump > /dev/null 2>&1;    2361         t) if which tcpdump > /dev/null 2>&1; then
2362                 TRACING=1                        2362                 TRACING=1
2363            else                                  2363            else
2364                 echo "=== tcpdump not availab    2364                 echo "=== tcpdump not available, tracing disabled"
2365            fi                                    2365            fi
2366            ;;                                    2366            ;;
2367         *) usage;;                               2367         *) usage;;
2368         esac                                     2368         esac
2369 done                                             2369 done
2370 shift $(($OPTIND-1))                             2370 shift $(($OPTIND-1))
2371                                                  2371 
2372 IFS="                                            2372 IFS="   
2373 "                                                2373 "
2374                                                  2374 
2375 for arg do                                       2375 for arg do
2376         # Check first that all requested test    2376         # Check first that all requested tests are available before running any
2377         command -v > /dev/null "test_${arg}"     2377         command -v > /dev/null "test_${arg}" || { echo "=== Test ${arg} not found"; usage; }
2378 done                                             2378 done
2379                                                  2379 
2380 trap cleanup EXIT                                2380 trap cleanup EXIT
2381                                                  2381 
2382 # start clean                                    2382 # start clean
2383 cleanup                                          2383 cleanup
2384                                                  2384 
2385 HAVE_NH=no                                       2385 HAVE_NH=no
2386 ip nexthop ls >/dev/null 2>&1                    2386 ip nexthop ls >/dev/null 2>&1
2387 [ $? -eq 0 ] && HAVE_NH=yes                      2387 [ $? -eq 0 ] && HAVE_NH=yes
2388                                                  2388 
2389 name=""                                          2389 name=""
2390 desc=""                                          2390 desc=""
2391 rerun_nh=0                                       2391 rerun_nh=0
2392 for t in ${tests}; do                            2392 for t in ${tests}; do
2393         [ "${name}" = "" ]      && name="${t}    2393         [ "${name}" = "" ]      && name="${t}"  && continue
2394         [ "${desc}" = "" ]      && desc="${t}    2394         [ "${desc}" = "" ]      && desc="${t}"  && continue
2395                                                  2395 
2396         if [ "${HAVE_NH}" = "yes" ]; then        2396         if [ "${HAVE_NH}" = "yes" ]; then
2397                 rerun_nh="${t}"                  2397                 rerun_nh="${t}"
2398         fi                                       2398         fi
2399                                                  2399 
2400         run_this=1                               2400         run_this=1
2401         for arg do                               2401         for arg do
2402                 [ "${arg}" != "${arg#--*}" ]     2402                 [ "${arg}" != "${arg#--*}" ] && continue
2403                 [ "${arg}" = "${name}" ] && r    2403                 [ "${arg}" = "${name}" ] && run_this=1 && break
2404                 run_this=0                       2404                 run_this=0
2405         done                                     2405         done
2406         if [ $run_this -eq 1 ]; then             2406         if [ $run_this -eq 1 ]; then
2407                 run_test "${name}" "${desc}"     2407                 run_test "${name}" "${desc}"
2408                 # if test was skipped no need    2408                 # if test was skipped no need to retry with nexthop objects
2409                 [ $? -eq $ksft_skip ] && reru    2409                 [ $? -eq $ksft_skip ] && rerun_nh=0
2410                                                  2410 
2411                 if [ "${rerun_nh}" = "1" ]; t    2411                 if [ "${rerun_nh}" = "1" ]; then
2412                         run_test_nh "${name}"    2412                         run_test_nh "${name}" "${desc}"
2413                 fi                               2413                 fi
2414         fi                                       2414         fi
2415         name=""                                  2415         name=""
2416         desc=""                                  2416         desc=""
2417         rerun_nh=0                               2417         rerun_nh=0
2418 done                                             2418 done
2419                                                  2419 
2420 exit ${exitcode}                                 2420 exit ${exitcode}
                                                      

~ [ source navigation ] ~ [ diff markup ] ~ [ identifier search ] ~

kernel.org | git.kernel.org | LWN.net | Project Home | SVN repository | Mail admin

Linux® is a registered trademark of Linus Torvalds in the United States and other countries.
TOMOYO® is a registered trademark of NTT DATA CORPORATION.

sflogo.php