2025-04-04T04:45:16Z Script '/data/test/netlink/bin/net.pl -h root@ot41 -d latest-ot41 -c all -i ixl -m none,jumbo -p all' started. 2025-04-04T04:45:16Z Command '/data/test/netlink/bin/power.pl -h root@ot41 -d 2025-04-04T00:42:57Z up' started. 2025-04-04T04:45:21Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T04:45:35Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T04:47:43Z Command '/data/test/netlink/bin/power.pl -h root@ot41 -d 2025-04-04T00:42:57Z up' finished. 2025-04-04T04:47:43Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T04:47:50Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T04:47:50Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T04:47:59Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T04:47:59Z Command '/data/test/netlink/bin/setup-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T04:48:07Z Command '/data/test/netlink/bin/setup-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T04:48:07Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c none -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt40 ip link delete dev ens2f1.1 ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt43 ip link delete dev ens2f1.1 ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 0 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 pfctl: pf already enabled net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig ixl0 inet 10.10.11.2/24 ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::2/64 ifconfig ixl0 inet 10.10.11.20/32 alias ifconfig ixl0 inet 10.10.11.21/32 alias ifconfig ixl0 inet 10.10.11.22/32 alias ifconfig ixl0 inet 10.10.11.23/32 alias ifconfig ixl0 inet 10.10.11.24/32 alias ifconfig ixl0 inet 10.10.11.25/32 alias ifconfig ixl0 inet 10.10.11.26/32 alias ifconfig ixl0 inet 10.10.11.27/32 alias ifconfig ixl0 inet 10.10.11.28/32 alias ifconfig ixl0 inet 10.10.11.29/32 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig ixl0 up ifconfig ixl1 inet 10.10.12.3/24 ifconfig ixl1 inet6 fdd7:e83e:66bd:1012::3/64 ifconfig ixl1 up ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1 ; done ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.459 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.459/0.459/0.459/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.441 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.441/0.441/0.441/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.447 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.447/0.447/0.447/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.561 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.561/0.561/0.561/0.000 ms new config created: modify none, iface ixl0, pseudo none test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 Use of uninitialized value in subtraction (-) at /root/netlink/Netstat.pm line 218. Use of uninitialized value in subtraction (-) at /root/netlink/Netstat.pm line 218. Use of uninitialized value in subtraction (-) at /root/netlink/Netstat.pm line 218. test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 Use of uninitialized value in subtraction (-) at /root/netlink/Netstat.pm line 218. Use of uninitialized value in subtraction (-) at /root/netlink/Netstat.pm line 218. Use of uninitialized value in subtraction (-) at /root/netlink/Netstat.pm line 218. test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rixl0_-Sens2f1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1_-Sixl1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T05:05:51Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c none -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T05:05:51Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T05:05:56Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T05:06:03Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T05:06:07Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T05:06:07Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T05:06:11Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T05:06:11Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T05:06:20Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T05:06:20Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T05:06:20Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c bridge -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" ssh root@lt43 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig bridge0 create ifconfig vether0 create ifconfig bridge0 add ixl0 ifconfig bridge0 add ixl1 ifconfig bridge0 add vether0 ifconfig ixl0 up ifconfig ixl1 up pfctl: pf already enabled ifconfig bridge0 up ifconfig vether0 inet 10.10.11.2/21 ifconfig vether0 inet6 fdd7:e83e:66bd:1011::2/60 ifconfig vether0 inet 10.10.11.20/32 alias ifconfig vether0 inet 10.10.11.21/32 alias ifconfig vether0 inet 10.10.11.22/32 alias ifconfig vether0 inet 10.10.11.23/32 alias ifconfig vether0 inet 10.10.11.24/32 alias ifconfig vether0 inet 10.10.11.25/32 alias ifconfig vether0 inet 10.10.11.26/32 alias ifconfig vether0 inet 10.10.11.27/32 alias ifconfig vether0 inet 10.10.11.28/32 alias ifconfig vether0 inet 10.10.11.29/32 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig vether0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig vether0 up ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 ; do ip address add $net dev ens2f1 ; done ssh root@lt43 for net in 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 ; do ip address add $net dev ens2f1 ; done ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.528 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.528/0.528/0.528/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.471 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.471/0.471/0.471/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.661 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.661/0.661/0.661/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.542 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.542/0.542/0.542/0.000 ms new config created: modify none, iface ixl0, pseudo bridge test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rvether0_-Sens2f1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.11.2_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1_-Svether0_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T05:23:58Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c bridge -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T05:23:58Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T05:24:03Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T05:24:08Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T05:24:08Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T05:24:11Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T05:24:11Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T05:24:14Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T05:24:14Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T05:24:21Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T05:24:21Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T05:24:21Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c carp -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig bridge0 -inet -inet6 down ifconfig bridge0 destroy ifconfig vether0 -inet -inet6 down ifconfig vether0 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" ssh root@lt43 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf pfctl: pf already enabled sysctl net.inet.tcp.tso=1 net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig carp0 create ifconfig carp1 create ifconfig carp0 carpdev ixl0 vhid 111 ifconfig carp1 carpdev ixl1 vhid 112 ifconfig ixl0 up ifconfig ixl1 up ifconfig carp0 inet 10.10.11.2/24 ifconfig carp0 inet6 fdd7:e83e:66bd:1011::2/64 ifconfig carp0 inet 10.10.11.20/32 alias ifconfig carp0 inet 10.10.11.21/32 alias ifconfig carp0 inet 10.10.11.22/32 alias ifconfig carp0 inet 10.10.11.23/32 alias ifconfig carp0 inet 10.10.11.24/32 alias ifconfig carp0 inet 10.10.11.25/32 alias ifconfig carp0 inet 10.10.11.26/32 alias ifconfig carp0 inet 10.10.11.27/32 alias ifconfig carp0 inet 10.10.11.28/32 alias ifconfig carp0 inet 10.10.11.29/32 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig carp0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig carp0 up ifconfig carp1 inet 10.10.12.3/24 ifconfig carp1 inet6 fdd7:e83e:66bd:1012::3/64 ifconfig carp1 up ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1 ; done ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.583 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.583/0.583/0.583/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.464 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.464/0.464/0.464/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.571 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.571/0.571/0.571/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.566 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.566/0.566/0.566/0.000 ms new config created: modify none, iface ixl0, pseudo carp test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rcarp0_-Sens2f1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1_-Scarp1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T05:42:08Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c carp -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T05:42:08Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T05:42:12Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T05:42:18Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T05:42:18Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T05:42:22Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T05:42:22Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T05:42:26Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T05:42:26Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T05:42:33Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T05:42:33Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T05:42:33Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c gif -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig carp0 -inet -inet6 down ifconfig carp0 destroy ifconfig carp1 -inet -inet6 down ifconfig carp1 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done Cannot find device "ens2f1.1" RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" ssh root@lt40 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 pfctl: pf already enabled net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig ixl0 inet 10.10.13.2/24 ifconfig ixl1 inet 10.10.14.3/24 ifconfig gif0 create ifconfig gif1 create ifconfig gif0 mtu 1480 tunnel 10.10.13.2 10.10.13.1 ifconfig gif1 mtu 1480 tunnel 10.10.14.3 10.10.14.4 ifconfig ixl0 up ifconfig ixl1 up ssh root@lt40 modprobe sit ssh root@lt43 modprobe sit ssh root@lt40 ip address add 10.10.13.1/24 dev ens2f1 ssh root@lt43 ip address add 10.10.14.4/24 dev ens2f1 ssh root@lt40 ip link add name ens2f1.1 type sit mode any local 10.10.13.1 remote 10.10.13.2 ssh root@lt43 ip link add name ens2f1.1 type sit mode any local 10.10.14.4 remote 10.10.14.3 ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ifconfig gif0 inet 10.10.11.2/32 10.10.11.1 ifconfig gif0 inet6 fdd7:e83e:66bd:1011::2/128 fdd7:e83e:66bd:1011::1 ifconfig gif0 inet 10.10.11.20/32 alias ifconfig gif0 inet 10.10.11.21/32 alias ifconfig gif0 inet 10.10.11.22/32 alias ifconfig gif0 inet 10.10.11.23/32 alias ifconfig gif0 inet 10.10.11.24/32 alias ifconfig gif0 inet 10.10.11.25/32 alias ifconfig gif0 inet 10.10.11.26/32 alias ifconfig gif0 inet 10.10.11.27/32 alias ifconfig gif0 inet 10.10.11.28/32 alias ifconfig gif0 inet 10.10.11.29/32 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig gif0 up ifconfig gif1 inet 10.10.12.3/32 10.10.12.4 ifconfig gif1 inet6 fdd7:e83e:66bd:1012::3/128 fdd7:e83e:66bd:1012::4 ifconfig gif1 up route add 10.10.11.0/24 10.10.11.1 add net 10.10.11.0/24: gateway 10.10.11.1 route add fdd7:e83e:66bd:1011::/64 fdd7:e83e:66bd:1011::1 add net fdd7:e83e:66bd:1011::/64: gateway fdd7:e83e:66bd:1011::1 route add 10.10.12.0/24 10.10.12.4 add net 10.10.12.0/24: gateway 10.10.12.4 route add fdd7:e83e:66bd:1012::/64 fdd7:e83e:66bd:1012::4 add net fdd7:e83e:66bd:1012::/64: gateway fdd7:e83e:66bd:1012::4 ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt40 ip link set dev ens2f1.1 up ssh root@lt43 ip link set dev ens2f1.1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1.1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1.1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1.1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1.1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.320 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.320/0.320/0.320/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.300 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.300/0.300/0.300/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.298 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.298/0.298/0.298/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.300 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.300/0.300/0.300/0.000 ms new config created: modify none, iface ixl0, pseudo gif test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rgif0_-Sens2f1.1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1.1_-Sgif1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T06:00:19Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c gif -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T06:00:19Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T06:00:25Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T06:00:34Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T06:00:34Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T06:00:40Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T06:00:40Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T06:00:47Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T06:00:47Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T06:00:58Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T06:00:58Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T06:00:58Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c gif6 -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig gif0 -inet -inet6 down ifconfig gif0 destroy ifconfig gif1 -inet -inet6 down ifconfig gif1 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt40 ip link delete dev ens2f1.1 ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt43 ip link delete dev ens2f1.1 ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 pfctl: pf already enabled net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig ixl0 inet6 fdd7:e83e:66bd:1013::2/64 ifconfig ixl1 inet6 fdd7:e83e:66bd:1014::3/64 ifconfig gif0 create ifconfig gif1 create ifconfig gif0 mtu 1460 tunnel fdd7:e83e:66bd:1013::2 fdd7:e83e:66bd:1013::1 ifconfig gif1 mtu 1460 tunnel fdd7:e83e:66bd:1014::3 fdd7:e83e:66bd:1014::4 ifconfig ixl0 up ifconfig ixl1 up ssh root@lt40 modprobe ip6_tunnel ssh root@lt43 modprobe ip6_tunnel ssh root@lt40 ip address add fdd7:e83e:66bd:1013::1/64 dev ens2f1 ssh root@lt43 ip address add fdd7:e83e:66bd:1014::4/64 dev ens2f1 ssh root@lt40 ip link add name ens2f1.1 type ip6tnl mode any encaplimit none local fdd7:e83e:66bd:1013::1 remote fdd7:e83e:66bd:1013::2 ssh root@lt43 ip link add name ens2f1.1 type ip6tnl mode any encaplimit none local fdd7:e83e:66bd:1014::4 remote fdd7:e83e:66bd:1014::3 ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ifconfig gif0 inet 10.10.11.2/32 10.10.11.1 ifconfig gif0 inet6 fdd7:e83e:66bd:1011::2/128 fdd7:e83e:66bd:1011::1 ifconfig gif0 inet 10.10.11.20/32 alias ifconfig gif0 inet 10.10.11.21/32 alias ifconfig gif0 inet 10.10.11.22/32 alias ifconfig gif0 inet 10.10.11.23/32 alias ifconfig gif0 inet 10.10.11.24/32 alias ifconfig gif0 inet 10.10.11.25/32 alias ifconfig gif0 inet 10.10.11.26/32 alias ifconfig gif0 inet 10.10.11.27/32 alias ifconfig gif0 inet 10.10.11.28/32 alias ifconfig gif0 inet 10.10.11.29/32 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig gif0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig gif0 up ifconfig gif1 inet 10.10.12.3/32 10.10.12.4 ifconfig gif1 inet6 fdd7:e83e:66bd:1012::3/128 fdd7:e83e:66bd:1012::4 ifconfig gif1 up route add 10.10.11.0/24 10.10.11.1 add net 10.10.11.0/24: gateway 10.10.11.1 route add fdd7:e83e:66bd:1011::/64 fdd7:e83e:66bd:1011::1 add net fdd7:e83e:66bd:1011::/64: gateway fdd7:e83e:66bd:1011::1 route add 10.10.12.0/24 10.10.12.4 add net 10.10.12.0/24: gateway 10.10.12.4 route add fdd7:e83e:66bd:1012::/64 fdd7:e83e:66bd:1012::4 add net fdd7:e83e:66bd:1012::/64: gateway fdd7:e83e:66bd:1012::4 ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt40 ip link set dev ens2f1.1 up ssh root@lt43 ip link set dev ens2f1.1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1.1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1.1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1.1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1.1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.390 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.390/0.390/0.390/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.299 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.299/0.299/0.299/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.299 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.299/0.299/0.299/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.294 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.294/0.294/0.294/0.000 ms new config created: modify none, iface ixl0, pseudo gif6 test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rgif0_-Sens2f1.1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1.1_-Sgif1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T06:18:50Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c gif6 -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T06:18:50Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T06:18:55Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T06:19:01Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T06:19:01Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T06:19:05Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T06:19:05Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T06:19:10Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T06:19:10Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T06:19:17Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T06:19:17Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T06:19:17Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c gre -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig gif0 -inet -inet6 down ifconfig gif0 destroy ifconfig gif1 -inet -inet6 down ifconfig gif1 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt40 ip link delete dev ens2f1.1 ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt43 ip link delete dev ens2f1.1 ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 pfctl: pf already enabled net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig ixl0 inet 10.10.13.2/24 ifconfig ixl1 inet 10.10.14.3/24 ifconfig gre0 create ifconfig gre1 create ifconfig gre0 vnetid 211 tunnel 10.10.13.2 10.10.13.1 ifconfig gre1 vnetid 212 tunnel 10.10.14.3 10.10.14.4 ifconfig ixl0 up ifconfig ixl1 up ssh root@lt40 modprobe ip_gre ssh root@lt43 modprobe ip_gre ssh root@lt40 ip address add 10.10.13.1/24 dev ens2f1 ssh root@lt43 ip address add 10.10.14.4/24 dev ens2f1 ssh root@lt40 ip link add name ens2f1.1 type gre key 211 local 10.10.13.1 remote 10.10.13.2 ssh root@lt43 ip link add name ens2f1.1 type gre key 212 local 10.10.14.4 remote 10.10.14.3 ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ifconfig gre0 inet 10.10.11.2/32 10.10.11.1 ifconfig gre0 inet6 fdd7:e83e:66bd:1011::2/128 fdd7:e83e:66bd:1011::1 ifconfig gre0 inet 10.10.11.20/32 alias ifconfig gre0 inet 10.10.11.21/32 alias ifconfig gre0 inet 10.10.11.22/32 alias ifconfig gre0 inet 10.10.11.23/32 alias ifconfig gre0 inet 10.10.11.24/32 alias ifconfig gre0 inet 10.10.11.25/32 alias ifconfig gre0 inet 10.10.11.26/32 alias ifconfig gre0 inet 10.10.11.27/32 alias ifconfig gre0 inet 10.10.11.28/32 alias ifconfig gre0 inet 10.10.11.29/32 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig gre0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig gre0 up ifconfig gre1 inet 10.10.12.3/32 10.10.12.4 ifconfig gre1 inet6 fdd7:e83e:66bd:1012::3/128 fdd7:e83e:66bd:1012::4 ifconfig gre1 up route add 10.10.11.0/24 10.10.11.1 add net 10.10.11.0/24: gateway 10.10.11.1 route add fdd7:e83e:66bd:1011::/64 fdd7:e83e:66bd:1011::1 add net fdd7:e83e:66bd:1011::/64: gateway fdd7:e83e:66bd:1011::1 route add 10.10.12.0/24 10.10.12.4 add net 10.10.12.0/24: gateway 10.10.12.4 route add fdd7:e83e:66bd:1012::/64 fdd7:e83e:66bd:1012::4 add net fdd7:e83e:66bd:1012::/64: gateway fdd7:e83e:66bd:1012::4 ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt40 ip link set dev ens2f1.1 up ssh root@lt43 ip link set dev ens2f1.1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1.1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1.1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1.1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1.1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.383 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.383/0.383/0.383/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.287 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.287/0.287/0.287/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.300 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.300/0.300/0.300/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.290 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.290/0.290/0.290/0.000 ms new config created: modify none, iface ixl0, pseudo gre test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rgre0_-Sens2f1.1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1.1_-Sgre1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T06:37:06Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c gre -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T06:37:06Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T06:37:10Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T06:37:14Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T06:37:14Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T06:37:17Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T06:37:17Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T06:37:19Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T06:37:19Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T06:37:23Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T06:37:23Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T06:37:23Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c veb -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig gre0 -inet -inet6 down ifconfig gre0 destroy ifconfig gre1 -inet -inet6 down ifconfig gre1 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt40 ip link delete dev ens2f1.1 ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt43 ip link delete dev ens2f1.1 ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 pfctl: pf already enabled net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig veb0 create ifconfig vport0 create ifconfig veb0 add ixl0 ifconfig veb0 add ixl1 ifconfig veb0 add vport0 ifconfig ixl0 up ifconfig ixl1 up ifconfig veb0 up ifconfig vport0 inet 10.10.11.2/21 ifconfig vport0 inet6 fdd7:e83e:66bd:1011::2/60 ifconfig vport0 inet 10.10.11.20/32 alias ifconfig vport0 inet 10.10.11.21/32 alias ifconfig vport0 inet 10.10.11.22/32 alias ifconfig vport0 inet 10.10.11.23/32 alias ifconfig vport0 inet 10.10.11.24/32 alias ifconfig vport0 inet 10.10.11.25/32 alias ifconfig vport0 inet 10.10.11.26/32 alias ifconfig vport0 inet 10.10.11.27/32 alias ifconfig vport0 inet 10.10.11.28/32 alias ifconfig vport0 inet 10.10.11.29/32 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig vport0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig vport0 up ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 ; do ip address add $net dev ens2f1 ; done ssh root@lt43 for net in 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 ; do ip address add $net dev ens2f1 ; done ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.569 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.569/0.569/0.569/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.458 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.458/0.458/0.458/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.574 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.574/0.574/0.574/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.709 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.709/0.709/0.709/0.000 ms new config created: modify none, iface ixl0, pseudo veb test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rvport0_-Sens2f1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.11.2_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1_-Svport0_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T06:54:58Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c veb -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T06:54:58Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T06:55:01Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T06:55:06Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T06:55:06Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T06:55:08Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T06:55:08Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T06:55:10Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T06:55:10Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T06:55:14Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T06:55:14Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T06:55:14Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c vlan -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig veb0 -inet -inet6 down ifconfig veb0 destroy ifconfig vport0 -inet -inet6 down ifconfig vport0 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt40 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done Cannot find device "ens2f1.1" Cannot find device "ens2f1.1" ssh root@lt43 ip link delete dev ens2f1.1 Cannot find device "ens2f1.1" ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf pfctl: pf already enabled sysctl net.inet.tcp.tso=1 net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig vlan0 create ifconfig vlan1 create ifconfig vlan0 parent ixl0 vnetid 211 ifconfig vlan1 parent ixl1 vnetid 212 ifconfig ixl0 up ifconfig ixl1 up ssh root@lt40 modprobe 8021q ssh root@lt43 modprobe 8021q ssh root@lt40 ip link add link ens2f1 name ens2f1.1 type vlan id 211 ssh root@lt43 ip link add link ens2f1 name ens2f1.1 type vlan id 212 ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ifconfig vlan0 inet 10.10.11.2/24 ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::2/64 ifconfig vlan0 inet 10.10.11.20/32 alias ifconfig vlan0 inet 10.10.11.21/32 alias ifconfig vlan0 inet 10.10.11.22/32 alias ifconfig vlan0 inet 10.10.11.23/32 alias ifconfig vlan0 inet 10.10.11.24/32 alias ifconfig vlan0 inet 10.10.11.25/32 alias ifconfig vlan0 inet 10.10.11.26/32 alias ifconfig vlan0 inet 10.10.11.27/32 alias ifconfig vlan0 inet 10.10.11.28/32 alias ifconfig vlan0 inet 10.10.11.29/32 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig vlan0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig vlan0 up ifconfig vlan1 inet 10.10.12.3/24 ifconfig vlan1 inet6 fdd7:e83e:66bd:1012::3/64 ifconfig vlan1 up ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt40 ip link set dev ens2f1.1 up ssh root@lt43 ip link set dev ens2f1.1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1.1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1.1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1.1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1.1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.480 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.480/0.480/0.480/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.497 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.497/0.497/0.497/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.451 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.451/0.451/0.451/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.468 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.468/0.468/0.468/0.000 ms new config created: modify none, iface ixl0, pseudo vlan test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rvlan0_-Sens2f1.1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1.1_-Svlan1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T07:12:55Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c vlan -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T07:12:55Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T07:12:58Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T07:13:03Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T07:13:03Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T07:13:05Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T07:13:05Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T07:13:08Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T07:13:08Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T07:13:13Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T07:13:13Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T07:13:13Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c vxlan -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig vlan0 -inet -inet6 down ifconfig vlan0 destroy ifconfig vlan1 -inet -inet6 down ifconfig vlan1 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt40 ip link delete dev ens2f1.1 ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt43 ip link delete dev ens2f1.1 ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 pfctl: pf already enabled net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ifconfig ixl0 inet 10.10.13.2/24 ifconfig ixl1 inet 10.10.14.3/24 ifconfig ixl0 mtu 1600 ifconfig ixl1 mtu 1600 ifconfig vxlan0 create ifconfig vxlan1 create ifconfig vxlan0 parent ixl0 tunnel 10.10.13.2 234.10.13.1 ifconfig vxlan1 parent ixl1 tunnel 10.10.14.3 234.10.14.1 ifconfig vxlan0 vnetid 411 ifconfig vxlan1 vnetid 412 ifconfig ixl0 up ifconfig ixl1 up ssh root@lt40 modprobe vxlan ssh root@lt43 modprobe vxlan ssh root@lt40 ip address add 10.10.13.1/24 dev ens2f1 ssh root@lt43 ip address add 10.10.14.4/24 dev ens2f1 ssh root@lt40 ip link add name ens2f1.1 type vxlan id 411 dstport 4789 dev ens2f1 local 10.10.13.1 group 234.10.13.1 ssh root@lt43 ip link add name ens2f1.1 type vxlan id 412 dstport 4789 dev ens2f1 local 10.10.14.4 group 234.10.14.1 ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ifconfig vxlan0 inet 10.10.11.2/24 ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::2/64 ifconfig vxlan0 inet 10.10.11.20/32 alias ifconfig vxlan0 inet 10.10.11.21/32 alias ifconfig vxlan0 inet 10.10.11.22/32 alias ifconfig vxlan0 inet 10.10.11.23/32 alias ifconfig vxlan0 inet 10.10.11.24/32 alias ifconfig vxlan0 inet 10.10.11.25/32 alias ifconfig vxlan0 inet 10.10.11.26/32 alias ifconfig vxlan0 inet 10.10.11.27/32 alias ifconfig vxlan0 inet 10.10.11.28/32 alias ifconfig vxlan0 inet 10.10.11.29/32 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig vxlan0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig vxlan0 up ifconfig vxlan1 inet 10.10.12.3/24 ifconfig vxlan1 inet6 fdd7:e83e:66bd:1012::3/64 ifconfig vxlan1 up ssh root@lt40 ip link set mtu 1600 dev ens2f1 ssh root@lt43 ip link set mtu 1600 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt40 ip link set dev ens2f1.1 up ssh root@lt43 ip link set dev ens2f1.1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1.1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1.1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1.1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1.1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.799 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.799/0.799/0.799/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.791 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.791/0.791/0.791/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.717 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.717/0.717/0.717/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.695 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.695/0.695/0.695/0.000 ms new config created: modify none, iface ixl0, pseudo vxlan test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rvxlan0_-Sens2f1.1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1.1_-Svxlan1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T07:34:59Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c vxlan -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T07:34:59Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T07:35:02Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T07:35:07Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T07:35:07Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T07:35:09Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T07:35:09Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T07:35:12Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T07:35:12Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T07:35:15Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T07:35:15Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T07:35:15Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c wg -e /root/netlink/env-ot41.sh -i ixl0 -m none all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig vxlan0 -inet -inet6 down ifconfig vxlan0 destroy ifconfig vxlan1 -inet -inet6 down ifconfig vxlan1 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt40 ip link delete dev ens2f1.1 ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt43 ip link delete dev ens2f1.1 ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf sysctl net.inet.tcp.tso=1 pfctl: pf already enabled net.inet.tcp.tso: 1 -> 1 old config destroyed: modify none /sbin/ifconfig ixl0 mtu 1500 /sbin/ifconfig ixl1 mtu 1500 ssh root@lt40 modprobe wireguard ssh root@lt40 wg genkey | tee wg-private.key | wg pubkey >wg-public.key ssh root@lt43 modprobe wireguard ssh root@lt43 wg genkey | tee wg-private.key | wg pubkey >wg-public.key ifconfig ixl0 inet 10.10.13.2/24 ifconfig ixl1 inet 10.10.14.3/24 ifconfig wg0 create ifconfig wg1 create ifconfig wg0 wgport 7112 wgkey QIZcDi19oVLCVXf8F52wGlRmfxNPYz8WSnn1cjKwbpo= wgpeer pha7ZufT+RoVk+/r5qieudtE00kO7mGbYkPXAwPrbiI= wgendpoint 10.10.13.1 7111 wgaip 10.10.11.1/24 wgaip fdd7:e83e:66bd:1011::1/64 ifconfig wg1 wgport 7113 wgkey L76ClUE/15Cxwx7h3P89+TNwSkZHmdpN+dATONw3IYQ= wgpeer P6cVmd0rohmQ4gUzt6J6C0BVWcww0hV6cYkgZ/KQiEU= wgendpoint 10.10.14.4 7114 wgaip 10.10.12.4/24 wgaip fdd7:e83e:66bd:1012::4/64 ifconfig ixl0 up ifconfig ixl1 up ssh root@lt40 ip address add 10.10.13.1/24 dev ens2f1 ssh root@lt43 ip address add 10.10.14.4/24 dev ens2f1 ssh root@lt40 ip link add name ens2f1.1 type wireguard ssh root@lt43 ip link add name ens2f1.1 type wireguard ssh root@lt40 wg set ens2f1.1 listen-port 7111 private-key wg-private.key peer Ciu3gQAE3aTSd7div6ZvVJY8f1+fUq+jMYz6fr7ugiw= allowed-ips 10.10.11.0/24 allowed-ips fdd7:e83e:66bd:1011::/64 allowed-ips 10.10.12.0/24 allowed-ips fdd7:e83e:66bd:1012::/64 endpoint 10.10.13.2:7112 ssh root@lt43 wg set ens2f1.1 listen-port 7114 private-key wg-private.key peer JvZAyxv2dkTudxAocgLzqEfZP7VLA2NU0qMAC6iDFhA= allowed-ips 10.10.12.0/24 allowed-ips fdd7:e83e:66bd:1012::/64 allowed-ips 10.10.11.0/24 allowed-ips fdd7:e83e:66bd:1011::/64 endpoint 10.10.14.3:7113 ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ifconfig wg0 inet 10.10.11.2/24 ifconfig wg0 inet6 fdd7:e83e:66bd:1011::2/64 ifconfig wg0 inet 10.10.11.20/32 alias ifconfig wg0 inet 10.10.11.21/32 alias ifconfig wg0 inet 10.10.11.22/32 alias ifconfig wg0 inet 10.10.11.23/32 alias ifconfig wg0 inet 10.10.11.24/32 alias ifconfig wg0 inet 10.10.11.25/32 alias ifconfig wg0 inet 10.10.11.26/32 alias ifconfig wg0 inet 10.10.11.27/32 alias ifconfig wg0 inet 10.10.11.28/32 alias ifconfig wg0 inet 10.10.11.29/32 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig wg0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig wg0 up ifconfig wg1 inet 10.10.12.3/24 ifconfig wg1 inet6 fdd7:e83e:66bd:1012::3/64 ifconfig wg1 up ssh root@lt40 ip link set mtu 1500 dev ens2f1 ssh root@lt43 ip link set mtu 1500 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1.1 ; done ssh root@lt40 ip link set dev ens2f1.1 up ssh root@lt43 ip link set dev ens2f1.1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1.1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1.1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1.1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1.1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes --- 10.10.11.1 ping statistics --- 1 packets transmitted, 0 packets received, 100.0% packet loss ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=2.468 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 2.468/2.468/2.468/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=4195.008 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 4195.008/4195.008/4195.008/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.557 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.557/0.557/0.557/0.000 ms new config created: modify none, iface ixl0, pseudo wg test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 12/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.12.4 test 13/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.12.4 test 14/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1011::2 test 15/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1011::2 test 16/72 tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 17/72 tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 18/72 ssh_root@lt40_tcpbench_-S1000000_-t10_fdd7:e83e:66bd:1012::4 test 19/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_fdd7:e83e:66bd:1012::4 test 20/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-a10.10.11.20_-t10_udpbench test 21/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 22/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 23/72 netbench.pl_-v_-b1000000_-f0_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 24/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 25/72 netbench.pl_-v_-b1000000_-f0_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 26/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-a10.10.11.20_-t10_udpbench test 27/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 28/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 29/72 netbench.pl_-v_-b1000000_-f1_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 30/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 31/72 netbench.pl_-v_-b1000000_-f1_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 32/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-a10.10.11.20_-t10_udpbench test 33/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 34/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 35/72 netbench.pl_-v_-b1000000_-f2_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 36/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 37/72 netbench.pl_-v_-b1000000_-f2_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 38/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 39/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 40/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 41/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 42/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 43/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 44/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 45/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 46/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 47/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 48/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 49/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 50/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-a10.10.11.20_-t10_udpbench test 51/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-afdd7:e83e:66bd:1011::20_-t10_udpbench test 52/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 53/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-croot@lt40_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 54/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-a10.10.12.40_-t10_udpbench test 55/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f2_-i0_-N10_-sroot@lt43_-afdd7:e83e:66bd:1012::40_-t10_udpbench test 56/72 ssh -f root@lt43 service tcpbench stop rcctl -f stop tcpbench tcpbench(ok) test 57/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 58/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpsplice test 59/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 60/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpsplice test 61/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 62/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_tcpcopy test 63/72 netbench.pl_-v_-b1000000_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 64/72 netbench.pl_-v_-b1000000_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_tcpcopy test 65/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 66/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f0_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 67/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-A10.10.11.20_-a10.10.12.40_-t10_udpsplice test 68/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-croot@lt40_-sroot@lt43_-Afdd7:e83e:66bd:1011::20_-afdd7:e83e:66bd:1012::40_-t10_udpsplice test 69/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.11.2_-S10.10.11.1_-croot@lt40_-a234.10.11.10_-t10_udpbench test 70/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rwg0_-Sens2f1.1_-croot@lt40_-aff34:40:fdd7:e83e:66bd:1011::10_-t10_udpbench test 71/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-R10.10.12.4_-S10.10.12.3_-sroot@lt43_-a234.10.12.10_-t10_udpbench test 72/72 netbench.pl_-v_-B1000000000_-b1000000_-d1_-f1_-i0_-N10_-Rens2f1.1_-Swg1_-sroot@lt43_-aff34:40:fdd7:e83e:66bd:1012::10_-t10_udpbench tests finished: all all4 all44 all46 all6 all64 all66 icmp4 icmp44 icmp46 icmp6 icmp64 icmp66 mcast4 mcast44 mcast46 mcast6 mcast64 mcast66 splice4 splice44 splice46 splice6 splice64 splice66 tcp4 tcp44 tcp46 tcp6 tcp64 tcp66 udp4 udp44 udp46 udp6 udp64 udp66 pax -x cpio -wzf /root/netlink/test.log.tgz -s,^/root/netlink/logs/,, -s,^/root/netlink/logs,, /root/netlink/logs 2025-04-04T07:55:50Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c wg -e /root/netlink/env-ot41.sh -i ixl0 -m none all' finished. 2025-04-04T07:55:50Z Command 'scp -q root@ot41:/root/netlink/test.* .' started. 2025-04-04T07:55:53Z Command 'scp -q root@ot41:/root/netlink/test.* .' finished. 2025-04-04T07:55:58Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' finished. 2025-04-04T07:55:58Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' started. Writing output to 'version-ot41.txt'. 2025-04-04T07:56:00Z Command 'ssh root@ot41 sysctl kern.version hw.machine hw.ncpu hw.ncpuonline' finished. 2025-04-04T07:56:00Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' started. Writing output to 'dmesg-boot-ot41.txt'. 2025-04-04T07:56:02Z Command 'ssh root@ot41 cat /var/run/dmesg.boot' finished. 2025-04-04T07:56:02Z Command '/data/test/netlink/bin/setup-html.pl' started. 2025-04-04T07:56:06Z Command '/data/test/netlink/bin/setup-html.pl' finished. 2025-04-04T07:56:06Z Command '/data/test/netlink/bin/netlink-html.pl -d 2025-04-04T00:42:57Z' started. 2025-04-04T07:56:06Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c none -e /root/netlink/env-ot41.sh -i ixl0 -m jumbo all' started. ifconfig ix0 -inet -inet6 down ifconfig ix1 -inet -inet6 down ifconfig ixl0 -inet -inet6 down ifconfig ixl1 -inet -inet6 down ifconfig em0 -inet -inet6 down ifconfig em1 -inet -inet6 down ifconfig em2 -inet -inet6 down ifconfig em3 -inet -inet6 down ifconfig wg0 -inet -inet6 down ifconfig wg0 destroy ifconfig wg1 -inet -inet6 down ifconfig wg1 destroy route delete 10.10.11.0/24 delete net 10.10.11.0/24: not in table route delete fdd7:e83e:66bd:1011::/64 delete net fdd7:e83e:66bd:1011::/64: not in table route delete 10.10.12.0/24 delete net 10.10.12.0/24: not in table route delete fdd7:e83e:66bd:1012::/64 delete net fdd7:e83e:66bd:1012::/64: not in table ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 10.10.11.1/21 fdd7:e83e:66bd:1011::1/60 10.10.13.1/24 fdd7:e83e:66bd:1013::1/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.4/21 fdd7:e83e:66bd:1012::4/60 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 10.10.12.40/21 10.10.12.41/21 10.10.12.42/21 10.10.12.43/21 10.10.12.44/21 10.10.12.45/21 10.10.12.46/21 10.10.12.47/21 10.10.12.48/21 10.10.12.49/21 fdd7:e83e:66bd:1012::40/60 fdd7:e83e:66bd:1012::41/60 fdd7:e83e:66bd:1012::42/60 fdd7:e83e:66bd:1012::43/60 fdd7:e83e:66bd:1012::44/60 fdd7:e83e:66bd:1012::45/60 fdd7:e83e:66bd:1012::46/60 fdd7:e83e:66bd:1012::47/60 fdd7:e83e:66bd:1012::48/60 fdd7:e83e:66bd:1012::49/60 10.10.14.4/24 fdd7:e83e:66bd:1014::4/64 ; do ip address delete $net dev $if ; done ; done Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv4: Address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv6: address not found. Error: ipv4: Address not found. Error: ipv6: address not found. ssh root@lt40 for net in 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process ssh root@lt43 for net in 10.10.11.0/24 fdd7:e83e:66bd:1011::/64 10.10.12.0/24 fdd7:e83e:66bd:1012::/64 ; do ip route delete $net ; done RTNETLINK answers: No such process RTNETLINK answers: No such process RTNETLINK answers: No such process arp -da 10.0.1.1 (10.0.1.1) deleted 10.0.1.2 (10.0.1.2) deleted 10.0.1.60 (10.0.1.60) deleted 10.0.1.63 (10.0.1.63) deleted ndp -c ssh root@lt40 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt40 ip link delete dev ens2f1.1 ssh root@lt40 ip link set ens2f1 up ssh root@lt43 for if in ens2f1 ens2f1.1 ; do for af in -4 -6 ; do ip $af neigh flush all dev $if ; done ; done ssh root@lt43 ip link delete dev ens2f1.1 ssh root@lt43 ip link set ens2f1 up sysctl net.inet.ip.forwarding=1 net.inet.ip.forwarding: 1 -> 1 sysctl net.inet6.ip6.forwarding=1 net.inet6.ip6.forwarding: 1 -> 1 sysctl net.inet.gre.allow=1 net.inet.gre.allow: 1 -> 1 ssh root@lt40 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt43 sysctl net.ipv6.bindv6only=1 net.ipv6.bindv6only = 1 ssh root@lt40 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv6.ip6frag_high_thresh=1073741824 net.ipv6.ip6frag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt43 sysctl net.ipv4.ipfrag_high_thresh=1073741824 net.ipv4.ipfrag_high_thresh = 1073741824 ssh root@lt40 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt43 sysctl net.ipv4.ipfrag_time=2 net.ipv4.ipfrag_time = 2 ssh root@lt40 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 sysctl net.ipv6.ip6frag_time=2 net.ipv6.ip6frag_time = 2 ssh root@lt43 cat - > /etc/systemd/system/tcpbench.service ssh root@lt43 cat - > /etc/init.d/tcpbench ssh root@lt43 chmod 0555 /etc/init.d/tcpbench /sbin/pfctl -e -f /etc/pf.conf pfctl: pf already enabled sysctl net.inet.tcp.tso=1 net.inet.tcp.tso: 1 -> 1 old config destroyed: modify jumbo /sbin/ifconfig ixl0 mtu 9000 /sbin/ifconfig ixl1 mtu 9000 ifconfig ixl0 inet 10.10.11.2/24 ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::2/64 ifconfig ixl0 inet 10.10.11.20/32 alias ifconfig ixl0 inet 10.10.11.21/32 alias ifconfig ixl0 inet 10.10.11.22/32 alias ifconfig ixl0 inet 10.10.11.23/32 alias ifconfig ixl0 inet 10.10.11.24/32 alias ifconfig ixl0 inet 10.10.11.25/32 alias ifconfig ixl0 inet 10.10.11.26/32 alias ifconfig ixl0 inet 10.10.11.27/32 alias ifconfig ixl0 inet 10.10.11.28/32 alias ifconfig ixl0 inet 10.10.11.29/32 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::20/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::21/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::22/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::23/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::24/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::25/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::26/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::27/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::28/128 alias ifconfig ixl0 inet6 fdd7:e83e:66bd:1011::29/128 alias ifconfig ixl0 up ifconfig ixl1 inet 10.10.12.3/24 ifconfig ixl1 inet6 fdd7:e83e:66bd:1012::3/64 ifconfig ixl1 up ssh root@lt40 ip link set mtu 9000 dev ens2f1 ssh root@lt43 ip link set mtu 9000 dev ens2f1 ssh root@lt40 for net in 10.10.11.1/24 fdd7:e83e:66bd:1011::1/64 ; do ip address add $net dev ens2f1 ; done ssh root@lt43 for net in 10.10.12.4/24 fdd7:e83e:66bd:1012::4/64 10.10.12.40/24 10.10.12.41/24 10.10.12.42/24 10.10.12.43/24 10.10.12.44/24 10.10.12.45/24 10.10.12.46/24 10.10.12.47/24 10.10.12.48/24 10.10.12.49/24 fdd7:e83e:66bd:1012::40/64 fdd7:e83e:66bd:1012::41/64 fdd7:e83e:66bd:1012::42/64 fdd7:e83e:66bd:1012::43/64 fdd7:e83e:66bd:1012::44/64 fdd7:e83e:66bd:1012::45/64 fdd7:e83e:66bd:1012::46/64 fdd7:e83e:66bd:1012::47/64 fdd7:e83e:66bd:1012::48/64 fdd7:e83e:66bd:1012::49/64 ; do ip address add $net dev ens2f1 ; done ssh root@lt40 ip link set dev ens2f1 up ssh root@lt43 ip link set dev ens2f1 up ssh root@lt40 ip route add 10.10.12.0/24 via 10.10.11.2 dev ens2f1 ssh root@lt40 ip route add fdd7:e83e:66bd:1012::/64 via fdd7:e83e:66bd:1011::2 dev ens2f1 ssh root@lt43 ip route add 10.10.11.0/24 via 10.10.12.3 dev ens2f1 ssh root@lt43 ip route add fdd7:e83e:66bd:1011::/64 via fdd7:e83e:66bd:1012::3 dev ens2f1 ping -n -c1 -w5 10.10.11.1 PING 10.10.11.1 (10.10.11.1): 56 data bytes 64 bytes from 10.10.11.1: icmp_seq=0 ttl=64 time=0.561 ms --- 10.10.11.1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.561/0.561/0.561/0.000 ms ping -n -c1 -w5 10.10.12.4 PING 10.10.12.4 (10.10.12.4): 56 data bytes 64 bytes from 10.10.12.4: icmp_seq=0 ttl=64 time=0.469 ms --- 10.10.12.4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.469/0.469/0.469/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1011::1 PING fdd7:e83e:66bd:1011::1 (fdd7:e83e:66bd:1011::1): 56 data bytes 64 bytes from fdd7:e83e:66bd:1011::1: icmp_seq=0 hlim=64 time=0.489 ms --- fdd7:e83e:66bd:1011::1 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.489/0.489/0.489/0.000 ms ping6 -n -c1 -w5 fdd7:e83e:66bd:1012::4 PING fdd7:e83e:66bd:1012::4 (fdd7:e83e:66bd:1012::4): 56 data bytes 64 bytes from fdd7:e83e:66bd:1012::4: icmp_seq=0 hlim=64 time=0.562 ms --- fdd7:e83e:66bd:1012::4 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/std-dev = 0.562/0.562/0.562/0.000 ms new config created: modify jumbo, iface ixl0, pseudo none test 1/72 ssh_root@lt40_ping_-qfc10000_10.10.11.2 test 2/72 ping_-qfc10000_10.10.12.4 test 3/72 ssh_root@lt40_ping_-qfc10000_10.10.12.4 test 4/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1011::2 test 5/72 ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 6/72 ssh_root@lt40_ping6_-qfc10000_fdd7:e83e:66bd:1012::4 test 7/72 ssh -f root@lt43 service tcpbench start rcctl -f start tcpbench tcpbench(ok) test 8/72 ssh_root@lt40_tcpbench_-S1000000_-t10_10.10.11.2 test 9/72 ssh_root@lt40_tcpbench_-S1000000_-t10_-n100_10.10.11.2 test 10/72 tcpbench_-S1000000_-t10_10.10.12.4 test 11/72 tcpbench_-S1000000_-t10_-n100_10.10.12.4 Timeout, server ot41 not responding. 2025-04-04T08:01:59Z Command 'ssh root@ot41 perl /root/netlink/netlink.pl -c none -e /root/netlink/env-ot41.sh -i ixl0 -m jumbo all' failed: 65280 at /data/test/netlink/bin/net.pl line 321.