Hi Brett,
We also want the function you mentioned. vel-tool does not have the function
to examine its test results (for example, there is no IF statement to check
return code in *.sc files).
That means the users need to examine their test results by theirselves.
The examination is done by checking command line results, checking captured
packets and so on.
Basically the users can ignore "was canceled by <Operation not permitted>"
messages. The message expresses that a command failed as the words said,
but the failed commands often appears. For example, test scenarios attempt to
remove the addresses used in each scenario, but cleanup scenarios attempt to
remove all addresses used in Interoperability Test Specification even if the
removed addresses are not assigned. So the messages are shown.
It may be a little verbose.
But, In your test log, "was canceled by <Operation not permitted>" message appears
at ping6 command. It may mean ping6 command does not work correctly.
Please could you check captured packets on DUMPER, command outputs on TAR2 node
and /root/1.1.A.NetBSD.T10K-A.result file on TAR2?
Best Regards,
--
Hiroki ENDO
On Thu, 02 Jul 2009 09:48:48 -0600
Brett Lee <Brett.Lee@Sun.COM> wrote:
> Hi Hiroki,
>
> Thank you for the clarification.
>
> In my attempts to execute Interop tests using vel-5.0.0 I do not see a
> clear signal of PASS or FAIL. Am suspecting I am missing something.
>
> For example, in running "1_1_A.sc" (output below) it looks like the ping
> succeeded however am not sure if that was all there was to be tested.
>
> Is there any type of status or scoreboard of results, perhaps similar to
> the RFC "Self_Test" packages?
>
> Note that I have only installed vel-5.0.0 and no other software (v6eval,
> etc.) on the Unified Topology machines.
>
> Also, am seeing "was canceled by <Operation not permitted>" on the
> console both during a test and during the cleanup in between. Can this
> message be safely ignored?
>
> Thanks again! -Brett
>
>
> [root@superm1 /usr/local/v6/interop_ph1_core/20090630170721]# velm -e
> environment.def -s host.NetBSD/host.host.1_1_A.sc interop
> 1.1.ABC (Host vs Host)
>
> Network 1
> ------+--------------+-----------+------+-
> | | | |
> | 1 | | 1 +-------------+
> TG +-----------+ | +------+ |
> +------| REF-1 (V) | | | LOGO | |
> | +-----------+ | +------+ |
> | (Router) | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | | |
> | TG +----------+ 1 | |
> | +---| TAR* (V) |------+ |
> | | +----------+ |
> | | (Host) |
> | | |
> | | |
> | | |
> | | Network for TG +---------+ |
> -+---+----+-------+- | dump (V)|--+
> | | +---------+ 1
> TG | | | TG
> +---------+ +---------------------------------+
> | vel mgr |
> +---------+
>
> (V) means vel agent is running.
>
> vel mgr> Press Enter key to start test.
>
> setup_cleanup_REF1@mgr : 1.156105 : wait ("wait_show_topology")
> setup_DUMPER@mgr : 5.001033 : delay (5)
> setup_cleanup_REF2@mgr : 5.001142 : sync ("start_setup")
> setup_cleanup_TAR2@mgr : 5.001191 : sync ("start_setup")
> setup_cleanup_REF1@mgr : 5.001100 : sync ("start_setup")
> setup_DUMPER@mgr : 0.000216 : sync ("start_setup")
> setup_cleanup_REF1@REF1 : 0.008949 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.209062 : execute REF1 ("sysctl -w
> net.inet6.ip6.accept_rtadv=0")
> setup_cleanup_REF2@REF2 : 0.009250 : execute-EXECUTE
> setup_cleanup_REF2@mgr : 0.209284 : execute REF2 ("sysctl -w
> net.inet6.ip6.accept_rtadv=0")
> setup_cleanup_REF1@REF1 : 0.008985 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.209019 : execute REF1 ("sysctl -w
> net.inet6.ip6.forwarding=1")
> setup_cleanup_REF2@REF2 : 0.009223 : execute-EXECUTE
> setup_cleanup_REF2@mgr : 0.209043 : execute REF2 ("sysctl -w
> net.inet6.ip6.forwarding=0")
> setup_cleanup_REF2@REF2 : 0.024572 : execute-EXECUTE
> setup_cleanup_REF2@mgr : 0.223759 : execute REF2 ("ifconfig em1 down")
> setup_cleanup_REF1@REF1 : 0.046066 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.245875 : execute REF1 ("ifconfig em1 up")
> setup_cleanup_REF2@REF2 : 0.024310 : execute-EXECUTE
> setup_cleanup_REF2@mgr : 0.223952 : execute REF2 ("ifconfig em2 down")
> setup_cleanup_REF1@REF1 : 0.024473 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.223955 : execute REF1 ("ifconfig em2 down")
> setup_cleanup_REF1@mgr : 2.000779 : delay (2)
> setup_cleanup_REF1@REF1 : 0.009840 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.210201 : execute REF1 ("ifconfig em1
> inet6 3ffe:501:ffff:100:0204:23ff:fe9f:3a38 prefixlen 64")
> cleanup_DUMPER@mgr : 10.001018 : delay (10)
> setup_cleanup_REF1@mgr : 2.001739 : delay (2)
> setup_cleanup_REF1@REF1 : 0.009749 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.209237 : execute REF1 ("/bin/sh -c echo
> default:\\ > /tmp/rtadvd.conf")
> setup_cleanup_REF1@REF1 : 0.009677 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208960 : execute REF1 ("/bin/sh -c echo
> :vltime#2592000: >> /tmp/rtadvd.conf")
> setup_cleanup_REF1@REF1 : 0.009688 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208963 : execute REF1 ("/bin/sh -c echo
> em1:\\ >> /tmp/rtadvd.conf")
> setup_cleanup_REF1@REF1 : 0.009644 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208964 : execute REF1 ("/bin/sh -c echo
> :addr=\"3ffe:501:ffff:100::\":mtu#1500:tc=default: >>
> /tmp/rtadvd.conf")
> setup_cleanup_REF1@REF1 : 0.009657 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.209086 : execute REF1 ("/bin/sh -c echo
> > /dev/null")
> setup_cleanup_REF1@REF1 : 0.009669 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208962 : execute REF1 ("/bin/sh -c echo
> > /dev/null")
> setup_cleanup_REF1@REF1 : 0.009624 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208967 : execute REF1 ("/bin/sh -c echo
> > /dev/null")
> setup_cleanup_REF1@REF1 : 0.009658 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208962 : execute REF1 ("/bin/sh -c echo
> > /dev/null")
> setup_cleanup_REF1@REF1 : 0.025135 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.224961 : execute REF1 ("rtadvd -c
> /tmp/rtadvd.conf em1")
> setup_cleanup_REF1@mgr : 2.000726 : delay (2)
> test_TAR2@mgr : 14.000111 : sync ("finish_router_setup")
> setup_cleanup_TAR2@mgr : 8.998942 : sync ("finish_router_setup")
> setup_cleanup_REF1@mgr : 0.000141 : sync ("finish_router_setup")
> setup_cleanup_TAR2@TAR2 : 0.001579 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.294092 : execute TAR2 ("sysctl -w
> net.inet6.ip6.forwarding=0")
> setup_cleanup_TAR2@TAR2 : 0.001537 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.299028 : execute TAR2 ("sysctl -w
> net.inet6.ip6.accept_rtadv=1")
> setup_cleanup_TAR2@TAR2 : 1.072235 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 1.371073 : execute TAR2 ("ifconfig wm1 up")
> setup_cleanup_TAR2@TAR2 : 0.001114 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.298898 : execute TAR2 ("ifconfig wm2 down")
> setup_cleanup_REF2@mgr : 10.396131 : sync ("finish_setup")
> cleanup_DUMPER@mgr : 6.262347 : sync ("finish_setup")
> test_TAR2@mgr : 2.263314 : sync ("finish_setup")
>
> vel mgr> Setup
> vel mgr> You can initialize YOUR DEVICE.
> vel mgr> Allow time for all devices to perform stateless address
> vel mgr> autoconfiguration and Duplicate Address Detection.
> vel mgr> Press Enter key for continue.
>
> setup_cleanup_REF1@mgr : 550.852879 : sync ("finish_setup")
> setup_cleanup_TAR2@mgr : 548.589811 : sync ("finish_setup")
> test_TAR2@mgr : 548.589673 : wait ("wait_setup")
>
> vel mgr> Step 1 (Spec)
> vel mgr> Transmit ICMPv6 Echo Request from YOUR DEVICE to TAR2
> vel mgr> Link-Local Address fe80::0207:e9ff:fe17:bda6 and Save the command
> vel mgr> result log as /tmp/1.1.A.T10K-A.NetBSD.result.
> vel mgr> Press Enter key for continue.
>
> test_TAR2@mgr : 470.232155 : wait ("wait_step1")
>
> vel mgr> Step 3 (Spec)
> test_TAR2@TAR2 : 0.001737 : execute-EXECUTE
> test_TAR2@mgr : 0.302057 : execute TAR2 ("ndp -cn")
> test_TAR2@TAR2 : 0.003988 : execute-EXECUTE
> test_TAR2@mgr : 0.301894 : execute TAR2 ("ndp -a")
> test_TAR2@TAR2 : 0.001649 : execute-EXECUTE
> test_TAR2@mgr : 0.298161 : execute TAR2 ("/bin/sh -c echo > /dev/null")
> test_TAR2@TAR2 : 0.001630 : execute-EXECUTE
> test_TAR2@mgr : 0.299901 : execute TAR2 ("/bin/sh -c echo > /dev/null")
> test_TAR2@TAR2 : 0.001582 : execute-EXECUTE
> test_TAR2@mgr : 0.299905 : execute TAR2 ("/bin/sh -c echo > /dev/null")
> test_TAR2@TAR2 : 0.001604 : execute-EXECUTE
> test_TAR2@mgr : 0.300028 : execute TAR2 ("/bin/sh -c echo > /dev/null")
>
>
> TAR2> execute(/bin/sh -c ping6 -c 5 -I wm1 fe80::0210:4fff:fe07:63d5 |
> tee /root/1.1.A.NetBSD.T10K-A.result) was canceled by <Operation not
> permitted>.
>
> test_TAR2@mgr : 5.359083 : execute TAR2 ("/bin/sh -c ping6 -c 5 -I
> wm1 fe80::0210:4fff:fe07:63d5 | tee /root/1.1.A.NetBSD.T10K-A.result")
> test_TAR2@mgr : 5.000642 : delay (5)
> setup_cleanup_REF2@mgr : 1030.984094 : sync ("finish_test")
> cleanup_DUMPER@mgr : 1030.984086 : sync ("finish_test")
> setup_cleanup_REF1@mgr : 482.394413 : sync ("finish_test")
> setup_cleanup_TAR2@mgr : 482.394438 : sync ("finish_test")
> test_TAR2@mgr : 0.000222 : sync ("finish_test")
> setup_cleanup_REF1@REF1 : 0.009911 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.210038 : execute REF1 ("killall -9 rtadvd")
> setup_cleanup_TAR2@TAR2 : 0.001189 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.299041 : execute TAR2 ("ifconfig wm1 down")
> setup_cleanup_REF1@REF1 : 0.009675 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208960 : execute REF1 ("/bin/sh -c echo
> > /dev/null")
> setup_cleanup_TAR2@TAR2 : 0.001257 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.299903 : execute TAR2 ("ifconfig wm1
> inet6 fe80::0207:e9ff:fe17:bda6 delete")
> setup_cleanup_REF1@REF1 : 0.009184 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208963 : execute REF1 ("sysctl -w
> net.inet6.ip6.accept_rtadv=0")
> setup_cleanup_REF1@REF1 : 0.008992 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208971 : execute REF1 ("sysctl -w
> net.inet6.ip6.forwarding=0")
> setup_cleanup_TAR2@TAR2 : 0.001258 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.300028 : execute TAR2 ("ifconfig wm1
> inet6 3ffe:501:ffff:100:0207:e9ff:fe17:bda6 delete")
> setup_cleanup_REF1@REF1 : 0.009763 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.209082 : execute REF1 ("ndp -cn")
> setup_cleanup_TAR2@TAR2 : 0.001514 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.300024 : execute TAR2 ("sysctl -w
> net.inet6.ip6.accept_rtadv=0")
> setup_cleanup_REF1@REF1 : 0.011537 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.210981 : execute REF1 ("ndp -a")
> setup_cleanup_REF1@REF1 : 0.009669 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208947 : execute REF1 ("/bin/sh -c echo
> > /dev/null")
> setup_cleanup_TAR2@TAR2 : 0.001503 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.300900 : execute TAR2 ("sysctl -w
> net.inet6.ip6.forwarding=0")
> setup_cleanup_REF1@REF1 : 0.009714 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208965 : execute REF1 ("/bin/sh -c echo
> > /dev/null")
> setup_cleanup_TAR2@TAR2 : 0.001198 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.299032 : execute TAR2 ("ndp -Rn")
> setup_cleanup_REF1@REF1 : 0.024496 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.223949 : execute REF1 ("ifconfig em1 down")
> setup_cleanup_TAR2@TAR2 : 0.001260 : execute-EXECUTE
> setup_cleanup_TAR2@mgr : 0.299904 : execute TAR2 ("ndp -Pn")
> setup_cleanup_REF1@REF1 : 0.009432 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208966 : execute REF1 ("ifconfig em2 down")
> setup_cleanup_REF1@REF1 : 0.009555 : execute-EXECUTE
> setup_cleanup_REF1@mgr : 0.208965 : execute REF1 ("ifconfig em1
> inet6 3ffe:501:ffff:100:0204:23ff:fe9f:3a38 delete")
> cleanup_DUMPER@mgr : 5.000876 : delay (5)
> cleanup_DUMPER@DUMPER : 0.009997 : execute-EXECUTE
> cleanup_DUMPER@mgr : 0.210219 : execute DUMPER ("killall tcpdump")
> setup_DUMPER@DUMPER : 0.010448 : execute-EXECUTE
> setup_DUMPER@mgr : 1047.457454 : execute DUMPER ("tcpdump -i em1 -c
> 10000 -s 0 -w /tmp/1.1.A.T10K-A.NetBSD.Network1.dump")
> [root@superm1 /usr/local/v6/interop_ph1_core/20090630170721]#
>
>
>
>
> [root@superm1 /usr/local/v6/interop_ph1_core/20090630170721]#
> ./collect_result.sh
> scp: No match.
> scp: /tmp/1.*: No such file or directory
> scp: /tmp/1.*: No such file or directory
> scp: /tmp/1.*: No such file or directory
> scp: No match.
> 1.1.A.T10K-A.NetBSD.Network1.dump
> 100% 181KB 181.1KB/s 00:00
> [root@superm1 /usr/local/v6/interop_ph1_core/20090630170721]#
>
>
>
>
> [root@superm1 ~]# ssh superm6
> Last login: Tue Jun 30 13:05:41 2009 from superm1.apevt.local
> NetBSD 4.0.1 (GENERIC) #0: Tue Oct 7 22:58:48 PDT 2008
>
> Welcome to NetBSD!
>
> Terminal type is xterm.
> We recommend creating a non-root account and using su(1) for root access.
> superm6# cat /root/1.1.A.NetBSD.T10K-A.result
> PING6(56=40+8+8 bytes) fe80::207:e9ff:fe17:bda6%wm1 -->
> fe80::210:4fff:fe07:63d5
> 16 bytes from fe80::210:4fff:fe07:63d5%wm1, icmp_seq=0 hlim=64 time=0.644 ms
> 16 bytes from fe80::210:4fff:fe07:63d5%wm1, icmp_seq=1 hlim=64 time=0.373 ms
> 16 bytes from fe80::210:4fff:fe07:63d5%wm1, icmp_seq=2 hlim=64 time=0.385 ms
> 16 bytes from fe80::210:4fff:fe07:63d5%wm1, icmp_seq=3 hlim=64 time=0.251 ms
> 16 bytes from fe80::210:4fff:fe07:63d5%wm1, icmp_seq=4 hlim=64 time=0.264 ms
>
> --- fe80::0210:4fff:fe07:63d5 ping6 statistics ---
> 5 packets transmitted, 5 packets received, 0.0% packet loss
> round-trip min/avg/max/std-dev = 0.251/0.383/0.644/0.158 ms
> superm6# ls -l /root/1.1.A.NetBSD.T10K-A.result
> -rw-r--r-- 1 root wheel 638 Jun 30 13:22 /root/1.1.A.NetBSD.T10K-A.result
> superm6# date
> Tue Jun 30 13:30:48 MDT 2009
> superm6#
>
>
>
> Hiroki ENDO wrote:
> > Hello Brett,
> >
> > Sorry to have kept you waiting.
> > Please see answers in-line.
> >
> > On Thu, 25 Jun 2009 17:32:56 -0600
> > Brett Lee <Brett.Lee@Sun.COM> wrote:
> >
> >> Hello,
> >>
> >> Am setting up Virtual Evaluation Lab (vel) for the first time.
> >>
> >> Have a couple questions regarding the Traffic Generation (TG) network to
> >> which the VEL MGR is attached:
> >>
> >> 1. Is it permissible to have hosts that are not part of the Unified
> >> Topology on this Ethernet (VLAN, collision domain)?
> >
> > Yes. If VEL MGR can only communicate with VEL AGENTs, you can work free
> > on TG network.
> >
> >> 2. Similarly, if the currently unused target (TAR) nodes have their
> >> other interfaces (Network 1, Network 2 and Network 3) down, is it
> >> permissible for the unused TAR nodes to have their TG interfaces up?
> >
> > Yes. VEL MGR does not attempt to connect to the unused TAR nodes.
> > It has no effect on the behavior.
> >
> > Best Regards,
> > --
> > Hiroki ENDO
> >
> >> Thanks in advance for the clarification.
> >>
> >> -Brett
> >> Brett.Lee@Sun.COM
> >>
> >>
> >>
> >>
> >>
> >>
> >
>
>