File System Summary =================== WARN: Device /dev/loop1 (/snap/lxd/19647) is 100% full, might be an issue WARN: Device /dev/loop0 (/snap/core18/1997) is 100% full, might be an issue WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 1.3M 1.2G 1% /run /dev/sda1 39G 5.2G 34G 14% / tmpfs 5.9G 4.0K 5.9G 1% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/loop1 71M 71M 0 100% /snap/lxd/19647 /dev/loop0 56M 56M 0 100% /snap/core18/1997 /dev/loop2 33M 33M 0 100% /snap/snapd/11588 /dev/sda15 105M 7.8M 97M 8% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 123M 390M 24% /opt/stack/data/etcd /dev/loop3 6.0G 73M 6.0G 2% /opt/stack/data/swift/drives/sdb1 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 1.6 0.1 169052 13204 ? Ss 21:25:45 00:01:34 /lib/systemd/systemd --system --deserialize 27 root 0 2 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [kthreadd] root 2 3 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [rcu_gp] root 2 4 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [rcu_par_gp] root 2 6 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [kworker/0:0H] root 2 8 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [mm_percpu_wq] root 2 9 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [ksoftirqd/0] root 2 10 0.0 0.0 0 0 ? I 21:25:45 00:00:05 [rcu_sched] root 2 11 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [migration/0] root 2 12 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [idle_inject/0] root 2 14 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [cpuhp/0] root 2 15 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [cpuhp/1] root 2 16 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [idle_inject/1] root 2 17 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [migration/1] root 2 18 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [ksoftirqd/1] root 2 20 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [kworker/1:0H-kblockd] root 2 21 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [cpuhp/2] root 2 22 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [idle_inject/2] root 2 23 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [migration/2] root 2 24 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [ksoftirqd/2] root 2 26 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [kworker/2:0H-kblockd] root 2 27 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [cpuhp/3] root 2 28 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [idle_inject/3] root 2 29 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [migration/3] root 2 30 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [ksoftirqd/3] root 2 32 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [kworker/3:0H-kblockd] root 2 33 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [kdevtmpfs] root 2 34 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [netns] root 2 35 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [rcu_tasks_kthre] root 2 36 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [kauditd] root 2 41 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [khungtaskd] root 2 42 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [oom_reaper] root 2 43 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [writeback] root 2 44 0.0 0.0 0 0 ? S 21:25:45 00:00:00 [kcompactd0] root 2 45 0.0 0.0 0 0 ? SN 21:25:45 00:00:00 [ksmd] root 2 46 0.0 0.0 0 0 ? SN 21:25:45 00:00:00 [khugepaged] root 2 92 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [kintegrityd] root 2 93 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [kblockd] root 2 94 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [blkcg_punt_bio] root 2 95 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [tpm_dev_wq] root 2 96 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [ata_sff] root 2 97 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [md] root 2 98 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [edac-poller] root 2 99 0.0 0.0 0 0 ? I< 21:25:45 00:00:00 [devfreq_wq] root 2 100 0.0 0.0 0 0 ? S 21:25:46 00:00:00 [watchdogd] root 2 103 0.0 0.0 0 0 ? S 21:25:46 00:00:00 [kswapd0] root 2 104 0.0 0.0 0 0 ? S 21:25:46 00:00:00 [ecryptfs-kthrea] root 2 106 0.0 0.0 0 0 ? I< 21:25:46 00:00:00 [kthrotld] root 2 107 0.0 0.0 0 0 ? I< 21:25:46 00:00:00 [acpi_thermal_pm] root 2 109 0.0 0.0 0 0 ? S 21:25:46 00:00:00 [scsi_eh_0] root 2 110 0.0 0.0 0 0 ? I< 21:25:46 00:00:00 [scsi_tmf_0] root 2 111 0.0 0.0 0 0 ? S 21:25:46 00:00:00 [scsi_eh_1] root 2 112 0.0 0.0 0 0 ? I< 21:25:46 00:00:00 [scsi_tmf_1] root 2 114 0.0 0.0 0 0 ? I< 21:25:46 00:00:00 [vfio-irqfd-clea] root 2 116 0.0 0.0 0 0 ? I< 21:25:47 00:00:00 [ipv6_addrconf] root 2 125 0.0 0.0 0 0 ? I< 21:25:47 00:00:00 [kstrp] root 2 128 0.0 0.0 0 0 ? I< 21:25:47 00:00:00 [kworker/u257:0] root 2 141 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [charger_manager] root 2 183 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [hv_vmbus_con] root 2 184 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [hv_pri_chan] root 2 185 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [kworker/3:1H-kblockd] root 2 186 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [hv_sub_chan] root 2 188 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [cryptd] root 2 229 0.0 0.0 0 0 ? I< 21:25:48 00:00:02 [kworker/0:1H-kblockd] root 2 230 0.0 0.0 0 0 ? S 21:25:48 00:00:00 [scsi_eh_2] root 2 231 0.0 0.0 0 0 ? S 21:25:48 00:00:00 [scsi_eh_3] root 2 232 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [scsi_tmf_2] root 2 233 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [scsi_tmf_3] root 2 236 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [storvsc_error_w] root 2 237 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [storvsc_error_w] root 2 242 0.0 0.0 0 0 ? I< 21:25:48 00:00:00 [kworker/1:1H-kblockd] root 2 275 0.0 0.0 0 0 ? I< 21:25:50 00:00:00 [raid5wq] root 2 315 0.1 0.0 0 0 ? S 21:25:50 00:00:10 [jbd2/sda1-8] root 2 316 0.0 0.0 0 0 ? I< 21:25:50 00:00:00 [ext4-rsv-conver] root 2 357 0.0 0.0 0 0 ? I< 21:25:51 00:00:00 [kworker/2:1H-kblockd] root 1 425 0.0 0.0 19076 5372 ? Ss 21:25:53 00:00:02 /lib/systemd/systemd-udevd root 2 451 0.0 0.0 0 0 ? S 21:25:53 00:00:00 [hv_balloon] root 2 552 0.0 0.0 0 0 ? I< 21:25:54 00:00:00 [kaluad] root 2 553 0.0 0.0 0 0 ? I< 21:25:54 00:00:00 [kmpath_rdacd] root 2 554 0.0 0.0 0 0 ? I< 21:25:54 00:00:00 [kmpathd] root 2 555 0.0 0.0 0 0 ? I< 21:25:54 00:00:00 [kmpath_handlerd] root 1 556 0.0 0.1 280136 17940 ? SLsl 21:25:54 00:00:00 /sbin/multipathd -d -s root 2 566 0.0 0.0 0 0 ? S< 21:25:54 00:00:00 [loop0] root 2 568 0.0 0.0 0 0 ? S< 21:25:54 00:00:00 [loop1] root 2 570 0.0 0.0 0 0 ? S< 21:25:54 00:00:00 [loop2] root 1 772 0.0 0.0 241128 9564 ? Ssl 21:26:06 00:00:01 /usr/lib/accountsservice/accounts-daemon root 1 775 0.0 0.0 8536 2864 ? Ss 21:26:06 00:00:00 /usr/sbin/cron -f message+ 1 776 0.1 0.0 7740 4988 ? Ss 21:26:06 00:00:10 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 781 0.0 0.0 81828 3632 ? Ssl 21:26:06 00:00:00 /usr/sbin/irqbalance --foreground root 1 790 0.0 0.1 29264 17980 ? Ss 21:26:06 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers root 1 794 0.0 0.2 1445148 34112 ? Ssl 21:26:06 00:00:05 /usr/lib/snapd/snapd root 1 796 0.0 0.0 16780 7776 ? Ss 21:26:06 00:00:05 /lib/systemd/systemd-logind daemon 1 801 0.0 0.0 3792 2220 ? Ss 21:26:06 00:00:00 /usr/sbin/atd -f root 1 823 0.0 0.0 7352 2220 ttyS0 Ss+ 21:26:06 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 852 0.0 0.0 5828 1820 tty1 Ss+ 21:26:06 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 871 0.0 0.1 108100 20584 ? Ssl 21:26:06 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 876 0.0 0.0 237752 10292 ? Ssl 21:26:06 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 900 0.0 0.0 12176 7612 ? Ss 21:26:07 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups root 900 1559 0.0 0.0 13792 9012 ? Ss 21:30:01 00:00:00 sshd: ubuntu [priv] ubuntu 1 1570 0.0 0.0 18512 9784 ? Ss 21:30:01 00:00:00 /lib/systemd/systemd --user ubuntu 1570 1576 0.0 0.0 169836 4584 ? S 21:30:01 00:00:00 (sd-pam) ubuntu 1559 1655 0.0 0.0 13928 6596 ? S 21:30:02 00:00:00 sshd: ubuntu@pts/0 root 2 10026 0.0 0.0 2488 588 ? S 21:39:59 00:00:00 bpfilter_umh root 1 18733 0.0 0.0 8140 3792 ? Ss 21:43:18 00:00:01 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf root 1 18890 0.0 0.0 15304 9068 ? Ss 21:43:27 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock haproxy 18890 18891 0.0 0.0 236500 3096 ? Sl 21:43:27 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock pcp 1 21333 0.0 0.0 8388 4364 ? Ss 21:44:11 00:00:03 /usr/lib/pcp/bin/pmcd root 21333 21336 0.0 0.0 7736 3880 ? S 21:44:11 00:00:00 /var/lib/pcp/pmdas/root/pmdaroot root 21336 21337 0.0 0.0 8304 5000 ? S 21:44:11 00:00:00 /var/lib/pcp/pmdas/proc/pmdaproc -d 3 root 21336 21338 0.0 0.0 7212 1640 ? S 21:44:11 00:00:00 /var/lib/pcp/pmdas/xfs/pmdaxfs -d 11 root 21336 21339 0.3 0.0 8268 4940 ? S 21:44:11 00:00:17 /var/lib/pcp/pmdas/linux/pmdalinux root 21336 21340 0.0 0.0 7268 3716 ? S 21:44:11 00:00:00 /var/lib/pcp/pmdas/kvm/pmdakvm -d 95 systemd+ 1 32528 0.0 0.0 26736 8028 ? Ss 21:44:28 00:00:00 /lib/systemd/systemd-networkd systemd+ 1 32549 0.0 0.0 23892 12212 ? Ss 21:44:28 00:00:00 /lib/systemd/systemd-resolved systemd+ 1 32680 0.0 0.0 90228 6152 ? Ssl 21:44:30 00:00:00 /lib/systemd/systemd-timesyncd syslog 1 37395 0.1 0.0 224348 5540 ? Ssl 21:44:46 00:00:07 /usr/sbin/rsyslogd -n -iNONE epmd 1 47367 0.0 0.0 6484 3104 ? Ss 21:46:35 00:00:00 /usr/bin/epmd -systemd rabbitmq 1 47519 0.0 0.0 2608 600 ? Ss 21:46:43 00:00:00 /bin/sh /usr/sbin/rabbitmq-server rabbitmq 47519 47533 0.5 0.7 3316396 88036 ? Sl 21:46:43 00:00:24 /usr/lib/erlang/erts-10.6.4/bin/beam.smp -W w -A 64 -MBas ageffcbf -MHas ageffcbf -MBlmbcs 512 -MHlmbcs 512 -MMmcs 30 -P 1048576 -t 5000000 -stbt db -zdbbl 128000 -K true -- -root /usr/lib/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/ebin -noshell -noinput -s rabbit boot -sname rabbit@dv-neutron-798961-3-hyperv -boot start_sasl -kernel inet_default_connect_options [{nodelay,true}] -sasl errlog_type error -sasl sasl_error_logger false -rabbit lager_log_root "/var/log/rabbitmq" -rabbit lager_default_file "/var/log/rabbitmq/rabbit@dv-neutron-798961-3-hyperv.log" -rabbit lager_upgrade_file "/var/log/rabbitmq/rabbit@dv-neutron-798961-3-hyperv_upgrade.log" -rabbit feature_flags_file "/var/lib/rabbitmq/mnesia/rabbit@dv-neutron-798961-3-hyperv-feature_flags" -rabbit enabled_plugins_file "/etc/rabbitmq/enabled_plugins" -rabbit plugins_dir "/usr/lib/rabbitmq/plugins:/usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/plugins" -rabbit plugins_expand_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-neutron-798961-3-hyperv-plugins-expand" -os_mon start_cpu_sup false -os_mon start_disksup false -os_mon start_memsup false -mnesia dir "/var/lib/rabbitmq/mnesia/rabbit@dv-neutron-798961-3-hyperv" -ra data_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-neutron-798961-3-hyperv/quorum" -kernel inet_dist_listen_min 25672 -kernel inet_dist_listen_max 25672 -- rabbitmq 47533 47790 0.0 0.0 2492 1464 ? Ss 21:46:44 00:00:00 erl_child_setup 65536 rabbitmq 47790 47820 0.0 0.0 3880 928 ? Ss 21:46:48 00:00:00 inet_gethost 4 rabbitmq 47820 47821 0.0 0.0 3960 1860 ? S 21:46:48 00:00:00 inet_gethost 4 root 2 61312 0.0 0.0 0 0 ? I< 21:52:23 00:00:00 [target_completi] root 2 61313 0.0 0.0 0 0 ? I< 21:52:23 00:00:00 [xcopy_wq] ubuntu 1570 71132 0.0 0.0 7244 4560 ? Ss 21:54:07 00:00:01 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only uuidd 1 84717 0.0 0.0 6780 1028 ? Ss 21:59:27 00:00:00 /usr/sbin/uuidd --socket-activation root 2 86447 0.0 0.0 0 0 ? I< 21:59:36 00:00:00 [xfsalloc] root 2 86451 0.0 0.0 0 0 ? I< 21:59:36 00:00:00 [xfs_mru_cache] root 2 87258 0.0 0.0 0 0 ? I< 22:00:29 00:00:00 [dio/sda1] root 2 154940 0.0 0.0 0 0 ? I 22:24:41 00:00:00 [kworker/1:2-rcu_par_gp] root 2 184268 0.0 0.0 0 0 ? I 22:29:34 00:00:00 [kworker/u256:3-events_power_efficient] pcp 1 191238 0.0 0.0 8552 5436 ? S 22:30:32 00:00:00 /usr/lib/pcp/bin/pmlogger -P -r -T24h10m -c config.default -v 100mb -m pmlogger_check 20210701.22.30 root 2 206504 0.0 0.0 0 0 ? I 22:37:39 00:00:00 [kworker/u256:2-events_power_efficient] root 2 209857 0.0 0.0 0 0 ? I 22:41:10 00:00:00 [kworker/1:1-events] root 2 209862 0.0 0.0 0 0 ? I 22:41:10 00:00:00 [kworker/3:1-events] root 2 209943 0.0 0.0 0 0 ? I 22:41:10 00:00:00 [kworker/0:1-events] ubuntu 1655 216093 0.0 0.0 2608 608 pts/0 Ss+ 22:42:09 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1625179329.42-192725197942194/AnsiballZ_command.py && sleep 0 ubuntu 216093 216094 0.0 0.1 25320 17932 pts/0 S+ 22:42:09 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1625179329.42-192725197942194/AnsiballZ_command.py ubuntu 216094 216098 0.0 0.0 2608 608 pts/0 S+ 22:42:09 00:00:00 /bin/sh -c ./unstack.sh > /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 217745 0.0 0.0 0 0 ? I 22:42:13 00:00:00 [kworker/3:2-cgroup_destroy] root 2 218882 0.0 0.0 0 0 ? I 22:42:21 00:00:00 [kworker/2:2-events] ubuntu 216098 220382 0.7 0.0 15192 10564 pts/0 S+ 22:43:46 00:00:06 bash ./stack.sh ubuntu 220382 222600 0.0 0.0 10588 3876 pts/0 S+ 22:43:49 00:00:00 bash ./stack.sh ubuntu 220382 222605 0.0 0.0 10588 3876 pts/0 S+ 22:43:49 00:00:00 bash ./stack.sh ubuntu 222600 222606 0.1 0.0 14924 11068 pts/0 S+ 22:43:49 00:00:01 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2021-07-01-224349 ubuntu 222605 222612 0.0 0.0 14792 11112 pts/0 S+ 22:43:49 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2021-07-01-224349.summary.2021-07-01-224349 root 1 226016 0.4 0.6 142392 79712 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:10:50:08 brd ff:ff:ff:ff:ff:ff inet 10.222.0.24/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 81908sec preferred_lft 81908sec inet6 fe80::f816:3eff:fe10:5008/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000 link/ether fa:16:3e:4c:6b:dc brd ff:ff:ff:ff:ff:ff inet6 fe80::f816:3eff:fe4c:6bdc/64 scope link valid_lft forever preferred_lft forever 13: ovs-system: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 36:57:f8:d2:e3:1f brd ff:ff:ff:ff:ff:ff 14: br-int: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether ee:60:53:3c:24:49 brd ff:ff:ff:ff:ff:ff 15: br-data: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether 8e:d1:f4:02:c7:47 brd ff:ff:ff:ff:ff:ff inet 192.168.0.11/22 brd 192.168.3.255 scope global br-data valid_lft forever preferred_lft forever inet6 fe80::8cd1:f4ff:fe02:c747/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.24 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.24 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.24 metric 100 192.168.0.0/22 dev br-data proto kernel scope link src 192.168.0.11 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.24 metric 100 ip -6 route ----------- ::1 dev lo proto kernel metric 256 pref medium fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium fe80::/64 dev br-data proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- 4e1e9595-1834-48a5-8635-14e2e1691bfb Manager "ptcp:6640:127.0.0.1" is_connected: true Bridge br-data Controller "tcp:127.0.0.1:6633" is_connected: true fail_mode: secure datapath_type: system Port br-data Interface br-data type: internal Port phy-br-data Interface phy-br-data type: patch options: {peer=int-br-data} Port eth1 Interface eth1 Bridge br-int Controller "tcp:127.0.0.1:6633" is_connected: true fail_mode: secure datapath_type: system Port int-br-data Interface int-br-data type: patch options: {peer=phy-br-data} Port br-int Interface br-int type: internal ovs_version: "2.13.3" sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-data --------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:00008ed1f402c747 n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.4) (xid=0x3): 1(eth1): addr:fa:16:3e:4c:6b:dc config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max 2(phy-br-data): addr:1a:35:cf:d6:cf:a8 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:8e:d1:f4:02:c7:47 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-int -------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:0000ee60533c2449 n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.4) (xid=0x3): 1(int-br-data): addr:d6:22:20:f8:c9:41 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-int): addr:ee:60:53:3c:24:49 config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-data -------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.4) (xid=0x2): 1(eth1): addr:fa:16:3e:4c:6b:dc config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max 2(phy-br-data): addr:1a:35:cf:d6:cf:a8 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:8e:d1:f4:02:c7:47 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-int ------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.4) (xid=0x2): 1(int-br-data): addr:d6:22:20:f8:c9:41 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-int): addr:ee:60:53:3c:24:49 config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-data --------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.4) (xid=0x2): 3 ports port LOCAL: rx pkts=230, bytes=57891, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=12, bytes=936, drop=0, errs=0, coll=0 duration=423.990s port 1: rx pkts=3738, bytes=885033, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=78, bytes=6992, drop=0, errs=0, coll=0 duration=420.043s port 2: rx pkts=0, bytes=0, drop=?, errs=?, frame=?, over=?, crc=? tx pkts=12, bytes=3014, drop=?, errs=?, coll=? duration=16.834s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-int -------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.4) (xid=0x2): 2 ports port LOCAL: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=0, bytes=0, drop=0, errs=0, coll=0 duration=424.182s port 1: rx pkts=12, bytes=3014, drop=?, errs=?, frame=?, over=?, crc=? tx pkts=0, bytes=0, drop=?, errs=?, coll=? duration=16.867s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-data --------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.4) (xid=0x2): cookie=0x3aca02fa0cd6a56, duration=16.847s, table=0, n_packets=0, n_bytes=0, priority=2,in_port=2 actions=drop cookie=0x3aca02fa0cd6a56, duration=16.891s, table=0, n_packets=12, n_bytes=3014, priority=0 actions=NORMAL sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-int -------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.4) (xid=0x2): cookie=0x4ab24bcb8c61c6ff, duration=16.962s, table=0, n_packets=0, n_bytes=0, priority=65535,vlan_tci=0x0fff/0x1fff actions=drop cookie=0x4ab24bcb8c61c6ff, duration=16.862s, table=0, n_packets=12, n_bytes=3014, priority=2,in_port=1 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=16.973s, table=0, n_packets=0, n_bytes=0, priority=0 actions=goto_table:60 cookie=0x4ab24bcb8c61c6ff, duration=16.975s, table=23, n_packets=0, n_bytes=0, priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=16.968s, table=24, n_packets=0, n_bytes=0, priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=16.971s, table=60, n_packets=0, n_bytes=0, priority=3 actions=NORMAL cookie=0x4ab24bcb8c61c6ff, duration=16.960s, table=62, n_packets=0, n_bytes=0, priority=3 actions=NORMAL cookie=0x4ab24bcb8c61c6ff, duration=13.453s, table=71, n_packets=0, n_bytes=0, reset_counts priority=110,ct_state=+trk actions=ct_clear,resubmit(,71) cookie=0x4ab24bcb8c61c6ff, duration=13.614s, table=71, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=13.586s, table=72, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=13.562s, table=73, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=13.527s, table=81, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=13.495s, table=82, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=13.390s, table=91, n_packets=0, n_bytes=0, reset_counts priority=1 actions=resubmit(,94) cookie=0x4ab24bcb8c61c6ff, duration=13.352s, table=92, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=13.320s, table=93, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop cookie=0x4ab24bcb8c61c6ff, duration=13.418s, table=94, n_packets=0, n_bytes=0, reset_counts priority=1 actions=NORMAL IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 617K packets, 506M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 560K packets, 105M bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 3571 packets, 1094K bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 3285 packets, 1059K bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 6295 packets, 396K bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 6295 packets, 396K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 391K packets, 122M bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 391K packets, 122M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 388K packets, 77M bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 388K packets, 77M bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= 271150 killall -e -USR2 neutron-dhcp-agent ----------------------------------- guru meditation report in neutron-dhcp-agent log neutron-l3-agent Guru Meditation Report ======================================= 271540 killall -e -USR2 neutron-l3-agent --------------------------------- guru meditation report in neutron-l3-agent log neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= 271910 272424 272425 killall -e -USR2 neutron-metadata-agent --------------------------------------- guru meditation report in neutron-metadata-agent log neutron-openvswitch-agent Guru Meditation Report ================================================ 270789 killall -e -USR2 neutron-openvswitch-agent ------------------------------------------ guru meditation report in neutron-openvswitch-agent log cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running