File System Summary
===================

WARN: Device /dev/loop0 (/snap/lxd/19647) is 100% full, might be an issue
WARN: Device /dev/loop1 (/snap/core18/1997) is 100% full, might be an issue
WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue
Filesystem      Size  Used Avail Use% Mounted on
udev            5.9G     0  5.9G   0% /dev
tmpfs           1.2G  1.3M  1.2G   1% /run
/dev/sda1        39G  6.3G   33G  17% /
tmpfs           5.9G  4.0K  5.9G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           5.9G     0  5.9G   0% /sys/fs/cgroup
/dev/loop0       71M   71M     0 100% /snap/lxd/19647
/dev/loop1       56M   56M     0 100% /snap/core18/1997
/dev/loop2       33M   33M     0 100% /snap/snapd/11588
/dev/sda15      105M  7.8M   97M   8% /boot/efi
tmpfs           1.2G     0  1.2G   0% /run/user/1000
tmpfs           512M  123M  390M  24% /opt/stack/data/etcd
/dev/loop3      6.0G  689M  5.4G  12% /opt/stack/data/swift/drives/sdb1


Process Listing
===============

ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args
---------------------------------------------------------------

USER        PPID     PID %CPU %MEM    VSZ   RSS TT       STAT  STARTED     TIME COMMAND
root           0       1  2.3  0.1 171064 13248 ?        Ss   15:05:53 00:00:54 /lib/systemd/systemd --system --deserialize 27
root           0       2  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [kthreadd]
root           2       3  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [rcu_gp]
root           2       4  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [rcu_par_gp]
root           2       6  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [kworker/0:0H]
root           2       8  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [mm_percpu_wq]
root           2       9  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [ksoftirqd/0]
root           2      10  0.1  0.0      0     0 ?        I    15:05:53 00:00:03 [rcu_sched]
root           2      11  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [migration/0]
root           2      12  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [idle_inject/0]
root           2      14  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [cpuhp/0]
root           2      15  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [cpuhp/1]
root           2      16  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [idle_inject/1]
root           2      17  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [migration/1]
root           2      18  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [ksoftirqd/1]
root           2      20  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [kworker/1:0H-kblockd]
root           2      21  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [cpuhp/2]
root           2      22  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [idle_inject/2]
root           2      23  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [migration/2]
root           2      24  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [ksoftirqd/2]
root           2      26  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [kworker/2:0H-kblockd]
root           2      27  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [cpuhp/3]
root           2      28  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [idle_inject/3]
root           2      29  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [migration/3]
root           2      30  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [ksoftirqd/3]
root           2      32  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [kworker/3:0H-kblockd]
root           2      33  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [kdevtmpfs]
root           2      34  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [netns]
root           2      35  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [rcu_tasks_kthre]
root           2      36  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [kauditd]
root           2      39  0.0  0.0      0     0 ?        I    15:05:53 00:00:00 [kworker/2:1-events]
root           2      41  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [khungtaskd]
root           2      42  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [oom_reaper]
root           2      43  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [writeback]
root           2      44  0.0  0.0      0     0 ?        S    15:05:53 00:00:00 [kcompactd0]
root           2      45  0.0  0.0      0     0 ?        SN   15:05:53 00:00:00 [ksmd]
root           2      46  0.0  0.0      0     0 ?        SN   15:05:53 00:00:00 [khugepaged]
root           2      92  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [kintegrityd]
root           2      93  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [kblockd]
root           2      94  0.0  0.0      0     0 ?        I<   15:05:53 00:00:00 [blkcg_punt_bio]
root           2      95  0.0  0.0      0     0 ?        I<   15:05:54 00:00:00 [tpm_dev_wq]
root           2      96  0.0  0.0      0     0 ?        I<   15:05:54 00:00:00 [ata_sff]
root           2      97  0.0  0.0      0     0 ?        I<   15:05:54 00:00:00 [md]
root           2      98  0.0  0.0      0     0 ?        I<   15:05:54 00:00:00 [edac-poller]
root           2      99  0.0  0.0      0     0 ?        I<   15:05:54 00:00:00 [devfreq_wq]
root           2     100  0.0  0.0      0     0 ?        S    15:05:54 00:00:00 [watchdogd]
root           2     105  0.0  0.0      0     0 ?        S    15:05:55 00:00:00 [kswapd0]
root           2     106  0.0  0.0      0     0 ?        S    15:05:55 00:00:00 [ecryptfs-kthrea]
root           2     108  0.0  0.0      0     0 ?        I<   15:05:55 00:00:00 [kthrotld]
root           2     109  0.0  0.0      0     0 ?        I<   15:05:55 00:00:00 [acpi_thermal_pm]
root           2     110  0.0  0.0      0     0 ?        S    15:05:55 00:00:00 [scsi_eh_0]
root           2     111  0.0  0.0      0     0 ?        I<   15:05:55 00:00:00 [scsi_tmf_0]
root           2     112  0.0  0.0      0     0 ?        S    15:05:55 00:00:00 [scsi_eh_1]
root           2     113  0.0  0.0      0     0 ?        I<   15:05:55 00:00:00 [scsi_tmf_1]
root           2     115  0.0  0.0      0     0 ?        I<   15:05:55 00:00:00 [vfio-irqfd-clea]
root           2     116  0.0  0.0      0     0 ?        I<   15:05:56 00:00:00 [ipv6_addrconf]
root           2     126  0.0  0.0      0     0 ?        I<   15:05:56 00:00:00 [kstrp]
root           2     129  0.0  0.0      0     0 ?        I<   15:05:56 00:00:00 [kworker/u257:0]
root           2     142  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [charger_manager]
root           2     188  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [hv_vmbus_con]
root           2     189  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [hv_pri_chan]
root           2     190  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [hv_sub_chan]
root           2     191  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [kworker/3:1H-kblockd]
root           2     192  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [cryptd]
root           2     232  0.0  0.0      0     0 ?        I<   15:05:57 00:00:01 [kworker/0:1H-kblockd]
root           2     233  0.0  0.0      0     0 ?        S    15:05:57 00:00:00 [scsi_eh_2]
root           2     234  0.0  0.0      0     0 ?        S    15:05:57 00:00:00 [scsi_eh_3]
root           2     235  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [scsi_tmf_2]
root           2     236  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [scsi_tmf_3]
root           2     237  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [storvsc_error_w]
root           2     238  0.0  0.0      0     0 ?        I<   15:05:57 00:00:00 [storvsc_error_w]
root           2     271  0.0  0.0      0     0 ?        I<   15:05:59 00:00:00 [raid5wq]
root           2     297  0.0  0.0      0     0 ?        I<   15:05:59 00:00:00 [kworker/2:1H-kblockd]
root           2     312  0.0  0.0      0     0 ?        I<   15:05:59 00:00:00 [kworker/1:1H-kblockd]
root           2     313  0.2  0.0      0     0 ?        S    15:05:59 00:00:04 [jbd2/sda1-8]
root           2     314  0.0  0.0      0     0 ?        I<   15:05:59 00:00:00 [ext4-rsv-conver]
root           1     417  0.0  0.0  19064  5344 ?        Ss   15:06:01 00:00:01 /lib/systemd/systemd-udevd
root           2     448  0.0  0.0      0     0 ?        S    15:06:02 00:00:00 [hv_balloon]
root           2     546  0.0  0.0      0     0 ?        I<   15:06:02 00:00:00 [kaluad]
root           2     547  0.0  0.0      0     0 ?        I<   15:06:02 00:00:00 [kmpath_rdacd]
root           2     548  0.0  0.0      0     0 ?        I<   15:06:02 00:00:00 [kmpathd]
root           2     549  0.0  0.0      0     0 ?        I<   15:06:02 00:00:00 [kmpath_handlerd]
root           1     550  0.0  0.1 280136 17940 ?        SLsl 15:06:02 00:00:00 /sbin/multipathd -d -s
root           2     560  0.0  0.0      0     0 ?        S<   15:06:03 00:00:00 [loop0]
root           2     562  0.0  0.0      0     0 ?        S<   15:06:03 00:00:00 [loop1]
root           2     565  0.0  0.0      0     0 ?        S<   15:06:03 00:00:00 [loop2]
root           1     775  0.0  0.0 241048  9504 ?        Ssl  15:06:13 00:00:00 /usr/lib/accountsservice/accounts-daemon
root           1     778  0.0  0.0   8536  2888 ?        Ss   15:06:13 00:00:00 /usr/sbin/cron -f
message+       1     780  0.2  0.0   7740  4880 ?        Ss   15:06:13 00:00:06 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root           1     788  0.0  0.0  81828  3792 ?        Ssl  15:06:14 00:00:00 /usr/sbin/irqbalance --foreground
root           1     793  0.0  0.1  29264 18116 ?        Ss   15:06:14 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
root           1     797  0.1  0.2 1296628 34024 ?       Ssl  15:06:14 00:00:04 /usr/lib/snapd/snapd
root           1     798  0.1  0.0  16780  7620 ?        Ss   15:06:14 00:00:03 /lib/systemd/systemd-logind
daemon         1     800  0.0  0.0   3792  2216 ?        Ss   15:06:14 00:00:00 /usr/sbin/atd -f
root           2     815  0.0  0.0      0     0 ?        I    15:06:14 00:00:00 [kworker/3:3-events]
root           1     853  0.0  0.0   7352  2424 ttyS0    Ss+  15:06:14 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220
root           1     864  0.0  0.0   5828  1876 tty1     Ss+  15:06:14 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
root           1     872  0.0  0.1 108100 20972 ?        Ssl  15:06:14 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root           1     878  0.0  0.0 237752 10228 ?        Ssl  15:06:14 00:00:00 /usr/lib/policykit-1/polkitd --no-debug
root           1    1566  0.0  0.0  13796  9008 ?        Ss   15:10:33 00:00:00 sshd: ubuntu [priv]
ubuntu         1    1583  0.0  0.0  18508  9640 ?        Ss   15:10:33 00:00:00 /lib/systemd/systemd --user
ubuntu      1583    1584  0.0  0.0 169784  4556 ?        S    15:10:33 00:00:00 (sd-pam)
ubuntu      1566    1662  0.0  0.0  14060  6596 ?        S    15:10:34 00:00:00 sshd: ubuntu@pts/0
root           2    8508  0.1  0.0      0     0 ?        I    15:17:33 00:00:01 [kworker/u256:2-events_power_efficient]
ubuntu      1662    9022  0.0  0.0   2608   612 pts/0    Ss+  15:23:59 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1632756239.61-45555952081473/AnsiballZ_command.py && sleep 0
ubuntu      9022    9023  0.0  0.1  27828 18072 pts/0    S+   15:23:59 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1632756239.61-45555952081473/AnsiballZ_command.py
ubuntu      9023    9025  0.0  0.0   2608   532 pts/0    S+   15:23:59 00:00:00 /bin/sh -c ./unstack.sh > /dev/null 2>&1  ./stack.sh > /dev/null 2>&1
root           2   10232  0.0  0.0   2488   588 ?        S    15:24:02 00:00:00 bpfilter_umh
root           2   11354  0.1  0.0      0     0 ?        I    15:24:04 00:00:01 [kworker/u256:0-events_power_efficient]
ubuntu      9025   11762  0.7  0.0  15268 10476 pts/0    S+   15:24:07 00:00:09 bash ./stack.sh
ubuntu     11762   14021  0.0  0.0  10644  3752 pts/0    S+   15:24:11 00:00:00 bash ./stack.sh
ubuntu     11762   14026  0.0  0.0  10644  3752 pts/0    S+   15:24:11 00:00:00 bash ./stack.sh
ubuntu     14021   14027  0.2  0.0  17516 11200 pts/0    S+   15:24:11 00:00:03 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2021-09-27-152412
ubuntu     14026   14033  0.0  0.0  17384 11276 pts/0    S+   15:24:11 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2021-09-27-152412.summary.2021-09-27-152412
root           1   19123  0.0  0.0   8140  3784 ?        Ss   15:25:42 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf
root           1   19279  0.0  0.0  15304  9016 ?        Ss   15:25:45 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock
haproxy    19279   19280  0.0  0.0 236500  3024 ?        Sl   15:25:45 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock
root           2   20571  0.0  0.0      0     0 ?        I    15:25:51 00:00:00 [kworker/1:3-events]
root           1   20800  0.0  0.0  12176  7032 ?        Ss   15:25:55 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
pcp            1   21903  0.2  0.0   8356  4448 ?        Ss   15:26:06 00:00:02 /usr/lib/pcp/bin/pmcd
root       21903   21906  0.0  0.0   7736  3828 ?        S    15:26:06 00:00:00 /var/lib/pcp/pmdas/root/pmdaroot
root       21906   21907  0.0  0.0   8304  5024 ?        S    15:26:06 00:00:00 /var/lib/pcp/pmdas/proc/pmdaproc -d 3
root       21906   21908  0.0  0.0   7212  1692 ?        S    15:26:06 00:00:00 /var/lib/pcp/pmdas/xfs/pmdaxfs -d 11
root       21906   21909  0.3  0.0   8264  5108 ?        S    15:26:06 00:00:03 /var/lib/pcp/pmdas/linux/pmdalinux
root       21906   21910  0.0  0.0   7264  3760 ?        S    15:26:06 00:00:00 /var/lib/pcp/pmdas/kvm/pmdakvm -d 95
systemd+       1   33131  0.0  0.0  34932  7960 ?        Ss   15:26:23 00:00:00 /lib/systemd/systemd-networkd
systemd+       1   33147  0.0  0.0  23896 12172 ?        Ss   15:26:23 00:00:00 /lib/systemd/systemd-resolved
root           2   33154  0.0  0.0      0     0 ?        I    15:26:23 00:00:00 [kworker/0:4-rcu_par_gp]
systemd+       1   33275  0.0  0.0  90228  6148 ?        Ssl  15:26:24 00:00:00 /lib/systemd/systemd-timesyncd
syslog         1   37988  0.3  0.0 224348  4668 ?        Ssl  15:26:40 00:00:03 /usr/sbin/rsyslogd -n -iNONE
ubuntu      1583   47060  0.0  0.0   7244  4520 ?        Ss   15:27:23 00:00:00 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root           1   47375  0.7  0.4  94440 58564 ?        S<s  15:27:40 00:00:07 /lib/systemd/systemd-journald
epmd           1   48230  0.0  0.0   6352  1316 ?        Ss   15:28:33 00:00:00 /usr/bin/epmd -systemd
rabbitmq       1   48384  0.0  0.0   2608   540 ?        Ss   15:28:38 00:00:00 /bin/sh /usr/sbin/rabbitmq-server
rabbitmq   48384   48397  1.4  0.6 3345932 84692 ?       Sl   15:28:38 00:00:13 /usr/lib/erlang/erts-10.6.4/bin/beam.smp -W w -A 64 -MBas ageffcbf -MHas ageffcbf -MBlmbcs 512 -MHlmbcs 512 -MMmcs 30 -P 1048576 -t 5000000 -stbt db -zdbbl 128000 -K true -- -root /usr/lib/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/ebin  -noshell -noinput -s rabbit boot -sname rabbit@dv-cinder-809518-3-smb -boot start_sasl -kernel inet_default_connect_options [{nodelay,true}] -sasl errlog_type error -sasl sasl_error_logger false -rabbit lager_log_root "/var/log/rabbitmq" -rabbit lager_default_file "/var/log/rabbitmq/rabbit@dv-cinder-809518-3-smb.log" -rabbit lager_upgrade_file "/var/log/rabbitmq/rabbit@dv-cinder-809518-3-smb_upgrade.log" -rabbit feature_flags_file "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-809518-3-smb-feature_flags" -rabbit enabled_plugins_file "/etc/rabbitmq/enabled_plugins" -rabbit plugins_dir "/usr/lib/rabbitmq/plugins:/usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/plugins" -rabbit plugins_expand_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-809518-3-smb-plugins-expand" -os_mon start_cpu_sup false -os_mon start_disksup false -os_mon start_memsup false -mnesia dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-809518-3-smb" -ra data_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-809518-3-smb/quorum" -kernel inet_dist_listen_min 25672 -kernel inet_dist_listen_max 25672 --
rabbitmq   48397   48654  0.0  0.0   2492  1328 ?        Ss   15:28:39 00:00:00 erl_child_setup 65536
rabbitmq   48654   48684  0.0  0.0   3880   924 ?        Ss   15:28:44 00:00:00 inet_gethost 4
rabbitmq   48684   48685  0.0  0.0   3960  1848 ?        S    15:28:44 00:00:00 inet_gethost 4
root           1   51996  0.0  0.0   9660  5168 ?        S<s  15:29:58 00:00:00 ovsdb-server /etc/openvswitch/conf.db -vconsole:emer -vsyslog:err -vfile:info --remote=punix:/var/run/openvswitch/db.sock --private-key=db:Open_vSwitch,SSL,private_key --certificate=db:Open_vSwitch,SSL,certificate --bootstrap-ca-cert=db:Open_vSwitch,SSL,ca_cert --no-chdir --log-file=/var/log/openvswitch/ovsdb-server.log --pidfile=/var/run/openvswitch/ovsdb-server.pid --detach
root           2   51998  0.0  0.0      0     0 ?        I    15:29:58 00:00:00 [kworker/2:0-rcu_par_gp]
root           1   52047  0.1  0.4 382544 55404 ?        S<Lsl 15:29:58 00:00:01 ovs-vswitchd unix:/var/run/openvswitch/db.sock -vconsole:emer -vsyslog:err -vfile:info --mlockall --no-chdir --log-file=/var/log/openvswitch/ovs-vswitchd.log --pidfile=/var/run/openvswitch/ovs-vswitchd.pid --detach
pcp            1   60534  0.1  0.0   8428  5004 ?        S    15:30:50 00:00:00 /usr/lib/pcp/bin/pmlogger -P -r -T24h10m -c config.default -v 100mb -m pmlogger_check 20210927.15.30
root           2   68754  0.0  0.0      0     0 ?        I<   15:33:23 00:00:00 [target_completi]
root           2   68755  0.0  0.0      0     0 ?        I<   15:33:23 00:00:00 [xcopy_wq]
root           2   77260  0.0  0.0      0     0 ?        I    15:35:08 00:00:00 [kworker/0:0-rcu_par_gp]
root           1   77278  0.0  0.0  13972  5528 ?        Ss   15:35:08 00:00:00 /usr/sbin/apache2 -k start
www-data   77278   77279  0.1  0.1 1943492 12324 ?       Sl   15:35:08 00:00:00 /usr/sbin/apache2 -k start
www-data   77278   77280  0.3  0.1 1943584 12324 ?       Sl   15:35:08 00:00:01 /usr/sbin/apache2 -k start
mysql          1   78309 11.5  5.4 2856296 666492 ?      Ssl  15:35:19 00:00:58 /usr/sbin/mysqld
root           2   78739  0.0  0.0      0     0 ?        I    15:35:23 00:00:00 [kworker/u256:1-events_power_efficient]
ubuntu         1   78768  0.0  0.0   5648  3180 ?        Ss   15:35:23 00:00:00 /bin/bash /home/ubuntu/devstack/tools/dstat.sh /opt/stack/logs
ubuntu     78768   78927  0.3  0.1  21356 16464 ?        S    15:35:23 00:00:01 python3 /usr/bin/dstat -tcmndrylpg --tcp --output /opt/stack/logs/dstat-csv.log
ubuntu     78768   78928  0.3  0.1  21356 16484 ?        S    15:35:23 00:00:01 python3 /usr/bin/dstat -tcmndrylpg --swap --tcp
root           1   79347  0.7  0.1 10516468 18952 ?      Ssl  15:35:27 00:00:03 /opt/stack/bin/etcd --name dv-cinder-809518-3-smb --data-dir /opt/stack/data/etcd --initial-cluster-state new --initial-cluster-token etcd-cluster-01 --initial-cluster dv-cinder-809518-3-smb=http://10.222.0.76:2380 --initial-advertise-peer-urls http://10.222.0.76:2380 --advertise-client-urls http://10.222.0.76:2379 --listen-peer-urls http://0.0.0.0:2380 --listen-client-urls http://10.222.0.76:2379 --debug
ubuntu         1   80127  0.0  0.1  52576 14656 ?        Ss   15:36:02 00:00:00 keystoneuWSGI master
ubuntu     80127   80137  7.7  1.0 185744 126636 ?       S    15:36:02 00:00:35 keystoneuWSGI worker 1
ubuntu     80127   80138  7.6  1.0 185572 126476 ?       S    15:36:02 00:00:35 keystoneuWSGI worker 2
ubuntu         1   80240  0.0  0.0   5448   596 pts/0    S+   15:36:03 00:00:00 cat /opt/stack/async/install_tempest.fifo
root           2   80308  0.0  0.0      0     0 ?        I    15:36:10 00:00:00 [kworker/1:0-events]
root           2   80325  0.0  0.0      0     0 ?        I    15:36:10 00:00:00 [kworker/3:0-rcu_par_gp]
root           2   80331  0.0  0.0      0     0 ?        I    15:36:10 00:00:00 [kworker/3:1-events]
uuidd          1   91776  0.0  0.0   6780  1028 ?        Ss   15:39:40 00:00:00 /usr/sbin/uuidd --socket-activation
root           2   91780  0.0  0.0      0     0 ?        I    15:39:40 00:00:00 [kworker/2:2-rcu_gp]
root           2   93528  0.3  0.0      0     0 ?        S<   15:39:49 00:00:00 [loop3]
root           2   93532  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfsalloc]
root           2   93534  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfs_mru_cache]
root           2   93537  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfs-buf/loop3]
root           2   93542  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfs-conv/loop3]
root           2   93543  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfs-cil/loop3]
root           2   93544  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfs-reclaim/loo]
root           2   93545  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfs-eofblocks/l]
root           2   93546  0.0  0.0      0     0 ?        I<   15:39:49 00:00:00 [xfs-log/loop3]
root           2   93547  0.0  0.0      0     0 ?        S    15:39:49 00:00:00 [xfsaild/loop3]
root           2   97225  0.0  0.0      0     0 ?        I    15:40:49 00:00:00 [kworker/0:1-events]
memcache       1   97228  0.1  0.1 417992 12532 ?        Ssl  15:40:49 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid
root           1   97268  0.0  0.0   3388   876 ?        Ss   15:40:49 00:00:00 /usr/bin/rsync --daemon --no-detach
root           2   97573  0.0  0.0      0     0 ?        I    15:40:50 00:00:00 [kworker/u256:3-events_power_efficient]
ubuntu         1   97601  1.8  0.3  55912 41240 ?        Ss   15:40:51 00:00:03 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu     97601   97957  2.9  0.2 1530552 36112 ?       Sl   15:40:52 00:00:05 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu     97601   97958  0.0  0.2  55912 34844 ?        S    15:40:52 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu         1   97964  1.8  0.3  56192 40724 ?        Ss   15:40:52 00:00:03 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu     97964   98303  0.0  0.2  56448 35868 ?        S    15:40:53 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu     97964   98319  0.0  0.2  56192 34276 ?        S    15:40:53 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu         1   98325  1.8  0.3  54948 39680 ?        Ss   15:40:54 00:00:03 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu     98325   98691  0.0  0.2  54948 34708 ?        S    15:40:55 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu     98325   98696  0.0  0.2  54948 34604 ?        S    15:40:55 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu         1   98724  0.7  0.3  58068 42788 ?        Ss   15:40:55 00:00:01 /usr/bin/python3.8 /usr/local/bin/swift-container-sync /etc/swift/container-server/1.conf
ubuntu         1   99098  2.5  0.4  79868 60844 ?        Ss   15:40:57 00:00:04 /usr/bin/python3.8 /usr/local/bin/swift-proxy-server /etc/swift/proxy-server.conf -v
ubuntu     99098   99191  6.4  0.4  80892 55068 ?        S    15:40:59 00:00:10 /usr/bin/python3.8 /usr/local/bin/swift-proxy-server /etc/swift/proxy-server.conf -v
ubuntu         1   99908  0.0  0.1  52576 15052 ?        Ss   15:41:02 00:00:00 nova-apiuWSGI master
ubuntu     99908   99909  4.6  1.1 196088 134776 ?       S    15:41:02 00:00:07 nova-apiuWSGI worker 1
ubuntu     99908   99910  4.4  1.1 196096 134832 ?       S    15:41:02 00:00:07 nova-apiuWSGI worker 2
ubuntu         1  100494  3.7  1.1 170716 139104 ?       Ss   15:41:11 00:00:05 /usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini
ubuntu    100494  100603  2.8  1.3 345468 159488 ?       Sl   15:41:16 00:00:04 neutron-server: api worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    100494  100604  2.2  1.2 416608 156832 ?       Sl   15:41:16 00:00:03 neutron-server: api worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    100494  100605  4.1  1.3 351148 164640 ?       Sl   15:41:16 00:00:06 neutron-server: rpc worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    100494  100606  1.5  1.2 340352 154168 ?       Sl   15:41:16 00:00:02 neutron-server: rpc worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu         1  101084  0.0  0.1  52576 14680 ?        Ss   15:41:18 00:00:00 placementuWSGI master
ubuntu    101084  101085  1.9  0.6 140172 84468 ?        S    15:41:18 00:00:02 placementuWSGI worker 1
ubuntu    101084  101086  1.9  0.6 140480 84804 ?        S    15:41:18 00:00:02 placementuWSGI worker 2
root           2  101435  0.0  0.0      0     0 ?        I    15:41:22 00:00:00 [kworker/1:1-rcu_par_gp]
ubuntu         1  101548  4.6  1.1 319752 138444 ?       Ssl  15:41:23 00:00:06 neutron-openvswitch-agent (/usr/bin/python3.8 /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu         1  101913  4.7  1.0 381908 126036 ?       Ssl  15:41:24 00:00:06 neutron-dhcp-agent (/usr/bin/python3.8 /usr/local/bin/neutron-dhcp-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini)
ubuntu         1  102305  4.7  1.0 308564 126556 ?       Ssl  15:41:26 00:00:06 neutron-l3-agent (/usr/bin/python3.8 /usr/local/bin/neutron-l3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini)
ubuntu         1  102678  3.4  0.9 297392 118808 ?       Ssl  15:41:28 00:00:04 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
root           1  103013  1.2  0.5 164412 69200 ?        Sl   15:41:30 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpjjnts9gj/privsep.sock
ubuntu         1  103046  3.2  0.9 298384 120008 ?       Ssl  15:41:31 00:00:04 neutron-metering-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metering-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/services/metering/metering_agent.ini)
ubuntu    102678  103164  0.0  0.8 149084 107108 ?       S    15:41:33 00:00:00 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
ubuntu    102678  103165  0.0  0.8 149084 107108 ?       S    15:41:33 00:00:00 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
root           1  103169  0.1  0.2 133344 32752 ?        Sl   15:41:34 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmp8rhmjr7j/privsep.sock
root           1  103175  1.1  0.5 165392 71740 ?        Sl   15:41:34 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmpn2qw8usy/privsep.sock
ubuntu    101548  103176  0.0  0.0   9236  4208 ?        S    15:41:34 00:00:00 ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json
root           1  103518  1.9  0.5 165396 71956 ?        Sl   15:41:51 00:00:02 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmp13n4l768/privsep.sock
root           1  103564  1.8  0.6 170864 76904 ?        Sl   15:41:54 00:00:02 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmp7d5kx25n/privsep.sock
root           1  103613  1.2  0.5 166676 72220 ?        Sl   15:41:57 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.link_cmd --privsep_sock_path /tmp/tmpj61o85sl/privsep.sock
root      101913  103729  0.0  0.0   8048  4600 ?        S    15:42:00 00:00:00 sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
root      103729  103730  0.2  0.2 262240 28672 ?        Sl   15:42:00 00:00:00 /usr/bin/python3.8 /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
nobody         1  103740  0.0  0.0  10964   352 ?        S    15:42:00 00:00:00 dnsmasq --no-hosts  --pid-file=/opt/stack/data/neutron/dhcp/cd065655-b703-4903-8fd8-9dea81639dec/pid --dhcp-hostsfile=/opt/stack/data/neutron/dhcp/cd065655-b703-4903-8fd8-9dea81639dec/host --addn-hosts=/opt/stack/data/neutron/dhcp/cd065655-b703-4903-8fd8-9dea81639dec/addn_hosts --dhcp-optsfile=/opt/stack/data/neutron/dhcp/cd065655-b703-4903-8fd8-9dea81639dec/opts --dhcp-leasefile=/opt/stack/data/neutron/dhcp/cd065655-b703-4903-8fd8-9dea81639dec/leases --dhcp-match=set:ipxe,175 --dhcp-userclass=set:ipxe6,iPXE --local-service --bind-dynamic --dhcp-range=set:subnet-c2c80c30-739f-4be9-acf7-6c0d70add7d8,172.20.0.0,static,255.255.255.192,86400s --dhcp-option-force=option:mtu,1500 --dhcp-lease-max=64 --conf-file=/dev/null --domain=openstacklocal
root           1  103932  2.2  0.6 244592 77344 ?        Sl   15:42:12 00:00:02 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpf1837i3n/privsep.sock
root           1  104026  1.5  0.5 166676 72492 ?        Sl   15:42:14 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.link_cmd --privsep_sock_path /tmp/tmpxw60681q/privsep.sock
root      102305  104125  0.0  0.0   8052  4532 ?        S    15:42:17 00:00:00 sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
root      104125  104127  0.3  0.2 262240 28888 ?        Sl   15:42:17 00:00:00 /usr/bin/python3.8 /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
ubuntu         1  104259  0.0  0.0 236496  3016 ?        Ssl  15:42:18 00:00:00 haproxy -f /opt/stack/data/neutron/ns-metadata-proxy/09aed246-e277-4f99-88fd-4f39bd1bc923.conf
root           2  104418  0.0  0.0      0     0 ?        I    15:42:20 00:00:00 [kworker/2:3-rcu_par_gp]
ubuntu         1  104707  5.7  0.9 147068 117000 ?       Ss   15:42:21 00:00:04 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu         1  105170  0.0  0.1  52576 14792 ?        Ss   15:42:23 00:00:00 nova-api-metauWSGI master
ubuntu    105170  105172  5.3  0.9 175576 115556 ?       S    15:42:23 00:00:04 nova-api-metauWSGI worker 1
ubuntu    105170  105173  5.3  0.9 175452 115768 ?       S    15:42:23 00:00:04 nova-api-metauWSGI worker 2
ubuntu    105170  105174  0.0  0.0  52576  4260 ?        S    15:42:23 00:00:00 nova-api-metauWSGI http 1
ubuntu    104707  105968  0.1  0.8 148544 109828 ?       S    15:42:25 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu    104707  105969  0.2  0.8 148520 109820 ?       S    15:42:25 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu         1  105978  6.2  0.9 147440 117416 ?       Ss   15:42:26 00:00:04 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu         1  106365  6.2  0.9 145776 115528 ?       Ss   15:42:28 00:00:04 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu    105978  106850  0.2  0.8 148888 110104 ?       S    15:42:30 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu    105978  106851  0.2  0.9 148892 110272 ?       S    15:42:30 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu    106365  106855  0.2  0.8 147444 108624 ?       S    15:42:32 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu    106365  106856  0.2  0.8 147452 108540 ?       S    15:42:32 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu         1  107423  0.0  0.1  52576 14732 ?        Ss   15:42:35 00:00:00 cinder-apiuWSGI master
ubuntu    107423  107435  7.9  1.0 271276 127788 ?       Sl   15:42:35 00:00:05 cinder-apiuWSGI worker 1
ubuntu    107423  107436  7.7  1.0 271048 127392 ?       Sl   15:42:35 00:00:05 cinder-apiuWSGI worker 2
ubuntu         1  107874  6.6  0.9 303028 119968 ?       Ssl  15:42:42 00:00:04 /usr/bin/python3.8 /usr/local/bin/cinder-scheduler --config-file /etc/cinder/cinder.conf
ubuntu         1  108620  0.1  0.1  52576 14916 ?        Ss   15:42:49 00:00:00 glance-apiuWSGI master
ubuntu    108620  108633  8.4  0.9 334944 122288 ?       Sl   15:42:49 00:00:04 glance-apiuWSGI worker 1
ubuntu    108620  108634 34.5  1.0 335352 122724 ?       Sl   15:42:49 00:00:19 glance-apiuWSGI worker 2
ubuntu     11762  110680  0.0  0.0  15148 11636 pts/0    S+   15:43:45 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs
ubuntu    110680  110683  0.0  0.0   2608   608 pts/0    S+   15:43:45 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args
ubuntu    110683  110684  0.0  0.0   8828  3412 pts/0    R+   15:43:45 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args


Network Dump
============

bridge link
-----------


ip link show type bridge
------------------------


ip neigh
--------

10.222.0.1 dev eth0 lladdr 0a:db:49:c3:70:44 STALE
10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE

ip addr
-------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:20:00:e1 brd ff:ff:ff:ff:ff:ff
    inet 10.222.0.76/22 brd 10.222.3.255 scope global dynamic eth0
       valid_lft 85359sec preferred_lft 85359sec
    inet6 fe80::f816:3eff:fe20:e1/64 scope link 
       valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000
    link/ether fa:16:3e:e9:3a:e1 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::f816:3eff:fee9:3ae1/64 scope link 
       valid_lft forever preferred_lft forever
4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether a2:b0:ff:28:a0:2d brd ff:ff:ff:ff:ff:ff
5: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 1a:88:56:c5:fa:4d brd ff:ff:ff:ff:ff:ff
6: br-data: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether de:ad:27:60:fb:47 brd ff:ff:ff:ff:ff:ff
    inet 192.168.0.30/22 brd 192.168.3.255 scope global br-data
       valid_lft forever preferred_lft forever
    inet 172.28.3.1/24 scope global br-data
       valid_lft forever preferred_lft forever
    inet6 fe80::dcad:27ff:fe60:fb47/64 scope link 
       valid_lft forever preferred_lft forever

ip route
--------

default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.76 metric 100 
10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.76 
169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.76 metric 100 
172.28.3.0/24 dev br-data proto kernel scope link src 172.28.3.1 
192.168.0.0/22 dev br-data proto kernel scope link src 192.168.0.30 
192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.76 metric 100 

ip -6 route
-----------

::1 dev lo proto kernel metric 256 pref medium
fe80::/64 dev eth1 proto kernel metric 256 pref medium
fe80::/64 dev eth0 proto kernel metric 256 pref medium
fe80::/64 dev br-data proto kernel metric 256 pref medium

ip netns
--------

qrouter-09aed246-e277-4f99-88fd-4f39bd1bc923 (id: 1)
qdhcp-cd065655-b703-4903-8fd8-9dea81639dec (id: 0)

sudo ip netns exec qrouter-09aed246-e277-4f99-88fd-4f39bd1bc923 ip neigh
------------------------------------------------------------------------

fe80::f42d:4dff:fea1:4646 dev qg-f1c5c7cf-ae lladdr f6:2d:4d:a1:46:46 STALE
fe80::f816:3eff:fee2:a6ad dev qg-f1c5c7cf-ae lladdr fa:16:3e:e2:a6:ad STALE
fe80::f816:3eff:fe03:9df dev qg-f1c5c7cf-ae lladdr fa:16:3e:03:09:df STALE
fe80::f816:3eff:fe52:5e3f dev qg-f1c5c7cf-ae lladdr fa:16:3e:52:5e:3f STALE
fe80::f816:3eff:fe42:aa36 dev qg-f1c5c7cf-ae lladdr fa:16:3e:42:aa:36 STALE
fe80::f816:3eff:fe07:1051 dev qg-f1c5c7cf-ae lladdr fa:16:3e:07:10:51 STALE
fe80::f816:3eff:fe57:ff9d dev qg-f1c5c7cf-ae lladdr fa:16:3e:57:ff:9d STALE

sudo ip netns exec qrouter-09aed246-e277-4f99-88fd-4f39bd1bc923 ip addr
-----------------------------------------------------------------------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
8: qr-6736795a-d2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:a3:ed:4c brd ff:ff:ff:ff:ff:ff
    inet 172.20.0.1/26 brd 172.20.0.63 scope global qr-6736795a-d2
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fea3:ed4c/64 scope link 
       valid_lft forever preferred_lft forever
9: qg-f1c5c7cf-ae: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:33:aa:b0 brd ff:ff:ff:ff:ff:ff
    inet 172.28.3.39/24 brd 172.28.3.255 scope global qg-f1c5c7cf-ae
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe33:aab0/64 scope link 
       valid_lft forever preferred_lft forever

sudo ip netns exec qrouter-09aed246-e277-4f99-88fd-4f39bd1bc923 ip route
------------------------------------------------------------------------

default via 172.28.3.1 dev qg-f1c5c7cf-ae proto static 
172.20.0.0/26 dev qr-6736795a-d2 proto kernel scope link src 172.20.0.1 
172.28.3.0/24 dev qg-f1c5c7cf-ae proto kernel scope link src 172.28.3.39 

sudo ip netns exec qrouter-09aed246-e277-4f99-88fd-4f39bd1bc923 ip -6 route
---------------------------------------------------------------------------

fe80::/64 dev qr-6736795a-d2 proto kernel metric 256 pref medium
fe80::/64 dev qg-f1c5c7cf-ae proto kernel metric 256 pref medium

sudo ip netns exec qdhcp-cd065655-b703-4903-8fd8-9dea81639dec ip neigh
----------------------------------------------------------------------


sudo ip netns exec qdhcp-cd065655-b703-4903-8fd8-9dea81639dec ip addr
---------------------------------------------------------------------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
7: tap27f4978c-b5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:e1:e9:08 brd ff:ff:ff:ff:ff:ff
    inet 172.20.0.2/26 brd 172.20.0.63 scope global tap27f4978c-b5
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fee1:e908/64 scope link 
       valid_lft forever preferred_lft forever

sudo ip netns exec qdhcp-cd065655-b703-4903-8fd8-9dea81639dec ip route
----------------------------------------------------------------------

default via 172.20.0.1 dev tap27f4978c-b5 proto static 
172.20.0.0/26 dev tap27f4978c-b5 proto kernel scope link src 172.20.0.2 

sudo ip netns exec qdhcp-cd065655-b703-4903-8fd8-9dea81639dec ip -6 route
-------------------------------------------------------------------------

fe80::/64 dev tap27f4978c-b5 proto kernel metric 256 pref medium


Open vSwitch Dump
=================

sudo ovs-vsctl show
-------------------

38932a0a-4e3a-4f41-885c-3e3389d47196
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-data
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        datapath_type: system
        Port eth1
            Interface eth1
        Port phy-br-data
            Interface phy-br-data
                type: patch
                options: {peer=int-br-data}
        Port br-data
            Interface br-data
                type: internal
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        datapath_type: system
        Port tap27f4978c-b5
            tag: 1
            Interface tap27f4978c-b5
                type: internal
        Port qr-6736795a-d2
            tag: 1
            Interface qr-6736795a-d2
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port int-br-data
            Interface int-br-data
                type: patch
                options: {peer=phy-br-data}
        Port qg-f1c5c7cf-ae
            tag: 2
            Interface qg-f1c5c7cf-ae
                type: internal
    ovs_version: "2.13.3"

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-data
---------------------------------------------------------------------------------------------------------

OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:0000dead2760fb47
n_tables:254, n_buffers:0
capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES
OFPST_PORT_DESC reply (OF1.4) (xid=0x3):
 1(eth1): addr:fa:16:3e:e9:3a:e1
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(phy-br-data): addr:56:22:e6:7d:a1:4e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-data): addr:de:ad:27:60:fb:47
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-int
--------------------------------------------------------------------------------------------------------

OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:00001a8856c5fa4d
n_tables:254, n_buffers:0
capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES
OFPST_PORT_DESC reply (OF1.4) (xid=0x3):
 1(int-br-data): addr:7e:4c:8e:b2:3e:8e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(tap27f4978c-b5): addr:fa:16:3e:e1:e9:08
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 3(qr-6736795a-d2): addr:fa:16:3e:a3:ed:4c
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 4(qg-f1c5c7cf-ae): addr:fa:16:3e:33:aa:b0
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:1a:88:56:c5:fa:4d
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-data
--------------------------------------------------------------------------------------------------------------------

OFPST_PORT_DESC reply (OF1.4) (xid=0x2):
 1(eth1): addr:fa:16:3e:e9:3a:e1
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(phy-br-data): addr:56:22:e6:7d:a1:4e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-data): addr:de:ad:27:60:fb:47
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-int
-------------------------------------------------------------------------------------------------------------------

OFPST_PORT_DESC reply (OF1.4) (xid=0x2):
 1(int-br-data): addr:7e:4c:8e:b2:3e:8e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(tap27f4978c-b5): addr:fa:16:3e:e1:e9:08
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 3(qr-6736795a-d2): addr:fa:16:3e:a3:ed:4c
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 4(qg-f1c5c7cf-ae): addr:fa:16:3e:33:aa:b0
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:1a:88:56:c5:fa:4d
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-data
---------------------------------------------------------------------------------------------------------------

OFPST_PORT reply (OF1.4) (xid=0x2): 3 ports
  port LOCAL: rx pkts=1231, bytes=653319, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=11, bytes=866, drop=0, errs=0, coll=0
           duration=244.486s
  port  1: rx pkts=8632, bytes=1550238, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=67, bytes=6066, drop=0, errs=0, coll=0
           duration=240.412s
  port  2: rx pkts=36, bytes=2792, drop=?, errs=?, frame=?, over=?, crc=?
           tx pkts=836, bytes=522203, drop=?, errs=?, coll=?
           duration=137.492s

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-int
--------------------------------------------------------------------------------------------------------------

OFPST_PORT reply (OF1.4) (xid=0x2): 5 ports
  port  4: rx pkts=661, bytes=461792, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=18, bytes=1348, drop=0, errs=0, coll=0
           duration=85.679s
  port LOCAL: rx pkts=0, bytes=0, drop=697, errs=0, frame=0, over=0, crc=0
           tx pkts=0, bytes=0, drop=0, errs=0, coll=0
           duration=244.723s
  port  1: rx pkts=836, bytes=522203, drop=?, errs=?, frame=?, over=?, crc=?
           tx pkts=36, bytes=2792, drop=?, errs=?, coll=?
           duration=137.529s
  port  2: rx pkts=12, bytes=720, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=5, bytes=446, drop=0, errs=0, coll=0
           duration=106.435s
  port  3: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=13, bytes=998, drop=0, errs=0, coll=0
           duration=88.967s

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-data
---------------------------------------------------------------------------------------------------------------

OFPST_FLOW reply (OF1.4) (xid=0x2):
 cookie=0xa88550472e30da49, duration=104.756s, table=0, n_packets=13, n_bytes=978, priority=4,in_port=2,dl_vlan=1 actions=set_field:4699->vlan_vid,NORMAL
 cookie=0xa88550472e30da49, duration=84.743s, table=0, n_packets=14, n_bytes=1000, priority=4,in_port=2,dl_vlan=2 actions=pop_vlan,NORMAL
 cookie=0xa88550472e30da49, duration=137.501s, table=0, n_packets=9, n_bytes=814, priority=2,in_port=2 actions=drop
 cookie=0xa88550472e30da49, duration=137.549s, table=0, n_packets=922, n_bytes=576541, priority=0 actions=NORMAL

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-int
--------------------------------------------------------------------------------------------------------------

OFPST_FLOW reply (OF1.4) (xid=0x2):
 cookie=0x37165254d1a4f2a1, duration=137.685s, table=0, n_packets=0, n_bytes=0, priority=65535,vlan_tci=0x0fff/0x1fff actions=drop
 cookie=0x37165254d1a4f2a1, duration=104.767s, table=0, n_packets=0, n_bytes=0, priority=3,in_port=1,dl_vlan=603 actions=set_field:4097->vlan_vid,goto_table:60
 cookie=0x37165254d1a4f2a1, duration=84.754s, table=0, n_packets=661, n_bytes=471046, priority=3,in_port=1,vlan_tci=0x0000/0x1fff actions=push_vlan:0x8100,set_field:4098->vlan_vid,goto_table:60
 cookie=0x37165254d1a4f2a1, duration=137.522s, table=0, n_packets=175, n_bytes=51157, priority=2,in_port=1 actions=drop
 cookie=0x37165254d1a4f2a1, duration=137.692s, table=0, n_packets=36, n_bytes=2792, priority=0 actions=goto_table:60
 cookie=0x37165254d1a4f2a1, duration=137.695s, table=23, n_packets=0, n_bytes=0, priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=137.687s, table=24, n_packets=0, n_bytes=0, priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=104.707s, table=60, n_packets=2, n_bytes=180, priority=100,in_port=2 actions=set_field:0x2->reg5,set_field:0x1->reg6,resubmit(,73)
 cookie=0x37165254d1a4f2a1, duration=88.697s, table=60, n_packets=12, n_bytes=888, priority=100,in_port=3 actions=set_field:0x3->reg5,set_field:0x1->reg6,resubmit(,73)
 cookie=0x37165254d1a4f2a1, duration=82.699s, table=60, n_packets=14, n_bytes=1000, priority=100,in_port=4 actions=set_field:0x4->reg5,set_field:0x2->reg6,resubmit(,73)
 cookie=0x37165254d1a4f2a1, duration=137.690s, table=60, n_packets=669, n_bytes=471770, priority=3 actions=NORMAL
 cookie=0x37165254d1a4f2a1, duration=137.682s, table=62, n_packets=0, n_bytes=0, priority=3 actions=NORMAL
 cookie=0x37165254d1a4f2a1, duration=132.855s, table=71, n_packets=0, n_bytes=0, reset_counts priority=110,ct_state=+trk actions=ct_clear,resubmit(,71)
 cookie=0x37165254d1a4f2a1, duration=132.988s, table=71, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=132.959s, table=72, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=104.707s, table=73, n_packets=2, n_bytes=180, priority=80,reg5=0x2 actions=resubmit(,94)
 cookie=0x37165254d1a4f2a1, duration=88.696s, table=73, n_packets=12, n_bytes=888, priority=80,reg5=0x3 actions=resubmit(,94)
 cookie=0x37165254d1a4f2a1, duration=82.699s, table=73, n_packets=14, n_bytes=1000, priority=80,reg5=0x4 actions=resubmit(,94)
 cookie=0x37165254d1a4f2a1, duration=132.933s, table=73, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=132.908s, table=81, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=132.883s, table=82, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=132.797s, table=91, n_packets=0, n_bytes=0, reset_counts priority=1 actions=resubmit(,94)
 cookie=0x37165254d1a4f2a1, duration=132.782s, table=92, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=132.753s, table=93, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x37165254d1a4f2a1, duration=132.826s, table=94, n_packets=28, n_bytes=2068, reset_counts priority=1 actions=NORMAL


IP Tables Dump
==============

sudo iptables --line-numbers -L -nv -t filter
---------------------------------------------

Chain INPUT (policy ACCEPT 439K packets, 3655M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 379K packets, 2633M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

sudo iptables --line-numbers -L -nv -t nat
------------------------------------------

Chain PREROUTING (policy ACCEPT 1183 packets, 326K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain INPUT (policy ACCEPT 961 packets, 308K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 2274 packets, 151K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain POSTROUTING (policy ACCEPT 2274 packets, 151K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

sudo iptables --line-numbers -L -nv -t mangle
---------------------------------------------

Chain PREROUTING (policy ACCEPT 216K packets, 3249M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain INPUT (policy ACCEPT 216K packets, 3249M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 216K packets, 2603M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain POSTROUTING (policy ACCEPT 216K packets, 2603M bytes)
num   pkts bytes target     prot opt in     out     source               destination         


EB Tables Dump
==============

sudo ebtables -t filter -L
--------------------------

Bridge table: filter

Bridge chain: INPUT, entries: 0, policy: ACCEPT

Bridge chain: FORWARD, entries: 0, policy: ACCEPT

Bridge chain: OUTPUT, entries: 0, policy: ACCEPT

sudo ebtables -t nat -L
-----------------------

Bridge table: nat

Bridge chain: PREROUTING, entries: 0, policy: ACCEPT

Bridge chain: OUTPUT, entries: 0, policy: ACCEPT

Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT


Compute consoles
================


nova-compute Guru Meditation Report
===================================

Skipping as nova-compute does not appear to be running

neutron-dhcp-agent Guru Meditation Report
=========================================

101913
killall -e -USR2 neutron-dhcp-agent
-----------------------------------


guru meditation report in neutron-dhcp-agent log

neutron-l3-agent Guru Meditation Report
=======================================

102305
killall -e -USR2 neutron-l3-agent
---------------------------------


guru meditation report in neutron-l3-agent log

neutron-linuxbridge-agent Guru Meditation Report
================================================

Skipping as neutron-linuxbridge-agent does not appear to be running

neutron-metadata-agent Guru Meditation Report
=============================================

102678
103164
103165
killall -e -USR2 neutron-metadata-agent
---------------------------------------


guru meditation report in neutron-metadata-agent log

neutron-openvswitch-agent Guru Meditation Report
================================================

101548
killall -e -USR2 neutron-openvswitch-agent
------------------------------------------


guru meditation report in neutron-openvswitch-agent log

cinder-volume Guru Meditation Report
====================================

Skipping as cinder-volume does not appear to be running