File System Summary
===================

WARN: Device /dev/loop0 (/snap/core18/1997) is 100% full, might be an issue
WARN: Device /dev/loop1 (/snap/lxd/19647) is 100% full, might be an issue
WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue
Filesystem      Size  Used Avail Use% Mounted on
udev            5.9G     0  5.9G   0% /dev
tmpfs           1.2G  1.3M  1.2G   1% /run
/dev/sda1        39G  6.4G   33G  17% /
tmpfs           5.9G  4.0K  5.9G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           5.9G     0  5.9G   0% /sys/fs/cgroup
/dev/loop0       56M   56M     0 100% /snap/core18/1997
/dev/loop1       71M   71M     0 100% /snap/lxd/19647
/dev/loop2       33M   33M     0 100% /snap/snapd/11588
/dev/sda15      105M  7.8M   97M   8% /boot/efi
tmpfs           1.2G     0  1.2G   0% /run/user/1000
tmpfs           512M  123M  390M  24% /opt/stack/data/etcd
/dev/loop3      6.0G  689M  5.4G  12% /opt/stack/data/swift/drives/sdb1


Process Listing
===============

ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args
---------------------------------------------------------------

USER        PPID     PID %CPU %MEM    VSZ   RSS TT       STAT  STARTED     TIME COMMAND
root           0       1  2.5  0.1 171056 13196 ?        Ss   19:50:12 00:00:48 /lib/systemd/systemd --system --deserialize 27
root           0       2  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [kthreadd]
root           2       3  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [rcu_gp]
root           2       4  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [rcu_par_gp]
root           2       6  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [kworker/0:0H-kblockd]
root           2       8  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [mm_percpu_wq]
root           2       9  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [ksoftirqd/0]
root           2      10  0.0  0.0      0     0 ?        I    19:50:12 00:00:01 [rcu_sched]
root           2      11  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [migration/0]
root           2      12  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [idle_inject/0]
root           2      14  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [cpuhp/0]
root           2      15  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [cpuhp/1]
root           2      16  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [idle_inject/1]
root           2      17  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [migration/1]
root           2      18  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [ksoftirqd/1]
root           2      20  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [kworker/1:0H-kblockd]
root           2      21  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [cpuhp/2]
root           2      22  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [idle_inject/2]
root           2      23  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [migration/2]
root           2      24  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [ksoftirqd/2]
root           2      26  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [kworker/2:0H-kblockd]
root           2      27  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [cpuhp/3]
root           2      28  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [idle_inject/3]
root           2      29  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [migration/3]
root           2      30  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [ksoftirqd/3]
root           2      32  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [kworker/3:0H-kblockd]
root           2      33  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [kdevtmpfs]
root           2      34  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [netns]
root           2      35  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [rcu_tasks_kthre]
root           2      36  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [kauditd]
root           2      38  0.0  0.0      0     0 ?        I    19:50:12 00:00:00 [kworker/1:1-rcu_par_gp]
root           2      40  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [khungtaskd]
root           2      41  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [oom_reaper]
root           2      42  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [writeback]
root           2      43  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [kcompactd0]
root           2      44  0.0  0.0      0     0 ?        SN   19:50:12 00:00:00 [ksmd]
root           2      45  0.0  0.0      0     0 ?        SN   19:50:12 00:00:00 [khugepaged]
root           2      92  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [kintegrityd]
root           2      93  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [kblockd]
root           2      94  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [blkcg_punt_bio]
root           2      95  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [tpm_dev_wq]
root           2      96  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [ata_sff]
root           2      97  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [md]
root           2      98  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [edac-poller]
root           2      99  0.0  0.0      0     0 ?        I<   19:50:12 00:00:00 [devfreq_wq]
root           2     100  0.0  0.0      0     0 ?        S    19:50:12 00:00:00 [watchdogd]
root           2     105  0.0  0.0      0     0 ?        S    19:50:13 00:00:00 [kswapd0]
root           2     106  0.0  0.0      0     0 ?        S    19:50:13 00:00:00 [ecryptfs-kthrea]
root           2     108  0.0  0.0      0     0 ?        I<   19:50:13 00:00:00 [kthrotld]
root           2     109  0.0  0.0      0     0 ?        I<   19:50:13 00:00:00 [acpi_thermal_pm]
root           2     110  0.0  0.0      0     0 ?        S    19:50:13 00:00:00 [scsi_eh_0]
root           2     111  0.0  0.0      0     0 ?        I<   19:50:13 00:00:00 [scsi_tmf_0]
root           2     112  0.0  0.0      0     0 ?        S    19:50:13 00:00:00 [scsi_eh_1]
root           2     113  0.0  0.0      0     0 ?        I<   19:50:13 00:00:00 [scsi_tmf_1]
root           2     115  0.0  0.0      0     0 ?        I<   19:50:13 00:00:00 [vfio-irqfd-clea]
root           2     116  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [ipv6_addrconf]
root           2     126  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [kstrp]
root           2     129  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [kworker/u257:0]
root           2     142  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [charger_manager]
root           2     190  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [hv_vmbus_con]
root           2     191  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [hv_pri_chan]
root           2     192  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [hv_sub_chan]
root           2     193  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [kworker/3:1H-kblockd]
root           2     194  0.0  0.0      0     0 ?        I<   19:50:14 00:00:00 [cryptd]
root           2     230  0.0  0.0      0     0 ?        S    19:50:15 00:00:00 [scsi_eh_2]
root           2     231  0.0  0.0      0     0 ?        S    19:50:15 00:00:00 [scsi_eh_3]
root           2     232  0.0  0.0      0     0 ?        I<   19:50:15 00:00:00 [scsi_tmf_2]
root           2     233  0.0  0.0      0     0 ?        I<   19:50:15 00:00:00 [scsi_tmf_3]
root           2     234  0.0  0.0      0     0 ?        I<   19:50:15 00:00:00 [storvsc_error_w]
root           2     236  0.0  0.0      0     0 ?        I<   19:50:15 00:00:00 [storvsc_error_w]
root           2     243  0.0  0.0      0     0 ?        I<   19:50:15 00:00:00 [kworker/1:1H-kblockd]
root           2     278  0.0  0.0      0     0 ?        I<   19:50:16 00:00:00 [raid5wq]
root           2     304  0.0  0.0      0     0 ?        I<   19:50:17 00:00:00 [kworker/2:1H-kblockd]
root           2     319  0.1  0.0      0     0 ?        S    19:50:17 00:00:03 [jbd2/sda1-8]
root           2     320  0.0  0.0      0     0 ?        I<   19:50:17 00:00:00 [ext4-rsv-conver]
root           2     321  0.0  0.0      0     0 ?        I<   19:50:17 00:00:00 [kworker/0:1H-kblockd]
root           1     424  0.0  0.0  19208  5556 ?        Ss   19:50:19 00:00:01 /lib/systemd/systemd-udevd
root           2     452  0.0  0.0      0     0 ?        S    19:50:19 00:00:00 [hv_balloon]
root           2     552  0.0  0.0      0     0 ?        I<   19:50:20 00:00:00 [kaluad]
root           2     553  0.0  0.0      0     0 ?        I<   19:50:20 00:00:00 [kmpath_rdacd]
root           2     554  0.0  0.0      0     0 ?        I<   19:50:20 00:00:00 [kmpathd]
root           2     555  0.0  0.0      0     0 ?        I<   19:50:20 00:00:00 [kmpath_handlerd]
root           1     556  0.0  0.1 280136 17940 ?        SLsl 19:50:20 00:00:00 /sbin/multipathd -d -s
root           2     565  0.0  0.0      0     0 ?        S<   19:50:20 00:00:00 [loop0]
root           2     568  0.0  0.0      0     0 ?        S<   19:50:20 00:00:00 [loop1]
root           2     569  0.0  0.0      0     0 ?        S<   19:50:20 00:00:00 [loop2]
root           1     782  0.0  0.0 241048  9564 ?        Ssl  19:50:31 00:00:00 /usr/lib/accountsservice/accounts-daemon
root           1     788  0.0  0.0   8536  3020 ?        Ss   19:50:31 00:00:00 /usr/sbin/cron -f
message+       1     789  0.2  0.0   7732  4900 ?        Ss   19:50:31 00:00:05 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root           1     798  0.0  0.0  81828  3600 ?        Ssl  19:50:31 00:00:00 /usr/sbin/irqbalance --foreground
root           1     799  0.0  0.1  29264 18096 ?        Ss   19:50:31 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
root           1     804  0.1  0.3 1374588 39400 ?       Ssl  19:50:31 00:00:03 /usr/lib/snapd/snapd
root           1     805  0.1  0.0  16780  7780 ?        Ss   19:50:31 00:00:02 /lib/systemd/systemd-logind
daemon         1     808  0.0  0.0   3792  2228 ?        Ss   19:50:31 00:00:00 /usr/sbin/atd -f
root           1     845  0.0  0.0   7352  2248 ttyS0    Ss+  19:50:31 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220
root           1     871  0.0  0.0   5828  1820 tty1     Ss+  19:50:31 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
root           1     883  0.0  0.1 108100 20592 ?        Ssl  19:50:31 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root           1     886  0.0  0.0 237748 10440 ?        Ssl  19:50:31 00:00:00 /usr/lib/policykit-1/polkitd --no-debug
root           1    1591  0.0  0.0  13800  9016 ?        Ss   19:54:56 00:00:00 sshd: ubuntu [priv]
ubuntu         1    1603  0.0  0.0  18516  9808 ?        Ss   19:54:56 00:00:00 /lib/systemd/systemd --user
ubuntu      1603    1606  0.0  0.0 169788  4564 ?        S    19:54:56 00:00:00 (sd-pam)
ubuntu      1591    1682  0.0  0.0  13932  6552 ?        S    19:54:57 00:00:00 sshd: ubuntu@pts/0
root           2    2907  0.0  0.0      0     0 ?        I    19:55:50 00:00:01 [kworker/u256:3-events_power_efficient]
root           2   14394  0.0  0.0      0     0 ?        I    20:01:40 00:00:00 [kworker/u256:2-events_power_efficient]
root           2   14413  0.0  0.0      0     0 ?        I    20:01:48 00:00:00 [kworker/3:3-events]
ubuntu      1682   14828  0.0  0.0   2608   596 pts/0    Ss+  20:03:38 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1637179419.23-205164587904953/AnsiballZ_command.py && sleep 0
ubuntu     14828   14829  0.0  0.1  27828 18068 pts/0    S+   20:03:38 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1637179419.23-205164587904953/AnsiballZ_command.py
ubuntu     14829   14831  0.0  0.0   2608   592 pts/0    S+   20:03:39 00:00:00 /bin/sh -c ./unstack.sh > /dev/null 2>&1  ./stack.sh > /dev/null 2>&1
root           2   16042  0.0  0.0   2488   584 ?        S    20:03:41 00:00:00 bpfilter_umh
root           2   16044  0.0  0.0      0     0 ?        I    20:03:41 00:00:00 [kworker/2:2-rcu_par_gp]
root           2   16068  0.0  0.0      0     0 ?        I    20:03:41 00:00:00 [kworker/0:0-rcu_par_gp]
root           2   17144  0.0  0.0      0     0 ?        I    20:03:43 00:00:00 [kworker/1:0-rcu_par_gp]
ubuntu     14831   17578  0.6  0.0  15404 10604 pts/0    S+   20:03:45 00:00:07 bash ./stack.sh
ubuntu     17578   19839  0.0  0.0  10652  3800 pts/0    S+   20:03:48 00:00:00 bash ./stack.sh
ubuntu     17578   19844  0.0  0.0  10652  3800 pts/0    S+   20:03:48 00:00:00 bash ./stack.sh
ubuntu     19839   19845  0.1  0.0  17516 11192 pts/0    S+   20:03:48 00:00:02 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2021-11-17-200348
ubuntu     19844   19851  0.0  0.0  17384 11332 pts/0    S+   20:03:48 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2021-11-17-200348.summary.2021-11-17-200348
root           1   24826  0.0  0.0   8272  3792 ?        Ss   20:05:11 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf
root           1   24983  0.0  0.0  15304  8916 ?        Ss   20:05:13 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock
haproxy    24983   24984  0.0  0.0 236500  3012 ?        Sl   20:05:13 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock
root           1   26506  0.0  0.0  12176  7140 ?        Ss   20:05:23 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
pcp            1   27638  0.1  0.0   8388  4456 ?        Ss   20:05:33 00:00:01 /usr/lib/pcp/bin/pmcd
root       27638   27641  0.0  0.0   7736  3832 ?        S    20:05:33 00:00:00 /var/lib/pcp/pmdas/root/pmdaroot
root       27641   27642  0.0  0.0   8308  5048 ?        S    20:05:33 00:00:00 /var/lib/pcp/pmdas/proc/pmdaproc -d 3
root       27641   27643  0.0  0.0   7212  3700 ?        S    20:05:33 00:00:00 /var/lib/pcp/pmdas/xfs/pmdaxfs -d 11
root       27641   27644  0.2  0.0   8268  5108 ?        S    20:05:33 00:00:02 /var/lib/pcp/pmdas/linux/pmdalinux
root       27641   27645  0.0  0.0   7268  3688 ?        S    20:05:33 00:00:00 /var/lib/pcp/pmdas/kvm/pmdakvm -d 95
pcp            1   38581  0.0  0.0   8428  5284 ?        S    20:05:47 00:00:00 /usr/lib/pcp/bin/pmlogger -P -r -T24h10m -c config.default -v 100mb -m pmlogger_check 20211117.20.05
systemd+       1   38819  0.0  0.0  34932  7940 ?        Ss   20:05:49 00:00:00 /lib/systemd/systemd-networkd
systemd+       1   38834  0.0  0.0  23896 12220 ?        Ss   20:05:49 00:00:00 /lib/systemd/systemd-resolved
systemd+       1   38967  0.0  0.0  90228  6124 ?        Ssl  20:05:50 00:00:00 /lib/systemd/systemd-timesyncd
syslog         1   43680  0.2  0.0 224348  4592 ?        Ssl  20:06:04 00:00:02 /usr/sbin/rsyslogd -n -iNONE
root           2   47938  0.0  0.0      0     0 ?        I    20:06:19 00:00:00 [kworker/3:4-rcu_par_gp]
ubuntu      1603   52740  0.0  0.0   7244  4500 ?        Ss   20:06:42 00:00:00 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root           1   53035  0.6  0.4  93000 59104 ?        S<s  20:06:58 00:00:05 /lib/systemd/systemd-journald
root           2   53479  0.0  0.0      0     0 ?        I    20:07:28 00:00:00 [kworker/u256:1-events_power_efficient]
epmd           1   53890  0.0  0.0   6352  1328 ?        Ss   20:07:47 00:00:00 /usr/bin/epmd -systemd
rabbitmq       1   54046  0.0  0.0   2608   608 ?        Ss   20:07:51 00:00:00 /bin/sh /usr/sbin/rabbitmq-server
rabbitmq   54046   54061  1.2  0.6 3340036 82868 ?       Sl   20:07:51 00:00:10 /usr/lib/erlang/erts-10.6.4/bin/beam.smp -W w -A 64 -MBas ageffcbf -MHas ageffcbf -MBlmbcs 512 -MHlmbcs 512 -MMmcs 30 -P 1048576 -t 5000000 -stbt db -zdbbl 128000 -K true -- -root /usr/lib/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/ebin  -noshell -noinput -s rabbit boot -sname rabbit@dv-cinder-777031-12-iscsi -boot start_sasl -kernel inet_default_connect_options [{nodelay,true}] -sasl errlog_type error -sasl sasl_error_logger false -rabbit lager_log_root "/var/log/rabbitmq" -rabbit lager_default_file "/var/log/rabbitmq/rabbit@dv-cinder-777031-12-iscsi.log" -rabbit lager_upgrade_file "/var/log/rabbitmq/rabbit@dv-cinder-777031-12-iscsi_upgrade.log" -rabbit feature_flags_file "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-777031-12-iscsi-feature_flags" -rabbit enabled_plugins_file "/etc/rabbitmq/enabled_plugins" -rabbit plugins_dir "/usr/lib/rabbitmq/plugins:/usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/plugins" -rabbit plugins_expand_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-777031-12-iscsi-plugins-expand" -os_mon start_cpu_sup false -os_mon start_disksup false -os_mon start_memsup false -mnesia dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-777031-12-iscsi" -ra data_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-777031-12-iscsi/quorum" -kernel inet_dist_listen_min 25672 -kernel inet_dist_listen_max 25672 --
rabbitmq   54061   54320  0.0  0.0   2492  1392 ?        Ss   20:07:52 00:00:00 erl_child_setup 65536
rabbitmq   54320   54350  0.0  0.0   3880   864 ?        Ss   20:07:55 00:00:00 inet_gethost 4
rabbitmq   54350   54351  0.0  0.0   3960  1908 ?        S    20:07:55 00:00:00 inet_gethost 4
root           1   57661  0.0  0.0   9672  5356 ?        S<s  20:09:04 00:00:00 ovsdb-server /etc/openvswitch/conf.db -vconsole:emer -vsyslog:err -vfile:info --remote=punix:/var/run/openvswitch/db.sock --private-key=db:Open_vSwitch,SSL,private_key --certificate=db:Open_vSwitch,SSL,certificate --bootstrap-ca-cert=db:Open_vSwitch,SSL,ca_cert --no-chdir --log-file=/var/log/openvswitch/ovsdb-server.log --pidfile=/var/run/openvswitch/ovsdb-server.pid --detach
root           1   57711  0.1  0.4 382548 55340 ?        S<Lsl 20:09:04 00:00:00 ovs-vswitchd unix:/var/run/openvswitch/db.sock -vconsole:emer -vsyslog:err -vfile:info --mlockall --no-chdir --log-file=/var/log/openvswitch/ovs-vswitchd.log --pidfile=/var/run/openvswitch/ovs-vswitchd.pid --detach
root           2   67447  0.0  0.0      0     0 ?        I<   20:12:34 00:00:00 [target_completi]
root           2   67448  0.0  0.0      0     0 ?        I<   20:12:34 00:00:00 [xcopy_wq]
root           2   67453  0.0  0.0      0     0 ?        I    20:12:34 00:00:00 [kworker/0:3-rcu_par_gp]
root           2   72211  0.0  0.0      0     0 ?        I    20:13:35 00:00:00 [kworker/2:1-rcu_par_gp]
root           2   74424  0.0  0.0      0     0 ?        I    20:13:42 00:00:00 [kworker/u256:0-events_power_efficient]
root           1   76043  0.0  0.0  13964  5628 ?        Ss   20:14:17 00:00:00 /usr/sbin/apache2 -k start
www-data   76043   76045  0.3  0.0 1943548 12212 ?       Sl   20:14:17 00:00:01 /usr/sbin/apache2 -k start
www-data   76043   76046  0.0  0.0 1943360 12208 ?       Sl   20:14:17 00:00:00 /usr/sbin/apache2 -k start
root           2   77085  0.0  0.0      0     0 ?        I    20:14:26 00:00:00 [kworker/3:1-events]
mysql          1   77086  9.8  5.4 2929964 666844 ?      Ssl  20:14:26 00:00:44 /usr/sbin/mysqld
ubuntu         1   77543  0.0  0.0   5648  3272 ?        Ss   20:14:29 00:00:00 /bin/bash /home/ubuntu/devstack/tools/dstat.sh /opt/stack/logs
ubuntu     77543   77634  0.2  0.1  21356 16476 ?        S    20:14:30 00:00:01 python3 /usr/bin/dstat -tcmndrylpg --tcp --output /opt/stack/logs/dstat-csv.log
ubuntu     77543   77635  0.2  0.1  21356 16532 ?        S    20:14:30 00:00:01 python3 /usr/bin/dstat -tcmndrylpg --swap --tcp
root           1   78120  0.5  0.1 10516468 18276 ?      Ssl  20:14:32 00:00:02 /opt/stack/bin/etcd --name dv-cinder-777031-12-iscsi --data-dir /opt/stack/data/etcd --initial-cluster-state new --initial-cluster-token etcd-cluster-01 --initial-cluster dv-cinder-777031-12-iscsi=http://10.222.0.36:2380 --initial-advertise-peer-urls http://10.222.0.36:2380 --advertise-client-urls http://10.222.0.36:2379 --listen-peer-urls http://0.0.0.0:2380 --listen-client-urls http://10.222.0.36:2379 --debug
ubuntu         1   79038  0.0  0.1  52576 14772 ?        Ss   20:14:58 00:00:00 keystoneuWSGI master
ubuntu     79038   79049  7.0  1.0 195760 128096 ?       S    20:14:58 00:00:29 keystoneuWSGI worker 1
ubuntu     79038   79050  6.6  1.0 198580 131224 ?       S    20:14:58 00:00:28 keystoneuWSGI worker 2
ubuntu         1   79343  0.0  0.0   5448   592 pts/0    S+   20:15:14 00:00:00 cat /opt/stack/async/install_tempest.fifo
uuidd          1   91438  0.0  0.0   6780  1088 ?        Ss   20:18:22 00:00:00 /usr/sbin/uuidd --socket-activation
root           2   91447  0.0  0.0      0     0 ?        I    20:18:22 00:00:00 [kworker/1:2-events]
root           2   91448  0.0  0.0      0     0 ?        I    20:18:22 00:00:00 [kworker/0:1-events]
root           2   93211  0.3  0.0      0     0 ?        S<   20:18:31 00:00:00 [loop3]
root           2   93218  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfsalloc]
root           2   93221  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfs_mru_cache]
root           2   93222  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfs-buf/loop3]
root           2   93223  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfs-conv/loop3]
root           2   93224  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfs-cil/loop3]
root           2   93225  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfs-reclaim/loo]
root           2   93226  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfs-eofblocks/l]
root           2   93227  0.0  0.0      0     0 ?        I<   20:18:31 00:00:00 [xfs-log/loop3]
root           2   93228  0.0  0.0      0     0 ?        S    20:18:31 00:00:00 [xfsaild/loop3]
root           2   98262  0.0  0.0      0     0 ?        I    20:19:26 00:00:00 [kworker/2:0-events]
memcache       1   98265  0.1  0.1 417992 12364 ?        Ssl  20:19:26 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid
root           1   98306  0.0  0.0   3388   880 ?        Ss   20:19:26 00:00:00 /usr/bin/rsync --daemon --no-detach
ubuntu         1   98638  1.5  0.3  65428 47848 ?        Ss   20:19:27 00:00:02 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu     98638   98994  0.0  0.3  65428 40540 ?        S    20:19:29 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu         1   99000  1.5  0.3  65952 47672 ?        Ss   20:19:29 00:00:02 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu     98638   99006  2.9  0.3 1540068 41712 ?       Sl   20:19:29 00:00:04 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu     99000   99355  0.0  0.3  65952 41856 ?        S    20:19:30 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu         1   99361  1.4  0.3  64648 45980 ?        Ss   20:19:30 00:00:02 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu     99000   99371  0.0  0.3  65952 41788 ?        S    20:19:30 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu     99361   99752  0.0  0.3  64904 40096 ?        S    20:19:31 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu     99361   99753  0.0  0.3  64904 40072 ?        S    20:19:31 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu         1   99759  0.8  0.4  67136 49208 ?        Ss   20:19:31 00:00:01 /usr/bin/python3.8 /usr/local/bin/swift-container-sync /etc/swift/container-server/1.conf
ubuntu         1  100133  2.3  0.5  85216 63288 ?        Ss   20:19:33 00:00:03 /usr/bin/python3.8 /usr/local/bin/swift-proxy-server /etc/swift/proxy-server.conf -v
ubuntu    100133  100226  6.8  0.4  86496 57152 ?        S    20:19:35 00:00:09 /usr/bin/python3.8 /usr/local/bin/swift-proxy-server /etc/swift/proxy-server.conf -v
root           2  100918  0.0  0.0      0     0 ?        I    20:19:38 00:00:00 [kworker/u256:4]
ubuntu         1  100946  0.0  0.1  52576 14668 ?        Ss   20:19:38 00:00:00 nova-apiuWSGI master
ubuntu    100946  100947  4.2  1.0 206868 132396 ?       S    20:19:38 00:00:05 nova-apiuWSGI worker 1
ubuntu    100946  100948  4.2  1.0 206880 132328 ?       S    20:19:38 00:00:05 nova-apiuWSGI worker 2
ubuntu         1  101530  4.1  1.1 183220 142720 ?       Ss   20:19:45 00:00:05 /usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini
ubuntu    101530  101639  0.0  1.0 183220 131576 ?       S    20:19:50 00:00:00 neutron-server: api worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    101530  101640  4.7  1.3 361952 165316 ?       Sl   20:19:50 00:00:06 neutron-server: api worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    101530  101641  4.7  1.3 437380 166532 ?       Sl   20:19:50 00:00:06 neutron-server: rpc worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    101530  101642  1.7  1.2 353280 155896 ?       Sl   20:19:50 00:00:02 neutron-server: rpc worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu         1  102120  0.0  0.1  52576 14712 ?        Ss   20:19:52 00:00:00 placementuWSGI master
ubuntu    102120  102121  2.1  0.7 152436 87708 ?        S    20:19:52 00:00:02 placementuWSGI worker 1
ubuntu    102120  102122  2.1  0.7 152452 87460 ?        S    20:19:52 00:00:02 placementuWSGI worker 2
ubuntu         1  102585  5.2  1.1 335628 145604 ?       Ssl  20:19:56 00:00:06 neutron-openvswitch-agent (/usr/bin/python3.8 /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu         1  102948  4.5  1.0 394832 130184 ?       Ssl  20:19:58 00:00:05 neutron-dhcp-agent (/usr/bin/python3.8 /usr/local/bin/neutron-dhcp-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini)
ubuntu         1  103357  4.4  1.0 321704 130396 ?       Ssl  20:19:59 00:00:05 neutron-l3-agent (/usr/bin/python3.8 /usr/local/bin/neutron-l3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini)
ubuntu         1  103721  3.2  1.0 310316 122664 ?       Ssl  20:20:01 00:00:03 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
ubuntu         1  104092  3.2  1.0 311336 123468 ?       Ssl  20:20:02 00:00:03 neutron-metering-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metering-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/services/metering/metering_agent.ini)
ubuntu    103721  104197  0.0  0.8 161764 109952 ?       S    20:20:05 00:00:00 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
ubuntu    103721  104198  0.0  0.8 161764 109952 ?       S    20:20:05 00:00:00 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
root           1  104262  1.1  0.5 177600 71744 ?        Sl   20:20:06 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpr1zd3k9w/privsep.sock
root           1  104287  1.0  0.6 178584 74172 ?        Sl   20:20:07 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmpdvbbkiyl/privsep.sock
root           1  104291  0.1  0.3 143348 38268 ?        Sl   20:20:08 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmpfcrw1cmd/privsep.sock
ubuntu    102585  104327  0.0  0.0   9236  4272 ?        S    20:20:09 00:00:00 ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json
root           1  104539  1.9  0.6 257784 79344 ?        Sl   20:20:21 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpzruaowow/privsep.sock
root           1  104578  1.2  0.6 178584 74132 ?        Sl   20:20:23 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmpm5au6ss5/privsep.sock
root           1  104635  1.3  0.6 178840 74564 ?        Sl   20:20:26 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.link_cmd --privsep_sock_path /tmp/tmpuq1ur1vi/privsep.sock
root      102948  104749  0.0  0.0   8052  4744 ?        S    20:20:28 00:00:00 sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
root      104749  104750  0.4  0.2 271996 35776 ?        Sl   20:20:28 00:00:00 /usr/bin/python3.8 /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
nobody         1  104761  0.0  0.0  10964   356 ?        S    20:20:29 00:00:00 dnsmasq --no-hosts  --pid-file=/opt/stack/data/neutron/dhcp/9f4a9556-0f2a-4b0f-9d50-87a629ad93ec/pid --dhcp-hostsfile=/opt/stack/data/neutron/dhcp/9f4a9556-0f2a-4b0f-9d50-87a629ad93ec/host --addn-hosts=/opt/stack/data/neutron/dhcp/9f4a9556-0f2a-4b0f-9d50-87a629ad93ec/addn_hosts --dhcp-optsfile=/opt/stack/data/neutron/dhcp/9f4a9556-0f2a-4b0f-9d50-87a629ad93ec/opts --dhcp-leasefile=/opt/stack/data/neutron/dhcp/9f4a9556-0f2a-4b0f-9d50-87a629ad93ec/leases --dhcp-match=set:ipxe,175 --dhcp-userclass=set:ipxe6,iPXE --local-service --bind-dynamic --dhcp-range=set:subnet-b4b2c03a-c440-463c-be88-3731cd4fa08b,172.20.0.0,static,255.255.255.192,86400s --dhcp-option-force=option:mtu,1500 --dhcp-lease-max=64 --conf-file=/dev/null --domain=openstacklocal
root           1  104951  2.4  0.6 331516 79836 ?        Sl   20:20:41 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpqd5oi5r0/privsep.sock
root           1  105045  1.6  0.6 252568 74744 ?        Sl   20:20:43 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.link_cmd --privsep_sock_path /tmp/tmpyzin77iv/privsep.sock
root      103357  105268  0.0  0.0   8052  4688 ?        S    20:20:46 00:00:00 sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
root      105268  105269  0.6  0.2 271996 35740 ?        Sl   20:20:46 00:00:00 /usr/bin/python3.8 /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
ubuntu         1  105279  0.0  0.0 236496  3064 ?        Ssl  20:20:46 00:00:00 haproxy -f /opt/stack/data/neutron/ns-metadata-proxy/d90cec20-0152-4f43-8372-0872ea52daca.conf
ubuntu         1  105727  5.7  0.9 152528 113556 ?       Ss   20:20:49 00:00:03 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu         1  106184  0.0  0.1  52576 14804 ?        Ss   20:20:51 00:00:00 nova-api-metauWSGI master
ubuntu    106184  106189  5.9  0.9 186320 113480 ?       S    20:20:51 00:00:03 nova-api-metauWSGI worker 1
ubuntu    106184  106190  5.9  0.9 186020 113188 ?       S    20:20:51 00:00:03 nova-api-metauWSGI worker 2
ubuntu    106184  106191  0.0  0.0  52576  4264 ?        S    20:20:51 00:00:00 nova-api-metauWSGI http 1
ubuntu    105727  106955  0.2  0.8 154192 105900 ?       S    20:20:53 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu    105727  106956  0.2  0.8 154176 105812 ?       S    20:20:53 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu         1  106991  6.0  0.9 152836 113880 ?       Ss   20:20:53 00:00:03 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu         1  107384  6.0  0.9 151356 112568 ?       Ss   20:20:55 00:00:03 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu    106991  107865  0.3  0.8 154516 106000 ?       S    20:20:57 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu    106991  107866  0.2  0.8 154632 105840 ?       S    20:20:57 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu    107384  107873  0.2  0.8 153128 104632 ?       S    20:20:58 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu    107384  107874  0.2  0.8 153096 104720 ?       S    20:20:58 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu         1  108473  0.0  0.1  52576 14896 ?        Ss   20:21:01 00:00:00 cinder-apiuWSGI master
ubuntu    108473  108476  8.3  1.0 281856 129684 ?       Sl   20:21:01 00:00:04 cinder-apiuWSGI worker 1
ubuntu    108473  108477  8.3  1.0 281776 130044 ?       Sl   20:21:01 00:00:04 cinder-apiuWSGI worker 2
ubuntu         1  108916  7.0  0.9 314112 121700 ?       Ssl  20:21:07 00:00:03 /usr/bin/python3.8 /usr/local/bin/cinder-scheduler --config-file /etc/cinder/cinder.conf
ubuntu         1  109623  0.1  0.1  52576 14636 ?        Ss   20:21:13 00:00:00 glance-apiuWSGI master
ubuntu    109623  109629 42.3  1.0 347444 125780 ?       Sl   20:21:13 00:00:18 glance-apiuWSGI worker 1
ubuntu    109623  109630  9.5  1.0 347028 125580 ?       Sl   20:21:13 00:00:04 glance-apiuWSGI worker 2
ubuntu     17578  110986  0.0  0.0  15148 11640 pts/0    S+   20:21:57 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs
ubuntu    110986  110989  0.0  0.0   2608   604 pts/0    S+   20:21:57 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args
ubuntu    110989  110990  0.0  0.0   8828  3304 pts/0    R+   20:21:57 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args


Network Dump
============

bridge link
-----------


ip link show type bridge
------------------------


ip neigh
--------

10.222.0.1 dev eth0 lladdr 0a:db:49:c3:70:44 REACHABLE
10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE

ip addr
-------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:39:b5:13 brd ff:ff:ff:ff:ff:ff
    inet 10.222.0.36/22 brd 10.222.3.255 scope global dynamic eth0
       valid_lft 85432sec preferred_lft 85432sec
    inet6 fe80::f816:3eff:fe39:b513/64 scope link 
       valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000
    link/ether fa:16:3e:1b:cb:b3 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::f816:3eff:fe1b:cbb3/64 scope link 
       valid_lft forever preferred_lft forever
4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 9a:d2:ac:ed:91:a8 brd ff:ff:ff:ff:ff:ff
5: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether b6:ca:5f:fb:e6:49 brd ff:ff:ff:ff:ff:ff
6: br-data: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 06:d1:4c:94:68:45 brd ff:ff:ff:ff:ff:ff
    inet 192.168.0.31/22 brd 192.168.3.255 scope global br-data
       valid_lft forever preferred_lft forever
    inet 172.27.3.1/24 scope global br-data
       valid_lft forever preferred_lft forever
    inet6 fe80::4d1:4cff:fe94:6845/64 scope link 
       valid_lft forever preferred_lft forever

ip route
--------

default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.36 metric 100 
10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.36 
169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.36 metric 100 
172.27.3.0/24 dev br-data proto kernel scope link src 172.27.3.1 
192.168.0.0/22 dev br-data proto kernel scope link src 192.168.0.31 
192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.36 metric 100 

ip -6 route
-----------

::1 dev lo proto kernel metric 256 pref medium
fe80::/64 dev eth1 proto kernel metric 256 pref medium
fe80::/64 dev eth0 proto kernel metric 256 pref medium
fe80::/64 dev br-data proto kernel metric 256 pref medium

ip netns
--------

qrouter-d90cec20-0152-4f43-8372-0872ea52daca (id: 1)
qdhcp-9f4a9556-0f2a-4b0f-9d50-87a629ad93ec (id: 0)

sudo ip netns exec qrouter-d90cec20-0152-4f43-8372-0872ea52daca ip neigh
------------------------------------------------------------------------

fe80::f816:3eff:fea0:929c dev qg-178df5e4-d5 lladdr fa:16:3e:a0:92:9c STALE
fe80::f816:3eff:fe66:501 dev qg-178df5e4-d5 lladdr fa:16:3e:66:05:01 STALE
fe80::f816:3eff:feea:cc83 dev qg-178df5e4-d5 lladdr fa:16:3e:ea:cc:83 STALE

sudo ip netns exec qrouter-d90cec20-0152-4f43-8372-0872ea52daca ip addr
-----------------------------------------------------------------------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
8: qr-06e87369-0c: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:22:89:82 brd ff:ff:ff:ff:ff:ff
    inet 172.20.0.1/26 brd 172.20.0.63 scope global qr-06e87369-0c
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe22:8982/64 scope link 
       valid_lft forever preferred_lft forever
9: qg-178df5e4-d5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:68:25:22 brd ff:ff:ff:ff:ff:ff
    inet 172.27.3.33/24 brd 172.27.3.255 scope global qg-178df5e4-d5
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe68:2522/64 scope link 
       valid_lft forever preferred_lft forever

sudo ip netns exec qrouter-d90cec20-0152-4f43-8372-0872ea52daca ip route
------------------------------------------------------------------------

default via 172.27.3.1 dev qg-178df5e4-d5 proto static 
172.20.0.0/26 dev qr-06e87369-0c proto kernel scope link src 172.20.0.1 
172.27.3.0/24 dev qg-178df5e4-d5 proto kernel scope link src 172.27.3.33 

sudo ip netns exec qrouter-d90cec20-0152-4f43-8372-0872ea52daca ip -6 route
---------------------------------------------------------------------------

fe80::/64 dev qr-06e87369-0c proto kernel metric 256 pref medium
fe80::/64 dev qg-178df5e4-d5 proto kernel metric 256 pref medium

sudo ip netns exec qdhcp-9f4a9556-0f2a-4b0f-9d50-87a629ad93ec ip neigh
----------------------------------------------------------------------


sudo ip netns exec qdhcp-9f4a9556-0f2a-4b0f-9d50-87a629ad93ec ip addr
---------------------------------------------------------------------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
7: tap8f3ea38b-bf: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:6a:5b:42 brd ff:ff:ff:ff:ff:ff
    inet 172.20.0.2/26 brd 172.20.0.63 scope global tap8f3ea38b-bf
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe6a:5b42/64 scope link 
       valid_lft forever preferred_lft forever

sudo ip netns exec qdhcp-9f4a9556-0f2a-4b0f-9d50-87a629ad93ec ip route
----------------------------------------------------------------------

default via 172.20.0.1 dev tap8f3ea38b-bf proto static 
172.20.0.0/26 dev tap8f3ea38b-bf proto kernel scope link src 172.20.0.2 

sudo ip netns exec qdhcp-9f4a9556-0f2a-4b0f-9d50-87a629ad93ec ip -6 route
-------------------------------------------------------------------------

fe80::/64 dev tap8f3ea38b-bf proto kernel metric 256 pref medium


Open vSwitch Dump
=================

sudo ovs-vsctl show
-------------------

54d4bfea-854b-4f99-b385-1a35887a4205
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-data
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        datapath_type: system
        Port phy-br-data
            Interface phy-br-data
                type: patch
                options: {peer=int-br-data}
        Port br-data
            Interface br-data
                type: internal
        Port eth1
            Interface eth1
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        datapath_type: system
        Port br-int
            Interface br-int
                type: internal
        Port qg-178df5e4-d5
            tag: 2
            Interface qg-178df5e4-d5
                type: internal
        Port qr-06e87369-0c
            tag: 1
            Interface qr-06e87369-0c
                type: internal
        Port int-br-data
            Interface int-br-data
                type: patch
                options: {peer=phy-br-data}
        Port tap8f3ea38b-bf
            tag: 1
            Interface tap8f3ea38b-bf
                type: internal
    ovs_version: "2.13.3"

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-data
---------------------------------------------------------------------------------------------------------

OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:000006d14c946845
n_tables:254, n_buffers:0
capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES
OFPST_PORT_DESC reply (OF1.4) (xid=0x3):
 1(eth1): addr:fa:16:3e:1b:cb:b3
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(phy-br-data): addr:ae:f7:b2:7d:ce:87
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-data): addr:06:d1:4c:94:68:45
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-int
--------------------------------------------------------------------------------------------------------

OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:0000b6ca5ffbe649
n_tables:254, n_buffers:0
capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES
OFPST_PORT_DESC reply (OF1.4) (xid=0x3):
 1(int-br-data): addr:e2:25:60:a7:ad:95
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(tap8f3ea38b-bf): addr:fa:16:3e:6a:5b:42
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 3(qr-06e87369-0c): addr:fa:16:3e:22:89:82
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 4(qg-178df5e4-d5): addr:fa:16:3e:68:25:22
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:b6:ca:5f:fb:e6:49
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-data
--------------------------------------------------------------------------------------------------------------------

OFPST_PORT_DESC reply (OF1.4) (xid=0x2):
 1(eth1): addr:fa:16:3e:1b:cb:b3
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(phy-br-data): addr:ae:f7:b2:7d:ce:87
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-data): addr:06:d1:4c:94:68:45
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-int
-------------------------------------------------------------------------------------------------------------------

OFPST_PORT_DESC reply (OF1.4) (xid=0x2):
 1(int-br-data): addr:e2:25:60:a7:ad:95
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(tap8f3ea38b-bf): addr:fa:16:3e:6a:5b:42
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 3(qr-06e87369-0c): addr:fa:16:3e:22:89:82
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 4(qg-178df5e4-d5): addr:fa:16:3e:68:25:22
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:b6:ca:5f:fb:e6:49
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-data
---------------------------------------------------------------------------------------------------------------

OFPST_PORT reply (OF1.4) (xid=0x2): 3 ports
  port LOCAL: rx pkts=250, bytes=41666, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=11, bytes=866, drop=0, errs=0, coll=0
           duration=214.909s
  port  1: rx pkts=3119, bytes=477777, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=63, bytes=5794, drop=0, errs=0, coll=0
           duration=211.055s
  port  2: rx pkts=36, bytes=2792, drop=?, errs=?, frame=?, over=?, crc=?
           tx pkts=132, bytes=26131, drop=?, errs=?, coll=?
           duration=114.530s

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-int
--------------------------------------------------------------------------------------------------------------

OFPST_PORT reply (OF1.4) (xid=0x2): 5 ports
  port  4: rx pkts=104, bytes=17949, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=18, bytes=1348, drop=0, errs=0, coll=0
           duration=69.121s
  port LOCAL: rx pkts=0, bytes=0, drop=140, errs=0, frame=0, over=0, crc=0
           tx pkts=0, bytes=0, drop=0, errs=0, coll=0
           duration=215.131s
  port  1: rx pkts=132, bytes=26131, drop=?, errs=?, frame=?, over=?, crc=?
           tx pkts=36, bytes=2792, drop=?, errs=?, coll=?
           duration=114.574s
  port  2: rx pkts=6, bytes=304, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=5, bytes=446, drop=0, errs=0, coll=0
           duration=90.088s
  port  3: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=13, bytes=998, drop=0, errs=0, coll=0
           duration=72.487s

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-data
---------------------------------------------------------------------------------------------------------------

OFPST_FLOW reply (OF1.4) (xid=0x2):
 cookie=0xc541e4e0995430ce, duration=88.625s, table=0, n_packets=9, n_bytes=658, priority=4,in_port=2,dl_vlan=1 actions=set_field:4266->vlan_vid,NORMAL
 cookie=0xc541e4e0995430ce, duration=68.616s, table=0, n_packets=16, n_bytes=1196, priority=4,in_port=2,dl_vlan=2 actions=pop_vlan,NORMAL
 cookie=0xc541e4e0995430ce, duration=114.533s, table=0, n_packets=11, n_bytes=938, priority=2,in_port=2 actions=drop
 cookie=0xc541e4e0995430ce, duration=114.594s, table=0, n_packets=132, n_bytes=26131, priority=0 actions=NORMAL

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-int
--------------------------------------------------------------------------------------------------------------

OFPST_FLOW reply (OF1.4) (xid=0x2):
 cookie=0x6a6f77a80b515a13, duration=115.805s, table=0, n_packets=0, n_bytes=0, priority=65535,vlan_tci=0x0fff/0x1fff actions=drop
 cookie=0x6a6f77a80b515a13, duration=88.636s, table=0, n_packets=0, n_bytes=0, priority=3,in_port=1,dl_vlan=170 actions=set_field:4097->vlan_vid,goto_table:60
 cookie=0x6a6f77a80b515a13, duration=68.626s, table=0, n_packets=104, n_bytes=19405, priority=3,in_port=1,vlan_tci=0x0000/0x1fff actions=push_vlan:0x8100,set_field:4098->vlan_vid,goto_table:60
 cookie=0x6a6f77a80b515a13, duration=114.562s, table=0, n_packets=28, n_bytes=6726, priority=2,in_port=1 actions=drop
 cookie=0x6a6f77a80b515a13, duration=115.816s, table=0, n_packets=36, n_bytes=2792, priority=0 actions=goto_table:60
 cookie=0x6a6f77a80b515a13, duration=115.823s, table=23, n_packets=0, n_bytes=0, priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=115.809s, table=24, n_packets=0, n_bytes=0, priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=86.605s, table=60, n_packets=2, n_bytes=180, priority=100,in_port=2 actions=set_field:0x2->reg5,set_field:0x1->reg6,resubmit(,73)
 cookie=0x6a6f77a80b515a13, duration=70.578s, table=60, n_packets=8, n_bytes=608, priority=100,in_port=3 actions=set_field:0x3->reg5,set_field:0x1->reg6,resubmit(,73)
 cookie=0x6a6f77a80b515a13, duration=66.540s, table=60, n_packets=16, n_bytes=1196, priority=100,in_port=4 actions=set_field:0x4->reg5,set_field:0x2->reg6,resubmit(,73)
 cookie=0x6a6f77a80b515a13, duration=115.813s, table=60, n_packets=114, n_bytes=20213, priority=3 actions=NORMAL
 cookie=0x6a6f77a80b515a13, duration=115.798s, table=62, n_packets=0, n_bytes=0, priority=3 actions=NORMAL
 cookie=0x6a6f77a80b515a13, duration=110.555s, table=71, n_packets=0, n_bytes=0, reset_counts priority=110,ct_state=+trk actions=ct_clear,resubmit(,71)
 cookie=0x6a6f77a80b515a13, duration=110.605s, table=71, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=110.595s, table=72, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=86.605s, table=73, n_packets=2, n_bytes=180, priority=80,reg5=0x2 actions=resubmit(,94)
 cookie=0x6a6f77a80b515a13, duration=70.578s, table=73, n_packets=8, n_bytes=608, priority=80,reg5=0x3 actions=resubmit(,94)
 cookie=0x6a6f77a80b515a13, duration=66.539s, table=73, n_packets=16, n_bytes=1196, priority=80,reg5=0x4 actions=resubmit(,94)
 cookie=0x6a6f77a80b515a13, duration=110.585s, table=73, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=110.575s, table=81, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=110.565s, table=82, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=110.534s, table=91, n_packets=0, n_bytes=0, reset_counts priority=1 actions=resubmit(,94)
 cookie=0x6a6f77a80b515a13, duration=110.524s, table=92, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=110.514s, table=93, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x6a6f77a80b515a13, duration=110.544s, table=94, n_packets=26, n_bytes=1984, reset_counts priority=1 actions=NORMAL


IP Tables Dump
==============

sudo iptables --line-numbers -L -nv -t filter
---------------------------------------------

Chain INPUT (policy ACCEPT 439K packets, 3649M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 395K packets, 2633M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

sudo iptables --line-numbers -L -nv -t nat
------------------------------------------

Chain PREROUTING (policy ACCEPT 983 packets, 288K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain INPUT (policy ACCEPT 817 packets, 264K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 2259 packets, 151K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain POSTROUTING (policy ACCEPT 2259 packets, 151K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

sudo iptables --line-numbers -L -nv -t mangle
---------------------------------------------

Chain PREROUTING (policy ACCEPT 213K packets, 3249M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain INPUT (policy ACCEPT 213K packets, 3249M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 212K packets, 2603M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain POSTROUTING (policy ACCEPT 212K packets, 2603M bytes)
num   pkts bytes target     prot opt in     out     source               destination         


EB Tables Dump
==============

sudo ebtables -t filter -L
--------------------------

Bridge table: filter

Bridge chain: INPUT, entries: 0, policy: ACCEPT

Bridge chain: FORWARD, entries: 0, policy: ACCEPT

Bridge chain: OUTPUT, entries: 0, policy: ACCEPT

sudo ebtables -t nat -L
-----------------------

Bridge table: nat

Bridge chain: PREROUTING, entries: 0, policy: ACCEPT

Bridge chain: OUTPUT, entries: 0, policy: ACCEPT

Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT


Compute consoles
================


nova-compute Guru Meditation Report
===================================

Skipping as nova-compute does not appear to be running

neutron-dhcp-agent Guru Meditation Report
=========================================

102948
killall -e -USR2 neutron-dhcp-agent
-----------------------------------


guru meditation report in neutron-dhcp-agent log

neutron-l3-agent Guru Meditation Report
=======================================

103357
killall -e -USR2 neutron-l3-agent
---------------------------------


guru meditation report in neutron-l3-agent log

neutron-linuxbridge-agent Guru Meditation Report
================================================

Skipping as neutron-linuxbridge-agent does not appear to be running

neutron-metadata-agent Guru Meditation Report
=============================================

103721
104197
104198
killall -e -USR2 neutron-metadata-agent
---------------------------------------


guru meditation report in neutron-metadata-agent log

neutron-openvswitch-agent Guru Meditation Report
================================================

102585
killall -e -USR2 neutron-openvswitch-agent
------------------------------------------


guru meditation report in neutron-openvswitch-agent log

cinder-volume Guru Meditation Report
====================================

Skipping as cinder-volume does not appear to be running