File System Summary
===================

WARN: Device /dev/loop1 (/snap/lxd/19647) is 100% full, might be an issue
WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue
WARN: Device /dev/loop0 (/snap/core18/1997) is 100% full, might be an issue
Filesystem      Size  Used Avail Use% Mounted on
udev            5.9G     0  5.9G   0% /dev
tmpfs           1.2G  1.3M  1.2G   1% /run
/dev/sda1        39G  5.2G   34G  14% /
tmpfs           5.9G  4.0K  5.9G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           5.9G     0  5.9G   0% /sys/fs/cgroup
/dev/loop1       71M   71M     0 100% /snap/lxd/19647
/dev/loop2       33M   33M     0 100% /snap/snapd/11588
/dev/loop0       56M   56M     0 100% /snap/core18/1997
/dev/sda15      105M  7.8M   97M   8% /boot/efi
tmpfs           1.2G     0  1.2G   0% /run/user/1000
tmpfs           512M  123M  390M  24% /opt/stack/data/etcd
/dev/loop3      6.0G   73M  6.0G   2% /opt/stack/data/swift/drives/sdb1


Process Listing
===============

ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args
---------------------------------------------------------------

USER        PPID     PID %CPU %MEM    VSZ   RSS TT       STAT  STARTED     TIME COMMAND
root           0       1  1.9  0.1 169148 13116 ?        Ss   14:24:26 00:00:50 /lib/systemd/systemd --system --deserialize 27
root           0       2  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [kthreadd]
root           2       3  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [rcu_gp]
root           2       4  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [rcu_par_gp]
root           2       6  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [kworker/0:0H-kblockd]
root           2       8  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [mm_percpu_wq]
root           2       9  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [ksoftirqd/0]
root           2      10  0.1  0.0      0     0 ?        I    14:24:26 00:00:02 [rcu_sched]
root           2      11  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [migration/0]
root           2      12  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [idle_inject/0]
root           2      14  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [cpuhp/0]
root           2      15  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [cpuhp/1]
root           2      16  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [idle_inject/1]
root           2      17  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [migration/1]
root           2      18  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [ksoftirqd/1]
root           2      20  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [kworker/1:0H-kblockd]
root           2      21  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [cpuhp/2]
root           2      22  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [idle_inject/2]
root           2      23  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [migration/2]
root           2      24  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [ksoftirqd/2]
root           2      25  0.0  0.0      0     0 ?        I    14:24:26 00:00:00 [kworker/2:0-memcg_kmem_cache]
root           2      26  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [kworker/2:0H-kblockd]
root           2      27  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [cpuhp/3]
root           2      28  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [idle_inject/3]
root           2      29  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [migration/3]
root           2      30  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [ksoftirqd/3]
root           2      32  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [kworker/3:0H-kblockd]
root           2      33  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [kdevtmpfs]
root           2      34  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [netns]
root           2      35  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [rcu_tasks_kthre]
root           2      36  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [kauditd]
root           2      41  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [khungtaskd]
root           2      42  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [oom_reaper]
root           2      43  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [writeback]
root           2      44  0.0  0.0      0     0 ?        S    14:24:26 00:00:00 [kcompactd0]
root           2      45  0.0  0.0      0     0 ?        SN   14:24:26 00:00:00 [ksmd]
root           2      46  0.0  0.0      0     0 ?        SN   14:24:26 00:00:00 [khugepaged]
root           2      93  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [kintegrityd]
root           2      94  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [kblockd]
root           2      95  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [blkcg_punt_bio]
root           2      96  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [tpm_dev_wq]
root           2      97  0.0  0.0      0     0 ?        I<   14:24:26 00:00:00 [ata_sff]
root           2      98  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [md]
root           2      99  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [edac-poller]
root           2     100  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [devfreq_wq]
root           2     101  0.0  0.0      0     0 ?        S    14:24:27 00:00:00 [watchdogd]
root           2     105  0.0  0.0      0     0 ?        S    14:24:27 00:00:00 [kswapd0]
root           2     106  0.0  0.0      0     0 ?        S    14:24:27 00:00:00 [ecryptfs-kthrea]
root           2     108  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [kthrotld]
root           2     109  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [acpi_thermal_pm]
root           2     111  0.0  0.0      0     0 ?        S    14:24:27 00:00:00 [scsi_eh_0]
root           2     112  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [scsi_tmf_0]
root           2     113  0.0  0.0      0     0 ?        S    14:24:27 00:00:00 [scsi_eh_1]
root           2     114  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [scsi_tmf_1]
root           2     116  0.0  0.0      0     0 ?        I<   14:24:27 00:00:00 [vfio-irqfd-clea]
root           2     117  0.0  0.0      0     0 ?        I<   14:24:28 00:00:00 [ipv6_addrconf]
root           2     127  0.0  0.0      0     0 ?        I<   14:24:28 00:00:00 [kstrp]
root           2     130  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [kworker/u257:0]
root           2     143  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [charger_manager]
root           2     186  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [hv_vmbus_con]
root           2     187  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [hv_pri_chan]
root           2     188  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [hv_sub_chan]
root           2     190  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [kworker/3:1H-kblockd]
root           2     191  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [cryptd]
root           2     229  0.0  0.0      0     0 ?        S    14:24:29 00:00:00 [scsi_eh_2]
root           2     230  0.0  0.0      0     0 ?        S    14:24:29 00:00:00 [scsi_eh_3]
root           2     231  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [scsi_tmf_3]
root           2     232  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [scsi_tmf_2]
root           2     233  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [storvsc_error_w]
root           2     240  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [storvsc_error_w]
root           2     245  0.0  0.0      0     0 ?        I<   14:24:29 00:00:00 [kworker/0:1H-kblockd]
root           2     278  0.0  0.0      0     0 ?        I<   14:24:31 00:00:00 [raid5wq]
root           2     304  0.0  0.0      0     0 ?        I<   14:24:31 00:00:00 [kworker/1:1H-kblockd]
root           2     319  0.0  0.0      0     0 ?        I<   14:24:32 00:00:00 [kworker/2:1H-kblockd]
root           2     320  0.1  0.0      0     0 ?        S    14:24:32 00:00:04 [jbd2/sda1-8]
root           2     321  0.0  0.0      0     0 ?        I<   14:24:32 00:00:00 [ext4-rsv-conver]
root           1     423  0.0  0.0  19348  5892 ?        Ss   14:24:34 00:00:01 /lib/systemd/systemd-udevd
root           2     461  0.0  0.0      0     0 ?        S    14:24:35 00:00:00 [hv_balloon]
root           2     552  0.0  0.0      0     0 ?        I<   14:24:35 00:00:00 [kaluad]
root           2     553  0.0  0.0      0     0 ?        I<   14:24:35 00:00:00 [kmpath_rdacd]
root           2     554  0.0  0.0      0     0 ?        I<   14:24:35 00:00:00 [kmpathd]
root           2     555  0.0  0.0      0     0 ?        I<   14:24:35 00:00:00 [kmpath_handlerd]
root           1     556  0.0  0.1 280200 17992 ?        SLsl 14:24:35 00:00:00 /sbin/multipathd -d -s
root           2     564  0.0  0.0      0     0 ?        S<   14:24:35 00:00:00 [loop0]
root           2     568  0.0  0.0      0     0 ?        S<   14:24:35 00:00:00 [loop1]
root           2     571  0.0  0.0      0     0 ?        S<   14:24:35 00:00:00 [loop2]
root           1     782  0.0  0.0 241136  9520 ?        Ssl  14:24:46 00:00:00 /usr/lib/accountsservice/accounts-daemon
root           1     785  0.0  0.0   8536  2888 ?        Ss   14:24:46 00:00:00 /usr/sbin/cron -f
message+       1     787  0.2  0.0   7780  4976 ?        Ss   14:24:46 00:00:05 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root           1     795  0.0  0.0  81828  3688 ?        Ssl  14:24:46 00:00:00 /usr/sbin/irqbalance --foreground
root           1     798  0.0  0.1  29264 18056 ?        Ss   14:24:46 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
root           1     802  0.1  0.2 1372472 34240 ?       Ssl  14:24:46 00:00:03 /usr/lib/snapd/snapd
root           1     803  0.1  0.0  16780  7824 ?        Ss   14:24:46 00:00:02 /lib/systemd/systemd-logind
daemon         1     805  0.0  0.0   3792  2224 ?        Ss   14:24:46 00:00:00 /usr/sbin/atd -f
root           2     846  0.0  0.0      0     0 ?        I    14:24:46 00:00:00 [kworker/1:4-rcu_par_gp]
root           1     847  0.0  0.0   7352  2288 ttyS0    Ss+  14:24:46 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220
root           1     858  0.0  0.0   5828  1932 tty1     Ss+  14:24:46 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
root           1     877  0.0  0.1 108100 20504 ?        Ssl  14:24:46 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root           1     882  0.0  0.0 237748 10320 ?        Ssl  14:24:46 00:00:00 /usr/lib/policykit-1/polkitd --no-debug
root           1    1585  0.0  0.0  13800  8992 ?        Ss   14:29:02 00:00:00 sshd: ubuntu [priv]
ubuntu         1    1603  0.0  0.0  18496  9796 ?        Ss   14:29:02 00:00:00 /lib/systemd/systemd --user
ubuntu      1603    1609  0.0  0.0 169784  4556 ?        S    14:29:02 00:00:00 (sd-pam)
ubuntu      1585    1684  0.0  0.0  13932  6512 ?        S    14:29:03 00:00:00 sshd: ubuntu@pts/0
root           2   14552  0.0  0.0      0     0 ?        I    14:37:03 00:00:01 [kworker/u256:1-events_power_efficient]
ubuntu      1684   15063  0.0  0.0   2608   532 pts/0    Ss+  14:47:27 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1652107647.87-232561715866107/AnsiballZ_command.py && sleep 0
ubuntu     15063   15064  0.0  0.1  28116 17892 pts/0    S+   14:47:27 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1652107647.87-232561715866107/AnsiballZ_command.py
ubuntu     15064   15066  0.0  0.0   2608   596 pts/0    S+   14:47:27 00:00:00 /bin/sh -c # workaround get-pip breaking when setuptools installed  # ref: https://github.com/pypa/pip/issues/10742  sudo -H -E pip3 uninstall setuptools -y || true  ./unstack.sh > /dev/null 2>&1  ./stack.sh > /dev/null 2>&1
ubuntu      1603   15070  0.0  0.0   7348  4444 ?        Ss   14:47:28 00:00:00 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root           2   16327  0.0  0.0   2488   512 ?        S    14:47:31 00:00:00 bpfilter_umh
root           2   16353  0.0  0.0      0     0 ?        I    14:47:31 00:00:00 [kworker/0:0-events]
root           2   17435  0.0  0.0      0     0 ?        I    14:47:33 00:00:00 [kworker/0:3-rcu_par_gp]
root           2   17464  0.0  0.0      0     0 ?        I    14:47:33 00:00:00 [kworker/2:1-rcu_par_gp]
ubuntu     15066   17840  0.7  0.0  15612 10924 pts/0    S+   14:47:35 00:00:08 bash ./stack.sh
ubuntu     17840   20126  0.0  0.0  10644  3972 pts/0    S+   14:47:39 00:00:00 bash ./stack.sh
ubuntu     17840   20131  0.0  0.0  10644  3908 pts/0    S+   14:47:39 00:00:00 bash ./stack.sh
ubuntu     20126   20132  0.2  0.0  17516 11296 pts/0    S+   14:47:39 00:00:02 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2022-05-09-144739
ubuntu     20131   20139  0.0  0.0  17384 11176 pts/0    S+   14:47:39 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2022-05-09-144739.summary.2022-05-09-144739
root           2   25184  0.0  0.0      0     0 ?        I    14:49:12 00:00:00 [kworker/3:3-mm_percpu_wq]
uuidd          1   25246  0.0  0.0   9744  1064 ?        Ss   14:49:13 00:00:00 /usr/sbin/uuidd --socket-activation
root           1   25321  0.0  0.0   8136  3772 ?        Ss   14:49:15 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf
root           1   25585  0.0  0.0  15300  8896 ?        Ss   14:49:19 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock
haproxy    25585   25586  0.0  0.0 236496  3044 ?        Sl   14:49:19 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock
root           2   26214  0.0  0.0      0     0 ?        I    14:49:26 00:00:00 [kworker/1:2-events]
root           1   26445  0.0  0.0  12172  7028 ?        Ss   14:49:30 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
pcp            1   28357  0.1  0.0   8384  4428 ?        Ss   14:49:41 00:00:01 /usr/lib/pcp/bin/pmcd
root       28357   28360  0.0  0.0   7736  3932 ?        S    14:49:42 00:00:00 /var/lib/pcp/pmdas/root/pmdaroot
root       28360   28361  0.0  0.0   8308  4996 ?        S    14:49:42 00:00:00 /var/lib/pcp/pmdas/proc/pmdaproc -d 3
root       28360   28362  0.0  0.0   7212  1612 ?        S    14:49:42 00:00:00 /var/lib/pcp/pmdas/xfs/pmdaxfs -d 11
root       28360   28363  0.2  0.0   8272  5056 ?        S    14:49:42 00:00:02 /var/lib/pcp/pmdas/linux/pmdalinux
root       28360   28364  0.0  0.0   7268  3800 ?        S    14:49:42 00:00:00 /var/lib/pcp/pmdas/kvm/pmdakvm -d 95
pcp            1   39382  0.0  0.0   8564  5156 ?        S    14:49:58 00:00:00 /usr/lib/pcp/bin/pmlogger -P -r -T24h10m -c config.default -v 100mb -m pmlogger_check 20220509.14.49
systemd+       1   39607  0.0  0.0  26740  7896 ?        Ss   14:50:00 00:00:00 /lib/systemd/systemd-networkd
systemd+       1   39641  0.0  0.0  23896 12160 ?        Ss   14:50:00 00:00:00 /lib/systemd/systemd-resolved
systemd+       1   39770  0.0  0.0  90224  6028 ?        Ssl  14:50:01 00:00:00 /lib/systemd/systemd-timesyncd
syslog         1   44483  0.2  0.0 224344  4904 ?        Ssl  14:50:16 00:00:02 /usr/sbin/rsyslogd -n -iNONE
root           1   53912  0.6  0.5 115052 65744 ?        S<s  14:51:07 00:00:06 /lib/systemd/systemd-journald
epmd           1   54762  0.0  0.0   6348  1372 ?        Ss   14:51:56 00:00:00 /usr/bin/epmd -systemd
rabbitmq       1   54918  0.0  0.0   2608   532 ?        Ss   14:52:01 00:00:00 /bin/sh /usr/sbin/rabbitmq-server
rabbitmq   54918   54935  1.2  0.6 3326948 82288 ?       Sl   14:52:01 00:00:11 /usr/lib/erlang/erts-10.6.4/bin/beam.smp -W w -A 64 -MBas ageffcbf -MHas ageffcbf -MBlmbcs 512 -MHlmbcs 512 -MMmcs 30 -P 1048576 -t 5000000 -stbt db -zdbbl 128000 -K true -- -root /usr/lib/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/ebin  -noshell -noinput -s rabbit boot -sname rabbit@dv-cinder-840678-3-smb -boot start_sasl -kernel inet_default_connect_options [{nodelay,true}] -sasl errlog_type error -sasl sasl_error_logger false -rabbit lager_log_root "/var/log/rabbitmq" -rabbit lager_default_file "/var/log/rabbitmq/rabbit@dv-cinder-840678-3-smb.log" -rabbit lager_upgrade_file "/var/log/rabbitmq/rabbit@dv-cinder-840678-3-smb_upgrade.log" -rabbit feature_flags_file "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-840678-3-smb-feature_flags" -rabbit enabled_plugins_file "/etc/rabbitmq/enabled_plugins" -rabbit plugins_dir "/usr/lib/rabbitmq/plugins:/usr/lib/rabbitmq/lib/rabbitmq_server-3.8.2/plugins" -rabbit plugins_expand_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-840678-3-smb-plugins-expand" -os_mon start_cpu_sup false -os_mon start_disksup false -os_mon start_memsup false -mnesia dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-840678-3-smb" -ra data_dir "/var/lib/rabbitmq/mnesia/rabbit@dv-cinder-840678-3-smb/quorum" -kernel inet_dist_listen_min 25672 -kernel inet_dist_listen_max 25672 --
rabbitmq   54935   55192  0.0  0.0   2492  1340 ?        Ss   14:52:02 00:00:00 erl_child_setup 65536
rabbitmq   55192   55222  0.0  0.0   3880   840 ?        Ss   14:52:06 00:00:00 inet_gethost 4
rabbitmq   55222   55223  0.0  0.0   3960  1896 ?        S    14:52:06 00:00:00 inet_gethost 4
root           1   58575  0.0  0.0   9652  5352 ?        S<s  14:53:18 00:00:00 ovsdb-server /etc/openvswitch/conf.db -vconsole:emer -vsyslog:err -vfile:info --remote=punix:/var/run/openvswitch/db.sock --private-key=db:Open_vSwitch,SSL,private_key --certificate=db:Open_vSwitch,SSL,certificate --bootstrap-ca-cert=db:Open_vSwitch,SSL,ca_cert --no-chdir --log-file=/var/log/openvswitch/ovsdb-server.log --pidfile=/var/run/openvswitch/ovsdb-server.pid --detach
root           1   58625  0.0  0.4 382552 55352 ?        S<Lsl 14:53:18 00:00:00 ovs-vswitchd unix:/var/run/openvswitch/db.sock -vconsole:emer -vsyslog:err -vfile:info --mlockall --no-chdir --log-file=/var/log/openvswitch/ovs-vswitchd.log --pidfile=/var/run/openvswitch/ovs-vswitchd.pid --detach
root           2   61936  0.0  0.0      0     0 ?        I    14:54:36 00:00:00 [kworker/1:1-events]
root           2   67795  0.0  0.0      0     0 ?        I    14:55:47 00:00:00 [kworker/3:1-events]
root           2   68490  0.0  0.0      0     0 ?        I<   14:56:26 00:00:00 [target_completi]
root           2   68491  0.0  0.0      0     0 ?        I<   14:56:26 00:00:00 [xcopy_wq]
root           2   75560  0.0  0.0      0     0 ?        I    14:57:45 00:00:00 [kworker/u256:0-events_power_efficient]
root           1   77188  0.0  0.0  13964  5556 ?        Ss   14:58:31 00:00:00 /usr/sbin/apache2 -k start
www-data   77188   77189  0.0  0.0 2008980 11968 ?       Sl   14:58:31 00:00:00 /usr/sbin/apache2 -k start
www-data   77188   77190  0.1  0.0 2009172 11972 ?       Sl   14:58:31 00:00:00 /usr/sbin/apache2 -k start
mysql          1   78378 14.5  6.2 3057680 763468 ?      Ssl  14:58:45 00:01:07 /usr/sbin/mysqld
ubuntu         1   78834  0.0  0.0   5648  3228 ?        Ss   14:58:48 00:00:00 /bin/bash /home/ubuntu/devstack/tools/dstat.sh /opt/stack/logs
ubuntu     78834   78962  0.2  0.1  21320 16300 ?        S    14:58:48 00:00:01 python3 /usr/bin/dstat -tcmndrylpg --tcp --output /opt/stack/logs/dstat-csv.log
ubuntu     78834   78963  0.2  0.1  21320 16376 ?        S    14:58:48 00:00:01 python3 /usr/bin/dstat -tcmndrylpg --swap --tcp
root           1   79422  0.6  0.1 10516468 17940 ?      Ssl  14:58:50 00:00:03 /opt/stack/bin/etcd --name dv-cinder-840678-3-smb --data-dir /opt/stack/data/etcd --initial-cluster-state new --initial-cluster-token etcd-cluster-01 --initial-cluster dv-cinder-840678-3-smb=http://10.222.0.58:2380 --initial-advertise-peer-urls http://10.222.0.58:2380 --advertise-client-urls http://10.222.0.58:2379 --listen-peer-urls http://0.0.0.0:2380 --listen-client-urls http://10.222.0.58:2379 --debug
ubuntu         1   80218  0.0  0.1  52576 14804 ?        Ss   14:59:11 00:00:00 keystoneuWSGI master
ubuntu     80218   80228 19.1  1.1 205460 139592 ?       S    14:59:11 00:01:24 keystoneuWSGI worker 1
ubuntu     80218   80229 19.3  1.1 205852 140064 ?       S    14:59:11 00:01:24 keystoneuWSGI worker 2
ubuntu         1   80526  0.0  0.0   5448   576 pts/0    S+   14:59:29 00:00:00 cat /opt/stack/async/install_tempest.fifo
root           2   91674  0.0  0.0      0     0 ?        I    15:02:52 00:00:00 [kworker/1:0]
root           2   93464  0.0  0.0      0     0 ?        I    15:03:29 00:00:00 [kworker/3:0-rcu_par_gp]
root           2   95200  0.0  0.0      0     0 ?        S<   15:03:38 00:00:00 [loop3]
root           2   95204  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfsalloc]
root           2   95206  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfs_mru_cache]
root           2   95209  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfs-buf/loop3]
root           2   95216  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfs-conv/loop3]
root           2   95217  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfs-cil/loop3]
root           2   95218  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfs-reclaim/loo]
root           2   95219  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfs-eofblocks/l]
root           2   95220  0.0  0.0      0     0 ?        I<   15:03:38 00:00:00 [xfs-log/loop3]
root           2   95221  0.0  0.0      0     0 ?        S    15:03:38 00:00:00 [xfsaild/loop3]
root           2   96473  0.0  0.0      0     0 ?        I    15:04:17 00:00:00 [kworker/u256:2-events_power_efficient]
memcache       1  100111  0.1  0.0 416964 11416 ?        Ssl  15:04:45 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid
root           2  100113  0.0  0.0      0     0 ?        I    15:04:45 00:00:00 [kworker/2:2-events]
root           2  100147  0.0  0.0      0     0 ?        I    15:04:45 00:00:00 [kworker/0:1-events]
root           1  100148  0.0  0.0   3380   852 ?        Ss   15:04:45 00:00:00 /usr/bin/rsync --daemon --no-detach
root           2  100431  0.0  0.0      0     0 ?        I    15:04:45 00:00:00 [kworker/u256:3-events_power_efficient]
ubuntu         1  100483  2.3  0.4  76212 54632 ?        Ss   15:04:46 00:00:02 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu         1  100844  2.2  0.4  77608 55016 ?        Ss   15:04:48 00:00:02 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu    100483  100916  0.0  0.3  76212 46948 ?        S    15:04:48 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu    100483  100966  0.0  0.3  76212 46948 ?        S    15:04:48 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf -v
ubuntu    100844  101203  0.0  0.3  77608 47040 ?        S    15:04:49 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu         1  101206  2.2  0.4  75680 52976 ?        Ss   15:04:49 00:00:02 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu    100844  101251  0.0  0.3  77608 47040 ?        S    15:04:49 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-container-server /etc/swift/container-server/1.conf -v
ubuntu    101206  101597  0.0  0.3  75936 45220 ?        S    15:04:50 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu    101206  101598  0.0  0.3  75936 45204 ?        S    15:04:50 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-account-server /etc/swift/account-server/1.conf -v
ubuntu         1  101604  1.3  0.4  77916 55488 ?        Ss   15:04:50 00:00:01 /usr/bin/python3.8 /usr/local/bin/swift-container-sync /etc/swift/container-server/1.conf
ubuntu         1  101982  3.5  0.5  95348 71388 ?        Ss   15:04:52 00:00:03 /usr/bin/python3.8 /usr/local/bin/swift-proxy-server /etc/swift/proxy-server.conf -v
ubuntu    101982  102076  0.6  0.5  95860 63292 ?        S    15:04:54 00:00:00 /usr/bin/python3.8 /usr/local/bin/swift-proxy-server /etc/swift/proxy-server.conf -v
ubuntu         1  102795  0.0  0.1  52576 14620 ?        Ss   15:04:57 00:00:00 nova-apiuWSGI master
ubuntu    102795  102796  6.4  1.1 210984 142704 ?       S    15:04:57 00:00:05 nova-apiuWSGI worker 1
ubuntu    102795  102797  6.5  1.1 211248 142968 ?       S    15:04:57 00:00:06 nova-apiuWSGI worker 2
ubuntu         1  103427  6.5  1.2 184856 150260 ?       Ss   15:05:04 00:00:05 /usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini
ubuntu    103427  103570  7.1  1.4 365420 174248 ?       Sl   15:05:10 00:00:05 neutron-server: api worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    103427  103571  1.6  1.2 343480 152484 ?       Sl   15:05:10 00:00:01 neutron-server: api worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    103427  103572  7.0  1.4 364572 172916 ?       Sl   15:05:10 00:00:05 neutron-server: rpc worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu    103427  103573  2.8  1.3 355496 163816 ?       Sl   15:05:10 00:00:02 neutron-server: periodic worker (/usr/bin/python3.8 /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu         1  104051  0.0  0.1  52576 14760 ?        Ss   15:05:12 00:00:00 placementuWSGI master
ubuntu    104051  104052  3.2  0.6 142276 80868 ?        S    15:05:12 00:00:02 placementuWSGI worker 1
ubuntu    104051  104053  3.2  0.6 142524 81332 ?        S    15:05:12 00:00:02 placementuWSGI worker 2
ubuntu         1  104516  8.2  1.2 335540 151064 ?       Ssl  15:05:16 00:00:06 neutron-openvswitch-agent (/usr/bin/python3.8 /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini)
ubuntu         1  104879  7.3  1.1 396716 137836 ?       Ssl  15:05:17 00:00:05 neutron-dhcp-agent (/usr/bin/python3.8 /usr/local/bin/neutron-dhcp-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini)
ubuntu         1  105254  7.2  1.1 323476 138452 ?       Ssl  15:05:19 00:00:05 neutron-l3-agent (/usr/bin/python3.8 /usr/local/bin/neutron-l3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini)
ubuntu         1  105609  5.5  1.0 312388 130692 ?       Ssl  15:05:20 00:00:03 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
ubuntu         1  105988  5.6  1.0 313460 131516 ?       Ssl  15:05:22 00:00:03 neutron-metering-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metering-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/services/metering/metering_agent.ini)
ubuntu    105609  106089  0.0  0.9 164092 118268 ?       S    15:05:25 00:00:00 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
ubuntu    105609  106090  0.0  0.9 164092 118268 ?       S    15:05:25 00:00:00 neutron-metadata-agent (/usr/bin/python3.8 /usr/local/bin/neutron-metadata-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/metadata_agent.ini)
root           1  106133  1.3  0.6 184716 81148 ?        Sl   15:05:26 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmpn7jotq_4/privsep.sock
root           1  106137  1.5  0.6 183476 78372 ?        Sl   15:05:27 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpxvihy4vh/privsep.sock
root           1  106202  0.4  0.4 154596 49296 ?        Sl   15:05:30 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmpd4cq1lpt/privsep.sock
ubuntu    104516  106205  0.0  0.0   9232  4012 ?        S    15:05:31 00:00:00 ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json
root           1  106401  3.1  0.7 190952 87552 ?        Sl   15:05:39 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmp8395h4nw/privsep.sock
root           1  106451  1.7  0.6 184716 80980 ?        Sl   15:05:42 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.namespace_cmd --privsep_sock_path /tmp/tmpgwrckrpq/privsep.sock
root           1  106526  1.9  0.6 185228 81736 ?        Sl   15:05:46 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini --privsep_context neutron.privileged.link_cmd --privsep_sock_path /tmp/tmp0z6d8xra/privsep.sock
root      104879  106590  0.0  0.0   8048  4616 ?        S    15:05:48 00:00:00 sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
root      106590  106596  2.1  0.3 287060 47000 ?        Sl   15:05:48 00:00:00 /usr/bin/python3.8 /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
nobody         1  106643  0.0  0.0  10960   360 ?        S    15:05:49 00:00:00 dnsmasq --no-hosts  --pid-file=/opt/stack/data/neutron/dhcp/5ac61d0c-3514-40db-a4da-7286aa882e90/pid --dhcp-hostsfile=/opt/stack/data/neutron/dhcp/5ac61d0c-3514-40db-a4da-7286aa882e90/host --addn-hosts=/opt/stack/data/neutron/dhcp/5ac61d0c-3514-40db-a4da-7286aa882e90/addn_hosts --dhcp-optsfile=/opt/stack/data/neutron/dhcp/5ac61d0c-3514-40db-a4da-7286aa882e90/opts --dhcp-leasefile=/opt/stack/data/neutron/dhcp/5ac61d0c-3514-40db-a4da-7286aa882e90/leases --dhcp-match=set:ipxe,175 --dhcp-userclass=set:ipxe6,iPXE --local-service --bind-dynamic --dhcp-range=set:subnet-0414fc64-06fa-47a2-a6dc-64945c3fdb96,172.20.0.0,static,255.255.255.192,86400s --dhcp-option-force=option:mtu,1500 --dhcp-lease-max=64 --conf-file=/dev/null --domain=openstacklocal
root           1  106872  5.5  0.7 412404 87928 ?        Sl   15:06:00 00:00:01 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmp93r2vv6s/privsep.sock
root           1  106885  3.4  0.6 185228 81944 ?        Sl   15:06:03 00:00:00 /usr/bin/python3 /usr/local/bin/privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/l3_agent.ini --privsep_context neutron.privileged.link_cmd --privsep_sock_path /tmp/tmpshen9yu7/privsep.sock
root         423  107058  0.0  0.0  19348  3648 ?        S    15:06:04 00:00:00 /lib/systemd/systemd-udevd
root         423  107061  0.0  0.0  19348  3580 ?        S    15:06:04 00:00:00 /lib/systemd/systemd-udevd
root      105254  107108  0.0  0.0   8052  4660 ?        S    15:06:06 00:00:00 sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
root      107108  107109  3.8  0.3 287060 46672 ?        Sl   15:06:06 00:00:00 /usr/bin/python3.8 /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
ubuntu         1  107448  0.0  0.0 236492  2976 ?        Ssl  15:06:07 00:00:00 haproxy -f /opt/stack/data/neutron/ns-metadata-proxy/ed838a72-d4b5-479e-97b7-8a257289f971.conf
ubuntu         1  107510 18.0  1.0 156976 123880 ?       Ss   15:06:07 00:00:03 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
root         423  107515  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107516  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107517  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107518  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107519  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107520  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107521  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107522  0.2  0.0  19348  3648 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root         423  107525  0.0  0.0  19348  3580 ?        S    15:06:07 00:00:00 /lib/systemd/systemd-udevd
root           2  108024  0.0  0.0      0     0 ?        I    15:06:09 00:00:00 [kworker/0:2-events]
ubuntu         1  108033  0.2  0.1  52576 14660 ?        Ss   15:06:09 00:00:00 nova-api-metauWSGI master
ubuntu    108033  108035 21.9  1.0 190004 123404 ?       S    15:06:09 00:00:04 nova-api-metauWSGI worker 1
ubuntu    108033  108036 21.9  1.0 190312 123652 ?       S    15:06:09 00:00:04 nova-api-metauWSGI worker 2
ubuntu    108033  108037  0.0  0.0  52576  4292 ?        S    15:06:09 00:00:00 nova-api-metauWSGI http 1
ubuntu    107510  108842  0.6  0.9 158244 115592 ?       S    15:06:11 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu    107510  108843  0.6  0.9 158244 115600 ?       S    15:06:11 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-scheduler --config-file /etc/nova/nova.conf
ubuntu         1  108874 23.0  1.0 156924 124076 ?       Ss   15:06:12 00:00:03 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu         1  109263 25.0  1.0 155932 122968 ?       Ss   15:06:14 00:00:03 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu    108874  109749  0.7  0.9 158552 115960 ?       S    15:06:16 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu    108874  109750  0.7  0.9 158564 115864 ?       S    15:06:16 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova.conf
ubuntu    109263  109756  0.7  0.9 157292 114564 ?       S    15:06:17 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu    109263  109757  0.7  0.9 157300 114456 ?       S    15:06:17 00:00:00 /usr/bin/python3.8 /usr/local/bin/nova-conductor --config-file /etc/nova/nova_cell1.conf
ubuntu         1  110325  0.6  0.1  52576 14744 ?        Ss   15:06:21 00:00:00 cinder-apiuWSGI master
root         423  110326  0.0  0.0  19348  3580 ?        S    15:06:21 00:00:00 /lib/systemd/systemd-udevd
root         423  110327  0.1  0.0  19348  3580 ?        S    15:06:21 00:00:00 /lib/systemd/systemd-udevd
root         423  110328  0.0  0.0  19348  3580 ?        S    15:06:21 00:00:00 /lib/systemd/systemd-udevd
ubuntu    110325  110329 33.0  0.8 176032 103692 ?       S    15:06:21 00:00:02 cinder-apiuWSGI worker 1
ubuntu    110325  110330 32.8  0.8 176028 103696 ?       S    15:06:21 00:00:02 cinder-apiuWSGI worker 2
root         423  110765  0.0  0.0  19348  3580 ?        S    15:06:25 00:00:00 /lib/systemd/systemd-udevd
ubuntu     17840  111041 53.0  0.2  28360 25020 pts/0    S+   15:06:28 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs
ubuntu    111041  111045  0.0  0.0   2608   600 pts/0    S+   15:06:29 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args
ubuntu    111045  111046  0.0  0.0   8824  3308 pts/0    R+   15:06:29 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args


Network Dump
============

bridge link
-----------


ip link show type bridge
------------------------


ip neigh
--------

10.222.0.1 dev eth0 lladdr 0a:db:49:c3:70:44 REACHABLE
10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE

ip addr
-------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:d8:4f:69 brd ff:ff:ff:ff:ff:ff
    inet 10.222.0.58/22 brd 10.222.3.255 scope global dynamic eth0
       valid_lft 85411sec preferred_lft 85411sec
    inet6 fe80::f816:3eff:fed8:4f69/64 scope link 
       valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000
    link/ether fa:16:3e:40:fe:d0 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::f816:3eff:fe40:fed0/64 scope link 
       valid_lft forever preferred_lft forever
4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 6a:07:85:8c:81:19 brd ff:ff:ff:ff:ff:ff
5: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 5a:46:72:30:e6:41 brd ff:ff:ff:ff:ff:ff
6: br-data: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether f6:65:83:7d:14:49 brd ff:ff:ff:ff:ff:ff
    inet 192.168.0.48/22 brd 192.168.3.255 scope global br-data
       valid_lft forever preferred_lft forever
    inet 172.28.0.1/24 scope global br-data
       valid_lft forever preferred_lft forever
    inet6 fe80::f465:83ff:fe7d:1449/64 scope link 
       valid_lft forever preferred_lft forever

ip route
--------

default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.58 metric 100 
10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.58 
169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.58 metric 100 
172.28.0.0/24 dev br-data proto kernel scope link src 172.28.0.1 
192.168.0.0/22 dev br-data proto kernel scope link src 192.168.0.48 
192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.58 metric 100 

ip -6 route
-----------

::1 dev lo proto kernel metric 256 pref medium
fe80::/64 dev eth1 proto kernel metric 256 pref medium
fe80::/64 dev eth0 proto kernel metric 256 pref medium
fe80::/64 dev br-data proto kernel metric 256 pref medium

ip netns
--------

qrouter-ed838a72-d4b5-479e-97b7-8a257289f971 (id: 1)
qdhcp-5ac61d0c-3514-40db-a4da-7286aa882e90 (id: 0)

sudo ip netns exec qrouter-ed838a72-d4b5-479e-97b7-8a257289f971 ip neigh
------------------------------------------------------------------------

fe80::328d:99ff:fe30:1ca0 dev qg-8ddcb303-8b lladdr 30:8d:99:30:1c:a0 STALE

sudo ip netns exec qrouter-ed838a72-d4b5-479e-97b7-8a257289f971 ip addr
-----------------------------------------------------------------------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
8: qr-b8b16611-39: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:7d:39:6e brd ff:ff:ff:ff:ff:ff
    inet 172.20.0.1/26 brd 172.20.0.63 scope global qr-b8b16611-39
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe7d:396e/64 scope link 
       valid_lft forever preferred_lft forever
9: qg-8ddcb303-8b: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:17:c9:40 brd ff:ff:ff:ff:ff:ff
    inet 172.28.0.6/24 brd 172.28.0.255 scope global qg-8ddcb303-8b
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe17:c940/64 scope link 
       valid_lft forever preferred_lft forever

sudo ip netns exec qrouter-ed838a72-d4b5-479e-97b7-8a257289f971 ip route
------------------------------------------------------------------------

default via 172.28.0.1 dev qg-8ddcb303-8b proto static 
172.20.0.0/26 dev qr-b8b16611-39 proto kernel scope link src 172.20.0.1 
172.28.0.0/24 dev qg-8ddcb303-8b proto kernel scope link src 172.28.0.6 

sudo ip netns exec qrouter-ed838a72-d4b5-479e-97b7-8a257289f971 ip -6 route
---------------------------------------------------------------------------

fe80::/64 dev qr-b8b16611-39 proto kernel metric 256 pref medium
fe80::/64 dev qg-8ddcb303-8b proto kernel metric 256 pref medium

sudo ip netns exec qdhcp-5ac61d0c-3514-40db-a4da-7286aa882e90 ip neigh
----------------------------------------------------------------------


sudo ip netns exec qdhcp-5ac61d0c-3514-40db-a4da-7286aa882e90 ip addr
---------------------------------------------------------------------

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
7: tape082d826-f6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:16:3e:0f:ad:fd brd ff:ff:ff:ff:ff:ff
    inet 172.20.0.2/26 brd 172.20.0.63 scope global tape082d826-f6
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe0f:adfd/64 scope link 
       valid_lft forever preferred_lft forever

sudo ip netns exec qdhcp-5ac61d0c-3514-40db-a4da-7286aa882e90 ip route
----------------------------------------------------------------------

default via 172.20.0.1 dev tape082d826-f6 proto static 
172.20.0.0/26 dev tape082d826-f6 proto kernel scope link src 172.20.0.2 

sudo ip netns exec qdhcp-5ac61d0c-3514-40db-a4da-7286aa882e90 ip -6 route
-------------------------------------------------------------------------

fe80::/64 dev tape082d826-f6 proto kernel metric 256 pref medium


Open vSwitch Dump
=================

sudo ovs-vsctl show
-------------------

c31af56d-bc28-4c9f-b01d-6d604902fa80
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        datapath_type: system
        Port tape082d826-f6
            tag: 1
            Interface tape082d826-f6
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port int-br-data
            Interface int-br-data
                type: patch
                options: {peer=phy-br-data}
        Port qr-b8b16611-39
            tag: 1
            Interface qr-b8b16611-39
                type: internal
        Port qg-8ddcb303-8b
            tag: 2
            Interface qg-8ddcb303-8b
                type: internal
    Bridge br-data
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        datapath_type: system
        Port br-data
            Interface br-data
                type: internal
        Port eth1
            Interface eth1
        Port phy-br-data
            Interface phy-br-data
                type: patch
                options: {peer=int-br-data}
    ovs_version: "2.13.5"

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-data
---------------------------------------------------------------------------------------------------------

OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:0000f665837d1449
n_tables:254, n_buffers:0
capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES
OFPST_PORT_DESC reply (OF1.4) (xid=0x3):
 1(eth1): addr:fa:16:3e:40:fe:d0
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(phy-br-data): addr:f2:d7:be:f4:92:9a
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-data): addr:f6:65:83:7d:14:49
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-int
--------------------------------------------------------------------------------------------------------

OFPT_FEATURES_REPLY (OF1.4) (xid=0x2): dpid:00005a467230e641
n_tables:254, n_buffers:0
capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES
OFPST_PORT_DESC reply (OF1.4) (xid=0x3):
 1(int-br-data): addr:72:bb:2d:28:b3:2e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(tape082d826-f6): addr:fa:16:3e:0f:ad:fd
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 3(qr-b8b16611-39): addr:fa:16:3e:7d:39:6e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 4(qg-8ddcb303-8b): addr:00:00:00:00:00:00
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:5a:46:72:30:e6:41
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (OF1.4) (xid=0x5): frags=normal miss_send_len=0

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-data
--------------------------------------------------------------------------------------------------------------------

OFPST_PORT_DESC reply (OF1.4) (xid=0x2):
 1(eth1): addr:fa:16:3e:40:fe:d0
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(phy-br-data): addr:f2:d7:be:f4:92:9a
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-data): addr:f6:65:83:7d:14:49
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-int
-------------------------------------------------------------------------------------------------------------------

OFPST_PORT_DESC reply (OF1.4) (xid=0x2):
 1(int-br-data): addr:72:bb:2d:28:b3:2e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 2(tape082d826-f6): addr:fa:16:3e:0f:ad:fd
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 3(qr-b8b16611-39): addr:fa:16:3e:7d:39:6e
     config:     0
     state:      LIVE
     speed: 0 Mbps now, 0 Mbps max
 4(qg-8ddcb303-8b): addr:00:00:00:00:00:00
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:5a:46:72:30:e6:41
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-data
---------------------------------------------------------------------------------------------------------------

OFPST_PORT reply (OF1.4) (xid=0x2): 3 ports
  port LOCAL: rx pkts=145, bytes=26466, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=11, bytes=866, drop=0, errs=0, coll=0
           duration=180.332s
  port  1: rx pkts=6024, bytes=795266, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=68, bytes=6164, drop=0, errs=0, coll=0
           duration=176.051s
  port  2: rx pkts=28, bytes=2076, drop=?, errs=?, frame=?, over=?, crc=?
           tx pkts=62, bytes=10606, drop=?, errs=?, coll=?
           duration=66.350s

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-int
--------------------------------------------------------------------------------------------------------------

OFPST_PORT reply (OF1.4) (xid=0x2): 5 ports
  port  4: rx pkts=26, bytes=3122, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=16, bytes=1208, drop=0, errs=0, coll=0
           duration=20.954s
  port LOCAL: rx pkts=0, bytes=0, drop=54, errs=0, frame=0, over=0, crc=0
           tx pkts=0, bytes=0, drop=0, errs=0, coll=0
           duration=180.574s
  port  1: rx pkts=62, bytes=10606, drop=?, errs=?, frame=?, over=?, crc=?
           tx pkts=28, bytes=2076, drop=?, errs=?, coll=?
           duration=66.402s
  port  2: rx pkts=12, bytes=720, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=5, bytes=446, drop=0, errs=0, coll=0
           duration=42.299s
  port  3: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0
           tx pkts=13, bytes=998, drop=0, errs=0, coll=0
           duration=24.836s

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-data
---------------------------------------------------------------------------------------------------------------

OFPST_FLOW reply (OF1.4) (xid=0x2):
 cookie=0xee032165e1b9dc5d, duration=40.715s, table=0, n_packets=13, n_bytes=978, priority=4,in_port=2,dl_vlan=1 actions=set_field:4357->vlan_vid,NORMAL
 cookie=0xee032165e1b9dc5d, duration=20.700s, table=0, n_packets=15, n_bytes=1098, priority=4,in_port=2,dl_vlan=2 actions=pop_vlan,NORMAL
 cookie=0xee032165e1b9dc5d, duration=66.359s, table=0, n_packets=0, n_bytes=0, priority=2,in_port=2 actions=drop
 cookie=0xee032165e1b9dc5d, duration=66.422s, table=0, n_packets=62, n_bytes=10606, priority=0 actions=NORMAL

sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-int
--------------------------------------------------------------------------------------------------------------

OFPST_FLOW reply (OF1.4) (xid=0x2):
 cookie=0x1149b85074a847b2, duration=67.632s, table=0, n_packets=0, n_bytes=0, priority=65535,dl_vlan=4095 actions=drop
 cookie=0x1149b85074a847b2, duration=40.726s, table=0, n_packets=0, n_bytes=0, priority=3,in_port=1,dl_vlan=261 actions=set_field:4097->vlan_vid,goto_table:59
 cookie=0x1149b85074a847b2, duration=20.709s, table=0, n_packets=26, n_bytes=3486, priority=3,in_port=1,vlan_tci=0x0000/0x1fff actions=push_vlan:0x8100,set_field:4098->vlan_vid,goto_table:59
 cookie=0x1149b85074a847b2, duration=66.381s, table=0, n_packets=36, n_bytes=7120, priority=2,in_port=1 actions=drop
 cookie=0x1149b85074a847b2, duration=67.650s, table=0, n_packets=34, n_bytes=2652, priority=0 actions=goto_table:59
 cookie=0x1149b85074a847b2, duration=67.653s, table=23, n_packets=0, n_bytes=0, priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=67.634s, table=24, n_packets=0, n_bytes=0, priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=67.628s, table=30, n_packets=0, n_bytes=0, priority=0 actions=goto_table:59
 cookie=0x1149b85074a847b2, duration=67.627s, table=31, n_packets=0, n_bytes=0, priority=0 actions=goto_table:59
 cookie=0x1149b85074a847b2, duration=67.649s, table=59, n_packets=60, n_bytes=6138, priority=0 actions=goto_table:60
 cookie=0x1149b85074a847b2, duration=38.684s, table=60, n_packets=1, n_bytes=90, priority=100,in_port=2 actions=set_field:0x2->reg5,set_field:0x1->reg6,resubmit(,73)
 cookie=0x1149b85074a847b2, duration=24.666s, table=60, n_packets=12, n_bytes=888, priority=100,in_port=3 actions=set_field:0x3->reg5,set_field:0x1->reg6,resubmit(,73)
 cookie=0x1149b85074a847b2, duration=18.632s, table=60, n_packets=15, n_bytes=1098, priority=100,in_port=4 actions=set_field:0x4->reg5,set_field:0x2->reg6,resubmit(,73)
 cookie=0x1149b85074a847b2, duration=67.637s, table=60, n_packets=32, n_bytes=4062, priority=3 actions=NORMAL
 cookie=0x1149b85074a847b2, duration=67.632s, table=62, n_packets=0, n_bytes=0, priority=3 actions=NORMAL
 cookie=0x1149b85074a847b2, duration=61.397s, table=71, n_packets=0, n_bytes=0, reset_counts priority=110,ct_state=+trk actions=ct_clear,resubmit(,71)
 cookie=0x1149b85074a847b2, duration=61.447s, table=71, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=61.436s, table=72, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=38.684s, table=73, n_packets=1, n_bytes=90, priority=80,reg5=0x2 actions=resubmit(,94)
 cookie=0x1149b85074a847b2, duration=24.666s, table=73, n_packets=12, n_bytes=888, priority=80,reg5=0x3 actions=resubmit(,94)
 cookie=0x1149b85074a847b2, duration=18.631s, table=73, n_packets=15, n_bytes=1098, priority=80,reg5=0x4 actions=resubmit(,94)
 cookie=0x1149b85074a847b2, duration=61.426s, table=73, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=61.416s, table=81, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=61.406s, table=82, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=61.377s, table=91, n_packets=0, n_bytes=0, reset_counts priority=1 actions=resubmit(,94)
 cookie=0x1149b85074a847b2, duration=61.367s, table=92, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=61.357s, table=93, n_packets=0, n_bytes=0, reset_counts priority=0 actions=drop
 cookie=0x1149b85074a847b2, duration=61.387s, table=94, n_packets=28, n_bytes=2076, reset_counts priority=1 actions=NORMAL


IP Tables Dump
==============

sudo iptables --line-numbers -L -nv -t filter
---------------------------------------------

Chain INPUT (policy ACCEPT 493K packets, 461M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 436K packets, 100M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

sudo iptables --line-numbers -L -nv -t nat
------------------------------------------

Chain PREROUTING (policy ACCEPT 1105 packets, 310K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain INPUT (policy ACCEPT 915 packets, 295K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 2172 packets, 145K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain POSTROUTING (policy ACCEPT 2172 packets, 145K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

sudo iptables --line-numbers -L -nv -t mangle
---------------------------------------------

Chain PREROUTING (policy ACCEPT 15467 packets, 6685K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain INPUT (policy ACCEPT 15439 packets, 6683K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 15414 packets, 6674K bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain POSTROUTING (policy ACCEPT 15414 packets, 6674K bytes)
num   pkts bytes target     prot opt in     out     source               destination         


EB Tables Dump
==============

sudo ebtables -t filter -L
--------------------------

Bridge table: filter

Bridge chain: INPUT, entries: 0, policy: ACCEPT

Bridge chain: FORWARD, entries: 0, policy: ACCEPT

Bridge chain: OUTPUT, entries: 0, policy: ACCEPT

sudo ebtables -t nat -L
-----------------------

Bridge table: nat

Bridge chain: PREROUTING, entries: 0, policy: ACCEPT

Bridge chain: OUTPUT, entries: 0, policy: ACCEPT

Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT


Compute consoles
================


nova-compute Guru Meditation Report
===================================

Skipping as nova-compute does not appear to be running

neutron-dhcp-agent Guru Meditation Report
=========================================

104879
killall -e -USR2 neutron-dhcp-agent
-----------------------------------


guru meditation report in neutron-dhcp-agent log

neutron-l3-agent Guru Meditation Report
=======================================

105254
killall -e -USR2 neutron-l3-agent
---------------------------------


guru meditation report in neutron-l3-agent log

neutron-linuxbridge-agent Guru Meditation Report
================================================

Skipping as neutron-linuxbridge-agent does not appear to be running

neutron-metadata-agent Guru Meditation Report
=============================================

105609
106089
106090
killall -e -USR2 neutron-metadata-agent
---------------------------------------


guru meditation report in neutron-metadata-agent log

neutron-openvswitch-agent Guru Meditation Report
================================================

104516
killall -e -USR2 neutron-openvswitch-agent
------------------------------------------


guru meditation report in neutron-openvswitch-agent log

cinder-volume Guru Meditation Report
====================================

Skipping as cinder-volume does not appear to be running