File System Summary =================== WARN: Device /dev/loop0 (/snap/lxd/19647) is 100% full, might be an issue WARN: Device /dev/loop1 (/snap/core18/1997) is 100% full, might be an issue WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 1.2M 1.2G 1% /run /dev/sda1 39G 4.7G 34G 13% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/loop0 71M 71M 0 100% /snap/lxd/19647 /dev/loop1 56M 56M 0 100% /snap/core18/1997 /dev/loop2 33M 33M 0 100% /snap/snapd/11588 /dev/sda15 105M 7.8M 97M 8% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 0 512M 0% /opt/stack/data/etcd Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 2.2 0.1 168868 12880 ? Ss 06:33:51 00:00:29 /lib/systemd/systemd --system --deserialize 27 root 0 2 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [kthreadd] root 2 3 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [rcu_gp] root 2 4 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [rcu_par_gp] root 2 6 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [kworker/0:0H-kblockd] root 2 8 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [mm_percpu_wq] root 2 9 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [ksoftirqd/0] root 2 10 0.1 0.0 0 0 ? I 06:33:51 00:00:01 [rcu_sched] root 2 11 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [migration/0] root 2 12 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [idle_inject/0] root 2 13 0.0 0.0 0 0 ? I 06:33:51 00:00:00 [kworker/0:1-rcu_par_gp] root 2 14 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [cpuhp/0] root 2 15 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [cpuhp/1] root 2 16 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [idle_inject/1] root 2 17 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [migration/1] root 2 18 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [ksoftirqd/1] root 2 20 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [kworker/1:0H-kblockd] root 2 21 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [cpuhp/2] root 2 22 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [idle_inject/2] root 2 23 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [migration/2] root 2 24 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [ksoftirqd/2] root 2 26 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [kworker/2:0H] root 2 27 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [cpuhp/3] root 2 28 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [idle_inject/3] root 2 29 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [migration/3] root 2 30 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [ksoftirqd/3] root 2 31 0.0 0.0 0 0 ? I 06:33:51 00:00:00 [kworker/3:0-events] root 2 32 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [kworker/3:0H-kblockd] root 2 33 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [kdevtmpfs] root 2 34 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [netns] root 2 35 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [rcu_tasks_kthre] root 2 36 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [kauditd] root 2 37 0.0 0.0 0 0 ? I 06:33:51 00:00:00 [kworker/1:1-events] root 2 41 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [khungtaskd] root 2 42 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [oom_reaper] root 2 43 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [writeback] root 2 44 0.0 0.0 0 0 ? S 06:33:51 00:00:00 [kcompactd0] root 2 45 0.0 0.0 0 0 ? SN 06:33:51 00:00:00 [ksmd] root 2 46 0.0 0.0 0 0 ? SN 06:33:51 00:00:00 [khugepaged] root 2 93 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [kintegrityd] root 2 94 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [kblockd] root 2 95 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [blkcg_punt_bio] root 2 96 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [tpm_dev_wq] root 2 97 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [ata_sff] root 2 98 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [md] root 2 99 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [edac-poller] root 2 100 0.0 0.0 0 0 ? I< 06:33:51 00:00:00 [devfreq_wq] root 2 101 0.0 0.0 0 0 ? S 06:33:52 00:00:00 [watchdogd] root 2 103 0.0 0.0 0 0 ? I 06:33:52 00:00:00 [kworker/0:2-events] root 2 105 0.0 0.0 0 0 ? S 06:33:52 00:00:00 [kswapd0] root 2 106 0.0 0.0 0 0 ? S 06:33:52 00:00:00 [ecryptfs-kthrea] root 2 108 0.0 0.0 0 0 ? I< 06:33:52 00:00:00 [kthrotld] root 2 109 0.0 0.0 0 0 ? I< 06:33:52 00:00:00 [acpi_thermal_pm] root 2 110 0.0 0.0 0 0 ? S 06:33:52 00:00:00 [scsi_eh_0] root 2 111 0.0 0.0 0 0 ? I< 06:33:52 00:00:00 [scsi_tmf_0] root 2 112 0.0 0.0 0 0 ? S 06:33:52 00:00:00 [scsi_eh_1] root 2 113 0.0 0.0 0 0 ? I< 06:33:52 00:00:00 [scsi_tmf_1] root 2 115 0.0 0.0 0 0 ? I< 06:33:52 00:00:00 [vfio-irqfd-clea] root 2 117 0.0 0.0 0 0 ? I< 06:33:53 00:00:00 [ipv6_addrconf] root 2 118 0.0 0.0 0 0 ? I 06:33:53 00:00:01 [kworker/u256:3-events_power_efficient] root 2 127 0.0 0.0 0 0 ? I< 06:33:53 00:00:00 [kstrp] root 2 130 0.0 0.0 0 0 ? I< 06:33:53 00:00:00 [kworker/u257:0] root 2 143 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [charger_manager] root 2 185 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [hv_vmbus_con] root 2 186 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [hv_pri_chan] root 2 187 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [hv_sub_chan] root 2 188 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [kworker/3:1H-kblockd] root 2 189 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [cryptd] root 2 232 0.1 0.0 0 0 ? I 06:33:54 00:00:01 [kworker/u256:4-events_power_efficient] root 2 234 0.0 0.0 0 0 ? S 06:33:54 00:00:00 [scsi_eh_2] root 2 235 0.0 0.0 0 0 ? S 06:33:54 00:00:00 [scsi_eh_3] root 2 236 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [scsi_tmf_2] root 2 237 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [scsi_tmf_3] root 2 238 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [storvsc_error_w] root 2 239 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [storvsc_error_w] root 2 240 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [kworker/2:1H-kblockd] root 2 242 0.0 0.0 0 0 ? I< 06:33:54 00:00:00 [kworker/1:1H-kblockd] root 2 275 0.0 0.0 0 0 ? I< 06:33:56 00:00:00 [raid5wq] root 2 301 0.0 0.0 0 0 ? I< 06:33:56 00:00:00 [kworker/0:1H-kblockd] root 2 316 0.1 0.0 0 0 ? S 06:33:56 00:00:02 [jbd2/sda1-8] root 2 317 0.0 0.0 0 0 ? I< 06:33:56 00:00:00 [ext4-rsv-conver] root 2 413 0.0 0.0 0 0 ? I 06:33:59 00:00:00 [kworker/1:3-events] root 1 421 0.0 0.0 19352 5848 ? Ss 06:33:59 00:00:01 /lib/systemd/systemd-udevd root 2 450 0.0 0.0 0 0 ? S 06:33:59 00:00:00 [hv_balloon] root 2 549 0.0 0.0 0 0 ? I< 06:34:00 00:00:00 [kaluad] root 2 550 0.0 0.0 0 0 ? I< 06:34:00 00:00:00 [kmpath_rdacd] root 2 551 0.0 0.0 0 0 ? I< 06:34:00 00:00:00 [kmpathd] root 2 552 0.0 0.0 0 0 ? I< 06:34:00 00:00:00 [kmpath_handlerd] root 1 553 0.0 0.1 280200 17992 ? SLsl 06:34:00 00:00:00 /sbin/multipathd -d -s root 2 559 0.0 0.0 0 0 ? I 06:34:00 00:00:00 [kworker/2:3-events] root 2 565 0.0 0.0 0 0 ? S< 06:34:00 00:00:00 [loop0] root 2 568 0.0 0.0 0 0 ? S< 06:34:00 00:00:00 [loop1] root 2 569 0.0 0.0 0 0 ? S< 06:34:00 00:00:00 [loop2] root 1 780 0.0 0.0 241132 9488 ? Ssl 06:34:10 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 783 0.0 0.0 8536 2972 ? Ss 06:34:10 00:00:00 /usr/sbin/cron -f message+ 1 785 0.2 0.0 7736 4920 ? Ss 06:34:10 00:00:02 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 795 0.0 0.0 81828 3708 ? Ssl 06:34:10 00:00:00 /usr/sbin/irqbalance --foreground root 1 796 0.0 0.1 29264 17904 ? Ss 06:34:10 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers root 1 801 0.2 0.2 1297684 35284 ? Ssl 06:34:10 00:00:02 /usr/lib/snapd/snapd root 1 802 0.1 0.0 16780 7816 ? Ss 06:34:10 00:00:01 /lib/systemd/systemd-logind daemon 1 804 0.0 0.0 3792 2220 ? Ss 06:34:10 00:00:00 /usr/sbin/atd -f root 1 850 0.0 0.0 7352 2284 ttyS0 Ss+ 06:34:10 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 867 0.0 0.0 5828 1848 tty1 Ss+ 06:34:10 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 869 0.0 0.1 108100 20616 ? Ssl 06:34:10 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 876 0.0 0.0 237744 10156 ? Ssl 06:34:10 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1570 0.0 0.0 13800 9104 ? Ss 06:37:47 00:00:00 sshd: ubuntu [priv] ubuntu 1 1584 0.0 0.0 18384 9748 ? Ss 06:37:47 00:00:00 /lib/systemd/systemd --user ubuntu 1584 1588 0.0 0.0 169780 4552 ? S 06:37:47 00:00:00 (sd-pam) ubuntu 1570 1663 0.0 0.0 13932 6548 ? S 06:37:47 00:00:00 sshd: ubuntu@pts/0 root 2 13501 0.0 0.0 0 0 ? I 06:39:40 00:00:00 [kworker/u256:1-events_power_efficient] root 2 14466 0.0 0.0 0 0 ? I 06:44:54 00:00:00 [kworker/2:0-events] root 2 14467 0.0 0.0 0 0 ? I 06:44:54 00:00:00 [kworker/3:2-events] root 2 14921 0.0 0.0 0 0 ? I 06:48:57 00:00:00 [kworker/3:3-events] ubuntu 1663 15073 0.0 0.0 2608 532 pts/0 Ss+ 06:49:06 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1649832547.45-145929712514096/AnsiballZ_command.py && sleep 0 ubuntu 15073 15074 0.0 0.1 27824 17900 pts/0 S+ 06:49:06 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1649832547.45-145929712514096/AnsiballZ_command.py ubuntu 15074 15076 0.0 0.0 2608 600 pts/0 S+ 06:49:07 00:00:00 /bin/sh -c ./unstack.sh > /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 16215 0.0 0.0 2488 576 ? S 06:49:09 00:00:00 bpfilter_umh root 2 16216 0.0 0.0 0 0 ? I 06:49:09 00:00:00 [kworker/0:0-events] ubuntu 15076 17601 0.3 0.0 14644 9792 pts/0 S+ 06:49:12 00:00:01 bash ./stack.sh ubuntu 17601 19868 0.0 0.0 10528 3708 pts/0 S+ 06:49:16 00:00:00 bash ./stack.sh ubuntu 17601 19873 0.0 0.0 10528 3708 pts/0 S+ 06:49:16 00:00:00 bash ./stack.sh ubuntu 19868 19876 0.2 0.0 17384 11192 pts/0 S+ 06:49:16 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2022-04-13-064916 ubuntu 19873 19880 0.0 0.0 17384 11244 pts/0 S+ 06:49:16 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2022-04-13-064916.summary.2022-04-13-064916 root 1 21563 0.0 0.1 283804 16304 ? Ssl 06:49:19 00:00:00 /usr/lib/packagekit/packagekitd root 2 24549 0.0 0.0 0 0 ? I 06:51:01 00:00:00 [kworker/0:3-events] uuidd 1 24611 0.0 0.0 9744 1000 ? Ss 06:51:02 00:00:00 /usr/sbin/uuidd --socket-activation root 2 24615 0.0 0.0 0 0 ? I 06:51:02 00:00:00 [kworker/2:1-cgroup_destroy] root 1 24682 0.0 0.0 7740 2896 ? Ss 06:51:04 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf root 1 24844 0.0 0.0 15300 8844 ? Ss 06:51:07 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock haproxy 24844 24845 0.0 0.0 236496 2960 ? Sl 06:51:07 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock memcache 1 25045 0.0 0.0 409768 3820 ? Ssl 06:51:09 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid root 2 25046 0.0 0.0 0 0 ? I 06:51:09 00:00:00 [kworker/1:0-events] root 2 25409 0.0 0.0 0 0 ? I 06:51:13 00:00:00 [kworker/2:2-cgroup_destroy] root 1 25721 0.0 0.0 12172 6992 ? Ss 06:51:18 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups root 2 25722 0.0 0.0 0 0 ? I 06:51:18 00:00:00 [kworker/2:4-events] systemd+ 1 27203 0.0 0.0 34936 7868 ? Ss 06:51:28 00:00:00 /lib/systemd/systemd-networkd systemd+ 1 27208 0.0 0.0 23896 12124 ? Ss 06:51:28 00:00:00 /lib/systemd/systemd-resolved systemd+ 1 27300 0.0 0.0 90224 6156 ? Ssl 06:51:29 00:00:00 /lib/systemd/systemd-timesyncd syslog 1 32011 0.0 0.0 224344 4384 ? Ssl 06:51:44 00:00:00 /usr/sbin/rsyslogd -n -iNONE root 2 35794 0.0 0.0 0 0 ? I 06:51:58 00:00:00 [kworker/1:2-events] root 2 35795 0.0 0.0 0 0 ? I 06:51:58 00:00:00 [kworker/1:4-events] root 1 40598 0.0 0.0 35028 10036 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:33:aa:0a brd ff:ff:ff:ff:ff:ff inet 10.222.0.43/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 86172sec preferred_lft 86172sec inet6 fe80::f816:3eff:fe33:aa0a/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:87:11:07 brd ff:ff:ff:ff:ff:ff inet 192.168.0.65/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 86172sec preferred_lft 86172sec inet6 fe80::f816:3eff:fe87:1107/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.43 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.43 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.65 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.65 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.43 metric 100 192.168.0.0/22 dev eth1 proto kernel scope link src 192.168.0.65 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.43 metric 100 ip -6 route ----------- ::1 dev lo proto kernel metric 256 pref medium fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- f4815c1d-6a50-4669-84cb-2ccd634826e0 ovs_version: "2.13.5" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 106K packets, 261M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 41169 packets, 2827K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 307 packets, 93975 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 275 packets, 89516 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 473 packets, 42889 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 473 packets, 42889 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running