File System Summary =================== WARN: Device /dev/loop0 (/snap/core18/1997) is 100% full, might be an issue WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue WARN: Device /dev/loop1 (/snap/lxd/19647) is 100% full, might be an issue Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 1.2M 1.2G 1% /run /dev/sda1 39G 3.6G 36G 10% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/loop0 56M 56M 0 100% /snap/core18/1997 /dev/loop2 33M 33M 0 100% /snap/snapd/11588 /dev/sda15 105M 7.8M 97M 8% /boot/efi /dev/loop1 71M 71M 0 100% /snap/lxd/19647 tmpfs 1.2G 0 1.2G 0% /run/user/1000 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 1.4 0.1 168736 12856 ? Ss 11:04:42 00:00:24 /lib/systemd/systemd --system --deserialize 74 root 0 2 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [kthreadd] root 2 3 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [rcu_gp] root 2 4 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [rcu_par_gp] root 2 6 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [kworker/0:0H-kblockd] root 2 7 0.0 0.0 0 0 ? I 11:04:42 00:00:00 [kworker/u256:0-events_power_efficient] root 2 8 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [mm_percpu_wq] root 2 9 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [ksoftirqd/0] root 2 10 0.0 0.0 0 0 ? I 11:04:42 00:00:00 [rcu_sched] root 2 11 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [migration/0] root 2 12 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [idle_inject/0] root 2 13 0.0 0.0 0 0 ? I 11:04:42 00:00:00 [kworker/0:1-memcg_kmem_cache] root 2 14 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [cpuhp/0] root 2 15 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [cpuhp/1] root 2 16 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [idle_inject/1] root 2 17 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [migration/1] root 2 18 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [ksoftirqd/1] root 2 20 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [kworker/1:0H-kblockd] root 2 21 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [cpuhp/2] root 2 22 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [idle_inject/2] root 2 23 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [migration/2] root 2 24 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [ksoftirqd/2] root 2 26 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [kworker/2:0H-kblockd] root 2 27 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [cpuhp/3] root 2 28 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [idle_inject/3] root 2 29 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [migration/3] root 2 30 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [ksoftirqd/3] root 2 32 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [kworker/3:0H-kblockd] root 2 33 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [kdevtmpfs] root 2 34 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [netns] root 2 35 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [rcu_tasks_kthre] root 2 36 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [kauditd] root 2 39 0.0 0.0 0 0 ? I 11:04:42 00:00:00 [kworker/1:2-events] root 2 40 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [khungtaskd] root 2 41 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [oom_reaper] root 2 42 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [writeback] root 2 43 0.0 0.0 0 0 ? S 11:04:42 00:00:00 [kcompactd0] root 2 44 0.0 0.0 0 0 ? SN 11:04:42 00:00:00 [ksmd] root 2 45 0.0 0.0 0 0 ? SN 11:04:42 00:00:00 [khugepaged] root 2 92 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [kintegrityd] root 2 93 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [kblockd] root 2 94 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [blkcg_punt_bio] root 2 95 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [tpm_dev_wq] root 2 96 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [ata_sff] root 2 97 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [md] root 2 98 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [edac-poller] root 2 99 0.0 0.0 0 0 ? I< 11:04:42 00:00:00 [devfreq_wq] root 2 101 0.0 0.0 0 0 ? S 11:04:43 00:00:00 [watchdogd] root 2 104 0.0 0.0 0 0 ? S 11:04:43 00:00:00 [kswapd0] root 2 105 0.0 0.0 0 0 ? S 11:04:43 00:00:00 [ecryptfs-kthrea] root 2 107 0.0 0.0 0 0 ? I< 11:04:43 00:00:00 [kthrotld] root 2 108 0.0 0.0 0 0 ? I< 11:04:43 00:00:00 [acpi_thermal_pm] root 2 109 0.0 0.0 0 0 ? S 11:04:43 00:00:00 [scsi_eh_0] root 2 110 0.0 0.0 0 0 ? I< 11:04:43 00:00:00 [scsi_tmf_0] root 2 111 0.0 0.0 0 0 ? S 11:04:43 00:00:00 [scsi_eh_1] root 2 112 0.0 0.0 0 0 ? I< 11:04:43 00:00:00 [scsi_tmf_1] root 2 114 0.0 0.0 0 0 ? I< 11:04:43 00:00:00 [vfio-irqfd-clea] root 2 116 0.0 0.0 0 0 ? I< 11:04:44 00:00:00 [ipv6_addrconf] root 2 126 0.0 0.0 0 0 ? I< 11:04:44 00:00:00 [kstrp] root 2 129 0.0 0.0 0 0 ? I< 11:04:44 00:00:00 [kworker/u257:0] root 2 142 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [charger_manager] root 2 183 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [hv_vmbus_con] root 2 185 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [hv_pri_chan] root 2 191 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [hv_sub_chan] root 2 192 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [kworker/3:1H-kblockd] root 2 193 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [cryptd] root 2 218 0.0 0.0 0 0 ? S 11:04:45 00:00:00 [scsi_eh_2] root 2 219 0.0 0.0 0 0 ? S 11:04:45 00:00:00 [scsi_eh_3] root 2 220 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [scsi_tmf_3] root 2 222 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [storvsc_error_w] root 2 230 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [scsi_tmf_2] root 2 231 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [storvsc_error_w] root 2 234 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [kworker/0:1H-kblockd] root 2 240 0.0 0.0 0 0 ? I< 11:04:45 00:00:00 [kworker/2:1H-kblockd] root 2 273 0.0 0.0 0 0 ? I< 11:04:47 00:00:00 [raid5wq] root 2 299 0.0 0.0 0 0 ? I< 11:04:47 00:00:00 [kworker/1:1H-kblockd] root 2 314 0.0 0.0 0 0 ? S 11:04:47 00:00:01 [jbd2/sda1-8] root 2 315 0.0 0.0 0 0 ? I< 11:04:47 00:00:00 [ext4-rsv-conver] root 2 413 0.0 0.0 0 0 ? I 11:04:49 00:00:00 [kworker/2:3-events] root 1 418 0.0 0.0 19360 5836 ? Ss 11:04:49 00:00:00 /lib/systemd/systemd-udevd root 2 448 0.0 0.0 0 0 ? S 11:04:50 00:00:00 [hv_balloon] root 2 546 0.0 0.0 0 0 ? I< 11:04:50 00:00:00 [kaluad] root 2 547 0.0 0.0 0 0 ? I< 11:04:50 00:00:00 [kmpath_rdacd] root 2 548 0.0 0.0 0 0 ? I< 11:04:50 00:00:00 [kmpathd] root 2 549 0.0 0.0 0 0 ? I< 11:04:50 00:00:00 [kmpath_handlerd] root 1 550 0.0 0.1 280136 17940 ? SLsl 11:04:50 00:00:00 /sbin/multipathd -d -s root 2 560 0.0 0.0 0 0 ? S< 11:04:50 00:00:00 [loop0] root 2 564 0.0 0.0 0 0 ? S< 11:04:50 00:00:00 [loop1] root 2 565 0.0 0.0 0 0 ? S< 11:04:50 00:00:00 [loop2] root 1 783 0.0 0.0 241048 9492 ? Ssl 11:06:59 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 786 0.0 0.0 8536 2980 ? Ss 11:06:59 00:00:00 /usr/sbin/cron -f message+ 1 788 0.1 0.0 7736 4936 ? Ss 11:06:59 00:00:02 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 801 0.0 0.0 81828 3732 ? Ssl 11:06:59 00:00:00 /usr/sbin/irqbalance --foreground root 1 806 0.0 0.1 29264 17912 ? Ss 11:06:59 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers root 1 810 0.1 0.2 1295572 34992 ? Ssl 11:06:59 00:00:02 /usr/lib/snapd/snapd root 1 811 0.0 0.0 16780 7816 ? Ss 11:06:59 00:00:01 /lib/systemd/systemd-logind daemon 1 813 0.0 0.0 3792 2288 ? Ss 11:06:59 00:00:00 /usr/sbin/atd -f root 1 867 0.0 0.0 7352 2204 ttyS0 Ss+ 11:06:59 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 875 0.0 0.0 5828 1916 tty1 Ss+ 11:06:59 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 876 0.0 0.1 108100 20672 ? Ssl 11:06:59 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 891 0.0 0.0 237740 10444 ? Ssl 11:06:59 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 896 0.0 0.0 12176 7488 ? Ss 11:06:59 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups root 896 1567 0.0 0.0 13792 8948 ? Ss 11:09:35 00:00:00 sshd: ubuntu [priv] ubuntu 1 1583 0.0 0.0 18388 9528 ? Ss 11:09:35 00:00:00 /lib/systemd/systemd --user ubuntu 1583 1584 0.0 0.0 104240 4528 ? S 11:09:35 00:00:00 (sd-pam) ubuntu 1567 1659 0.0 0.0 13924 6540 ? S 11:09:36 00:00:00 sshd: ubuntu@pts/0 root 2 2846 0.0 0.0 0 0 ? I 11:10:29 00:00:00 [kworker/u256:1-events_power_efficient] root 2 8346 0.0 0.0 0 0 ? I 11:16:07 00:00:00 [kworker/3:0-events] root 2 8357 0.0 0.0 0 0 ? I 11:16:07 00:00:00 [kworker/3:1-ata_sff] root 2 8404 0.0 0.0 0 0 ? I 11:19:42 00:00:00 [kworker/2:0-rcu_par_gp] ubuntu 1659 8881 0.0 0.0 2608 540 pts/0 Ss+ 11:27:39 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1626262060.22-50846163199507/AnsiballZ_command.py && sleep 0 ubuntu 8881 8882 0.0 0.1 27828 17784 pts/0 S+ 11:27:39 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1626262060.22-50846163199507/AnsiballZ_command.py ubuntu 8882 8884 0.0 0.0 2608 600 pts/0 S+ 11:27:39 00:00:00 /bin/sh -c ./unstack.sh > /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 10071 0.0 0.0 2488 588 ? S 11:27:41 00:00:00 bpfilter_umh root 2 10072 0.0 0.0 0 0 ? I 11:27:41 00:00:00 [kworker/3:2-events] root 2 10074 0.0 0.0 0 0 ? I 11:27:41 00:00:00 [kworker/2:1-events] root 2 10098 0.0 0.0 0 0 ? I 11:27:41 00:00:00 [kworker/1:0-events] root 2 11174 0.0 0.0 0 0 ? I 11:27:43 00:00:00 [kworker/1:3-events] root 2 11201 0.0 0.0 0 0 ? I 11:27:43 00:00:00 [kworker/u256:2-events_power_efficient] root 2 11241 0.0 0.0 0 0 ? I 11:27:44 00:00:00 [kworker/0:0-cgroup_destroy] root 2 11243 0.0 0.0 0 0 ? I 11:27:44 00:00:00 [kworker/0:3-events] ubuntu 8884 11610 0.1 0.0 14736 9980 pts/0 S+ 11:27:45 00:00:00 bash ./stack.sh ubuntu 11610 13865 0.0 0.0 10644 3804 pts/0 S+ 11:27:49 00:00:00 bash ./stack.sh ubuntu 11610 13870 0.0 0.0 10644 3804 pts/0 S+ 11:27:49 00:00:00 bash ./stack.sh ubuntu 13865 13871 0.0 0.0 17384 11180 pts/0 S+ 11:27:49 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2021-07-14-112750 ubuntu 13870 13876 0.0 0.0 17384 11176 pts/0 S+ 11:27:49 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2021-07-14-112750.summary.2021-07-14-112750 root 1 15599 0.0 0.1 283824 16244 ? Ssl 11:27:51 00:00:00 /usr/lib/packagekit/packagekitd memcache 1 18547 0.0 0.0 406260 2868 ? Ssl 11:29:26 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid root 1 18782 0.0 0.0 7744 3000 ? Ss 11:29:30 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf root 1 18921 0.0 0.0 15304 8800 ? Ss 11:29:32 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock haproxy 18921 18922 0.0 0.0 236500 3004 ? Sl 11:29:32 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock root 2 20145 0.0 0.0 0 0 ? I 11:29:37 00:00:00 [kworker/3:3-events] root 1 20690 0.0 0.0 6528 4676 ? Ss 11:29:46 00:00:00 /usr/sbin/apache2 -k start www-data 20690 20691 0.0 0.0 1932312 4496 ? Sl 11:29:46 00:00:00 /usr/sbin/apache2 -k start www-data 20690 20693 0.0 0.0 1932312 4496 ? Sl 11:29:46 00:00:00 /usr/sbin/apache2 -k start pcp 1 21336 0.6 0.0 8384 4412 ? Ss 11:29:51 00:00:01 /usr/lib/pcp/bin/pmcd root 21336 21339 0.0 0.0 7736 3836 ? S 11:29:51 00:00:00 /var/lib/pcp/pmdas/root/pmdaroot root 21339 21340 0.0 0.0 8316 4944 ? S 11:29:51 00:00:00 /var/lib/pcp/pmdas/proc/pmdaproc -d 3 root 21339 21341 0.0 0.0 7212 1636 ? S 11:29:51 00:00:00 /var/lib/pcp/pmdas/xfs/pmdaxfs -d 11 root 21339 21342 0.2 0.0 8072 4900 ? S 11:29:51 00:00:00 /var/lib/pcp/pmdas/linux/pmdalinux root 21339 21343 0.0 0.0 7268 3712 ? S 11:29:51 00:00:00 /var/lib/pcp/pmdas/kvm/pmdakvm -d 95 systemd+ 1 28962 0.0 0.0 34932 7904 ? Ss 11:31:52 00:00:00 /lib/systemd/systemd-networkd root 1 28963 0.0 0.0 9500 5024 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:68:9e:77 brd ff:ff:ff:ff:ff:ff inet 10.222.0.55/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 86277sec preferred_lft 86277sec inet6 fe80::f816:3eff:fe68:9e77/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:78:c8:5d brd ff:ff:ff:ff:ff:ff inet 192.168.0.20/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 86277sec preferred_lft 86277sec inet6 fe80::f816:3eff:fe78:c85d/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.55 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.55 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.20 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.20 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.55 metric 100 192.168.0.0/22 dev eth1 proto kernel scope link src 192.168.0.20 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.55 metric 100 ip -6 route ----------- ::1 dev lo proto kernel metric 256 pref medium fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- 32e74314-3629-4f78-92cf-423a006435c0 ovs_version: "2.13.3" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 68574 packets, 159M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 31878 packets, 2028K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 458 packets, 111K bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 310 packets, 98860 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 440 packets, 39523 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 440 packets, 39523 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running