File System Summary =================== WARN: Device /dev/loop0 (/snap/core18/1997) is 100% full, might be an issue WARN: Device /dev/loop1 (/snap/snapd/11588) is 100% full, might be an issue WARN: Device /dev/loop2 (/snap/lxd/19647) is 100% full, might be an issue Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 1.1M 1.2G 1% /run /dev/sda1 39G 3.7G 35G 10% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/loop0 56M 56M 0 100% /snap/core18/1997 /dev/loop1 33M 33M 0 100% /snap/snapd/11588 /dev/loop2 71M 71M 0 100% /snap/lxd/19647 /dev/sda15 105M 7.9M 97M 8% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 1.1 0.1 168468 12828 ? Ss 05:49:46 00:00:19 /lib/systemd/systemd --system --deserialize 33 root 0 2 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [kthreadd] root 2 3 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [rcu_gp] root 2 4 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [rcu_par_gp] root 2 6 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [kworker/0:0H-kblockd] root 2 8 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [mm_percpu_wq] root 2 9 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [ksoftirqd/0] root 2 10 0.0 0.0 0 0 ? I 05:49:46 00:00:01 [rcu_sched] root 2 11 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [migration/0] root 2 12 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [idle_inject/0] root 2 14 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [cpuhp/0] root 2 15 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [cpuhp/1] root 2 16 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [idle_inject/1] root 2 17 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [migration/1] root 2 18 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [ksoftirqd/1] root 2 20 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [kworker/1:0H-kblockd] root 2 21 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [cpuhp/2] root 2 22 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [idle_inject/2] root 2 23 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [migration/2] root 2 24 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [ksoftirqd/2] root 2 26 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [kworker/2:0H-kblockd] root 2 27 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [cpuhp/3] root 2 28 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [idle_inject/3] root 2 29 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [migration/3] root 2 30 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [ksoftirqd/3] root 2 32 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [kworker/3:0H-kblockd] root 2 33 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [kdevtmpfs] root 2 34 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [netns] root 2 35 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [rcu_tasks_kthre] root 2 36 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [kauditd] root 2 41 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [khungtaskd] root 2 42 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [oom_reaper] root 2 43 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [writeback] root 2 44 0.0 0.0 0 0 ? S 05:49:46 00:00:00 [kcompactd0] root 2 45 0.0 0.0 0 0 ? SN 05:49:46 00:00:00 [ksmd] root 2 46 0.0 0.0 0 0 ? SN 05:49:46 00:00:00 [khugepaged] root 2 92 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [kintegrityd] root 2 93 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [kblockd] root 2 94 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [blkcg_punt_bio] root 2 95 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [tpm_dev_wq] root 2 96 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [ata_sff] root 2 97 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [md] root 2 98 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [edac-poller] root 2 99 0.0 0.0 0 0 ? I< 05:49:46 00:00:00 [devfreq_wq] root 2 100 0.0 0.0 0 0 ? S 05:49:47 00:00:00 [watchdogd] root 2 104 0.0 0.0 0 0 ? S 05:49:47 00:00:00 [kswapd0] root 2 105 0.0 0.0 0 0 ? S 05:49:47 00:00:00 [ecryptfs-kthrea] root 2 107 0.0 0.0 0 0 ? I< 05:49:47 00:00:00 [kthrotld] root 2 108 0.0 0.0 0 0 ? I< 05:49:47 00:00:00 [acpi_thermal_pm] root 2 109 0.0 0.0 0 0 ? I 05:49:47 00:00:00 [kworker/0:2-events] root 2 110 0.0 0.0 0 0 ? S 05:49:47 00:00:00 [scsi_eh_0] root 2 111 0.0 0.0 0 0 ? I< 05:49:47 00:00:00 [scsi_tmf_0] root 2 112 0.0 0.0 0 0 ? S 05:49:47 00:00:00 [scsi_eh_1] root 2 113 0.0 0.0 0 0 ? I< 05:49:47 00:00:00 [scsi_tmf_1] root 2 114 0.0 0.0 0 0 ? I 05:49:47 00:00:01 [kworker/u256:2-events_power_efficient] root 2 115 0.0 0.0 0 0 ? I< 05:49:47 00:00:00 [vfio-irqfd-clea] root 2 116 0.0 0.0 0 0 ? I< 05:49:48 00:00:00 [ipv6_addrconf] root 2 126 0.0 0.0 0 0 ? I< 05:49:48 00:00:00 [kstrp] root 2 129 0.0 0.0 0 0 ? I< 05:49:48 00:00:00 [kworker/u257:0] root 2 142 0.0 0.0 0 0 ? I< 05:49:48 00:00:00 [charger_manager] root 2 181 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [hv_vmbus_con] root 2 182 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [hv_pri_chan] root 2 183 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [hv_sub_chan] root 2 195 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [kworker/3:1H-kblockd] root 2 196 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [cryptd] root 2 233 0.0 0.0 0 0 ? S 05:49:49 00:00:00 [scsi_eh_2] root 2 234 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [scsi_tmf_2] root 2 235 0.0 0.0 0 0 ? S 05:49:49 00:00:00 [scsi_eh_3] root 2 236 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [storvsc_error_w] root 2 238 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [scsi_tmf_3] root 2 239 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [storvsc_error_w] root 2 240 0.0 0.0 0 0 ? I< 05:49:49 00:00:00 [kworker/0:1H-kblockd] root 2 273 0.0 0.0 0 0 ? I< 05:49:51 00:00:00 [raid5wq] root 2 299 0.0 0.0 0 0 ? I< 05:49:51 00:00:00 [kworker/1:1H-kblockd] root 2 314 0.0 0.0 0 0 ? S 05:49:51 00:00:01 [jbd2/sda1-8] root 2 315 0.0 0.0 0 0 ? I< 05:49:51 00:00:00 [ext4-rsv-conver] root 2 355 0.0 0.0 0 0 ? I< 05:49:52 00:00:00 [kworker/2:1H-kblockd] root 2 443 0.0 0.0 0 0 ? S 05:49:54 00:00:00 [hv_balloon] root 2 546 0.0 0.0 0 0 ? I< 05:49:54 00:00:00 [kaluad] root 2 547 0.0 0.0 0 0 ? I< 05:49:54 00:00:00 [kmpath_rdacd] root 2 548 0.0 0.0 0 0 ? I< 05:49:54 00:00:00 [kmpathd] root 2 549 0.0 0.0 0 0 ? I< 05:49:54 00:00:00 [kmpath_handlerd] root 1 550 0.0 0.1 280136 17940 ? SLsl 05:49:54 00:00:00 /sbin/multipathd -d -s root 2 558 0.0 0.0 0 0 ? S< 05:49:55 00:00:00 [loop0] root 2 562 0.0 0.0 0 0 ? S< 05:49:55 00:00:00 [loop1] root 2 564 0.0 0.0 0 0 ? S< 05:49:55 00:00:00 [loop2] root 1 778 0.0 0.0 8536 2920 ? Ss 05:50:06 00:00:00 /usr/sbin/cron -f message+ 1 779 0.1 0.0 7824 5120 ? Ss 05:50:06 00:00:02 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 786 0.0 0.0 81828 3728 ? Ssl 05:50:06 00:00:00 /usr/sbin/irqbalance --foreground root 1 792 0.0 0.1 29264 17992 ? Ss 05:50:06 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers syslog 1 794 0.0 0.0 224504 4996 ? Ssl 05:50:06 00:00:00 /usr/sbin/rsyslogd -n -iNONE root 1 797 0.0 0.0 16780 7860 ? Ss 05:50:06 00:00:01 /lib/systemd/systemd-logind daemon 1 799 0.0 0.0 3792 2128 ? Ss 05:50:06 00:00:00 /usr/sbin/atd -f root 1 839 0.0 0.0 7352 2420 ttyS0 Ss+ 05:50:06 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 862 0.0 0.0 5828 1844 tty1 Ss+ 05:50:06 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 864 0.0 0.1 108100 20812 ? Ssl 05:50:06 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 903 0.0 0.0 12176 7396 ? Ss 05:50:07 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups root 903 1572 0.0 0.0 13796 9160 ? Ss 05:55:31 00:00:00 sshd: ubuntu [priv] ubuntu 1 1586 0.0 0.0 18380 9612 ? Ss 05:55:31 00:00:00 /lib/systemd/systemd --user ubuntu 1586 1588 0.0 0.0 169784 4548 ? S 05:55:31 00:00:00 (sd-pam) ubuntu 1572 1665 0.0 0.0 13928 6496 ? S 05:55:32 00:00:00 sshd: ubuntu@pts/0 root 2 1765 0.0 0.0 0 0 ? I 05:55:37 00:00:00 [kworker/3:1-rcu_par_gp] root 2 1773 0.0 0.0 0 0 ? I 05:55:37 00:00:00 [kworker/2:0-rcu_gp] root 2 15018 0.0 0.0 0 0 ? I 05:57:32 00:00:00 [kworker/2:1-events] root 1 15848 0.0 0.0 2608 532 ? Ss 06:01:32 00:00:00 /bin/sh /usr/lib/apt/apt.systemd.daily install root 15848 15852 0.0 0.0 2608 1704 ? S 06:01:32 00:00:00 /bin/sh /usr/lib/apt/apt.systemd.daily lock_is_held install root 15852 15889 13.5 1.3 330140 169348 ? Sl 06:01:32 00:02:18 /usr/bin/python3 /usr/bin/unattended-upgrade root 2 15910 0.0 0.0 0 0 ? I 06:02:44 00:00:00 [kworker/1:0-events] root 2 16013 0.0 0.0 0 0 ? I 06:03:16 00:00:00 [kworker/u256:0-events_freezable_power_] root 1 16056 0.0 0.0 18940 5320 ? Ss 06:03:17 00:00:00 /lib/systemd/systemd-udevd root 2 16074 0.0 0.0 0 0 ? I 06:03:17 00:00:00 [kworker/3:2-events] root 1 20682 0.0 0.1 283800 15780 ? Ssl 06:03:32 00:00:00 /usr/lib/packagekit/packagekitd root 2 31911 0.0 0.0 0 0 ? I< 06:05:17 00:00:00 [xfsalloc] root 2 31913 0.0 0.0 0 0 ? I< 06:05:17 00:00:00 [xfs_mru_cache] systemd+ 1 36331 0.0 0.0 26740 7820 ? Ss 06:07:10 00:00:00 /lib/systemd/systemd-networkd root 2 36339 0.0 0.0 0 0 ? I 06:07:10 00:00:00 [kworker/1:3-events] systemd+ 1 36344 0.0 0.0 23892 12148 ? Ss 06:07:10 00:00:00 /lib/systemd/systemd-resolved root 1 36351 0.0 0.0 51552 11144 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 ubuntu 1586 67842 0.0 0.0 7104 4128 ? Ss 06:18:06 00:00:00 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 2 69141 0.0 0.0 2488 512 ? S 06:18:09 00:00:00 bpfilter_umh root 2 69167 0.0 0.0 0 0 ? I 06:18:09 00:00:00 [kworker/1:1-events] root 2 70297 0.0 0.0 0 0 ? I 06:18:11 00:00:00 [kworker/0:1-events] root 2 70302 0.0 0.0 0 0 ? I 06:18:11 00:00:00 [kworker/0:3-events] root 2 70370 0.0 0.0 0 0 ? I 06:18:12 00:00:00 [kworker/2:2-cgroup_destroy] ubuntu 67813 70718 3.5 0.0 15124 10324 pts/0 S+ 06:18:13 00:00:00 bash ./stack.sh ubuntu 70718 73069 0.0 0.0 10644 3784 pts/0 S+ 06:18:16 00:00:00 bash ./stack.sh ubuntu 70718 73074 0.0 0.0 10644 3784 pts/0 S+ 06:18:16 00:00:00 bash ./stack.sh ubuntu 73069 73077 0.6 0.0 17388 11296 pts/0 S+ 06:18:16 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2022-08-10-061816 ubuntu 73074 73081 0.3 0.0 17388 11240 pts/0 S+ 06:18:16 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2022-08-10-061816.summary.2022-08-10-061816 root 15889 75094 4.7 0.8 330140 109440 ? S 06:18:23 00:00:00 /usr/bin/python3 /usr/bin/unattended-upgrade root 75094 75165 0.0 0.5 330140 65672 ? S 06:18:25 00:00:00 /usr/bin/python3 /usr/bin/unattended-upgrade root 75165 75173 0.0 0.0 2608 528 ? S 06:18:25 00:00:00 sh -c if [ -d /var/lib/update-notifier ]; then touch /var/lib/update-notifier/dpkg-run-stamp; fi; /usr/lib/update-notifier/update-motd-updates-available 2>/dev/null || true root 75173 75175 0.0 0.0 2608 1720 ? S 06:18:25 00:00:00 /bin/sh -e /usr/lib/update-notifier/update-motd-updates-available root 75175 75190 23.0 1.1 151024 137580 ? SN 06:18:25 00:00:01 /usr/bin/python3 /usr/lib/update-notifier/apt-check --human-readable root 16056 75334 0.0 0.0 18940 3084 ? S 06:18:29 00:00:00 /lib/systemd/systemd-udevd ubuntu 70718 75820 0.0 0.0 17872 11820 pts/0 S+ 06:18:32 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs root 75190 75823 0.0 0.0 16296 9604 ? RN 06:18:32 00:00:00 /usr/bin/python3 -Es /usr/bin/lsb_release -c -s ubuntu 75820 75824 0.0 0.0 2608 596 pts/0 S+ 06:18:32 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args ubuntu 75824 75825 0.0 0.0 8888 3316 pts/0 R+ 06:18:32 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args Network Dump ============ bridge link ----------- ip link show type bridge ------------------------ ip neigh -------- 192.168.0.12 dev eth1 lladdr fa:16:3e:5d:de:df STALE 10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE 10.222.0.1 dev eth0 lladdr 0a:db:49:c3:70:44 REACHABLE ip addr ------- 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:b6:df:7d brd ff:ff:ff:ff:ff:ff inet 10.222.0.16/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 85718sec preferred_lft 85718sec inet6 fe80::f816:3eff:feb6:df7d/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:bd:b7:ef brd ff:ff:ff:ff:ff:ff inet 192.168.0.29/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 85718sec preferred_lft 85718sec inet6 fe80::f816:3eff:febd:b7ef/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.16 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.16 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.29 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.29 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.16 metric 100 ip -6 route ----------- ::1 dev lo proto kernel metric 256 pref medium fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- *** Failed to run 'sudo ovs-vsctl show': Command 'sudo ovs-vsctl show' returned non-zero exit status 1. IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 1098 packets, 136K bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 1092 packets, 92888 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 18 packets, 5944 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 18 packets, 5944 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 401 packets, 32705 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 401 packets, 32705 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running