File System Summary =================== WARN: Device /dev/loop0 (/snap/core18/1997) is 100% full, might be an issue WARN: Device /dev/loop1 (/snap/snapd/11588) is 100% full, might be an issue WARN: Device /dev/loop2 (/snap/lxd/19647) is 100% full, might be an issue Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 1.1M 1.2G 1% /run /dev/sda1 39G 3.7G 35G 10% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/loop0 56M 56M 0 100% /snap/core18/1997 /dev/loop1 33M 33M 0 100% /snap/snapd/11588 /dev/loop2 71M 71M 0 100% /snap/lxd/19647 /dev/sda15 105M 7.9M 97M 8% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 1.2 0.1 168460 12888 ? Ss 05:48:29 00:00:21 /lib/systemd/systemd --system --deserialize 33 root 0 2 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [kthreadd] root 2 3 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [rcu_gp] root 2 4 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [rcu_par_gp] root 2 6 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [kworker/0:0H-kblockd] root 2 8 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [mm_percpu_wq] root 2 9 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [ksoftirqd/0] root 2 10 0.0 0.0 0 0 ? I 05:48:29 00:00:01 [rcu_sched] root 2 11 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [migration/0] root 2 12 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [idle_inject/0] root 2 13 0.0 0.0 0 0 ? I 05:48:29 00:00:00 [kworker/0:1-rcu_par_gp] root 2 14 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [cpuhp/0] root 2 15 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [cpuhp/1] root 2 16 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [idle_inject/1] root 2 17 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [migration/1] root 2 18 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [ksoftirqd/1] root 2 20 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [kworker/1:0H-kblockd] root 2 21 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [cpuhp/2] root 2 22 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [idle_inject/2] root 2 23 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [migration/2] root 2 24 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [ksoftirqd/2] root 2 26 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [kworker/2:0H-kblockd] root 2 27 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [cpuhp/3] root 2 28 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [idle_inject/3] root 2 29 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [migration/3] root 2 30 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [ksoftirqd/3] root 2 32 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [kworker/3:0H-kblockd] root 2 33 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [kdevtmpfs] root 2 34 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [netns] root 2 35 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [rcu_tasks_kthre] root 2 36 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [kauditd] root 2 39 0.0 0.0 0 0 ? I 05:48:29 00:00:00 [kworker/1:2-rcu_par_gp] root 2 40 0.0 0.0 0 0 ? I 05:48:29 00:00:00 [kworker/2:1-events] root 2 41 0.0 0.0 0 0 ? I 05:48:29 00:00:00 [kworker/2:2-rcu_par_gp] root 2 42 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [khungtaskd] root 2 43 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [oom_reaper] root 2 44 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [writeback] root 2 45 0.0 0.0 0 0 ? S 05:48:29 00:00:00 [kcompactd0] root 2 46 0.0 0.0 0 0 ? SN 05:48:29 00:00:00 [ksmd] root 2 47 0.0 0.0 0 0 ? SN 05:48:29 00:00:00 [khugepaged] root 2 94 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [kintegrityd] root 2 95 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [kblockd] root 2 96 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [blkcg_punt_bio] root 2 97 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [tpm_dev_wq] root 2 98 0.0 0.0 0 0 ? I< 05:48:29 00:00:00 [ata_sff] root 2 99 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [md] root 2 100 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [edac-poller] root 2 101 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [devfreq_wq] root 2 102 0.0 0.0 0 0 ? S 05:48:30 00:00:00 [watchdogd] root 2 105 0.0 0.0 0 0 ? S 05:48:30 00:00:00 [kswapd0] root 2 106 0.0 0.0 0 0 ? S 05:48:30 00:00:00 [ecryptfs-kthrea] root 2 108 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [kthrotld] root 2 109 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [acpi_thermal_pm] root 2 111 0.0 0.0 0 0 ? S 05:48:30 00:00:00 [scsi_eh_0] root 2 112 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [scsi_tmf_0] root 2 113 0.0 0.0 0 0 ? S 05:48:30 00:00:00 [scsi_eh_1] root 2 114 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [scsi_tmf_1] root 2 115 0.0 0.0 0 0 ? I 05:48:30 00:00:01 [kworker/u256:2-events_power_efficient] root 2 116 0.0 0.0 0 0 ? I< 05:48:30 00:00:00 [vfio-irqfd-clea] root 2 117 0.0 0.0 0 0 ? I< 05:48:31 00:00:00 [ipv6_addrconf] root 2 127 0.0 0.0 0 0 ? I< 05:48:31 00:00:00 [kstrp] root 2 130 0.0 0.0 0 0 ? I< 05:48:31 00:00:00 [kworker/u257:0] root 2 143 0.0 0.0 0 0 ? I< 05:48:31 00:00:00 [charger_manager] root 2 180 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [hv_vmbus_con] root 2 181 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [hv_pri_chan] root 2 182 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [hv_sub_chan] root 2 186 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [kworker/3:1H-kblockd] root 2 187 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [cryptd] root 2 218 0.0 0.0 0 0 ? S 05:48:32 00:00:00 [scsi_eh_2] root 2 219 0.0 0.0 0 0 ? S 05:48:32 00:00:00 [scsi_eh_3] root 2 230 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [scsi_tmf_3] root 2 231 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [scsi_tmf_2] root 2 233 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [storvsc_error_w] root 2 235 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [storvsc_error_w] root 2 236 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [kworker/2:1H-kblockd] root 2 242 0.0 0.0 0 0 ? I< 05:48:32 00:00:00 [kworker/0:1H-kblockd] root 2 276 0.0 0.0 0 0 ? I< 05:48:34 00:00:00 [raid5wq] root 2 302 0.0 0.0 0 0 ? I< 05:48:34 00:00:00 [kworker/1:1H-kblockd] root 2 317 0.0 0.0 0 0 ? S 05:48:34 00:00:01 [jbd2/sda1-8] root 2 318 0.0 0.0 0 0 ? I< 05:48:34 00:00:00 [ext4-rsv-conver] root 1 420 0.0 0.0 19208 5736 ? Ss 05:48:37 00:00:01 /lib/systemd/systemd-udevd root 2 451 0.0 0.0 0 0 ? S 05:48:37 00:00:00 [hv_balloon] root 2 549 0.0 0.0 0 0 ? I< 05:48:38 00:00:00 [kaluad] root 2 550 0.0 0.0 0 0 ? I< 05:48:38 00:00:00 [kmpath_rdacd] root 2 551 0.0 0.0 0 0 ? I< 05:48:38 00:00:00 [kmpathd] root 2 552 0.0 0.0 0 0 ? I< 05:48:38 00:00:00 [kmpath_handlerd] root 1 553 0.0 0.1 280136 17940 ? SLsl 05:48:38 00:00:00 /sbin/multipathd -d -s root 2 563 0.0 0.0 0 0 ? S< 05:48:38 00:00:00 [loop0] root 2 566 0.0 0.0 0 0 ? S< 05:48:38 00:00:00 [loop1] root 2 568 0.0 0.0 0 0 ? S< 05:48:38 00:00:00 [loop2] root 2 592 0.0 0.0 0 0 ? I 05:48:38 00:00:00 [kworker/3:3-events] root 1 772 0.0 0.0 8536 2996 ? Ss 05:48:51 00:00:00 /usr/sbin/cron -f message+ 1 776 0.1 0.0 7792 5096 ? Ss 05:48:51 00:00:02 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 783 0.0 0.0 81828 3776 ? Ssl 05:48:51 00:00:00 /usr/sbin/irqbalance --foreground root 1 788 0.0 0.1 29264 17812 ? Ss 05:48:51 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers syslog 1 791 0.0 0.0 224504 5008 ? Ssl 05:48:51 00:00:00 /usr/sbin/rsyslogd -n -iNONE root 1 792 0.1 0.2 1296628 36300 ? Ssl 05:48:51 00:00:02 /usr/lib/snapd/snapd root 1 794 0.0 0.0 16812 7816 ? Ss 05:48:51 00:00:01 /lib/systemd/systemd-logind daemon 1 796 0.0 0.0 3792 2228 ? Ss 05:48:51 00:00:00 /usr/sbin/atd -f root 1 816 0.0 0.0 7352 2332 ttyS0 Ss+ 05:48:51 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 835 0.0 0.0 5828 1848 tty1 Ss+ 05:48:51 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 843 0.0 0.1 108100 21032 ? Ssl 05:48:51 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 895 0.0 0.0 12176 7320 ? Ss 05:48:52 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups root 895 1563 0.0 0.0 13800 9132 ? Ss 05:54:22 00:00:00 sshd: ubuntu [priv] ubuntu 1 1578 0.0 0.0 18388 9772 ? Ss 05:54:22 00:00:00 /lib/systemd/systemd --user ubuntu 1578 1583 0.0 0.0 169784 4564 ? S 05:54:22 00:00:00 (sd-pam) ubuntu 1563 1665 0.0 0.0 13932 6556 ? S 05:54:23 00:00:00 sshd: ubuntu@pts/0 root 2 15892 0.0 0.0 0 0 ? I 06:02:45 00:00:00 [kworker/1:3-events] root 1 15990 0.0 0.0 2608 528 ? Ss 06:04:01 00:00:00 /bin/sh /usr/lib/apt/apt.systemd.daily install root 15990 15994 0.0 0.0 2608 1688 ? S 06:04:01 00:00:00 /bin/sh /usr/lib/apt/apt.systemd.daily lock_is_held install root 15994 16031 16.0 1.3 329996 169364 ? Sl 06:04:01 00:02:12 /usr/bin/python3 /usr/bin/unattended-upgrade root 2 16103 0.1 0.0 0 0 ? I 06:04:29 00:00:00 [kworker/u256:0-events_freezable_power_] root 1 16680 0.0 0.1 283804 16152 ? Ssl 06:06:10 00:00:00 /usr/lib/packagekit/packagekitd ubuntu 1578 17480 0.0 0.0 7104 4016 ? Ss 06:06:47 00:00:00 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 2 18772 0.0 0.0 2488 572 ? S 06:06:50 00:00:00 bpfilter_umh root 2 18774 0.0 0.0 0 0 ? I 06:06:50 00:00:00 [kworker/3:0-cgroup_destroy] root 2 19910 0.0 0.0 0 0 ? I 06:06:52 00:00:00 [kworker/0:2-rcu_par_gp] root 2 41278 0.0 0.0 0 0 ? I 06:08:10 00:00:00 [kworker/2:0-rcu_gp] root 2 41310 0.0 0.0 0 0 ? I 06:08:10 00:00:00 [kworker/3:1-events] root 1 60117 0.0 0.0 241236 9708 ? Ssl 06:09:22 00:00:00 /usr/lib/accountsservice/accounts-daemon root 2 63170 0.0 0.0 0 0 ? I 06:09:47 00:00:00 [kworker/u256:3-events_power_efficient] root 2 64602 0.0 0.0 0 0 ? I< 06:10:14 00:00:00 [xfsalloc] root 2 64603 0.0 0.0 0 0 ? I< 06:10:14 00:00:00 [xfs_mru_cache] root 2 111430 0.0 0.0 0 0 ? I 06:14:01 00:00:00 [kworker/3:2-events] root 2 111450 0.0 0.0 0 0 ? I 06:14:01 00:00:00 [kworker/1:0-ata_sff] root 2 111452 0.0 0.0 0 0 ? I 06:14:02 00:00:00 [kworker/1:1-events] root 2 116860 0.0 0.0 0 0 ? I 06:14:39 00:00:00 [kworker/0:0-events] systemd+ 1 116863 0.0 0.0 34936 8016 ? Ss 06:14:39 00:00:00 /lib/systemd/systemd-networkd root 1 116865 0.0 0.0 9760 5248 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 uuidd 1 136376 0.3 0.0 9744 1004 ? Ss 06:17:20 00:00:00 /usr/sbin/uuidd --socket-activation ubuntu 134128 137998 3.8 0.0 15120 10312 pts/0 S+ 06:17:24 00:00:00 bash ./stack.sh ubuntu 137998 140266 0.0 0.0 10644 3844 pts/0 S+ 06:17:26 00:00:00 bash ./stack.sh ubuntu 137998 140271 0.0 0.0 10644 3844 pts/0 S+ 06:17:26 00:00:00 bash ./stack.sh ubuntu 140266 140276 0.6 0.0 17388 11280 pts/0 S+ 06:17:26 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2022-08-26-061727 ubuntu 140271 140278 0.2 0.0 17388 11180 pts/0 S+ 06:17:26 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2022-08-26-061727.summary.2022-08-26-061727 root 16031 142208 4.3 0.8 329996 109848 ? S 06:17:32 00:00:00 /usr/bin/python3 /usr/bin/unattended-upgrade root 142208 142387 0.0 0.5 329996 65644 ? S 06:17:36 00:00:00 /usr/bin/python3 /usr/bin/unattended-upgrade root 142387 142396 0.0 0.0 2608 536 ? S 06:17:36 00:00:00 sh -c if [ -d /var/lib/update-notifier ]; then touch /var/lib/update-notifier/dpkg-run-stamp; fi; /usr/lib/update-notifier/update-motd-updates-available 2>/dev/null || true root 142396 142398 0.0 0.0 2608 1624 ? S 06:17:36 00:00:00 /bin/sh -e /usr/lib/update-notifier/update-motd-updates-available root 142398 142412 26.5 1.1 150848 137308 ? SN 06:17:36 00:00:01 /usr/bin/python3 /usr/lib/update-notifier/apt-check --human-readable ubuntu 137998 143022 0.0 0.0 17872 11608 pts/0 S+ 06:17:42 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs root 142412 143023 0.0 0.0 17472 10952 ? RN 06:17:42 00:00:00 /usr/bin/python3 -Es /usr/bin/lsb_release -c -s ubuntu 143022 143026 0.0 0.0 2608 592 pts/0 S+ 06:17:42 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args ubuntu 143026 143027 0.0 0.0 8888 3400 pts/0 R+ 06:17:42 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args Network Dump ============ bridge link ----------- ip link show type bridge ------------------------ ip neigh -------- 192.168.0.12 dev eth1 lladdr fa:16:3e:5d:de:df STALE 10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE 10.222.0.1 dev eth0 lladdr 0a:db:49:c3:70:44 REACHABLE ip addr ------- 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:8b:f0:79 brd ff:ff:ff:ff:ff:ff inet 10.222.0.17/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 86217sec preferred_lft 86217sec inet6 fe80::f816:3eff:fe8b:f079/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:da:cb:af brd ff:ff:ff:ff:ff:ff inet 192.168.0.11/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 86217sec preferred_lft 86217sec inet6 fe80::f816:3eff:feda:cbaf/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.17 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.17 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.11 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.11 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.17 metric 100 ip -6 route ----------- ::1 dev lo proto kernel metric 256 pref medium fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- 211ba424-c503-4773-917f-0789b5cf0393 ovs_version: "2.13.8" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 116K packets, 308M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 65452 packets, 3729K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 1039 packets, 225K bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 661 packets, 196K bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 938 packets, 73950 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 938 packets, 73950 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 115K packets, 307M bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 115K packets, 307M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 64360 packets, 3636K bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 64360 packets, 3636K bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running