File System Summary =================== WARN: Device /dev/loop0 (/snap/core18/1997) is 100% full, might be an issue WARN: Device /dev/loop1 (/snap/lxd/19647) is 100% full, might be an issue WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 1.1M 1.2G 1% /run /dev/sda1 39G 3.2G 36G 9% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/loop0 56M 56M 0 100% /snap/core18/1997 /dev/loop1 71M 71M 0 100% /snap/lxd/19647 /dev/loop2 33M 33M 0 100% /snap/snapd/11588 /dev/sda15 105M 7.8M 97M 8% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 0.6 0.1 168848 12912 ? Ss 14:32:42 00:00:09 /sbin/init root 0 2 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [kthreadd] root 2 3 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [rcu_gp] root 2 4 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [rcu_par_gp] root 2 6 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [kworker/0:0H-kblockd] root 2 8 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [mm_percpu_wq] root 2 9 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [ksoftirqd/0] root 2 10 0.0 0.0 0 0 ? I 14:32:42 00:00:00 [rcu_sched] root 2 11 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [migration/0] root 2 12 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [idle_inject/0] root 2 13 0.0 0.0 0 0 ? I 14:32:42 00:00:00 [kworker/0:1-events] root 2 14 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [cpuhp/0] root 2 15 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [cpuhp/1] root 2 16 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [idle_inject/1] root 2 17 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [migration/1] root 2 18 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [ksoftirqd/1] root 2 20 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [kworker/1:0H-kblockd] root 2 21 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [cpuhp/2] root 2 22 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [idle_inject/2] root 2 23 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [migration/2] root 2 24 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [ksoftirqd/2] root 2 26 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [kworker/2:0H-kblockd] root 2 27 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [cpuhp/3] root 2 28 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [idle_inject/3] root 2 29 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [migration/3] root 2 30 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [ksoftirqd/3] root 2 32 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [kworker/3:0H-kblockd] root 2 33 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [kdevtmpfs] root 2 34 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [netns] root 2 35 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [rcu_tasks_kthre] root 2 36 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [kauditd] root 2 37 0.0 0.0 0 0 ? I 14:32:42 00:00:00 [kworker/0:2-events] root 2 40 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [khungtaskd] root 2 41 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [oom_reaper] root 2 42 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [writeback] root 2 43 0.0 0.0 0 0 ? S 14:32:42 00:00:00 [kcompactd0] root 2 44 0.0 0.0 0 0 ? SN 14:32:42 00:00:00 [ksmd] root 2 45 0.0 0.0 0 0 ? SN 14:32:42 00:00:00 [khugepaged] root 2 91 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [kintegrityd] root 2 92 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [kblockd] root 2 93 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [blkcg_punt_bio] root 2 94 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [tpm_dev_wq] root 2 95 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [ata_sff] root 2 96 0.0 0.0 0 0 ? I< 14:32:42 00:00:00 [md] root 2 97 0.0 0.0 0 0 ? I< 14:32:43 00:00:00 [edac-poller] root 2 98 0.0 0.0 0 0 ? I< 14:32:43 00:00:00 [devfreq_wq] root 2 99 0.0 0.0 0 0 ? I 14:32:43 00:00:00 [kworker/2:1-events] root 2 100 0.0 0.0 0 0 ? S 14:32:43 00:00:00 [watchdogd] root 2 102 0.0 0.0 0 0 ? I 14:32:43 00:00:01 [kworker/u256:1-events_power_efficient] root 2 105 0.0 0.0 0 0 ? S 14:32:43 00:00:00 [kswapd0] root 2 106 0.0 0.0 0 0 ? S 14:32:43 00:00:00 [ecryptfs-kthrea] root 2 108 0.0 0.0 0 0 ? I< 14:32:43 00:00:00 [kthrotld] root 2 109 0.0 0.0 0 0 ? I< 14:32:43 00:00:00 [acpi_thermal_pm] root 2 110 0.0 0.0 0 0 ? S 14:32:43 00:00:00 [scsi_eh_0] root 2 111 0.0 0.0 0 0 ? I< 14:32:43 00:00:00 [scsi_tmf_0] root 2 112 0.0 0.0 0 0 ? S 14:32:43 00:00:00 [scsi_eh_1] root 2 113 0.0 0.0 0 0 ? I< 14:32:43 00:00:00 [scsi_tmf_1] root 2 115 0.0 0.0 0 0 ? I< 14:32:43 00:00:00 [vfio-irqfd-clea] root 2 116 0.0 0.0 0 0 ? I< 14:32:44 00:00:00 [ipv6_addrconf] root 2 117 0.0 0.0 0 0 ? I 14:32:44 00:00:00 [kworker/u256:3-events_power_efficient] root 2 126 0.0 0.0 0 0 ? I< 14:32:44 00:00:00 [kstrp] root 2 129 0.0 0.0 0 0 ? I< 14:32:44 00:00:00 [kworker/u257:0] root 2 142 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [charger_manager] root 2 190 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [hv_vmbus_con] root 2 191 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [kworker/3:1H-kblockd] root 2 192 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [hv_pri_chan] root 2 193 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [hv_sub_chan] root 2 195 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [cryptd] root 2 229 0.0 0.0 0 0 ? S 14:32:45 00:00:00 [scsi_eh_2] root 2 230 0.0 0.0 0 0 ? S 14:32:45 00:00:00 [scsi_eh_3] root 2 231 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [scsi_tmf_2] root 2 232 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [scsi_tmf_3] root 2 235 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [storvsc_error_w] root 2 236 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [storvsc_error_w] root 2 237 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [kworker/0:1H-kblockd] root 2 238 0.0 0.0 0 0 ? I< 14:32:45 00:00:00 [kworker/2:1H-kblockd] root 2 276 0.0 0.0 0 0 ? I< 14:32:47 00:00:00 [raid5wq] root 2 302 0.0 0.0 0 0 ? I< 14:32:47 00:00:00 [kworker/1:1H-kblockd] root 2 317 0.0 0.0 0 0 ? S 14:32:47 00:00:00 [jbd2/sda1-8] root 2 318 0.0 0.0 0 0 ? I< 14:32:47 00:00:00 [ext4-rsv-conver] root 1 420 0.0 0.0 19208 5816 ? Ss 14:32:49 00:00:00 /lib/systemd/systemd-udevd root 2 447 0.0 0.0 0 0 ? S 14:32:50 00:00:00 [hv_balloon] root 2 549 0.0 0.0 0 0 ? I< 14:32:50 00:00:00 [kaluad] root 2 550 0.0 0.0 0 0 ? I< 14:32:50 00:00:00 [kmpath_rdacd] root 2 551 0.0 0.0 0 0 ? I< 14:32:50 00:00:00 [kmpathd] root 2 552 0.0 0.0 0 0 ? I< 14:32:50 00:00:00 [kmpath_handlerd] root 1 553 0.0 0.1 280136 17940 ? SLsl 14:32:50 00:00:00 /sbin/multipathd -d -s root 2 561 0.0 0.0 0 0 ? S< 14:32:50 00:00:00 [loop0] root 2 566 0.0 0.0 0 0 ? S< 14:32:50 00:00:00 [loop1] root 2 568 0.0 0.0 0 0 ? S< 14:32:50 00:00:00 [loop2] root 2 587 0.0 0.0 0 0 ? I 14:32:51 00:00:00 [kworker/2:3-rcu_gp] systemd+ 1 592 0.0 0.0 90228 6108 ? Ssl 14:32:51 00:00:00 /lib/systemd/systemd-timesyncd systemd+ 1 659 0.0 0.0 26720 7828 ? Ss 14:32:55 00:00:00 /lib/systemd/systemd-networkd systemd+ 1 661 0.0 0.0 23892 12052 ? Ss 14:32:55 00:00:00 /lib/systemd/systemd-resolved root 1 779 0.0 0.0 241048 9332 ? Ssl 14:33:02 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 782 0.0 0.0 8536 3000 ? Ss 14:33:02 00:00:00 /usr/sbin/cron -f message+ 1 783 0.0 0.0 7792 4844 ? Ss 14:33:02 00:00:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 793 0.0 0.0 81828 3776 ? Ssl 14:33:02 00:00:00 /usr/sbin/irqbalance --foreground root 1 795 0.0 0.1 29264 17912 ? Ss 14:33:02 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers syslog 1 797 0.0 0.0 224504 5020 ? Ssl 14:33:02 00:00:00 /usr/sbin/rsyslogd -n -iNONE root 1 799 0.1 0.2 1297684 33816 ? Ssl 14:33:02 00:00:02 /usr/lib/snapd/snapd root 1 800 0.0 0.0 16780 7796 ? Ss 14:33:02 00:00:00 /lib/systemd/systemd-logind daemon 1 802 0.0 0.0 3792 2168 ? Ss 14:33:02 00:00:00 /usr/sbin/atd -f root 1 850 0.0 0.0 7352 2248 ttyS0 Ss+ 14:33:02 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 873 0.0 0.0 5828 1824 tty1 Ss+ 14:33:02 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 877 0.0 0.1 108100 20600 ? Ssl 14:33:02 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 880 0.0 0.0 237368 10004 ? Ssl 14:33:02 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 908 0.0 0.0 12176 7548 ? Ss 14:33:03 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups root 908 1582 0.0 0.0 13792 8860 ? Ss 14:38:36 00:00:00 sshd: ubuntu [priv] ubuntu 1 1597 0.0 0.0 18388 9588 ? Ss 14:38:36 00:00:00 /lib/systemd/systemd --user ubuntu 1597 1598 0.0 0.0 169792 4552 ? S 14:38:36 00:00:00 (sd-pam) ubuntu 1582 1678 0.0 0.0 13924 6544 ? S 14:38:37 00:00:00 sshd: ubuntu@pts/0 root 1 1777 0.0 0.0 53400 10632 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 ubuntu 1597 16350 0.0 0.0 7104 3996 ? Ss 14:54:23 00:00:00 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 2 17600 0.0 0.0 2488 508 ? S 14:54:26 00:00:00 bpfilter_umh root 2 17623 0.0 0.0 0 0 ? I 14:54:26 00:00:00 [kworker/3:0-events] root 2 18707 0.0 0.0 0 0 ? I 14:54:27 00:00:00 [kworker/0:0-mm_percpu_wq] root 2 18710 0.0 0.0 0 0 ? I 14:54:28 00:00:00 [kworker/2:0-cgroup_destroy] root 2 18738 0.0 0.0 0 0 ? I 14:54:28 00:00:00 [kworker/2:2-mm_percpu_wq] ubuntu 16346 19115 0.3 0.0 15124 10316 pts/0 S+ 14:54:29 00:00:00 bash ./stack.sh ubuntu 19115 21421 0.0 0.0 10652 3828 pts/0 S+ 14:54:33 00:00:00 bash ./stack.sh ubuntu 19115 21426 0.0 0.0 10652 3828 pts/0 S+ 14:54:33 00:00:00 bash ./stack.sh ubuntu 21421 21428 0.1 0.0 17520 11356 pts/0 S+ 14:54:33 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2022-08-29-145433 ubuntu 21426 21433 0.0 0.0 17388 11280 pts/0 S+ 14:54:33 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2022-08-29-145433.summary.2022-08-29-145433 root 2 23192 0.0 0.0 0 0 ? I 14:56:43 00:00:00 [kworker/u256:0] ubuntu 19115 23314 0.0 0.0 17872 11812 pts/0 S+ 14:57:47 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs ubuntu 23314 23317 0.0 0.0 2608 532 pts/0 S+ 14:57:47 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args ubuntu 23317 23318 0.0 0.0 8888 3388 pts/0 R+ 14:57:47 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args Network Dump ============ bridge link ----------- ip link show type bridge ------------------------ ip neigh -------- 10.222.0.1 dev eth0 lladdr 0a:db:49:c3:70:44 STALE 10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE 192.168.0.12 dev eth1 lladdr fa:16:3e:5d:de:df STALE 10.222.0.1 dev eth1 lladdr 0a:db:49:c3:70:44 STALE ip addr ------- 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:2f:15:6b brd ff:ff:ff:ff:ff:ff inet 10.222.0.16/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 84909sec preferred_lft 84909sec inet6 fe80::f816:3eff:fe2f:156b/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:73:30:1c brd ff:ff:ff:ff:ff:ff inet 192.168.0.66/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 84908sec preferred_lft 84908sec inet6 fe80::f816:3eff:fe73:301c/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.16 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.16 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.66 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.66 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.16 metric 100 ip -6 route ----------- ::1 dev lo proto kernel metric 256 pref medium fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- *** Failed to run 'sudo ovs-vsctl show': Command 'sudo ovs-vsctl show' returned non-zero exit status 1. IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 1710 packets, 236K bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 1276 packets, 105K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 402 packets, 76874 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 228 packets, 64458 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 458 packets, 36839 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 458 packets, 36839 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running