File System Summary =================== Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 740K 1.2G 1% /run /dev/sda1 39G 3.6G 35G 10% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/sda15 105M 3.6M 101M 4% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 0 512M 0% /opt/stack/data/etcd Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 1.1 0.0 225532 9480 ? Ss 07:39:37 00:00:15 /lib/systemd/systemd --system --deserialize 34 root 0 2 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [kthreadd] root 2 4 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [kworker/0:0H] root 2 6 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [mm_percpu_wq] root 2 7 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [ksoftirqd/0] root 2 8 0.0 0.0 0 0 ? I 07:39:37 00:00:01 [rcu_sched] root 2 9 0.0 0.0 0 0 ? I 07:39:37 00:00:00 [rcu_bh] root 2 10 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [migration/0] root 2 11 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [watchdog/0] root 2 12 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [cpuhp/0] root 2 13 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [cpuhp/1] root 2 14 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [watchdog/1] root 2 15 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [migration/1] root 2 16 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [ksoftirqd/1] root 2 18 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [kworker/1:0H] root 2 19 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [cpuhp/2] root 2 20 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [watchdog/2] root 2 21 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [migration/2] root 2 22 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [ksoftirqd/2] root 2 24 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [kworker/2:0H] root 2 25 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [cpuhp/3] root 2 26 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [watchdog/3] root 2 27 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [migration/3] root 2 28 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [ksoftirqd/3] root 2 30 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [kworker/3:0H] root 2 31 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [kdevtmpfs] root 2 32 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [netns] root 2 33 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [rcu_tasks_kthre] root 2 34 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [kauditd] root 2 35 0.0 0.0 0 0 ? I 07:39:37 00:00:00 [kworker/0:1] root 2 37 0.0 0.0 0 0 ? I 07:39:37 00:00:00 [kworker/2:1] root 2 38 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [khungtaskd] root 2 39 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [oom_reaper] root 2 40 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [writeback] root 2 41 0.0 0.0 0 0 ? S 07:39:37 00:00:00 [kcompactd0] root 2 42 0.0 0.0 0 0 ? SN 07:39:37 00:00:00 [ksmd] root 2 43 0.0 0.0 0 0 ? SN 07:39:37 00:00:00 [khugepaged] root 2 44 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [crypto] root 2 45 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [kintegrityd] root 2 46 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [kblockd] root 2 47 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [ata_sff] root 2 48 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [md] root 2 49 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [edac-poller] root 2 50 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [devfreq_wq] root 2 51 0.0 0.0 0 0 ? I< 07:39:37 00:00:00 [watchdogd] root 2 52 0.0 0.0 0 0 ? I 07:39:38 00:00:00 [kworker/u256:1] root 2 55 0.0 0.0 0 0 ? S 07:39:38 00:00:00 [kswapd0] root 2 56 0.0 0.0 0 0 ? I< 07:39:38 00:00:00 [kworker/u257:0] root 2 57 0.0 0.0 0 0 ? S 07:39:38 00:00:00 [ecryptfs-kthrea] root 2 99 0.0 0.0 0 0 ? I< 07:39:38 00:00:00 [kthrotld] root 2 100 0.0 0.0 0 0 ? I< 07:39:38 00:00:00 [acpi_thermal_pm] root 2 101 0.0 0.0 0 0 ? S 07:39:38 00:00:00 [scsi_eh_0] root 2 102 0.0 0.0 0 0 ? I< 07:39:38 00:00:00 [scsi_tmf_0] root 2 103 0.0 0.0 0 0 ? S 07:39:38 00:00:00 [scsi_eh_1] root 2 104 0.0 0.0 0 0 ? I< 07:39:38 00:00:00 [scsi_tmf_1] root 2 111 0.0 0.0 0 0 ? I< 07:39:39 00:00:00 [ipv6_addrconf] root 2 120 0.0 0.0 0 0 ? I< 07:39:39 00:00:00 [kstrp] root 2 137 0.0 0.0 0 0 ? I< 07:39:40 00:00:00 [charger_manager] root 2 186 0.0 0.0 0 0 ? I< 07:39:40 00:00:00 [hv_vmbus_con] root 2 187 0.0 0.0 0 0 ? I< 07:39:40 00:00:00 [hv_pri_chan] root 2 188 0.0 0.0 0 0 ? I< 07:39:40 00:00:00 [hv_sub_chan] root 2 221 0.0 0.0 0 0 ? S 07:39:40 00:00:00 [scsi_eh_2] root 2 222 0.0 0.0 0 0 ? I< 07:39:40 00:00:00 [scsi_tmf_2] root 2 223 0.0 0.0 0 0 ? I< 07:39:40 00:00:00 [storvsc_error_w] root 2 224 0.0 0.0 0 0 ? S 07:39:40 00:00:00 [scsi_eh_3] root 2 225 0.0 0.0 0 0 ? I< 07:39:40 00:00:00 [scsi_tmf_3] root 2 226 0.0 0.0 0 0 ? I< 07:39:41 00:00:00 [storvsc_error_w] root 2 228 0.0 0.0 0 0 ? I< 07:39:41 00:00:00 [kworker/0:1H] root 2 302 0.0 0.0 0 0 ? I< 07:39:43 00:00:00 [raid5wq] root 2 334 0.0 0.0 0 0 ? I< 07:39:43 00:00:00 [kworker/3:1H] root 2 350 0.2 0.0 0 0 ? S 07:39:43 00:00:02 [jbd2/sda1-8] root 2 351 0.0 0.0 0 0 ? I< 07:39:43 00:00:00 [ext4-rsv-conver] root 2 402 0.0 0.0 0 0 ? I< 07:39:44 00:00:00 [kworker/2:1H] root 2 415 0.0 0.0 0 0 ? I< 07:39:45 00:00:00 [kworker/1:1H] root 2 424 0.0 0.0 0 0 ? I< 07:39:45 00:00:00 [iscsi_eh] root 2 434 0.0 0.0 0 0 ? I< 07:39:45 00:00:00 [ib-comp-wq] root 2 435 0.0 0.0 0 0 ? I< 07:39:45 00:00:00 [ib_mcast] root 2 436 0.0 0.0 0 0 ? I< 07:39:45 00:00:00 [ib_nl_sa_wq] root 2 439 0.0 0.0 0 0 ? I< 07:39:45 00:00:00 [rdma_cm] root 1 444 0.1 0.0 44680 5696 ? Ss 07:39:45 00:00:01 /lib/systemd/systemd-udevd root 2 492 0.0 0.0 0 0 ? S 07:39:46 00:00:00 [hv_balloon] root 2 647 0.0 0.0 0 0 ? I 07:39:47 00:00:00 [kworker/1:2] root 2 837 0.0 0.0 0 0 ? I 07:39:51 00:00:00 [kworker/0:3] message+ 1 1008 0.2 0.0 50324 4532 ? Ss 07:39:56 00:00:02 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 1022 0.0 0.0 288088 6864 ? Ssl 07:39:56 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 1023 0.0 0.0 31748 3208 ? Ss 07:39:56 00:00:00 /usr/sbin/cron -f root 1 1056 0.0 0.0 110412 1940 ? Ssl 07:39:57 00:00:00 /usr/sbin/irqbalance --foreground root 1 1067 0.1 0.0 70584 6176 ? Ss 07:39:57 00:00:01 /lib/systemd/systemd-logind daemon 1 1073 0.0 0.0 28332 2288 ? Ss 07:39:57 00:00:00 /usr/sbin/atd -f root 1 1115 0.0 0.0 161076 1620 ? Ssl 07:39:57 00:00:00 /usr/bin/lxcfs /var/lib/lxcfs/ root 1 1136 0.0 0.1 170880 17440 ? Ssl 07:39:57 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers root 1 1196 0.0 0.1 187720 20300 ? Ssl 07:39:57 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 1205 0.0 0.0 291468 7180 ? Ssl 07:39:57 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1230 0.0 0.0 16412 2416 ttyS0 Ss+ 07:39:57 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 1285 0.0 0.0 14888 1908 tty1 Ss+ 07:39:57 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 1418 0.0 0.0 72296 5644 ? Ss 07:39:59 00:00:00 /usr/sbin/sshd -D root 1418 1720 0.0 0.0 107984 7388 ? Ss 07:43:47 00:00:00 sshd: ubuntu [priv] ubuntu 1 1722 0.0 0.0 76636 7416 ? Ss 07:43:47 00:00:00 /lib/systemd/systemd --user ubuntu 1722 1723 0.0 0.0 259248 2428 ? S 07:43:47 00:00:00 (sd-pam) ubuntu 1720 1798 0.0 0.0 108436 5356 ? S 07:43:48 00:00:00 sshd: ubuntu@pts/0 root 2 7009 0.0 0.0 0 0 ? I 07:45:16 00:00:00 [kworker/u256:0] root 2 7095 0.0 0.0 0 0 ? I 07:45:17 00:00:00 [kworker/1:3] root 2 7639 0.0 0.0 0 0 ? I 07:45:25 00:00:00 [kworker/3:5] ubuntu 1798 9085 0.0 0.0 4636 820 pts/0 Ss+ 07:53:09 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1619423589.24-187159514311039/AnsiballZ_command.py && sleep 0 ubuntu 9085 9086 0.0 0.1 77292 18572 pts/0 S+ 07:53:09 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1619423589.24-187159514311039/AnsiballZ_command.py ubuntu 9086 9088 0.0 0.0 4636 892 pts/0 S+ 07:53:09 00:00:00 /bin/sh -c ./unstack.sh > /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 11411 0.0 0.0 0 0 ? I 07:53:13 00:00:00 [kworker/u256:3] root 2 11428 0.0 0.0 0 0 ? I 07:53:13 00:00:00 [kworker/u256:4] root 2 11429 0.0 0.0 0 0 ? I 07:53:13 00:00:00 [kworker/0:0] root 2 11430 0.0 0.0 0 0 ? I 07:53:13 00:00:00 [kworker/0:2] root 2 11431 0.0 0.0 0 0 ? I 07:53:13 00:00:00 [kworker/0:4] root 2 11432 0.0 0.0 0 0 ? I 07:53:13 00:00:00 [kworker/0:5] root 2 11439 0.0 0.0 0 0 ? I 07:53:13 00:00:00 [kworker/0:7] ubuntu 9088 11599 0.6 0.0 19432 9708 pts/0 S+ 07:53:13 00:00:03 bash ./stack.sh ubuntu 11599 13858 0.0 0.0 15248 3708 pts/0 S+ 07:53:17 00:00:00 bash ./stack.sh ubuntu 11599 13863 0.0 0.0 15248 3708 pts/0 S+ 07:53:17 00:00:00 bash ./stack.sh ubuntu 13858 13865 0.2 0.0 29640 10824 pts/0 S+ 07:53:17 00:00:01 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2021-04-26-075317 ubuntu 13863 13870 0.0 0.0 29640 10888 pts/0 S+ 07:53:17 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2021-04-26-075317.summary.2021-04-26-075317 root 2 16230 0.0 0.0 0 0 ? I 07:53:52 00:00:00 [kworker/1:0] root 2 16231 0.0 0.0 0 0 ? I 07:53:52 00:00:00 [kworker/1:1] root 2 16232 0.0 0.0 0 0 ? I 07:53:52 00:00:00 [kworker/1:4] root 2 16235 0.0 0.0 0 0 ? I 07:53:52 00:00:00 [kworker/1:6] root 2 16236 0.0 0.0 0 0 ? I 07:53:52 00:00:00 [kworker/1:7] root 2 17818 0.0 0.0 0 0 ? I 07:54:19 00:00:00 [kworker/3:0] root 2 17821 0.0 0.0 0 0 ? I 07:54:19 00:00:00 [kworker/3:3] root 2 17823 0.0 0.0 0 0 ? I 07:54:19 00:00:00 [kworker/3:6] root 2 17824 0.0 0.0 0 0 ? I 07:54:19 00:00:00 [kworker/3:7] root 2 18348 0.0 0.0 0 0 ? I 07:54:27 00:00:00 [kworker/2:0] root 2 18349 0.0 0.0 0 0 ? I 07:54:27 00:00:00 [kworker/2:3] root 2 18350 0.0 0.0 0 0 ? I 07:54:27 00:00:00 [kworker/2:4] root 2 18351 0.0 0.0 0 0 ? I 07:54:27 00:00:00 [kworker/2:5] root 2 18352 0.0 0.0 0 0 ? I 07:54:27 00:00:00 [kworker/2:6] root 2 18353 0.0 0.0 0 0 ? I 07:54:27 00:00:00 [kworker/2:7] root 1 18426 0.0 0.0 105912 1800 ? Ss 07:54:28 00:00:00 /sbin/lvmetad -f uuidd 1 22862 0.0 0.0 28600 1436 ? Ss 07:54:45 00:00:00 /usr/sbin/uuidd --socket-activation systemd+ 1 22931 0.0 0.0 88392 5560 ? Ss 07:54:47 00:00:00 /lib/systemd/systemd-networkd systemd+ 1 22962 0.0 0.0 70772 6300 ? Ss 07:54:47 00:00:00 /lib/systemd/systemd-resolved systemd+ 1 23006 0.0 0.0 141936 3320 ? Ssl 07:54:48 00:00:00 /lib/systemd/systemd-timesyncd root 1 29519 0.0 0.0 54068 7888 ? Ss 07:55:15 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid haproxy 29519 29527 0.0 0.0 54292 1256 ? Ss 07:55:15 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid root 2 29621 0.0 0.0 0 0 ? I 07:55:18 00:00:00 [kworker/3:8] root 2 29623 0.0 0.0 0 0 ? I 07:55:18 00:00:00 [kworker/3:9] memcache 1 29673 0.0 0.0 424772 2916 ? Ssl 07:55:18 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid root 2 30205 0.0 0.0 0 0 ? I 07:55:24 00:00:00 [kworker/u256:5] root 1 30231 0.0 0.0 34000 2832 ? Ss 07:55:25 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf syslog 1 34912 0.0 0.0 263040 4208 ? Ssl 07:55:44 00:00:00 /usr/sbin/rsyslogd -n root 1 38000 0.0 0.0 70264 8980 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:29:9e:96 brd ff:ff:ff:ff:ff:ff inet 10.222.0.30/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 85995sec preferred_lft 85995sec inet6 fe80::f816:3eff:fe29:9e96/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:38:e8:a5 brd ff:ff:ff:ff:ff:ff inet 192.168.0.31/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 85995sec preferred_lft 85995sec inet6 fe80::f816:3eff:fe38:e8a5/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.30 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.30 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.31 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.31 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.30 metric 100 192.168.0.0/22 dev eth1 proto kernel scope link src 192.168.0.31 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.30 metric 100 ip -6 route ----------- fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- c4c4648e-24ba-4b5d-a11c-04f0a69c5e3f ovs_version: "2.13.1" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 55442 packets, 202M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 50083 packets, 3781K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT sudo ebtables -t broute -L -------------------------- Bridge table: broute Bridge chain: BROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running