File System Summary =================== Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 740K 1.2G 1% /run /dev/sda1 39G 3.5G 36G 10% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/sda15 105M 3.6M 101M 4% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 0 512M 0% /opt/stack/data/etcd Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 1.0 0.0 225516 9604 ? Ss 18:08:17 00:00:14 /lib/systemd/systemd --system --deserialize 35 root 0 2 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [kthreadd] root 2 4 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [kworker/0:0H] root 2 5 0.0 0.0 0 0 ? I 18:08:17 00:00:00 [kworker/u256:0] root 2 6 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [mm_percpu_wq] root 2 7 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [ksoftirqd/0] root 2 8 0.0 0.0 0 0 ? I 18:08:17 00:00:00 [rcu_sched] root 2 9 0.0 0.0 0 0 ? I 18:08:17 00:00:00 [rcu_bh] root 2 10 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [migration/0] root 2 11 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [watchdog/0] root 2 12 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [cpuhp/0] root 2 13 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [cpuhp/1] root 2 14 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [watchdog/1] root 2 15 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [migration/1] root 2 16 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [ksoftirqd/1] root 2 18 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [kworker/1:0H] root 2 19 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [cpuhp/2] root 2 20 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [watchdog/2] root 2 21 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [migration/2] root 2 22 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [ksoftirqd/2] root 2 24 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [kworker/2:0H] root 2 25 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [cpuhp/3] root 2 26 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [watchdog/3] root 2 27 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [migration/3] root 2 28 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [ksoftirqd/3] root 2 30 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [kworker/3:0H] root 2 31 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [kdevtmpfs] root 2 32 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [netns] root 2 33 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [rcu_tasks_kthre] root 2 34 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [kauditd] root 2 35 0.0 0.0 0 0 ? I 18:08:17 00:00:00 [kworker/0:1] root 2 36 0.0 0.0 0 0 ? I 18:08:17 00:00:00 [kworker/1:1] root 2 37 0.0 0.0 0 0 ? I 18:08:17 00:00:00 [kworker/2:1] root 2 38 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [khungtaskd] root 2 39 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [oom_reaper] root 2 40 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [writeback] root 2 41 0.0 0.0 0 0 ? S 18:08:17 00:00:00 [kcompactd0] root 2 42 0.0 0.0 0 0 ? SN 18:08:17 00:00:00 [ksmd] root 2 43 0.0 0.0 0 0 ? SN 18:08:17 00:00:00 [khugepaged] root 2 44 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [crypto] root 2 45 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [kintegrityd] root 2 46 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [kblockd] root 2 47 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [ata_sff] root 2 48 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [md] root 2 49 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [edac-poller] root 2 50 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [devfreq_wq] root 2 51 0.0 0.0 0 0 ? I< 18:08:17 00:00:00 [watchdogd] root 2 55 0.0 0.0 0 0 ? S 18:08:18 00:00:00 [kswapd0] root 2 56 0.0 0.0 0 0 ? I< 18:08:18 00:00:00 [kworker/u257:0] root 2 57 0.0 0.0 0 0 ? S 18:08:18 00:00:00 [ecryptfs-kthrea] root 2 99 0.0 0.0 0 0 ? I< 18:08:18 00:00:00 [kthrotld] root 2 100 0.0 0.0 0 0 ? I< 18:08:18 00:00:00 [acpi_thermal_pm] root 2 101 0.0 0.0 0 0 ? S 18:08:18 00:00:00 [scsi_eh_0] root 2 102 0.0 0.0 0 0 ? I< 18:08:18 00:00:00 [scsi_tmf_0] root 2 103 0.0 0.0 0 0 ? S 18:08:18 00:00:00 [scsi_eh_1] root 2 104 0.0 0.0 0 0 ? I< 18:08:18 00:00:00 [scsi_tmf_1] root 2 111 0.0 0.0 0 0 ? I< 18:08:19 00:00:00 [ipv6_addrconf] root 2 120 0.0 0.0 0 0 ? I< 18:08:19 00:00:00 [kstrp] root 2 137 0.0 0.0 0 0 ? I< 18:08:19 00:00:00 [charger_manager] root 2 193 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [hv_vmbus_con] root 2 194 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [hv_pri_chan] root 2 195 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [hv_sub_chan] root 2 230 0.0 0.0 0 0 ? S 18:08:20 00:00:00 [scsi_eh_2] root 2 231 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [scsi_tmf_2] root 2 232 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [storvsc_error_w] root 2 233 0.0 0.0 0 0 ? S 18:08:20 00:00:00 [scsi_eh_3] root 2 234 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [scsi_tmf_3] root 2 235 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [storvsc_error_w] root 2 237 0.0 0.0 0 0 ? I< 18:08:20 00:00:00 [kworker/0:1H] root 2 239 0.0 0.0 0 0 ? I< 18:08:21 00:00:00 [kworker/2:1H] root 2 241 0.0 0.0 0 0 ? I< 18:08:21 00:00:00 [kworker/3:1H] root 2 312 0.0 0.0 0 0 ? I< 18:08:22 00:00:00 [raid5wq] root 2 359 0.1 0.0 0 0 ? S 18:08:23 00:00:01 [jbd2/sda1-8] root 2 360 0.0 0.0 0 0 ? I< 18:08:23 00:00:00 [ext4-rsv-conver] root 2 409 0.0 0.0 0 0 ? I< 18:08:23 00:00:00 [kworker/1:1H] root 2 440 0.0 0.0 0 0 ? I< 18:08:24 00:00:00 [iscsi_eh] root 2 446 0.0 0.0 0 0 ? I< 18:08:25 00:00:00 [ib-comp-wq] root 2 447 0.0 0.0 0 0 ? I< 18:08:25 00:00:00 [ib_mcast] root 2 448 0.0 0.0 0 0 ? I< 18:08:25 00:00:00 [ib_nl_sa_wq] root 2 451 0.0 0.0 0 0 ? I< 18:08:25 00:00:00 [rdma_cm] root 1 452 0.1 0.0 44428 5392 ? Ss 18:08:25 00:00:01 /lib/systemd/systemd-udevd root 2 488 0.0 0.0 0 0 ? S 18:08:25 00:00:00 [hv_balloon] daemon 1 1060 0.0 0.0 28332 2280 ? Ss 18:08:36 00:00:00 /usr/sbin/atd -f root 1 1063 0.0 0.0 288092 6880 ? Ssl 18:08:36 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 1086 0.0 0.0 110412 2056 ? Ssl 18:08:36 00:00:00 /usr/sbin/irqbalance --foreground root 1 1110 0.1 0.0 70580 6020 ? Ss 18:08:36 00:00:01 /lib/systemd/systemd-logind root 1 1130 0.0 0.0 31748 3200 ? Ss 18:08:36 00:00:00 /usr/sbin/cron -f root 1 1134 0.0 0.0 161076 1616 ? Ssl 18:08:36 00:00:00 /usr/bin/lxcfs /var/lib/lxcfs/ root 1 1175 0.0 0.1 170880 17348 ? Ssl 18:08:36 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers message+ 1 1182 0.2 0.0 50332 4756 ? Ss 18:08:36 00:00:02 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 1210 0.0 0.1 187720 20524 ? Ssl 18:08:37 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 1291 0.0 0.0 291480 7064 ? Ssl 18:08:37 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1315 0.0 0.0 16412 2348 ttyS0 Ss+ 18:08:37 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 1364 0.0 0.0 14888 1908 tty1 Ss+ 18:08:37 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 1498 0.0 0.0 72296 5768 ? Ss 18:08:39 00:00:00 /usr/sbin/sshd -D root 1498 1788 0.0 0.0 107984 7304 ? Ss 18:13:25 00:00:00 sshd: ubuntu [priv] ubuntu 1 1790 0.0 0.0 76636 7504 ? Ss 18:13:25 00:00:00 /lib/systemd/systemd --user ubuntu 1790 1791 0.0 0.0 259264 2460 ? S 18:13:25 00:00:00 (sd-pam) ubuntu 1788 1866 0.0 0.0 108432 5376 ? S 18:13:26 00:00:00 sshd: ubuntu@pts/0 root 2 3104 0.0 0.0 0 0 ? I 18:14:34 00:00:00 [kworker/u256:3] root 2 3130 0.0 0.0 0 0 ? I 18:14:35 00:00:00 [kworker/0:5] root 2 7048 0.0 0.0 0 0 ? I 18:14:53 00:00:00 [kworker/u256:4] root 2 7073 0.0 0.0 0 0 ? I 18:14:53 00:00:00 [kworker/1:3] root 2 7105 0.0 0.0 0 0 ? I 18:14:54 00:00:00 [kworker/3:4] root 2 7106 0.0 0.0 0 0 ? I 18:14:54 00:00:00 [kworker/3:5] root 2 7219 0.0 0.0 0 0 ? I 18:14:54 00:00:00 [kworker/2:3] root 2 8640 0.0 0.0 0 0 ? I 18:22:15 00:00:00 [kworker/u256:1] root 2 8665 0.0 0.0 0 0 ? I 18:23:21 00:00:00 [kworker/0:0] ubuntu 1866 8977 0.0 0.0 4636 932 pts/0 Ss+ 18:24:57 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1606760697.5-137654816067718/AnsiballZ_command.py && sleep 0 ubuntu 8977 8978 0.0 0.1 77256 18492 pts/0 S+ 18:24:57 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1606760697.5-137654816067718/AnsiballZ_command.py ubuntu 8978 8980 0.0 0.0 4636 816 pts/0 S+ 18:24:57 00:00:00 /bin/sh -c ./unstack.sh > /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 11339 0.0 0.0 0 0 ? I 18:25:01 00:00:00 [kworker/u256:2] root 2 11356 0.0 0.0 0 0 ? I 18:25:01 00:00:00 [kworker/0:2] root 2 11362 0.0 0.0 0 0 ? I 18:25:01 00:00:00 [kworker/0:3] root 2 11363 0.0 0.0 0 0 ? I 18:25:01 00:00:00 [kworker/0:4] root 2 11364 0.0 0.0 0 0 ? I 18:25:01 00:00:00 [kworker/0:6] root 2 11365 0.0 0.0 0 0 ? I 18:25:01 00:00:00 [kworker/0:7] ubuntu 8980 11522 0.3 0.0 19296 9496 pts/0 S+ 18:25:02 00:00:01 bash ./stack.sh ubuntu 11522 13782 0.0 0.0 15204 3612 pts/0 S+ 18:25:05 00:00:00 bash ./stack.sh ubuntu 11522 13787 0.0 0.0 15204 3612 pts/0 S+ 18:25:05 00:00:00 bash ./stack.sh ubuntu 13782 13788 0.1 0.0 29564 10784 pts/0 S+ 18:25:05 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2020-11-30-182505 ubuntu 13787 13794 0.0 0.0 29564 10808 pts/0 S+ 18:25:05 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2020-11-30-182505.summary.2020-11-30-182505 root 2 15770 0.0 0.0 0 0 ? I 18:25:30 00:00:00 [kworker/1:0] root 2 16142 0.0 0.0 0 0 ? I 18:25:36 00:00:00 [kworker/3:0] root 2 16143 0.0 0.0 0 0 ? I 18:25:36 00:00:00 [kworker/3:1] root 2 16145 0.0 0.0 0 0 ? I 18:25:36 00:00:00 [kworker/3:2] root 2 16146 0.0 0.0 0 0 ? I 18:25:36 00:00:00 [kworker/3:3] root 2 17722 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/1:2] root 2 17723 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/1:4] root 2 17724 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/1:5] root 2 17760 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/2:0] root 2 17761 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/2:2] root 2 17762 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/2:4] root 2 17763 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/2:5] root 2 17764 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/2:6] root 2 17765 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/2:7] root 2 17782 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/1:6] root 2 17783 0.0 0.0 0 0 ? I 18:26:00 00:00:00 [kworker/1:7] root 1 18346 0.0 0.0 105912 1748 ? Ss 18:26:08 00:00:00 /sbin/lvmetad -f uuidd 1 22768 0.0 0.0 28600 1436 ? Ss 18:26:24 00:00:00 /usr/sbin/uuidd --socket-activation systemd+ 1 22837 0.0 0.0 88392 5320 ? Ss 18:26:26 00:00:00 /lib/systemd/systemd-networkd systemd+ 1 22870 0.0 0.0 70776 5492 ? Ss 18:26:26 00:00:00 /lib/systemd/systemd-resolved systemd+ 1 22914 0.0 0.0 141936 3148 ? Ssl 18:26:26 00:00:00 /lib/systemd/systemd-timesyncd root 2 29216 0.0 0.0 0 0 ? I 18:26:50 00:00:00 [kworker/0:8] root 2 29217 0.0 0.0 0 0 ? I 18:26:50 00:00:00 [kworker/0:9] root 1 29405 0.0 0.0 54068 7980 ? Ss 18:26:53 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid haproxy 29405 29413 0.0 0.0 54292 1252 ? Ss 18:26:53 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid memcache 1 29548 0.0 0.0 424772 2888 ? Ssl 18:26:55 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid root 2 29649 0.0 0.0 0 0 ? I 18:26:57 00:00:00 [kworker/3:6] root 2 29650 0.0 0.0 0 0 ? I 18:26:57 00:00:00 [kworker/3:7] root 2 29965 0.0 0.0 0 0 ? I 18:27:00 00:00:00 [kworker/u256:5] root 1 30120 0.0 0.0 34000 2824 ? Ss 18:27:02 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf syslog 1 34804 0.0 0.0 263040 4092 ? Ssl 18:27:20 00:00:00 /usr/sbin/rsyslogd -n root 1 38020 0.0 0.0 70268 8192 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:74:27:88 brd ff:ff:ff:ff:ff:ff inet 10.222.0.72/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 86132sec preferred_lft 86132sec inet6 fe80::f816:3eff:fe74:2788/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:5b:be:ad brd ff:ff:ff:ff:ff:ff inet 192.168.0.67/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 86132sec preferred_lft 86132sec inet6 fe80::f816:3eff:fe5b:bead/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.72 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.72 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.67 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.67 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.72 metric 100 192.168.0.0/22 dev eth1 proto kernel scope link src 192.168.0.67 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.72 metric 100 ip -6 route ----------- fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- f3947d90-fbfa-40f3-8b7c-3764dcb6e498 ovs_version: "2.13.1" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 44942 packets, 169M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 40398 packets, 2919K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT sudo ebtables -t broute -L -------------------------- Bridge table: broute Bridge chain: BROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running