File System Summary =================== Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 832K 1.2G 1% /run /dev/sda1 39G 3.6G 36G 10% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/sda15 105M 3.6M 101M 4% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 1.0 0.0 225516 9528 ? Ss 14:56:05 00:00:14 /lib/systemd/systemd --system --deserialize 34 root 0 2 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kthreadd] root 2 4 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/0:0H] root 2 6 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [mm_percpu_wq] root 2 7 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/0] root 2 8 0.0 0.0 0 0 ? I 14:56:05 00:00:00 [rcu_sched] root 2 9 0.0 0.0 0 0 ? I 14:56:05 00:00:00 [rcu_bh] root 2 10 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/0] root 2 11 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/0] root 2 12 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/0] root 2 13 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/1] root 2 14 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/1] root 2 15 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/1] root 2 16 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/1] root 2 18 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/1:0H] root 2 19 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/2] root 2 20 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/2] root 2 21 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/2] root 2 22 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/2] root 2 24 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/2:0H] root 2 25 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/3] root 2 26 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/3] root 2 27 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/3] root 2 28 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/3] root 2 30 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/3:0H] root 2 31 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kdevtmpfs] root 2 32 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [netns] root 2 33 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [rcu_tasks_kthre] root 2 34 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kauditd] root 2 37 0.0 0.0 0 0 ? I 14:56:05 00:00:00 [kworker/2:1] root 2 38 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [khungtaskd] root 2 39 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [oom_reaper] root 2 40 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [writeback] root 2 41 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kcompactd0] root 2 42 0.0 0.0 0 0 ? SN 14:56:05 00:00:00 [ksmd] root 2 43 0.0 0.0 0 0 ? SN 14:56:05 00:00:00 [khugepaged] root 2 44 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [crypto] root 2 45 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kintegrityd] root 2 46 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kblockd] root 2 47 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [ata_sff] root 2 48 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [md] root 2 49 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [edac-poller] root 2 50 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [devfreq_wq] root 2 51 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [watchdogd] root 2 52 0.0 0.0 0 0 ? I 14:56:06 00:00:00 [kworker/u256:1] root 2 54 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [kswapd0] root 2 55 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [kworker/u257:0] root 2 56 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [ecryptfs-kthrea] root 2 98 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [kthrotld] root 2 99 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [acpi_thermal_pm] root 2 100 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [scsi_eh_0] root 2 101 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [scsi_tmf_0] root 2 102 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [scsi_eh_1] root 2 103 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [scsi_tmf_1] root 2 104 0.0 0.0 0 0 ? I 14:56:06 00:00:00 [kworker/u256:2] root 2 111 0.0 0.0 0 0 ? I< 14:56:07 00:00:00 [ipv6_addrconf] root 2 120 0.0 0.0 0 0 ? I< 14:56:07 00:00:00 [kstrp] root 2 137 0.0 0.0 0 0 ? I< 14:56:07 00:00:00 [charger_manager] root 2 184 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [hv_vmbus_con] root 2 185 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [hv_pri_chan] root 2 186 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [hv_sub_chan] root 2 220 0.0 0.0 0 0 ? S 14:56:08 00:00:00 [scsi_eh_2] root 2 223 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [scsi_tmf_2] root 2 224 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [storvsc_error_w] root 2 225 0.0 0.0 0 0 ? S 14:56:08 00:00:00 [scsi_eh_3] root 2 227 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [scsi_tmf_3] root 2 228 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [storvsc_error_w] root 2 230 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [kworker/0:1H] root 2 304 0.0 0.0 0 0 ? I< 14:56:10 00:00:00 [raid5wq] root 2 336 0.0 0.0 0 0 ? I< 14:56:10 00:00:00 [kworker/3:1H] root 2 352 0.1 0.0 0 0 ? S 14:56:10 00:00:01 [jbd2/sda1-8] root 2 353 0.0 0.0 0 0 ? I< 14:56:10 00:00:00 [ext4-rsv-conver] root 2 402 0.0 0.0 0 0 ? I< 14:56:11 00:00:00 [kworker/2:1H] root 2 413 0.0 0.0 0 0 ? I< 14:56:11 00:00:00 [kworker/1:1H] root 2 432 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [iscsi_eh] root 2 438 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [ib-comp-wq] root 2 439 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [ib_mcast] root 2 440 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [ib_nl_sa_wq] root 2 445 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [rdma_cm] root 1 450 0.1 0.0 44576 5580 ? Ss 14:56:12 00:00:01 /lib/systemd/systemd-udevd root 2 491 0.0 0.0 0 0 ? S 14:56:13 00:00:00 [hv_balloon] root 2 847 0.0 0.0 0 0 ? I 14:56:17 00:00:00 [kworker/2:2] root 1 1027 0.0 0.0 288092 6968 ? Ssl 14:56:22 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 1035 0.0 0.0 31748 3204 ? Ss 14:56:22 00:00:00 /usr/sbin/cron -f root 1 1064 0.1 0.0 70588 6156 ? Ss 14:56:22 00:00:01 /lib/systemd/systemd-logind root 1 1072 0.0 0.1 170880 17436 ? Ssl 14:56:22 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers message+ 1 1080 0.2 0.0 50296 4788 ? Ss 14:56:22 00:00:02 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only daemon 1 1108 0.0 0.0 28332 2232 ? Ss 14:56:23 00:00:00 /usr/sbin/atd -f root 1 1109 0.0 0.0 161076 1612 ? Ssl 14:56:23 00:00:00 /usr/bin/lxcfs /var/lib/lxcfs/ root 1 1137 0.0 0.0 110412 2080 ? Ssl 14:56:23 00:00:00 /usr/sbin/irqbalance --foreground root 1 1212 0.0 0.0 291480 7384 ? Ssl 14:56:23 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1214 0.0 0.1 187720 20376 ? Ssl 14:56:23 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 1246 0.0 0.0 16412 2280 ttyS0 Ss+ 14:56:23 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 1290 0.0 0.0 14888 1908 tty1 Ss+ 14:56:23 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 1448 0.0 0.0 72296 5572 ? Ss 14:56:25 00:00:00 /usr/sbin/sshd -D root 1448 1740 0.0 0.0 107984 7176 ? Ss 15:01:06 00:00:00 sshd: ubuntu [priv] ubuntu 1 1742 0.0 0.0 76636 7180 ? Ss 15:01:06 00:00:00 /lib/systemd/systemd --user ubuntu 1742 1743 0.0 0.0 259252 2452 ? S 15:01:06 00:00:00 (sd-pam) ubuntu 1740 1818 0.0 0.0 108416 5192 ? S 15:01:07 00:00:00 sshd: ubuntu@pts/0 root 2 3256 0.0 0.0 0 0 ? I 15:02:13 00:00:00 [kworker/3:2] root 2 4133 0.0 0.0 0 0 ? I 15:02:16 00:00:00 [kworker/1:0] root 2 7024 0.0 0.0 0 0 ? I 15:02:30 00:00:00 [kworker/u256:4] root 2 7086 0.0 0.0 0 0 ? I 15:02:31 00:00:00 [kworker/1:3] root 2 8600 0.0 0.0 0 0 ? I 15:08:07 00:00:00 [kworker/u256:0] root 2 8879 0.0 0.0 0 0 ? I 15:11:19 00:00:00 [kworker/0:0] root 2 11065 0.0 0.0 0 0 ? I 15:11:29 00:00:00 [kworker/0:1] root 2 11069 0.0 0.0 0 0 ? I 15:11:29 00:00:00 [kworker/0:2] root 2 11070 0.0 0.0 0 0 ? I 15:11:29 00:00:00 [kworker/0:4] root 2 15604 0.0 0.0 0 0 ? I 15:11:57 00:00:00 [kworker/1:1] root 2 15656 0.0 0.0 0 0 ? I 15:11:58 00:00:00 [kworker/2:0] root 2 15657 0.0 0.0 0 0 ? I 15:11:58 00:00:00 [kworker/2:3] root 2 15658 0.0 0.0 0 0 ? I 15:11:58 00:00:00 [kworker/2:4] root 2 15659 0.0 0.0 0 0 ? I 15:11:58 00:00:00 [kworker/2:5] root 2 16009 0.0 0.0 0 0 ? I 15:12:04 00:00:00 [kworker/3:1] root 2 16010 0.0 0.0 0 0 ? I 15:12:04 00:00:00 [kworker/3:3] root 2 16011 0.0 0.0 0 0 ? I 15:12:04 00:00:00 [kworker/3:4] root 2 16012 0.0 0.0 0 0 ? I 15:12:04 00:00:00 [kworker/3:5] root 2 16013 0.0 0.0 0 0 ? I 15:12:04 00:00:00 [kworker/3:6] root 2 16014 0.0 0.0 0 0 ? I 15:12:04 00:00:00 [kworker/3:7] root 2 17559 0.0 0.0 0 0 ? I 15:12:28 00:00:00 [kworker/1:2] root 2 17561 0.0 0.0 0 0 ? I 15:12:28 00:00:00 [kworker/1:4] root 1 18092 0.0 0.0 105912 1840 ? Ss 15:12:34 00:00:00 /sbin/lvmetad -f uuidd 1 22482 0.0 0.0 28600 1440 ? Ss 15:12:49 00:00:00 /usr/sbin/uuidd --socket-activation systemd+ 1 22551 0.0 0.0 88392 5324 ? Ss 15:12:52 00:00:00 /lib/systemd/systemd-networkd systemd+ 1 22583 0.0 0.0 70772 6280 ? Ss 15:12:52 00:00:00 /lib/systemd/systemd-resolved systemd+ 1 22627 0.0 0.0 141936 3316 ? Ssl 15:12:52 00:00:00 /lib/systemd/systemd-timesyncd root 2 28890 0.0 0.0 0 0 ? I 15:13:16 00:00:00 [kworker/u256:5] root 2 28956 0.0 0.0 0 0 ? I 15:13:16 00:00:00 [kworker/0:6] root 2 28957 0.0 0.0 0 0 ? I 15:13:16 00:00:00 [kworker/0:7] root 2 28959 0.0 0.0 0 0 ? I 15:13:16 00:00:00 [kworker/0:9] root 2 29025 0.0 0.0 0 0 ? I 15:13:18 00:00:00 [kworker/2:7] root 1 29081 0.0 0.0 54068 8028 ? Ss 15:13:18 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid haproxy 29081 29083 0.0 0.0 54292 1256 ? Ss 15:13:18 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid root 2 29162 0.0 0.0 0 0 ? I 15:13:20 00:00:00 [kworker/1:6] root 2 29163 0.0 0.0 0 0 ? I 15:13:20 00:00:00 [kworker/1:7] memcache 1 29210 0.0 0.0 424772 2960 ? Ssl 15:13:20 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid root 1 29777 0.0 0.0 34000 2796 ? Ss 15:13:26 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf syslog 1 34460 0.0 0.0 263040 4084 ? Ssl 15:13:45 00:00:00 /usr/sbin/rsyslogd -n root 1 37640 0.1 0.0 78584 9272 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 ubuntu 54532 58017 3.0 0.0 19220 9700 pts/0 S+ 15:18:43 00:00:00 bash ./stack.sh ubuntu 58017 60742 0.0 0.0 15224 3664 pts/0 S+ 15:18:50 00:00:00 bash ./stack.sh ubuntu 58017 60747 0.0 0.0 15224 4048 pts/0 S+ 15:18:50 00:00:00 bash ./stack.sh ubuntu 60742 60750 0.9 0.0 29644 10800 pts/0 S+ 15:18:50 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2020-11-30-151850 ubuntu 60747 60755 0.3 0.0 29644 10816 pts/0 S+ 15:18:50 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2020-11-30-151850.summary.2020-11-30-151850 ubuntu 58017 63877 0.0 0.0 38776 12020 pts/0 S+ 15:19:05 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs ubuntu 63877 63880 0.0 0.0 4636 768 pts/0 S+ 15:19:05 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args ubuntu 63880 63881 0.0 0.0 38376 3640 pts/0 R+ 15:19:05 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args Network Dump ============ bridge link ----------- ip link show type bridge ------------------------ ip neigh -------- 10.222.0.1 dev eth0 lladdr 38:ea:a7:34:d4:dc REACHABLE 192.168.0.12 dev eth1 lladdr fa:16:3e:5d:de:df STALE 10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE ip addr ------- 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:89:b8:f6 brd ff:ff:ff:ff:ff:ff inet 10.222.0.41/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 86027sec preferred_lft 86027sec inet6 fe80::f816:3eff:fe89:b8f6/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:5c:44:01 brd ff:ff:ff:ff:ff:ff inet 192.168.0.39/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 86027sec preferred_lft 86027sec inet6 fe80::f816:3eff:fe5c:4401/64 scope link valid_lft forever preferred_lft forever ip link ------- 1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2: eth0: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether fa:16:3e:89:b8:f6 brd ff:ff:ff:ff:ff:ff 3: eth1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether fa:16:3e:5c:44:01 brd ff:ff:ff:ff:ff:ff ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.41 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.41 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.39 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.39 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.41 metric 100 192.168.0.0/22 dev eth1 proto kernel scope link src 192.168.0.39 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.41 metric 100 ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- 583eb8f7-908d-40d6-bbb6-5f1e5984c03f ovs_version: "2.12.1" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 1348 packets, 4761K bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 1082 packets, 73898 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 1529 packets, 4777K bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 1347 packets, 4760K bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 1082 packets, 73898 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 1082 packets, 73898 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT sudo ebtables -t broute -L -------------------------- Bridge table: broute Bridge chain: BROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running